The Crawler API is designed to automate the process of crawling websites, extracting data, and storing it for further analysis. It provides endpoints to initiate, monitor, and manage web crawling tasks efficiently.
Debug mode is OFF