We’ve just rolled out crawl histories and and error reporting for all your APIs. Now you can see the full story of all your kimono API crawls on a URL level. We built this feature so that you can quickly assess and debug your crawls, rapidly identify problematic URLs, and build the most robust data set possible.
Crawl history and error reports answer:
- When did this crawl run?
- Which URLs were succesfully crawled?
- Do the properties you are extracting exist on each URL?
- Why did some URLs fail?
This should make working with all your kimono APIs easier and get you the best data possible quickly. Here’s a sample view: