WEB Crawling
Get Crawl Status
Check the status and retrieve results of a crawl job
POST
Get the current status and results of a crawl operation. For large crawls, results may be paginated.
Path Parameters
The ID of the crawl job to check
Response Fields
Current status of the crawl: scraping
, completed
, or failed
Total number of pages attempted to crawl
Number of successfully crawled pages
Number of credits consumed by the crawl
ISO 8601 timestamp when the crawl data expires
URL to retrieve next batch of data (for paginated results)
Example Request
Example Response
Status Codes
Authorizations
Enter your API key prefixed with 'Bearer '
Body
application/json
Type of web service to use
Available options:
scrape
, crawl
, map
, taam-ai-search
, crawl-status
Parameters specific to the selected model
Response
200 - application/json
Successful response
Unique identifier for the request
Type of completion (e.g., scrape.completion)
Unix timestamp of when the request was created
Model used for the request
Model-specific response data