Sync vs Async
The XCrawl scrape endpoint supports sync and async modes.
Scrape
mode=sync(default):- completes within the request
- returns the full result
mode=async:- returns
scrape_idimmediately - supports webhook callbacks
- returns
Scrape status enum
pending: queuedcrawling: in progresscompleted: donefailed: failed
Crawl
POST /v1/crawl returns a crawl_id. Use GET /v1/crawl/{crawl_id} to check status.
Crawl status enum
pending: queuedcrawling: in progresscompleted: donefailed: failed
