Scrape Result API

概述

GET /v1/scrape/{scrape_id} 用于查询异步抓取任务的执行状态与结果。

请求

Endpoint

GET https://run.xcrawl.com/v1/scrape/{scrape_id}

Headers

Authorization: Bearer <api_key>

响应

字段	类型	说明
`scrape_id`	string	任务 ID
`endpoint`	string	固定为 `scrape`
`version`	string	版本标识
`status`	string	`pending` / `crawling` / `completed` / `failed`
`url`	string	本次抓取的 URL
`data`	object	抓取结果数据
`started_at`	string	任务开始时间（ISO 8601）
`ended_at`	string	任务结束时间（ISO 8601）

data 的字段与含义参考 Scrape API 的同步响应说明。任务处于进行中或失败时，响应中可能不包含 data。

示例

请求示例

curl -s -X GET 'https://run.xcrawl.com/v1/scrape/01KKE89TSDTP063R5PEX6XWSE1' \
  -H 'Authorization: Bearer $XCRAWL_API_KEY'

响应示例

{
  "scrape_id": "01KKE89TSDTP063R5PEX6XWSE1",
  "endpoint": "scrape",
  "version": "dca0d4b3bff035e4",
  "status": "completed",
  "url": "https://docs.xcrawl.com/doc/introduction/",
  "data": {
    "markdown": "Skip to content\n# Quickstart\nXCrawl quickly turns search results and website content into LLM-friendly formats.\n...",
    "metadata": {
      "charset": "utf-8",
      "content_type": "text/html",
      "description": "Quickstart XCrawl quickly turns search results and website content into LLM-friendly formats. ...",
      "favicon": "https://www.xcrawl.com/favicon.ico",
      "final_url": "https://docs.xcrawl.com/doc/introduction/",
      "generator": "VuePress 2.0.0-rc.26",
      "name": [
        "Home",
        "Documentation",
        "Getting Started",
        "Quickstart"
      ],
      "og:title": "Quickstart",
      "og:type": "article",
      "og:url": "https://docs.xcrawl.com/doc/introduction/",
      "position": [
        "1",
        "2",
        "3",
        "4"
      ],
      "proxy_location": "US",
      "proxy_sticky_session": "sticky-a11edf00",
      "requested_url": "https://docs.xcrawl.com/doc/introduction/",
      "status_code": 200,
      "theme": "VuePress Theme Plume 1.0.0-rc.177",
      "title": "Quickstart",
      "viewport": "width=device-width,initial-scale=1"
    },
    "traffic_bytes": 96895,
    "credits_used": 1,
    "credits_detail": {
      "base_cost": 1,
      "traffic_cost": 0,
      "json_extract_cost": 0
    }
  },
  "started_at": "2026-03-11T10:50:24Z",
  "ended_at": "2026-03-11T10:50:30Z"
}