BBC Topics Search
BBC Topics Search is used to fetch content list data from BBC topic pages by topic ID.
- Fetch BBC topic page content by topic ID
- Support region-based requests
- Support fetching multiple pages starting from a specific page
- Return articles, videos, and other content items from the topic page
Use XCrawl to Fetch BBC Topics Search Results
Usage
curl -s -X POST 'https://run.xcrawl.com/v1/data' \
-H 'Authorization: Bearer $XCRAWL_API_KEY'\
-H 'Content-Type: application/json' \
-d '{
"engine": "bbc_topics_search",
"location": "US",
"topic_id": "cq04nvd56lxt",
"start_page": 1,
"pages": 1
}'Request parameter notes:
enginemust bebbc_topics_searchlocationspecifies the target regiontopic_idspecifies the BBC topic identifierstart_pageandpagescontrol the page range to fetch
Response Example
{
"result": [
{
"url": "https://www.bbc.com/news/topics/cq04nvd56lxt?page=3",
"topic_id": "cq04nvd56lxt",
"topic_title": "Bereavement - BBC News",
"current_page": 3,
"item_count": 30,
"video_count": 1,
"result_count": 30,
"results": [
{
"position": 30,
"headline": "2 Jan 2026 How embracing grief can help you enjoy what you have",
"url": "https://www.bbc.com/news/videos/clyk58v1ykjo",
"content_type": "video",
"media_type": "video"
}
]
}
]
}Parameters
Required Parameters
| Parameter | Type | Description |
|---|---|---|
location | string | Specifies the target region. |
topic_id | string | Specifies the BBC topic ID. |
start_page | number | Specifies the page number to start from. |
pages | number | Specifies how many pages to fetch. |
Parameter Notes
locationdefaults toUSlocationsupports multiple region values such asUS,HK,CA,GB, andJPtopic_iddefaults tocq04nvd56lxtstart_pagedefaults to1pagesdefaults to1
Response Fields
| Field | Type | Description |
|---|---|---|
url | string | Fetched BBC topic page URL. |
base_url | string | Base site URL used to normalize relative links. |
page_title | string | Topic page title. |
canonical_url | string | Canonical URL declared by the page. |
topic_id | string | Topic identifier. |
topic_title | string | Topic page title. |
current_page | number | Current page number. |
language | string | Page language code. |
item_count | number | Number of returned content items. |
video_count | number | Number of video items. |
result_count | number | Number of parsed result objects. |
meta | object | Page metadata. |
results | array | Content item list. |
Result Item Fields
Each item in results[] typically includes:
| Field | Type | Description |
|---|---|---|
position | number | One-based result position. |
group_key | string | Source container key. |
group_title | string | Source container title. |
headline | string | Content headline. |
url | string | Content URL. |
path | string | Relative content path. |
content_type | string | Normalized content type such as article, video, or live. |
media_type | string | Raw media type, usually used for video items. |
