Core concepts
Repeat collection and task counts
Choose runCount and interpret successful runs and failures.
runCount repeats collection for each target. It defaults to 1; the maximum is determined by deployed MAX_CRAWL_RUN_COUNT. Repetition provides observations for your own analysis, not API-calculated rates or confidence intervals.
Browser tasks versus output targets
Google Search and Google News share one browser task per repetition when requested together. With targets ["google", "google_news", "chatgpt"] and runCount 2, there are four browser tasks, producing up to six successful target response objects. Selecting only google_news still creates one task per repetition.
Progress counts browser tasks. The result's failedRuns counts terminal failures per target. A failed combined Google/News task increments both google and google_news failures, but counts once in progress.failedRuns. Do not compare the sum of target failures directly with progress failures.
Successful run numbers can have gaps
In this example run 2 of a three-run combined Google/News job failed. Job progress would show completedRuns: 2, failedRuns: 1, runningRuns: 0, totalRuns: 3. The artifact has two successful entries per target with runNumber 1 and 3; failed entries are not included.
{
"requestId": "5f67c2d1-4c35-4f36-a980-29054104a56c",
"prompt": "What are the best CRM tools for a small team?",
"targets": [
"google",
"google_news"
],
"runCount": 3,
"requestedAt": "2026-10-09T10:00:00.000Z",
"updatedAt": "2026-10-09T10:02:00.000Z",
"completedAt": "2026-10-09T10:02:00.000Z",
"failedRuns": {
"google": 1,
"google_news": 1
},
"responses": {
"google": [
{
"runNumber": 1,
"runTaskId": "7f5c0888-f5ad-4661-b07b-79fbbe1c7b31",
"status": "completed",
"capturedAt": "2026-10-09T10:01:00.000Z",
"pageUrl": "https://www.google.com/search?q=example",
"aioverview": null,
"serp": {
"organic": [
{
"position": 1,
"snippet": "Illustrative search result summary.",
"title": "Illustrative CRM comparison",
"url": "https://example.com/crm-comparison"
}
],
"peopleAlsoAsk": [],
"shopping": [],
"sponsored": []
}
},
{
"runNumber": 3,
"runTaskId": "6f67c2d1-4c35-4f36-a980-29054104a56c",
"status": "completed",
"capturedAt": "2026-10-09T10:01:00.000Z",
"pageUrl": "https://www.google.com/search?q=example",
"aioverview": null,
"serp": {
"organic": [
{
"position": 1,
"snippet": "Illustrative search result summary.",
"title": "Illustrative CRM comparison",
"url": "https://example.com/crm-comparison"
}
],
"peopleAlsoAsk": [],
"shopping": [],
"sponsored": []
}
}
],
"google_news": [
{
"runNumber": 1,
"runTaskId": "7f5c0888-f5ad-4661-b07b-79fbbe1c7b31",
"status": "completed",
"capturedAt": "2026-10-09T10:01:00.000Z",
"pageUrl": "https://www.google.com/search?q=example&tbm=nws",
"googleNews": {
"results": [
{
"position": 1,
"publishedAt": "2 hours ago",
"publisher": "Example Publisher",
"snippet": "Illustrative article summary.",
"title": "Illustrative article title",
"url": "https://example.com/article"
}
],
"topNews": []
}
},
{
"runNumber": 3,
"runTaskId": "6f67c2d1-4c35-4f36-a980-29054104a56c",
"status": "completed",
"capturedAt": "2026-10-09T10:01:00.000Z",
"pageUrl": "https://www.google.com/search?q=example&tbm=nws",
"googleNews": {
"results": [
{
"position": 1,
"publishedAt": "2 hours ago",
"publisher": "Example Publisher",
"snippet": "Illustrative article summary.",
"title": "Illustrative article title",
"url": "https://example.com/article"
}
],
"topNews": []
}
}
]
}
}