Core concepts

Repeat collection and task counts

Choose runCount and interpret successful runs and failures.

runCount repeats collection for each target. It defaults to 1; the maximum is determined by deployed MAX_CRAWL_RUN_COUNT. Repetition provides observations for your own analysis, not API-calculated rates or confidence intervals.

Browser tasks versus output targets

Google Search and Google News share one browser task per repetition when requested together. With targets ["google", "google_news", "chatgpt"] and runCount 2, there are four browser tasks, producing up to six successful target response objects. Selecting only google_news still creates one task per repetition.

Progress counts browser tasks. The result's failedRuns counts terminal failures per target. A failed combined Google/News task increments both google and google_news failures, but counts once in progress.failedRuns. Do not compare the sum of target failures directly with progress failures.

Successful run numbers can have gaps

In this example run 2 of a three-run combined Google/News job failed. Job progress would show completedRuns: 2, failedRuns: 1, runningRuns: 0, totalRuns: 3. The artifact has two successful entries per target with runNumber 1 and 3; failed entries are not included.

{
  "requestId": "5f67c2d1-4c35-4f36-a980-29054104a56c",
  "prompt": "What are the best CRM tools for a small team?",
  "targets": [
    "google",
    "google_news"
  ],
  "runCount": 3,
  "requestedAt": "2026-10-09T10:00:00.000Z",
  "updatedAt": "2026-10-09T10:02:00.000Z",
  "completedAt": "2026-10-09T10:02:00.000Z",
  "failedRuns": {
    "google": 1,
    "google_news": 1
  },
  "responses": {
    "google": [
      {
        "runNumber": 1,
        "runTaskId": "7f5c0888-f5ad-4661-b07b-79fbbe1c7b31",
        "status": "completed",
        "capturedAt": "2026-10-09T10:01:00.000Z",
        "pageUrl": "https://www.google.com/search?q=example",
        "aioverview": null,
        "serp": {
          "organic": [
            {
              "position": 1,
              "snippet": "Illustrative search result summary.",
              "title": "Illustrative CRM comparison",
              "url": "https://example.com/crm-comparison"
            }
          ],
          "peopleAlsoAsk": [],
          "shopping": [],
          "sponsored": []
        }
      },
      {
        "runNumber": 3,
        "runTaskId": "6f67c2d1-4c35-4f36-a980-29054104a56c",
        "status": "completed",
        "capturedAt": "2026-10-09T10:01:00.000Z",
        "pageUrl": "https://www.google.com/search?q=example",
        "aioverview": null,
        "serp": {
          "organic": [
            {
              "position": 1,
              "snippet": "Illustrative search result summary.",
              "title": "Illustrative CRM comparison",
              "url": "https://example.com/crm-comparison"
            }
          ],
          "peopleAlsoAsk": [],
          "shopping": [],
          "sponsored": []
        }
      }
    ],
    "google_news": [
      {
        "runNumber": 1,
        "runTaskId": "7f5c0888-f5ad-4661-b07b-79fbbe1c7b31",
        "status": "completed",
        "capturedAt": "2026-10-09T10:01:00.000Z",
        "pageUrl": "https://www.google.com/search?q=example&tbm=nws",
        "googleNews": {
          "results": [
            {
              "position": 1,
              "publishedAt": "2 hours ago",
              "publisher": "Example Publisher",
              "snippet": "Illustrative article summary.",
              "title": "Illustrative article title",
              "url": "https://example.com/article"
            }
          ],
          "topNews": []
        }
      },
      {
        "runNumber": 3,
        "runTaskId": "6f67c2d1-4c35-4f36-a980-29054104a56c",
        "status": "completed",
        "capturedAt": "2026-10-09T10:01:00.000Z",
        "pageUrl": "https://www.google.com/search?q=example&tbm=nws",
        "googleNews": {
          "results": [
            {
              "position": 1,
              "publishedAt": "2 hours ago",
              "publisher": "Example Publisher",
              "snippet": "Illustrative article summary.",
              "title": "Illustrative article title",
              "url": "https://example.com/article"
            }
          ],
          "topNews": []
        }
      }
    ]
  }
}