How should failed or empty collections be handled?

Inspect per-target failedRuns and each successful run identity. Empty sources or null fields are valid output; a missing failed run is not an empty successful answer. A completed job can contain failed collections.

Collected data

Gemini app: sources

Provider-specific source titles and URLs, with empty lists allowed.

Collection target: gemini. Field availability depends on the provider output shown below.

Understand the collected data

Chatbots return sources alongside text and markdown. Google returns AI Overview sources within aioverview and search links within serp. Google News returns article links within googleNews.results and googleNews.topNews.

Collected data

The API does not guarantee a complete reference panel, resolve every redirect, or return normalized domains and source frequency. Build those transformations downstream if needed.

The gemini target returns collected answer text, markdown, pageUrl and sources with each successful run identity and capture time. Fields can be null and sources can be empty. Gemini can present a login wall that prevents collection. Eligible failures are retried, and unsuccessful runs are recorded in failedRuns instead of fabricated responses.

Provider output examples

These are illustrative successful run excerpts, not full result files or calculated metrics. Submit POST /v1/crawl-jobs, track completion, then download the authenticated result. Outputs depend on the target; a chatbot has no news articles or Google position fields.

{
  "runNumber": 1,
  "runTaskId": "9a7536e7-b610-420a-a34c-5f829956f4d3",
  "status": "completed",
  "capturedAt": "2026-10-09T10:01:00.000Z",
  "text": "Illustrative captured answer text.",
  "markdown": null,
  "pageUrl": "https://gemini.google.com/",
  "sources": []
}

Illustrative provider output. Empty lists and null fields are valid; inspect failedRuns in the result file.

Full result format and failed-run handling →

Sources FAQ

Does the API calculate sources?: Chatbots return sources alongside text and markdown. Google returns AI Overview sources within aioverview and search links within serp. Google News returns article links within googleNews.results and googleNews.topNews.
How should failed or empty collections be handled?: Inspect per-target failedRuns and each successful run identity. Empty sources or null fields are valid output; a missing failed run is not an empty successful answer. A completed job can contain failed collections.

Use collected data to build your own reporting and analysis. Our team arranges API access and follows up with next steps.

Request API access Read the docs