16 Jan 2025 AI Engineering 5 min read

Deep Research Agents: What They Do and What They Do Not

Deep research agents plan, browse and synthesize for minutes instead of answering in one shot. We define the pattern, examine Google's Gemini Deep Research from December 2024, and quantify the weak point: citation quality. Measured baselines show why the verification duty stays with the reader — and what that means for engineering teams.

The Limits of Single-Shot Search

Most research questions do not fit into one search query. "Which vector database fits our latency budget and license constraints" decomposes into a dozen sub-questions, each answered by different pages, each answer changing the next question. Classic chatbots with retrieval run one round of search and summarize the first hits. Retrieval-augmented generation answers the question you asked, not the question you should have asked next. The result reads well and stops one level too early.

The GAIA benchmark (Mialon et al., November 2023) measures exactly this gap. Its 466 questions require reasoning, web browsing and tool use. Human respondents reach 92 percent; GPT-4 with plugins reached 15 percent. Humans needed 6 to 17 minutes per question. The bottleneck is not knowledge. It is sustained process: searching, reading, searching again, keeping intermediate state.

A task arrives — the agent plans its next step. 1/4

What Defines a Deep Research Agent

A deep research agent is a system that turns a question into a research plan, executes that plan over many browsing steps, and condenses the collected evidence into a cited report. Three properties separate it from chat with retrieval: an explicit plan the user can inspect, a horizon of minutes and dozens of tool calls instead of one round trip, and a synthesis pass over the full accumulated state rather than over the last search result.

Equally important is what it is not. It does not validate its sources. It does not distinguish a peer-reviewed paper from a vendor blog unless instructed to. It does not know when it has read enough; it stops when its plan is exhausted. It produces a draft with references, not a verified document.

Gemini Deep Research in Practice

Google shipped the first mainstream implementation on December 11, 2024. Deep Research is part of Gemini Advanced, gated behind the Google One AI Premium plan at 20 US dollars per month. The user selects "Gemini 1.5 Pro with Deep Research", enters a question, and receives a multi-step research plan to revise or approve. Only then does the agent start browsing.

A run takes a few minutes. The agent searches, reads, and starts new searches based on what it has learned, holding intermediate results in a context window of one million tokens. The output is a structured report with links to the original sources, exportable to Google Docs. Since December 20, 2024 the feature has been available in over 45 languages and more than 150 countries.

The launch scope is instructive: no API access, no confidence scores, availability only inside the Gemini interface. The report carries links to original sources and a list of researched websites. Google describes the feature as working "under your supervision" — that clause carries more weight than the marketing tone suggests.

Long-Horizon Browsing and Synthesis

The underlying pattern is general and older than the product: plan decomposition, a loop of searching, reading and refining, state accumulation in a long context, and a final synthesis pass. Open-source projects such as GPT Researcher have implemented variants of it since 2023. The plan-approval step is the most important interface decision: it moves user control to the point where steering is still cheap. In our own agent work we see the same loop regardless of framework; the pattern, not the product, is what transfers.

The trade-offs are structural. Latency rises from seconds to minutes; cost scales with pages fetched and tokens held in context. An early misreading steers every subsequent search — errors compound instead of averaging out. Coverage ends where a crawler cannot reach: paywalled journals, internal wikis and documents behind logins stay invisible. And breadth tends to beat depth: ten skimmed pages rather than one page read carefully.

Citation Quality in Numbers

Citation quality has measured baselines. Liu, Zhang and Liang audited four generative search engines with human raters in 2023. On average only 51.5 percent of generated sentences were fully supported by their citations, and only 74.5 percent of citations supported their associated sentence. Worse, citation precision correlated negatively with perceived utility (r = −0.96): the answers that looked most helpful cited worst.

The study predates deep research agents, and longer pipelines may score better or worse: more sources per claim, but also more paraphrase steps between source and sentence. As of January 2025 no comparable public audit of Gemini Deep Research exists. Until one does, a link in a generated report is a claim, not proof.

System	Citation recall (%)	Citation precision (%)
Bing Chat	58.7	89.5
perplexity.ai	68.7	72.7
NeevaAI	67.6	72.0
YouChat	11.1	63.6
Average	51.5	74.5

Verification Stays With the Reader

The verification duty therefore stays with the reader. A cited report shifts work; it does not remove it. Our working rule at Blue IT Systems: treat the report as an annotated bibliography with a draft attached. Every load-bearing claim — numbers, dates, version compatibilities, legal statements — is checked against its primary source before it enters a decision.

Fluency is not evidence. The Stanford numbers show that polish and citation accuracy diverge. Reading the report costs minutes; reading the sources behind the three claims your decision rests on costs a few more. That ratio is the real productivity gain — not skipping verification, but concentrating it where it matters.

Outlook From January 2025

As of January 16, 2025 we expect three developments. First, competition: OpenAI announced its o3 reasoning model in December 2024, and pairing reasoning models with agentic browsing is the obvious next product. We expect every major lab to ship a deep research feature during 2025. Google has already announced that Deep Research will reach the Gemini mobile app and Workspace accounts in early 2025. Second, benchmarks: GAIA-style scores will rise quickly once long-horizon agents are tuned for them.

Third, citation precision will become a marketed metric, because it is measurable and currently weak. What we do not expect in 2025 is automated verification good enough to discharge the reader. Deep research agents compress research from hours to minutes. Judgment is not compressed. Plan accordingly.