DeepStress: Stress-Testing Deep Search Agents

Ismaël Rousseau, Geraldine Damnati, Frederic Bechet

DeepStress: Stress-Testing Deep Search Agents: 6 upvotes on Hugging Face Daily Papers, #21 of 34 papers on 2026-11-13. Day-by-day upvote history.

Upvotes over time

It had 3 upvotes by its first day, 5 upvotes by the next day, 6 upvotes by day 3, 6 upvotes by day 7, and has 6 now. It ranked #95 of 167 papers in its week and #302 of 520 in its month.

While search agents demonstrate impressive capabilities in multi-step question answering, their robustness to poor-quality evidence remains under-explored. Such evidence is rare in benchmark corpora, and resulting failures are hard to reproduce. We propose DeepStress, a dynamic stress-testing framework that subjects agents to degraded evidence at controlled rates. It replaces the retrieval module with a synthetic environment where documents are generated dynamically for each query, under independent control of their trustworthiness, relevance, and factuality. To characterize behavior under stress, we go beyond binary accuracy with a five-way classification of final-answer outcomes and two new reliability-aware metrics, RAS and CoPRAS, which credit cautious behavior and account for computational cost. Evaluating 12 systems on questions from HotpotQA and BrowseComp-Plus, we find that several open-weight agents answer confidently when sources contain obvious credibility red flags, and that many HotpotQA questions are answered from parametric knowledge even when all returned documents are factually wrong.

Paper page on Hugging Face · arXiv

Data: hysts-bot-data/daily-papers-stats and the Daily Papers API. Open data: tardellirs/paper-pulse-data. Sister project: Model Pulse, the download history of every model on the Hub.