OAgents: An Empirical Study of Building Effective Agents

He Zhu, tianrui, king zhu, Heyuan Huang, Yeyi Guan, Jinxiang Xia, yycsu, Hanhao Li, Ningning Wang, Pai Liu, Tianhao Peng, guixin, Xiaowan Li, Yuhui Liu, Yuchen Eleanor Jiang, Jun Wang, Changwang ZHANG, Xiangru Tang, Ge Zhang, Jian Yang, minghao, Xitong Gao, Jiaheng Liu, Zhou

OAgents: An Empirical Study of Building Effective Agents: 32 upvotes on Hugging Face Daily Papers, #4 of 39 papers on 2025-06-24. Day-by-day upvote history.

Recently, Agentic AI has become an increasingly popular research field. However, we argue that current agent research practices lack standardization and scientific rigor, making it hard to conduct fair comparisons among methods. As a result, it is still unclear how different design choices in agent frameworks affect effectiveness, and measuring their progress remains challenging. In this work, we conduct a systematic empirical study on GAIA benchmark and BrowseComp to examine the impact of popular design choices in key agent components in a fair and rigorous manner. We find that the lack of a standard evaluation protocol makes previous works, even open-sourced ones, non-reproducible, with significant variance between random runs. Therefore, we introduce a more robust evaluation protocol to stabilize comparisons. Our study reveals which components and designs are crucial for effective agents, while others are redundant, despite seeming logical. Based on our findings, we build and open-source OAgents, a new foundation agent framework that achieves state-of-the-art performance among open-source projects. OAgents offers a modular design for various agent components, promoting future research in Agentic AI.

Paper page on Hugging Face · arXiv

Data: hysts-bot-data/daily-papers-stats and the Daily Papers API. Open data: tardellirs/paper-pulse-data. Sister project: Model Pulse, the download history of every model on the Hub.