LLMs1 min read
HybridDeepResearch Benchmark Released: SQL & Web Search for Agents
A new benchmark, HybridDeepResearch, assesses autonomous agent performance requiring both web search and SQL queries to solve complex analytical tasks. Evaluations show current state-of-the-art models struggle with directional reasoning when integrating structured and unstructured data.
From arXiv cs.CL