Blind Benchmark Catches Frontier AI at Just 3-15% on Research Idea Recovery

My take: The Reconstruction benchmark confirms what many suspected: the most advanced AI models are not generating genuinely new ideas when training-data retrieval is removed as a crutch. Evaluated on 643 papers across six scientific domains, seven frontier models recovered the core idea of a paper in just 3 to 15% of cases.

The takeaway for those who use AI at work: the tool remains extremely valuable for producing faster, organizing ideas, and iterating on what already exists. But the original hypothesis (the question no one has asked yet) is still your responsibility. Delegating that to AI today means delegating too much.

The good news is in the multi-agent numbers: when several models review each other's outputs in a cross-review tournament, the rate climbs to 42%. That is a direct signal for how to design AI workflows that extract more value from what these tools can actually do.

For employees, freelancers, and business owners, the practical question is this: are you using AI to accelerate and improve what you already know how to do, or to think on your behalf? The first application is strategic; the second, for now, leads to mediocre results.