Science Explained/Brief
AI vs. traditional methods: a new meta-analysis finds a mixed record
A preprint analyzing 2,507 head-to-head comparisons between AI and other scientific methods across 27 disciplines finds a mixed record: AI often beats traditional statistics but at higher cost, and while it has improved against scientific computing since 2020, it still underperforms in many cases.
BriefPublished 16 September 20261 min read1 linked source · 5 checked facts
The analysis, which covers papers published between 2000 and early 2025, reports a 'profound dichotomy.' Against traditional statistics, AI frequently wins but requires more computation. However, in nearly a quarter of cases, AI is both more expensive and less accurate—a proportion that has remained stable for a decade. Against scientific computing, AI often loses but uses less computation. That is changing: since 2020, AI has outperformed scientific computing in more than half of comparisons. The authors conclude AI is not a universal replacement but a valuable, improving part of a new frontier.
Our view
This preprint offers a nuanced, evidence-based view of AI's role in science, but its findings are preliminary and not yet peer-reviewed.
What the reporting says: AI often outperforms traditional statistics at higher computational cost, that in nearly a quarter of cases AI is both more expensive and worse, and that since 2020 AI outperforms scientific computing on more than half of comparisons.
