Science Explained/Brief
AI long-task benchmark post warns some claims are out of date
A research blog post titled 'Measuring AI Ability to Complete Long Software Tasks' carries a banner saying some of its text and figures are out of date.
BriefPublished 15 September 20261 min read1 linked source · 3 checked facts
The page's own notice states that the interactive chart is kept up to date, but static figures and some claims in the text—such as the doubling time—reflect the state of the data at the time of original publication. It directs readers to a dedicated time horizons page and Time Horizon 1.1 for the latest methodology and results.
Our view
The post's original quantitative claims, including any doubling-time estimate, should be treated as historical rather than current.
What the reporting says: Some of the text and figures in the post are out of date, that the interactive chart is kept up to date, and that static figures and some claims in the text (e.g. the doubling time) reflect the state of the data at the time of original publication.