Published on December 20, 2025 7:13 AM GMTAn updated METR graph including Claude Opus 4.5 was just published 3 hours ago on X by METR (source): Same graph but without the log (source):Thread from METR on X (source):We estimate that, on our tasks, Claude Opus 4.5 has a 50%-time horizon of around 4 hrs 49 mins (95% confidence interval of 1 hr 49 mins to 20 hrs 25 mins). While we’re still working through evaluations for other recent models, this is our highest published time horizon to date.We don’t think the high upper CI bound reflects Opus’s actual capabilities: our current task suite doesn’t have enough long tasks to confidently upper bound Opus 4.5’s 50%-time horizon. We are working on updating our task suite, and hope to share more details soon.Based on our experience interacting with Opus 4.5, the model’s performance on specific tasks (including some not in our time horizon suite), and its benchmark performance, we would be surprised if further investigation showed Opus had a 20+ hour 50%-time horizon.Despite its high 50%-time horizon, Opus 4.5’s 80%-time horizon is only 27 minutes, similar to past models and below GPT-5.1-Codex-Max’s 32 mins. The gap between its 50%- and 80%- horizons reflects a flatter logistic success curve, as Opus differentially succeeds on longer tasks.You can find additional details about our current methodology as well as our time horizon estimates for Opus 4.5 and other models here: https://metr.org/blog/2025-03-19-measuring-ai-ability-to-complete-long-tasks/The 80%-horizon has stayed essentially flat (27-32 mins) since GPT-5.1-Codex-Max’s release but there’s a big jump with huge error bars on the 50%-horizons.I think Daniel Kokotajlo’s recent shortform offers a useful framing here. He models progress as increasing either the intercept (baseline performance) or the slope (how well models convert time budget into performance). If progress comes mainly from rising intercepts, an exponential fit to horizon length could hold indefinitely. But if progress comes from increasing slope, the crossover point eventually shoots to infinity as AI slope approaches human slope.The flat 80%-horizon while 50%-horizon climbs might be evidence for intercept-dominated progress.Discuss Read More
Claude Opus 4.5 Achieves 50%-Time Horizon Of Around 4 hrs 49 Mins
Published on December 20, 2025 7:13 AM GMTAn updated METR graph including Claude Opus 4.5 was just published 3 hours ago on X by METR (source): Same graph but without the log (source):Thread from METR on X (source):We estimate that, on our tasks, Claude Opus 4.5 has a 50%-time horizon of around 4 hrs 49 mins (95% confidence interval of 1 hr 49 mins to 20 hrs 25 mins). While we’re still working through evaluations for other recent models, this is our highest published time horizon to date.We don’t think the high upper CI bound reflects Opus’s actual capabilities: our current task suite doesn’t have enough long tasks to confidently upper bound Opus 4.5’s 50%-time horizon. We are working on updating our task suite, and hope to share more details soon.Based on our experience interacting with Opus 4.5, the model’s performance on specific tasks (including some not in our time horizon suite), and its benchmark performance, we would be surprised if further investigation showed Opus had a 20+ hour 50%-time horizon.Despite its high 50%-time horizon, Opus 4.5’s 80%-time horizon is only 27 minutes, similar to past models and below GPT-5.1-Codex-Max’s 32 mins. The gap between its 50%- and 80%- horizons reflects a flatter logistic success curve, as Opus differentially succeeds on longer tasks.You can find additional details about our current methodology as well as our time horizon estimates for Opus 4.5 and other models here: https://metr.org/blog/2025-03-19-measuring-ai-ability-to-complete-long-tasks/The 80%-horizon has stayed essentially flat (27-32 mins) since GPT-5.1-Codex-Max’s release but there’s a big jump with huge error bars on the 50%-horizons.I think Daniel Kokotajlo’s recent shortform offers a useful framing here. He models progress as increasing either the intercept (baseline performance) or the slope (how well models convert time budget into performance). If progress comes mainly from rising intercepts, an exponential fit to horizon length could hold indefinitely. But if progress comes from increasing slope, the crossover point eventually shoots to infinity as AI slope approaches human slope.The flat 80%-horizon while 50%-horizon climbs might be evidence for intercept-dominated progress.Discuss Read More
