Based on this YouTube video's total view count of 8.76K views and industry-standard rates, the estimated total earning is $6 - $18 through ad revenue. Historical data is not yet available to calculate daily, weekly, or monthly averages.

Explore Why Agent Hype can fall short of reality – Joel Becker, METR with 8,760 views, 165 likes, and 6 comments. Experience the impact of this video content that has captured audience attention.

AI models are crushing benchmarks. SWE-bench scores are climbing, and METR's measured time horizons are rising rapidly. Yet when we deployed these same models in a field study with experienced developers, they didn't speed up work. What's going on? Are benchmarks misleading us about AI capabilities? Are we missing something about how AI performs in the real world? In this talk, we'll reconcile lab and field evidence on AI capabilities. Drawing from METR's time horizon measurements and developer productivity RCT, we'll explore why impressive benchmark performance doesn't always translate to real-world impact. We'll examine potential explanations—from reliability requirements to task distribution to capability elicitation—and discuss what this means for automated AI R&D. Speaker: Joel Becker | Researcher, METR https://x.com/joel_bkr https://www.linkedin.com/in/joel-becker/ https://github.com/joel-becker **Timestamps:** 00:00 Introduction to METR & The Capability Gap 01:49 The Problem with Current Benchmarks (Saturation & Interpretation) 03:19 METR’s New Methodology: Human Time Horizons 04:52 Empirical Results: Fitting Capability Curves 06:19 Time Horizon Trends: Claude 3 Opus vs. o1-preview 17:43 Randomized Controlled Trial (RCT) Discussion 18:18 Reconciling the Gap: Why High Benchmarks Don't Mean High Productivity 19:18 Explaining the Discrepancy: Context, Reliability, and Task Interdependence 20:22 Future Work & Hiring at METR --- Watch along with the corrected transcript, summary, timestamps and resources on this talk's official AIE page: https://ai.engineer/talks/RhfqQKe22ZA-why-agent-hype-can-fall-short-of-reality-joel-becker-metr Join our upcoming AI Engineer conferences (see https://ai.engineer landing page): - AIEi Shanghai, November 5–6 — the first for meeting top Chinese labs and engineers - AIE CODE in SF, November 10–12 — the top AI Coding conference returns - AIEi Sydney, December 7–8 — the first AIEi run alongside NeurIPS 2026 in Sydney ---

With SocialCounts.org’s view counter, track your YouTube video’s live view count and YouTube likes count in real time with fast, reliable updates.

Watch every YouTube video live view count rise with our real-time YouTube views tracker—built for accuracy and minimal delay.

Follow YouTube real time views as they happen, using our dedicated view counter for YouTube videos.

Get up-to-date live view count on YouTube and see real-time growth with SocialCounts.org’s smart tracking tools.