

Rich Sutton and Khurram Javed: Why AI Models Stop Learning, and How to Start It Again
123,715
Socialcounts.Org
1,327
likes
200
comments
daily view 0
monthly view 0
Live Analytics
Comments 0
Rich Sutton and Khurram Javed: Why AI Models Stop Learning, and How to Start It Again Analytics Table
Income Estimates for Rich Sutton and Khurram Javed: Why AI Models Stop Learning, and How to Start It Again
Based on this YouTube video's total view count of 123K views and industry-standard rates, the estimated total earning is $87 - $247 through ad revenue. Historical data is not yet available to calculate daily, weekly, or monthly averages.
About Rich Sutton and Khurram Javed: Why AI Models Stop Learning, and How to Start It Again
Explore Rich Sutton and Khurram Javed: Why AI Models Stop Learning, and How to Start It Again with 123,715 views, 1,327 likes, and 200 comments. Experience the impact of this video content that has captured audience attention.
Rich Sutton, who helped pioneer reinforcement learning and wrote the seminal AI essay The Bitter Lesson, has now cofounded Oak Lab with his former student Khurram Javed. Their goal: to build agents that continuously learn from their own experience rather than from us. Rich doesn't think he holds a radical view: "I'm not weird. The field is weird." He says all learning is continual, and the field is the one that needed a new name for it. Rich and Khurram argue synthetic data is "a big mistake." Their "big world hypothesis" is that the world is massively more complex than any agent or simulator, so approximations have to be updated continuously rather than frozen at deployment. Rich calls LLMs an unanticipated scientific breakthrough, but says they represent roughly a quarter of intelligence. He says catastrophic forgetting is "totally curable" with the ideas behind their continual backprop algorithm. Khurram explains why the frontier labs can't follow: they sit in a local minimum where a new paradigm gets worse before it gets better. Their target, five to ten years out, is a trillion-parameter mind that keeps learning, stays coherent, and runs on 20 watts. Hosted by Sonya Huang and Alfred Lin, Sequoia Capital 00:00 Introduction 02:10 An AI winter, a cancer diagnosis, and the move to Alberta 07:07 Writing "The Bitter Lesson" — and the 26-word version 09:53 Are LLMs a positive or a negative example of it? 11:03 Synthetic data is "just a big mistake" — and the Big World Hypothesis 18:01 AlphaGo, human priors, and why prior knowledge and learning should be friends 22:37 "Their weights never change" — do LLM assistants actually learn? 26:09 Babies, squirrels, and why no animal learns by supervised learning 32:02 Rockets, imagination, and where paradigm shifts come from 36:42 The Alberta Plan and its 12 steps 38:53 Catastrophic forgetting — and the cure 43:43 Oak's biggest ambition: a self-maintaining mind 47:56 Why the big labs are stuck in a local minimum 49:13 If everything goes right — LLMs, many minds, and hiring
About YouTube Real-Time View Count
With SocialCounts.org’s view counter, track your YouTube video’s live view count and YouTube likes count in real time with fast, reliable updates.
Watch every YouTube video live view count rise with our real-time YouTube views tracker—built for accuracy and minimal delay.
Follow YouTube real time views as they happen, using our dedicated view counter for YouTube videos.
Get up-to-date live view count on YouTube and see real-time growth with SocialCounts.org’s smart tracking tools.
Embed Widget
Parameters:
fullscreen=true- Fullscreen countergraph=true- Live graph chartcounter=0/1/2- Select counter (0=likes, 1=views, 2=comments)
URL
Click to copy the embed URL to your clipboard