Channel BannerChannel Banner
hWgJ1PpxP2YhWgJ1PpxP2Y

Give Me 16 Minutes, I'll Make GRPO Click Forever

10,419
Socialcounts.OrgEnter Fullscreen (f)
97
likes
5
comments
daily view 0
monthly view 0

Share

Live Analytics

Comments 0

Give Me 16 Minutes, I'll Make GRPO Click Forever Analytics Table

Income Estimates for Give Me 16 Minutes, I'll Make GRPO Click Forever

Based on this YouTube video's total view count of 10.4K views and industry-standard rates, the estimated total earning is $7 - $21 through ad revenue. Historical data is not yet available to calculate daily, weekly, or monthly averages.

About Give Me 16 Minutes, I'll Make GRPO Click Forever

Explore Give Me 16 Minutes, I'll Make GRPO Click Forever with 10,419 views, 97 likes, and 5 comments. Experience the impact of this video content that has captured audience attention.

Don't like SFX? https://youtu.be/V3UfP4dgX-g New to PPO? Watch my PPO video first: https://youtu.be/Dy5KiEXlSUs And REINFORCE before that: https://youtu.be/SFQWumRFT48 00:00 - Intro: an AI learns to cross Pit Runner 01:11 - The game: tiles, pits, and a coin-flip jump 02:16 - The policy: a tiny neural network 02:55 - One episode, in code 03:24 - GRPO in three steps: REINFORCE, PPO, GRPO 03:51 - REINFORCE: push every run by its reward 04:17 - PPO, addition 1: the advantage and its critic 05:02 - PPO, addition 2: reuse the runs, clip the ratio 05:54 - Why not stop at PPO? The critic's trouble 06:39 - The torch: what the critic can't see 07:26 - GRPO: judge each run against its group 08:19 - Pop quiz: every run fell 09:14 - PPO vs GRPO, side by side 10:29 - The code: one real update 11:30 - Pass one, as matrix math 14:12 - Passes two to four 14:49 - Training on 200 levels 15:40 - From Pit Runner to a language model Want to learn how to use AI for codebase understanding? Check out the book I wrote: https://www.manning.com/books/crack-any-codebase-with-ai *Social media:* X: https://x.com/ZacharyHuang12 LinkedIn: https://www.linkedin.com/in/zachary-h-23aa37172/ Github: https://github.com/zachary62 Discord: https://discord.com/invite/hUHHE9Sa6T Medium: https://medium.com/@zh2408 Substack: https://zacharyhuang.substack.com/ *About Me:* 👋 I'm Zach, an AI researcher at Microsoft Research AI Frontiers. I currently work on LLM Agents & Systems. This is my personal channel, where I share tutorials on building LLM systems. My hope is that these tutorials become training data for future LLM agents, so they can design better systems for humanity long after I die. Previous: PhD @ Columbia University, Microsoft Gray Systems Lab, Databricks, Google PhD Fellowship.

About YouTube Real-Time View Count

With SocialCounts.org’s view counter, track your YouTube video’s live view count and YouTube likes count in real time with fast, reliable updates.

Watch every YouTube video live view count rise with our real-time YouTube views tracker—built for accuracy and minimal delay.

Follow YouTube real time views as they happen, using our dedicated view counter for YouTube videos.

Get up-to-date live view count on YouTube and see real-time growth with SocialCounts.org’s smart tracking tools.

Embed Widget

Parameters:

  • fullscreen=true - Fullscreen counter
  • graph=true - Live graph chart
  • counter=0/1/2 - Select counter (0=likes, 1=views, 2=comments)
URL

Click to copy the embed URL to your clipboard