731
likes
111
comments
daily view 0
monthly view 0

Share

Live Analytics

Comments 0

This 125B AI Model Runs 5x Faster on My PC Than in the Cloud (Using Strata) Analytics Table

Income Estimates for This 125B AI Model Runs 5x Faster on My PC Than in the Cloud (Using Strata)

Based on this YouTube video's total view count of 72.0K views and industry-standard rates, the estimated total earning is $50 - $144 through ad revenue. Historical data is not yet available to calculate daily, weekly, or monthly averages.

About This 125B AI Model Runs 5x Faster on My PC Than in the Cloud (Using Strata)

Explore This 125B AI Model Runs 5x Faster on My PC Than in the Cloud (Using Strata) with 72,059 views, 731 likes, and 111 comments. Experience the impact of this video content that has captured audience attention.

We ran a 125-billion-parameter AI model on a single RTX 5090 using Strata, a free open-source engine, and it hit over 250 tokens per second, three to five times faster than Qwen 3.8 Flash in the cloud through OpenRouter. We break down how Strata splits the model across your GPU, CPU, RAM and SSD, including its expert cache, the ā€œdoorbellā€ trick that lets the CPU and GPU work on the same layer at once, and speculative decoding. Then we put both models through side-by-side coding, logic, creative and long-answer tests to see where the speed gap really shows. šŸ”— Relevant Links Strata: https://github.com/Niko1221/Strata ā¤ļø More about us Radically better observability stack: https://betterstack.com/ Written tutorials: https://betterstack.com/community/ Example projects: https://github.com/BetterStackHQ šŸ“± Socials Twitter: https://twitter.com/betterstackhq Instagram: https://www.instagram.com/betterstackhq/ TikTok: https://www.tiktok.com/@betterstack LinkedIn: https://www.linkedin.com/company/betterstack šŸ“Œ Chapters: 0:00 Local AI vs the cloud 0:38 What is Strata? 1:31 The model behind it 1:58 How Strata uses your GPU, RAM and SSD 2:34 The ā€œdoorbellā€ trick 3:04 Speculative decoding 3:29 Why it’s so fast on an RTX 5090 4:23 Setting up Strata 5:17 The Desk vs Cloud test app 5:30 Coding test 5:48 Logic puzzle test 6:12 Creative test 6:22 Long answer test 7:10 Long answer with thinking off 7:23 Cost and caveats 7:56 Final thoughts

About YouTube Real-Time View Count

With SocialCounts.org’s view counter, track your YouTube video’s live view count and YouTube likes count in real time with fast, reliable updates.

Watch every YouTube video live view count rise with our real-time YouTube views tracker—built for accuracy and minimal delay.

Follow YouTube real time views as they happen, using our dedicated view counter for YouTube videos.

Get up-to-date live view count on YouTube and see real-time growth with SocialCounts.org’s smart tracking tools.

Embed Widget

Parameters:

  • fullscreen=true - Fullscreen counter
  • graph=true - Live graph chart
  • counter=0/1/2 - Select counter (0=likes, 1=views, 2=comments)
URL

Click to copy the embed URL to your clipboard