Channel BannerChannel Banner
L9QZ97y9ExgL9QZ97y9Exg

Your local LLM is 10x slower than it should be

203,514
Socialcounts.Org
Enter Fullscreen (f)
5,573
likes
272
comments
daily view 0
monthly view 0

Share

Live Analytics

Comments 0

Your local LLM is 10x slower than it should be Analytics Table

Income Estimates for Your local LLM is 10x slower than it should be

Based on this YouTube video's total view count of 203K views and industry-standard rates, the estimated total earning is $142 - $407 through ad revenue. Historical data is not yet available to calculate daily, weekly, or monthly averages.

About Your local LLM is 10x slower than it should be

Explore Your local LLM is 10x slower than it should be with 203,514 views, 5,573 likes, and 272 comments. Experience the impact of this video content that has captured audience attention.

Hereโ€™s the one change that took mine from ~120 tok/s to 1,200+ without a new GPU. TryHackMe just launched Cyber Security 101 (SEC1) โ€” and for a limited time you can get 40% off with my link: https://tryhackme.com/alexsec1 Use code ALEXSEC1 for 40% off the exam fee + 3 months of Premium access. ๐Ÿ›’ Gear Links ๐Ÿ›’ ๐Ÿช›๐Ÿช›Highly rated precision driver kit: https://amzn.to/4fkMVfg ๐Ÿ’ปโ˜• Favorite 15" display with magnet: https://amzn.to/3zD1DhQ ๐ŸŽงโšก Great 40Gbps T4 enclosure: https://amzn.to/3JNwBGW ๐Ÿ› ๏ธ๐Ÿš€ My nvme ssd: https://amzn.to/3YLEySo ๐Ÿ“ฆ๐ŸŽฎ My gear: https://www.amazon.com/shop/alexziskind ๐ŸŽฅ Related Videos ๐ŸŽฅ ๐Ÿงณ๐Ÿงฐ Mini PC portable setup - https://youtu.be/4RYmsrarOSw ๐ŸŽ๐Ÿ’ป Dev setup on Mac - https://youtu.be/KiKUN4i1SeU ๐Ÿ’ธ๐Ÿง  Cheap mini runs a 70B LLM ๐Ÿคฏ - https://youtu.be/xyKEQjUzfAk ๐Ÿงช๐Ÿ”ฅ RAM torture test on Mac - https://youtu.be/l3zIwPgan7M ๐Ÿโšก FREE Local LLMs on Apple Silicon | FAST! - https://youtu.be/bp2eev21Qfo ๐Ÿง ๐Ÿ“‰ REALITY vs Appleโ€™s Memory Claims | vs RTX4090m - https://youtu.be/fdvzQAWXU7A ๐Ÿงฌ๐Ÿ Set up Conda - https://youtu.be/2Acht_5_HTo โšก๐Ÿ’ฅ Thunderbolt 5 BREAKS Appleโ€™s Upcharge - https://youtu.be/nHqrvxcRc7o ๐Ÿง ๐Ÿš€ INSANE Machine Learning on Neural Engine - https://youtu.be/Y2FOUg_jo7k ๐Ÿงฑ๐Ÿ–ฅ๏ธ Mac Mini Cluster - https://youtu.be/GBR6pHZ68Ho * ๐Ÿ› ๏ธ Developer productivity Playlist - https://www.youtube.com/playlist?list=PLPwbI_iIX3aQCRdFGM7j4TY_7STfv2aXX ๐Ÿ”— AI for Coding Playlist: ๐Ÿ“š - https://www.youtube.com/playlist?list=PLPwbI_iIX3aSlUmRtYPfbQHt4n0YaX0qw GitHub repo for this code: https://github.com/alexziskind1/llama-throughput-lab โ€” โ€” โ€” โ€” โ€” โ€” โ€” โ€” โ€” โค๏ธ SUBSCRIBE TO MY YOUTUBE CHANNEL ๐Ÿ“บ Click here to subscribe: https://www.youtube.com/@AZisk?sub_confirmation=1 โ€” โ€” โ€” โ€” โ€” โ€” โ€” โ€” โ€” Join this channel to get access to perks: https://www.youtube.com/channel/UCajiMK_CY9icRhLepS8_3ug/join โ€” โ€” โ€” โ€” โ€” โ€” โ€” โ€” โ€” ๐Ÿ“ฑ ALEX on X: https://x.com/digitalix #macstudio #gdxspark #llamacpp

About YouTube Real-Time View Count

With SocialCounts.orgโ€™s view counter, track your YouTube videoโ€™s live view count and YouTube likes count in real time with fast, reliable updates.

Watch every YouTube video live view count rise with our real-time YouTube views trackerโ€”built for accuracy and minimal delay.

Follow YouTube real time views as they happen, using our dedicated view counter for YouTube videos.

Get up-to-date live view count on YouTube and see real-time growth with SocialCounts.orgโ€™s smart tracking tools.

Embed Widget

Parameters:

  • fullscreen=true - Fullscreen counter
  • graph=true - Live graph chart
  • counter=0/1/2 - Select counter (0=likes, 1=views, 2=comments)
URL

Click to copy the embed URL to your clipboard