114
likes
28
comments
daily view 0
monthly view 0
Live Analytics
Comments 0
Run 118B AI Model on a Laptop (100% Offline) Analytics Table
Income Estimates for Run 118B AI Model on a Laptop (100% Offline)
Based on this YouTube video's total view count of 5.83K views and industry-standard rates, the estimated total earning is $4 - $12 through ad revenue. Historical data is not yet available to calculate daily, weekly, or monthly averages.
About Run 118B AI Model on a Laptop (100% Offline)
Explore Run 118B AI Model on a Laptop (100% Offline) with 5,832 views, 114 likes, and 28 comments. Experience the impact of this video content that has captured audience attention.
Can you run a 118 Billion parameter AI model on a MacBook Pro with the Wi-Fi completely turned off? Yesāat 64 to 88 tokens per second, with zero API fees, zero rate limits, and zero data leaving your machine. In this technical breakdown, we explain the mechanics of Mixture-of-Experts (MoE) models (why only 8B parameters fire per token), benchmark top 120B models (gpt-oss-120b, Laguna S 2.1, Qwen3.5 122B), and walk through the exact runtime setup in MLX, llama.cpp, and LM Studio. We also tackle the three major walls: Apple's recent DRAM memory cutbacks, prompt processing bottlenecks, and the critical sysctl terminal command every Mac setup guide skips. š Subscribe: https://www.youtube.com/channel/UC0DZj1PNa_Fp0MU6uPSKv5w?sub_confirmation=1 š Become a Member: https://www.youtube.com/channel/UC0DZj1PNa_Fp0MU6uPSKv5w/join š¦ Twitter/X: https://x.com/cloud_codes š¬ Discord: https://discord.gg/4kJqEBMMf ā±ļø TIMESTAMPS: 00:00 - Running a 118B Model Offline at 64 tok/s 01:05 - Mixture of Experts (MoE): 8B Active Params Explained 02:17 - The Top 120B Models (Laguna, gpt-oss, Qwen) 02:53 - Quantization Cliffs & MXFP4 4-Bit Rules 03:47 - VRAM Math: KV Cache & System Memory 04:27 - Wall 1: Appleās RAM Crisis & Discontinued Studios 05:40 - The Missing Sysctl Command (Bypass 75% GPU Cap) 06:18 - M5 Max vs M3 Ultra Benchmarks 06:32 - Runtimes Tested: LM Studio, MLX, llama.cpp, Ollama 07:53 - Wall 2: Prompt Processing & Context Decay 08:54 - The Real Economics: Is a $5,300 Mac Worth It? 10:09 - The Final Hardware Verdict & Recommendations š§ COMMANDS & SYSCTL FIX: Raise macOS GPU Memory Limit: sudo sysctl iogpu.wired_mem_limit=122880 (Adjust based on RAM) #localai #macbookpro #m5max #mlx #llamacpp #ai #applesilicon #gptoss #hardware #deepseek
About YouTube Real-Time View Count
With SocialCounts.orgās view counter, track your YouTube videoās live view count and YouTube likes count in real time with fast, reliable updates.
Watch every YouTube video live view count rise with our real-time YouTube views trackerābuilt for accuracy and minimal delay.
Follow YouTube real time views as they happen, using our dedicated view counter for YouTube videos.
Get up-to-date live view count on YouTube and see real-time growth with SocialCounts.orgās smart tracking tools.
Embed Widget
Parameters:
fullscreen=true- Fullscreen countergraph=true- Live graph chartcounter=0/1/2- Select counter (0=likes, 1=views, 2=comments)
URL
Click to copy the embed URL to your clipboard

