Channel BannerChannel Banner
uAHd7pM_vOEuAHd7pM_vOE

Run 118B AI Model on a Laptop (100% Offline)

5,832
Socialcounts.OrgEnter Fullscreen (f)
114
likes
28
comments
daily view 0
monthly view 0

Share

Live Analytics

Comments 0

Run 118B AI Model on a Laptop (100% Offline) Analytics Table

Income Estimates for Run 118B AI Model on a Laptop (100% Offline)

Based on this YouTube video's total view count of 5.83K views and industry-standard rates, the estimated total earning is $4 - $12 through ad revenue. Historical data is not yet available to calculate daily, weekly, or monthly averages.

About Run 118B AI Model on a Laptop (100% Offline)

Explore Run 118B AI Model on a Laptop (100% Offline) with 5,832 views, 114 likes, and 28 comments. Experience the impact of this video content that has captured audience attention.

Can you run a 118 Billion parameter AI model on a MacBook Pro with the Wi-Fi completely turned off? Yes—at 64 to 88 tokens per second, with zero API fees, zero rate limits, and zero data leaving your machine. In this technical breakdown, we explain the mechanics of Mixture-of-Experts (MoE) models (why only 8B parameters fire per token), benchmark top 120B models (gpt-oss-120b, Laguna S 2.1, Qwen3.5 122B), and walk through the exact runtime setup in MLX, llama.cpp, and LM Studio. We also tackle the three major walls: Apple's recent DRAM memory cutbacks, prompt processing bottlenecks, and the critical sysctl terminal command every Mac setup guide skips. šŸ”” Subscribe: https://www.youtube.com/channel/UC0DZj1PNa_Fp0MU6uPSKv5w?sub_confirmation=1 šŸ’™ Become a Member: https://www.youtube.com/channel/UC0DZj1PNa_Fp0MU6uPSKv5w/join 🐦 Twitter/X: https://x.com/cloud_codes šŸ’¬ Discord: https://discord.gg/4kJqEBMMf ā±ļø TIMESTAMPS: 00:00 - Running a 118B Model Offline at 64 tok/s 01:05 - Mixture of Experts (MoE): 8B Active Params Explained 02:17 - The Top 120B Models (Laguna, gpt-oss, Qwen) 02:53 - Quantization Cliffs & MXFP4 4-Bit Rules 03:47 - VRAM Math: KV Cache & System Memory 04:27 - Wall 1: Apple’s RAM Crisis & Discontinued Studios 05:40 - The Missing Sysctl Command (Bypass 75% GPU Cap) 06:18 - M5 Max vs M3 Ultra Benchmarks 06:32 - Runtimes Tested: LM Studio, MLX, llama.cpp, Ollama 07:53 - Wall 2: Prompt Processing & Context Decay 08:54 - The Real Economics: Is a $5,300 Mac Worth It? 10:09 - The Final Hardware Verdict & Recommendations 🧠 COMMANDS & SYSCTL FIX: Raise macOS GPU Memory Limit: sudo sysctl iogpu.wired_mem_limit=122880 (Adjust based on RAM) #localai #macbookpro #m5max #mlx #llamacpp #ai #applesilicon #gptoss #hardware #deepseek

About YouTube Real-Time View Count

With SocialCounts.org’s view counter, track your YouTube video’s live view count and YouTube likes count in real time with fast, reliable updates.

Watch every YouTube video live view count rise with our real-time YouTube views tracker—built for accuracy and minimal delay.

Follow YouTube real time views as they happen, using our dedicated view counter for YouTube videos.

Get up-to-date live view count on YouTube and see real-time growth with SocialCounts.org’s smart tracking tools.

Embed Widget

Parameters:

  • fullscreen=true - Fullscreen counter
  • graph=true - Live graph chart
  • counter=0/1/2 - Select counter (0=likes, 1=views, 2=comments)
URL

Click to copy the embed URL to your clipboard