3
likes
0
comments
daily view 0
monthly view 0
Live Analytics
Comments 0
Deploy Multi-GPU AI Inference on Kubernetes with Ray Serve Analytics Table
Income Estimates for Deploy Multi-GPU AI Inference on Kubernetes with Ray Serve
Based on this YouTube video's total view count of 921 views and industry-standard rates, the estimated total earning is $1 - $2 through ad revenue. Historical data is not yet available to calculate daily, weekly, or monthly averages.
About Deploy Multi-GPU AI Inference on Kubernetes with Ray Serve
Explore Deploy Multi-GPU AI Inference on Kubernetes with Ray Serve with 921 views, 3 likes, and 0 comments. Experience the impact of this video content that has captured audience attention.
Pulling large model weights over public networks on every cold start wastes minutes you do not have. Evan Johnson and Aveek Saha walk through a production inference setup on Linode Kubernetes Engine (LKE) that fixes that bottleneck. They wire up OpenWebUI, KubeRay, and Ray Serve on NVIDIA Blackwell GPUs, carve up hardware with MIG to run 16 parallel OCR workers, and drop cold starts from minutes to 43 seconds using local object storage caching. ### 🔗 Useful Links & Resources: * Akamai Developers on GitHub: https://github.com/akamai-developers * Akamai Developer Hub: https://developers.akamai.com * $100 Akamai Cloud Credit: https://login.linode.com/signup?promo=akm-lp-akmtube-100-111325-T853 ### 📲 Follow Us & Join Our Community 🆇 X: https://x.com/akamaidevs?s=20 💼 LinkedIn: https://www.linkedin.com/showcase/akamai-dev/ 👾 Discord: https://discord.gg/5MJegzS8Y ### ⏱️ Timestamps: 0:00 Zero to AI Inference Overview 0:19 Reference Architecture: LKE, KubeRay, and Gateway API 0:43 Provisioning Infrastructure with Terraform and Tilt 1:25 Agentic Research Pipeline with MiniMax and Nemotron 1:51 Model Caching with Akamai Object Storage 2:27 Splitting GPUs with MIG Partitions for OCR 3:20 FP4 Quantization on NVIDIA Blackwell GPUs 3:51 Akamai Cloud Node Pools and GPU Allocation 4:42 Model Cache Startup Performance in Grafana 5:44 Running the Deep Research Agent in OpenWebUI 6:12 Real-Time GPU Metrics: Power, Temp, and Utilization 6:43 Ray Serve and vLLM Latency Dashboards 7:46 Research Agent Output and Key Findings 8:02 GitHub Repo Walkthrough and Wrap Up
About YouTube Real-Time View Count
With SocialCounts.org’s view counter, track your YouTube video’s live view count and YouTube likes count in real time with fast, reliable updates.
Watch every YouTube video live view count rise with our real-time YouTube views tracker—built for accuracy and minimal delay.
Follow YouTube real time views as they happen, using our dedicated view counter for YouTube videos.
Get up-to-date live view count on YouTube and see real-time growth with SocialCounts.org’s smart tracking tools.
Embed Widget
Parameters:
fullscreen=true- Fullscreen countergraph=true- Live graph chartcounter=0/1/2- Select counter (0=likes, 1=views, 2=comments)
URL
Click to copy the embed URL to your clipboard

