Channel BannerChannel Banner
PfR4S3ZzdooPfR4S3Zzdoo

Bytes Is This The End of Token?

16,854
Socialcounts.OrgEnter Fullscreen (f)
331
likes
53
comments
daily view 0
monthly view 0

Share

Live Analytics

Comments 0

Bytes Is This The End of Token? Analytics Table

Income Estimates for Bytes Is This The End of Token?

Based on this YouTube video's total view count of 16.8K views and industry-standard rates, the estimated total earning is $12 - $34 through ad revenue. Historical data is not yet available to calculate daily, weekly, or monthly averages.

About Bytes Is This The End of Token?

Explore Bytes Is This The End of Token? with 16,854 views, 331 likes, and 53 comments. Experience the impact of this video content that has captured audience attention.

Bytes instead of tokens: is this the end of tokens? Meta FAIR says AI models might not need a tokenizer anymore. I read the paper behind the headlines, and the byte-level language model gets by on one-sixth of the training data while doing 6.35× the math on every byte. This is AI tokens explained from the ground up: what a tokenizer actually does, why AI can't spell strawberry, what Meta's "Breaking the Token Ceiling" paper really measured, and what byte models cost you when you run them. TOKENIZER EXPLAINED Every LLM reads your text through a tokenizer: hand-written regex rules plus a fixed vocabulary. Llama 3's has 128,256 entries, and the two tables that hold them are about 29% of a small model's parameters. That's the AI tokens vs parameters trade-off most people never see. It's also the AI strawberry problem: "strawberry" reaches the model as 3 token IDs, not 10 letters. META FAIR BYTE MODELS (BREAKING THE TOKEN CEILING) Meta FAIR and the University of Washington trained three 1B models with Llama 3 distillation from the same Llama 3 8B teacher: one reads tokens, one reads raw bytes, and one uses End-Of-Token distillation (bytes plus an end-of-token marker). The fitted curves predict 52.4% vs 48.4%. The checkpoints they actually trained scored 44.6 vs 44.4. The 4-point win is a forecast. TOKENIZER VS BYTE MODEL: THE CATCH "One-sixth the data" is 6.35× the compute per byte. On an RTX 5090 that's about 127 tokens of text per second instead of 495, prompt reading runs 6.35× slower, and the same context window holds one-fifth of the text. The KV cache for a 100K-token codebase goes from about 20 GB to 113 GB. BYTE LATENT TRANSFORMER + H-NET Meta's own Byte Latent Transformer (BLT, 2024) groups bytes into patches, matches Llama 3, and scored 99.9% on spelling vs Llama 3's 1.1%. Cartesia's H-Net (Albert Gu) learns its own chunks and matched SmolLM3 on about 1T tokens of training data instead of 11.1T, at the same compute per byte. And you're already paying by the byte: Claude Opus 4.7 kept its price per token but its new tokenizer turns the same text into 1.0–1.35× as many tokens. CHAPTERS 0:00 Why my API bill went up 1:44 What a token actually is (the strawberry problem) 4:22 Meta's byte model: forecast vs fact 7:06 One-sixth the data, six times the math 11:49 BLT & H-Net: bytes without the slowdown 17:16 You're already paying by the byte 20:51 So is it the end of tokens? WATCH NEXT NCM: Is This the End of LLMs? → https://youtu.be/vLqswKyHS64 The End of AI Hallucinations? Meta's New Fix (CLM) → https://youtu.be/9-iiHFQyzuM How AI Got Smaller and Still Became Smarter → https://youtu.be/LqAxNIalgOw DeepSeek Just Shrunk the KV Cache 437× → https://youtu.be/n-_e9bROGHo Your AI Subscription Is Now Worth Less → https://youtu.be/FWShtLCP4OY SOURCES & REFERENCES Breaking the Token Ceiling (Meta FAIR + UW): https://arxiv.org/abs/2609.12303 Full paper, tables & figures: https://arxiv.org/html/2609.12303v1 Byte Latent Transformer (Meta, 2024): https://arxiv.org/abs/2412.09871 Cartesia, From Tokens to Bytes I: https://cartesia.ai/blog/from-tokens-to-bytes-part-1 Cartesia, From Tokens to Bytes II: https://cartesia.ai/blog/from-tokens-to-bytes-part-2 Albert Gu on H-Net: https://x.com/_albertgu/status/2115502110578290900 Albert Gu, hand-crafted regexes in every LLM: https://x.com/_albertgu/status/2113687798826111283 DeepSeek's hard-coded CJK regex: https://x.com/_albertgu/status/2113687831982076136 Llama 3 pre-tokenizer regex: https://github.com/meta-llama/llama3/blob/main/llama/tokenizer.py#L47 "strawberry" in the Llama 3 tokenizer: https://tiktokenizer.vercel.app/?model=meta-llama%2FMeta-Llama-3-8B Tokenizer unfairness between languages (Oxford): https://arxiv.org/abs/2305.15425 Better Stack, AI Models Might Not Need Tokens Anymore: https://www.youtube.com/shorts/vIkRLhHoxuo Comment, "hope you enjoy waiting 4x longer": https://www.youtube.com/watch?v=vIkRLhHoxuo&lc=Ugw_WwFygvxAL9vaLvh4AaABAg Comment, "context gets much more expensive": https://www.youtube.com/watch?v=vIkRLhHoxuo&lc=UgzKKvILGD26MNCdwHV4AaABAg r/LocalLLaMA thread: https://www.reddit.com/r/LocalLLaMA/comments/1xe88ja/ Anthropic, Claude Opus 4.7 tokenizer (archived): https://web.archive.org/web/20260425155635/https://www.anthropic.com/news/claude-opus-4-7 Simon Willison, Claude token counts: https://simonwillison.net/2026/Apr/20/claude-token-counts/ OpenRouter, Opus 4.7 tokenizer cost: https://openrouter.ai/blog/insights/opus-47-tokenizer-analysis/ Aleph Alpha Kolibri tokenizer test: https://www.reddit.com/r/LocalLLaMA/comments/1wwl7y6/ Bolmo 7B byte model (Ai2): https://huggingface.co/allenai/Bolmo-7B #tokenization #metaai #llm

About YouTube Real-Time View Count

With SocialCounts.org’s view counter, track your YouTube video’s live view count and YouTube likes count in real time with fast, reliable updates.

Watch every YouTube video live view count rise with our real-time YouTube views tracker—built for accuracy and minimal delay.

Follow YouTube real time views as they happen, using our dedicated view counter for YouTube videos.

Get up-to-date live view count on YouTube and see real-time growth with SocialCounts.org’s smart tracking tools.

Embed Widget

Parameters:

  • fullscreen=true - Fullscreen counter
  • graph=true - Live graph chart
  • counter=0/1/2 - Select counter (0=likes, 1=views, 2=comments)
URL

Click to copy the embed URL to your clipboard