Channel BannerChannel Banner
wjZofJX0v4MwjZofJX0v4M

Transformers, the tech behind LLMs | Deep Learning Chapter 5

10,937,417
Socialcounts.Org
Enter Fullscreen (f)
233,532
likes
4,118
comments
daily view 0
monthly view 0

Share

Live Analytics

Comments 0

Transformers, the tech behind LLMs | Deep Learning Chapter 5 Analytics Table

Income Estimates for Transformers, the tech behind LLMs | Deep Learning Chapter 5

Based on this YouTube video's total view count of 10.9M views and industry-standard rates, the estimated total earning is $7.65K - $21.8K through ad revenue. Historical data is not yet available to calculate daily, weekly, or monthly averages.

About Transformers, the tech behind LLMs | Deep Learning Chapter 5

Explore Transformers, the tech behind LLMs | Deep Learning Chapter 5 with 10,937,417 views, 233,532 likes, and 4,118 comments. Experience the impact of this video content that has captured audience attention.

Breaking down how Large Language Models work, visualizing how data flows through. Instead of sponsored ad reads, these lessons are funded directly by viewers: https://3b1b.co/support --- Here are a few other relevant resources Build a GPT from scratch, by Andrej Karpathy https://youtu.be/kCc8FmEb1nY If you want a conceptual understanding of language models from the ground up, @vcubingx just started a short series of videos on the topic: https://youtu.be/1il-s4mgNdI?si=XaVxj6bsdy3VkgEX If you're interested in the herculean task of interpreting what these large networks might actually be doing, the Transformer Circuits posts by Anthropic are great. In particular, it was only after reading one of these that I started thinking of the combination of the value and output matrices as being a combined low-rank map from the embedding space to itself, which, at least in my mind, made things much clearer than other sources. https://transformer-circuits.pub/2021/framework/index.html History of language models by Brit Cruise, @ArtOfTheProblem https://youtu.be/OFS90-FX6pg An early paper on how directions in embedding spaces have meaning: https://arxiv.org/pdf/1301.3781.pdf Звуковая дорожка на русском языке: Влад Бурмистров. --- Timestamps 0:00 - Predict, sample, repeat 3:03 - Inside a transformer 6:36 - Chapter layout 7:20 - The premise of Deep Learning 12:27 - Word embeddings 18:25 - Embeddings beyond words 20:22 - Unembedding 22:22 - Softmax with temperature 26:03 - Up next

About YouTube Real-Time View Count

With SocialCounts.org’s view counter, track your YouTube video’s live view count and YouTube likes count in real time with fast, reliable updates.

Watch every YouTube video live view count rise with our real-time YouTube views tracker—built for accuracy and minimal delay.

Follow YouTube real time views as they happen, using our dedicated view counter for YouTube videos.

Get up-to-date live view count on YouTube and see real-time growth with SocialCounts.org’s smart tracking tools.

Embed Widget

Parameters:

  • fullscreen=true - Fullscreen counter
  • graph=true - Live graph chart
  • counter=0/1/2 - Select counter (0=likes, 1=views, 2=comments)
URL

Click to copy the embed URL to your clipboard