Visualizing transformers and attention | Talk for TNG Big Tech Day '24

Published November 20, 2024

Views 1.30M | Likes 34.7K | Comments 730

Views#619,728

Views#144,665

Channel

Grant Sanderson

Grant Sanderson

140K subs•15 videos•Dec 2011

Views

1,303,507

Likes

34,737

Comments

730

Performance vs. channel

Outlier score

Engagement rate

Revenue estimate

Total (all-time): $912 – $2.60K

Based on estimated $0.7–$2 CPM.

More features coming

We're working on new analytics and tools. Stay tuned.

About

An overview of transforms, as used in LLMs, and the attention mechanism within them. Based on the 3blue1brown deep learning series: https://www.youtube.com/playlist?list=PLZHQObOWTQDNU6R1_67000Dx_ZCJB-3pi

Published: November 20, 2024
Made for kids: No

More features coming

We're working on new analytics and tools. Stay tuned.