Channel BannerChannel Banner
UGO_EhywuxcUGO_Ehywuxc

The Dark Matter of AI [Mechanistic Interpretability]

293,898
Socialcounts.Org
Enter Fullscreen (f)
13,185
likes
515
comments
daily view 0
monthly view 0

Share

Live Analytics

Comments 0

The Dark Matter of AI [Mechanistic Interpretability] Analytics Table

Income Estimates for The Dark Matter of AI [Mechanistic Interpretability]

Based on this YouTube video's total view count of 293K views and industry-standard rates, the estimated total earning is $206 - $588 through ad revenue. Historical data is not yet available to calculate daily, weekly, or monthly averages.

About The Dark Matter of AI [Mechanistic Interpretability]

Explore The Dark Matter of AI [Mechanistic Interpretability] with 293,898 views, 13,185 likes, and 515 comments. Experience the impact of this video content that has captured audience attention.

Take your personal data back with Incogni! Use code WELCHLABS at the link below and get 60% off an annual plan: http://incogni.com/welchlabs Welch Labs Imaginary Numbers Book! https://www.welchlabs.com/resources/imaginary-numbers-book Welch Labs Posters:https://www.welchlabs.com/resources Special Thanks to Patrons https://www.patreon.com/welchlabs Juan Benet, Ross Hanson, Yan Babitski, AJ Englehardt, Alvin Khaled, Eduardo Barraza, Hitoshi Yamauchi, Jaewon Jung, Mrgoodlight, Shinichi Hayashi, Sid Sarasvati, Dominic Beaumont, Shannon Prater, Ubiquity Ventures, Matias Forti, Brian Henry, Tim Palade, Petar Vecutin, Nicolas baumann, Jason Singh, Robert Riley, vornska, Barry Silverman My Gemma walkthrough notebook: https://colab.research.google.com/drive/1Y68yNr5TcHr4G5RJ0QHZhKkDe55AUkVj?usp=sharing Most animations made with Manim: https://github.com/3b1b/manim References and Further Reading Chris Olah’s original “Dark Matter of Neural Networks” post: https://transformer-circuits.pub/2024/july-update/index.html#dark-matter Great recent interview with Chris Olah: https://www.youtube.com/watch?v=ugvHCXCOmm4 Gemma Scope: https://arxiv.org/pdf/2408.05147 Experiment with SAEs yourself here! https://www.neuronpedia.org/ Relevant work from the Anthropic team: https://transformer-circuits.pub/2022/toy_model/index.html https://transformer-circuits.pub/2023/monosemantic-features https://transformer-circuits.pub/2024/scaling-monosemanticity/ Excellent intro Mechanistic Interpretability: https://arena3-chapter1-transformer-interp.streamlit.app/%5B1.2%5D_Intro_to_Mech_Interp Neel Nanda’s Mechanistic Interpretability Explainer: https://dynalist.io/d/n2ZWtnoYHrU1s4vnFSAQ519J Transformer Lens: https://github.com/TransformerLensOrg/TransformerLens SAE Lens: https://jbloomaus.github.io/SAELens/ Technical Notes 1. There are more advanced and more meaningful ways to map mid layer vectors to outputs, see: https://arxiv.org/pdf/2303.08112, https://neuralblog.github.io/logit-prisms/, https://www.lesswrong.com/posts/AcKRB8wDpdaN6v6ru/interpreting-gpt-the-logit-lens 2. The 6x2304 matrix is actually 7x2304, we’re ignoring the /bos token. 3. Gemma also includes positional embeddings and lots and lots of normalization layers, which we didn’t really cover 4. I’m conflating tokens and words sometimes, in this example each word is a token, so we don’t have to worry about it too much 5. The “_” characters represent spaces in the token strings CFAQJOTYQHT7JYIT

About YouTube Real-Time View Count

With SocialCounts.org’s view counter, track your YouTube video’s live view count and YouTube likes count in real time with fast, reliable updates.

Watch every YouTube video live view count rise with our real-time YouTube views tracker—built for accuracy and minimal delay.

Follow YouTube real time views as they happen, using our dedicated view counter for YouTube videos.

Get up-to-date live view count on YouTube and see real-time growth with SocialCounts.org’s smart tracking tools.

Embed Widget

Parameters:

  • fullscreen=true - Fullscreen counter
  • graph=true - Live graph chart
  • counter=0/1/2 - Select counter (0=likes, 1=views, 2=comments)
URL

Click to copy the embed URL to your clipboard