Channel BannerChannel Banner
9Ge0sMm65jo9Ge0sMm65jo

Train Your Own LLM – Tutorial

451,041
Socialcounts.OrgEnter Fullscreen (f)
9,764
likes
218
comments
daily view 0
monthly view 0

Share

Live Analytics

Comments 0

Train Your Own LLM – Tutorial Analytics Table

Income Estimates for Train Your Own LLM – Tutorial

Based on this YouTube video's total view count of 451K views and industry-standard rates, the estimated total earning is $316 - $902 through ad revenue. Historical data is not yet available to calculate daily, weekly, or monthly averages.

About Train Your Own LLM – Tutorial

Explore Train Your Own LLM – Tutorial with 451,041 views, 9,764 likes, and 218 comments. Experience the impact of this video content that has captured audience attention.

This course is designed to help beginners learn how to train a language model from start to finish. Imad will guide you through the whole process, using Moroccan Darija as an example. In this course, you will learn: - How to load text data - How to train a tokenizer from scratch using the Byte Pair Encoding (BPE) method - How to use the tokenizer to encode text data - How the Transformer architecture works in language models - How to pre-train a model - How to create a supervised fine-tuning dataset - How to fine-tune the model and build an AI assistant that you can chat with You can find the slides, notebook, and scripts in this GitHub repository: https://github.com/ImadSaddik/Train_Your_Language_Model_Course The supervised fine-tuning dataset is available here: https://github.com/ImadSaddik/BoDmaghDataset https://huggingface.co/datasets/ImadSaddik/BoDmaghDataset The tokenizers trained on AtlaSet can be found here: https://github.com/ImadSaddik/DarijaTokenizers You can access the AtlaSet on HuggingFace here: https://huggingface.co/datasets/atlasia/Atlaset To connect with Imad Saddik, check out his social accounts: - LinkedIn: https://www.linkedin.com/in/imadsaddik/ - YouTube: https://www.youtube.com/@3CodeCampers - Discord: imad_saddik ❤️ Support for this channel comes from our friends at Scrimba – the coding platform that's reinvented interactive learning: https://scrimba.com/freecodecamp ⭐️ Course Contents ⭐️ (0:00:00) About the Course (0:03:03) Introduction (0:07:24) Training Data (0:15:33) Tokenization (0:29:00) The Transformer Architecture (0:52:21) Pre-training (1:24:46) Fine-tuning Dataset (1:33:05) Instruction Fine-tuning (2:06:17) Fine-tuning with LoRA (2:20:39) Let's Scale Everything (3:09:40) Bonus (3:27:10) Conclusion 🎉 Thanks to our Champion and Sponsor supporters: 👾 Drake Milly 👾 Ulises Moralez 👾 Goddard Tan 👾 David MG 👾 Matthew Springman 👾 Claudio 👾 Oscar R. 👾 jedi-or-sith 👾 Nattira Maneerat 👾 Justin Hual -- Learn to code for free and get a developer job: https://www.freecodecamp.org Read hundreds of articles on programming: https://freecodecamp.org/news

About YouTube Real-Time View Count

With SocialCounts.org’s view counter, track your YouTube video’s live view count and YouTube likes count in real time with fast, reliable updates.

Watch every YouTube video live view count rise with our real-time YouTube views tracker—built for accuracy and minimal delay.

Follow YouTube real time views as they happen, using our dedicated view counter for YouTube videos.

Get up-to-date live view count on YouTube and see real-time growth with SocialCounts.org’s smart tracking tools.

Embed Widget

Parameters:

  • fullscreen=true - Fullscreen counter
  • graph=true - Live graph chart
  • counter=0/1/2 - Select counter (0=likes, 1=views, 2=comments)
URL

Click to copy the embed URL to your clipboard