Channel BannerChannel Banner
5mco9zAamRk5mco9zAamRk

How to Align AI: Put It in a Sandwich

182,174
Socialcounts.OrgEnter Fullscreen (f)
10,971
likes
756
comments
daily view 0
monthly view 0

Share

Live Analytics

Comments 0

How to Align AI: Put It in a Sandwich Analytics Table

Income Estimates for How to Align AI: Put It in a Sandwich

Based on this YouTube video's total view count of 182K views and industry-standard rates, the estimated total earning is $128 - $364 through ad revenue. Historical data is not yet available to calculate daily, weekly, or monthly averages.

About How to Align AI: Put It in a Sandwich

Explore How to Align AI: Put It in a Sandwich with 182,174 views, 10,971 likes, and 756 comments. Experience the impact of this video content that has captured audience attention.

In the future, AIs will likely be much smarter than we are. They'll produce outputs that may be difficult for humans to evaluate, either because evaluation is too labor-intensive, or because it's qualitatively hard to judge the actions of machines smarter than us. This is the problem of β€œscalable oversight.” Proposed solutions include β€œdebate” and iterated amplification. But how can we run experiments today to see whether these ideas actually work in practice? In this video, we cover Ajeya Cotra’s β€œsandwiching” proposal: asking non-experts to align a model that is smarter than they are but less smart than a group of experts, and seeing how well they do. We then show how Sam Bowman et al. tested a basic version of this idea in their paper β€œMeasuring Progress on Scalable Oversight for Large Language Models.” β–€β–€β–€β–€β–€β–€β–€β–€β–€SOURCES & READINGSβ–€β–€β–€β–€β–€β–€β–€β–€β–€β–€β–€β–€β–€β–€β–€β–€β–€ Where we explained RLHF: https://www.youtube.com/watch?v=qV_rOlHjvvs Learning to summarize from human feedback: Paper: https://arxiv.org/abs/2009.01325 Blog: https://openai.com/research/learning-to-summarize-with-human-feedback Summarizing books with human feedback: Paper: https://arxiv.org/abs/2109.10862 Blog: https://openai.com/research/summarizing-books Self-critiquing models for assisting human evaluators: Paper: https://arxiv.org/abs/2206.05802 Blog: https://openai.com/research/critiques AI Safety via debate: Paper: https://arxiv.org/abs/1805.00899 Blog: https://openai.com/index/debate/ Scalable agent alignment via reward modeling: Paper: https://arxiv.org/abs/1811.07871 Blog: https://deepmindsafetyresearch.medium.com/scalable-agent-alignment-via-reward-modeling-bf4ab06dfd84 Learning complex goals with iterated amplification: Paper: https://arxiv.org/abs/1810.08575 Blog: https://openai.com/research/learning-complex-goals-with-iterated-amplification Rob Miles explains reward modeling: https://www.youtube.com/watch?v=PYylPRX6z4Q Rob Miles explains iterated amplification and distillation: https://www.youtube.com/watch?v=v9M2Ho9I9Qo The case for aligning narrowly superhuman models, by Ajeya Cotra: https://www.alignmentforum.org/posts/PZtsoaoSLpKjjbMqM/the-case-for-aligning-narrowly-superhuman-models Measuring Progress on Scalable Oversight for Large Language Models: https://arxiv.org/abs/2211.03540 Meta-level adversarial evaluation: https://www.lesswrong.com/posts/MbWWKbyD5gLhJgfwn/meta-level-adversarial-evaluation-of-oversight-techniques-1 β–€β–€β–€β–€β–€β–€β–€β–€β–€PATREON, MEMBERSHIP, MERCHβ–€β–€β–€β–€β–€β–€β–€β–€β–€β–€β–€β–€β–€β–€β–€β–€β–€ 🟠 Patreon: https://www.patreon.com/rationalanimations πŸ”΅ Channel membership: https://www.youtube.com/channel/UCgqt1RE0k0MIr0LoyJRy2lg/join 🟒 Merch: https://rational-animations-shop.fourthwall.com 🟀 Ko-fi, for one-time and recurring donations: https://ko-fi.com/rationalanimations β–€β–€β–€β–€β–€β–€β–€β–€β–€SOCIAL & DISCORDβ–€β–€β–€β–€β–€β–€β–€β–€β–€β–€β–€β–€β–€β–€β–€β–€β–€ Rational Animations Discord: https://discord.gg/5Y3Dwz89yH Reddit: https://www.reddit.com/r/RationalAnimations/ X/Twitter: https://twitter.com/RationalAnimat1 Instagram: https://www.instagram.com/rationalanimations/ β–€β–€β–€β–€β–€β–€β–€β–€β–€PATRONS & MEMBERSβ–€β–€β–€β–€β–€β–€β–€β–€β–€β–€β–€β–€β–€β–€β–€β–€β–€ Once again, you don't fit in the description, so we have to thank you all in a Google Doc: https://docs.google.com/document/d/19zpSYz_vJk7rpFPQ7kHDPmUm3v0gulaDLUcNo2sdFRE/edit?usp=sharing Thank you all 😭 β–€β–€β–€β–€β–€β–€β–€CREDITSβ–€β–€β–€β–€β–€β–€β–€β–€β–€β–€β–€β–€β–€β–€β–€β–€β–€β–€β–€ Credits here: https://docs.google.com/document/d/1ZDEjyN3nVUfcTFsu6B_AOheQSpLKG3fNtYsnKWnq8Tk/edit?usp=sharing

About YouTube Real-Time View Count

With SocialCounts.org’s view counter, track your YouTube video’s live view count and YouTube likes count in real time with fast, reliable updates.

Watch every YouTube video live view count rise with our real-time YouTube views trackerβ€”built for accuracy and minimal delay.

Follow YouTube real time views as they happen, using our dedicated view counter for YouTube videos.

Get up-to-date live view count on YouTube and see real-time growth with SocialCounts.org’s smart tracking tools.

Embed Widget

Parameters:

  • fullscreen=true - Fullscreen counter
  • graph=true - Live graph chart
  • counter=0/1/2 - Select counter (0=likes, 1=views, 2=comments)
URL

Click to copy the embed URL to your clipboard