Channel BannerChannel Banner
Ng-EnWrwsAgNg-EnWrwsAg

Are long context LLMs the death of RAG?

1,121
Socialcounts.Org
Enter Fullscreen (f)
17
likes
0
comments
daily view 0
monthly view 0

Share

Live Analytics

Comments 0

Are long context LLMs the death of RAG? Analytics Table

Income Estimates for Are long context LLMs the death of RAG?

Based on this YouTube video's total view count of 1.12K views and industry-standard rates, the estimated total earning is $1 - $2 through ad revenue. Historical data is not yet available to calculate daily, weekly, or monthly averages.

About Are long context LLMs the death of RAG?

Explore Are long context LLMs the death of RAG? with 1,121 views, 17 likes, and 0 comments. Experience the impact of this video content that has captured audience attention.

Check out my essays: https://aisc.substack.com/ OR book me to talk: https://calendly.com/amirfzpr OR subscribe to our event calendar: https://lu.ma/aisc-llm-school AF: You said people are saying there's long context LLMs, therefore RAG is not that interesting. I want to go back to that and underline. Why do you disagree? AM: I think some people misunderstand what RAG is good for when they say that. Gemini with its really long context window, I can throw all the text I want at this and it can reference it inside its own context window. Why do I need RAG? For me, RAG is not just about giving an answer based on that information. I think having a data set that you manage separately is quite important from an audit point of view. In our line of work in financial services, it's important to see what's the whole lineage of the data you've used to come to this answer. Fundamentally, the data is sacrosanct. I think RAG's going to stay for a long time. With the large context window model, it probably means your RAG systems can become more powerful, or they can do more things at one time, or they can solve slightly more complex problems. AF: Maybe we need a new term for it because RAG has moved on from how it was proposed originally. At the retriever stage, there are so many things that we are layering in these days, there is the retrieval ranking, there is the privacy controls, there is the PII handling, there is access control, security control, domain knowledge. So many things we're doing there that a long context window is not a solution to. Even with a 4000 token context window, you're seeing a lot of "lost in the middle" type of problems. When you fill up the context, they're not particularly good at figuring out where to pay attention to exactly. MA: I think everything you've said about those other elements are super important when it comes to enterprise scale stuff. All of this architecture here, there's a lot of things in here that I will want to stick around for a long time. If I just replace this with "talk to an LLM", I lose so much control. I lose so much auditability. I lose so much security.

About YouTube Real-Time View Count

With SocialCounts.org’s view counter, track your YouTube video’s live view count and YouTube likes count in real time with fast, reliable updates.

Watch every YouTube video live view count rise with our real-time YouTube views tracker—built for accuracy and minimal delay.

Follow YouTube real time views as they happen, using our dedicated view counter for YouTube videos.

Get up-to-date live view count on YouTube and see real-time growth with SocialCounts.org’s smart tracking tools.

Embed Widget

Parameters:

  • fullscreen=true - Fullscreen counter
  • graph=true - Live graph chart
  • counter=0/1/2 - Select counter (0=likes, 1=views, 2=comments)
URL

Click to copy the embed URL to your clipboard