An AI model's ability to understand and recall information decreases when given too much text. Providing only the most important information helps the AI model focus and perform better.
By Pawan Nayar · from the LLOS AI Learning record
An AI model's ability to understand and recall information decreases when given too much text.
Providing only the most important information helps the AI model focus and perform better.
Giving an AI model too much information can make it less accurate. This is called 'context rot'. The AI model's attention gets spread too thin. It becomes harder for the AI model to find the most important parts. A user should choose only the most relevant files for the AI model to read. This helps the AI model focus on what truly matters.
A developer wants an AI model to plan a new chapter for a book. The developer gives the AI model 50 documents about the book. The AI model struggles to find the key details. It suggests ideas that do not fit the book's style. If the developer had given only 5 core documents, the AI model would have given much better suggestions.
Resolved from this lesson's own record — real definitions, not invented for this page.
More from the same record, pulled by shared topic — not written new for this page.
A developer should choose only a few important files. These files should be the main source of truth.
A single, very long prompt tries to cover too many situations. This makes the prompt complicated and hard to manage.
A developer should use one AI model call for each item. The prompt should ask the AI model to compare the item to a rule.
A bulk generation workflow uses a special method. It combines different types of prompts.
An AI model's ability to understand and recall information decreases when given too much text. Providing only the most important information helps the AI model focus and perform better.