/ 7 min read
How to retain context
Context windows are the working memory of an LLM application, and they fill up faster than anyone expects. What actually consumes them, why long conversations degrade, and the techniques that work.
Context windows are the working memory of an LLM application, and they fill up faster than anyone expects. What actually consumes them, why long conversations degrade, and the techniques that work.