Chroma/Paper/25/07/Context Rot - Increasing Input Tokens Impacts LLM Performance

• Context Rot: How Increasing Input Tokens Impacts LLM Performance | Chroma Research

  • model performance varies significantly as input length changes, even on simple tasks
    

  • models do not use their context uniformly; instead, their performance grows increasingly unreliable as input length grows.
    

  • covers alternatives to AI/Benchmark/Needle-in-a-Haystack