Increase model context length will not get AI to “understand the whole code base”
Can AI truly understand long texts, or just match words?
1️⃣ AI models lose 50% accuracy at 32K tokens without word-matching.
2️⃣ GPT-4o leads with an 8K effective context length.
3️⃣ Specialized models still score below 50% on complex reasoning.
🔗 Read more: https://the-decoder.com/ai-language-models-struggle-to-connect-the-dots-in-long-texts-study-finds/