Skip to content
Home » long context

long context

Inside Instacart’s ‘Brownie Recipe Problem’: Why Real-Time AI Needs Fine-Grained Context, Not Just Better Reasoning

Large language models (LLMs) are getting dramatically better at abstract reasoning, planning and natural language interaction. Yet when those same models are dropped into real-world, real-time products, the gaps become obvious: they often don’t know what’s actually available, where, when,… Read More »Inside Instacart’s ‘Brownie Recipe Problem’: Why Real-Time AI Needs Fine-Grained Context, Not Just Better Reasoning

MIT’s Recursive Language Models: A Systems Approach to 10M-Token Contexts

MIT CSAIL researchers are proposing a different answer to the long-context problem in large language models: don’t keep stretching the context window—change how the system uses it. Their new Recursive Language Models (RLMs) framework treats long prompts as an external… Read More »MIT’s Recursive Language Models: A Systems Approach to 10M-Token Contexts