Some developers are releasing longer context windows for Llama 3 thanks to Meta's open-source approach; Llama 3 has a short context window of 8,000+ tokens (Kalley Huang/The Information) | Techmeme | Podwise