Interconnects

Multimodal blogging: My AI tools to expand your audience

Multimodal LM roundup: Unified IO 2, inputs and outputs, Gemini, LLaVA-RLHF, and RLHF questions

Where 2024’s “open GPT4” can’t match OpenAI’s

Interviewing Tri Dao and Michael Poli of Together AI on the future of LLM architectures

Transformers dominate AI due to their hardware efficiency and scalability, yet their quadratic attention cost limits long-sequence processing. Alternative architectures like state space models and modern recurrent neural networks offer potential breakthroughs by optimizing memory usage and computational complexity. Tri...