MoMa: Efficient Early-Fusion Pre-training with Mixture of Modality-Aware Experts

Arxiv Papers - MoMa: Efficient Early-Fusion Pre-training with Mixture of Modality-Aware Experts