Learning Dynamics in Continual Pre-Training for Large Language Models

Xiaol.x - Learning Dynamics in Continual Pre-Training for Large Language Models