sDPO: Don't Use Your Data All at Once

Arxiv Papers - sDPO: Don't Use Your Data All at Once