NotaGen: An AI Composer Mastering Classical Music via Reinforcement Learning
2025-03-26
NotaGen, an AI music generation model, is pre-trained on 1.6 million pieces of music to learn fundamental musical structures. It's then fine-tuned on a curated dataset of 8,948 classical music scores, enhancing its musicality. To further refine both musicality and prompt control, the researchers employed CLaMP-DPO, a reinforcement learning method using Direct Preference Optimization and CLaMP 2 as an evaluator. Experiments showed CLaMP-DPO effectively improved both controllability and musicality across various music generation models, highlighting its broad applicability.