SongGeneration offers the following core features:
- Song Generation: Generate a full song with vocals and backing tracks based on the input lyrics and text description.
- Multi-track output: Supports separate generation of pure music, pure vocals, or separate vocal and backing tracks for easy post-editing.
- Style Control: Customize music styles with text descriptions (e.g. gender, timbre, genre, emotion, instrument, beat).
- Reference AudioThe model can upload a 10-second audio clip, and the model can mimic its style to generate a new song.
- Low memory optimization: Supports operation with as little as 10GB of GPU memory for a wide range of devices.
- Open Source Support: Model weights, inference scripts and configuration files are provided and can be freely modified and optimized by the developer.
This answer comes from the articleSongGeneration: open-source AI model for generating high-quality music and lyricsThe