The following steps are required to generate songs using SongGeneration:
- Preparing the input file: Create a JSON Lines format (.jsonl) file containing lyrics (segmented by [verse], [chorus], etc.), a style description (optional), and a reference audio path (optional).
- Running inference scripts: Use
generate.sh
Script that passes in the model weight paths, input files, and output paths - Optional parameters: can add
--pure_music
generating pure music.--pure_vocal
generating pure vocals.--separate_tracks
Separate vocals and backing tracks - Low memory mode: If the GPU memory is less than 30GB, use the
generate_lowmem.sh
scripts
Special note: Lyrics need to be strictly formatted in sections while specifying theprompt_audio_path
cap (a poem)descriptions
It may lead to a decrease in generation quality.
This answer comes from the articleSongGeneration: open-source AI model for generating high-quality music and lyricsThe