Join the conversation

Join the community of Machine Learners and AI enthusiasts.

Sign Up
evdcushย 
posted an update 5 days ago
Post
117
๐—ฌ๐˜‚๐—˜๐Ÿฎ ๐—ด๐—ฒ๐—ป๐—ฒ๐—ฟ๐—ฎ๐˜๐—ถ๐—ผ๐—ป ๐˜€๐—ฎ๐—บ๐—ฝ๐—น๐—ฒ๐˜€

Some m-a-p/YuE2-3B samples from my experiments.
All songs are: JA or EN/JA

5๏ธโƒฃ ๐Ž๐‘๐ˆ๐†๐ˆ๐๐€๐‹ (synth-pop)
This song started as a melody SheetSage2 cover of M83 - Midnight City.
Extended for my lyrics, and chords added.

๐˜ง๐˜ถ๐˜ญ๐˜ญ ๐˜ด๐˜ฐ๐˜ฏ๐˜จ: https://youtu.be/9RX3OLFqV5M

1๏ธโƒฃ ๐‘ช๐‘ถ๐‘ฝ๐‘ฌ๐‘น : BTS - FAKE LOVE (ja version)

๐™›๐™ช๐™ก๐™ก ๐™จ๐™ค๐™ฃ๐™œ: https://youtu.be/fBVmTeSScNg
cleanest sheetsage2-derived song I've gotten.
something that's quite rare about this one is that it's mixed EN and JA. (this has not worked for me in other songs)

4๏ธโƒฃ ๐Ž๐‘๐ˆ๐†๐ˆ๐๐€๐‹ (alt Rock)
๐˜ง๐˜ถ๐˜ญ๐˜ญ ๐˜ด๐˜ฐ๐˜ฏ๐˜จ: https://youtu.be/D-HXWWCdqNs
Generated from style + lyrics (no user-defined ABC).

Good result, but it is afflicted with the whizz, buzzing artifacting/degeneration on the singing voice, which I get not infrequently.
the singer's pitch and timbre change in a few spots too.

2๏ธโƒฃ ๐Ž๐‘๐ˆ๐†๐ˆ๐๐€๐‹ (synthwave J-Pop)
๐˜ง๐˜ถ๐˜ญ๐˜ญ ๐˜ด๐˜ฐ๐˜ฏ๐˜จ: https://youtu.be/PYGtp0VLjS8
This one was made without ABC, just letting YuE2 compose a plan before generation.
a few dropped words, odd emphases in certain places, but mostly coherent

3๏ธโƒฃ ๐‘ช๐‘ถ๐‘ฝ๐‘ฌ๐‘น (*attempted*) German
้€ฒๆ’ƒใฎๅทจไบบ, vogel im kamfig YouSeeBigGirl:TT
(Reference: https://youtu.be/2o5H8wIR8Go)

I didn't get a decent generation for the song.

but, there was *one* this one section of the song ๐Ÿ‘๐Ÿป

This happens; you'll have a killer track and *suddenly* some dude starts whispering pidgin language in a weird hermaphroditic AI voice for 2-3 sec, and then the song continues fine, no more cursed artifacts ๐Ÿ˜•

or, gen is a total trainwreck, but suddenly becomes coherent and makes something cool, like this thing ๐Ÿ˜Œ

m-a-p/YuE2-3B

Samples from other models:
- MiniMaxAI/MiniMax-Music3 : https://huggingface.co/posts/evdcush/304645800764284
- ACE-Step/acestep-v15-xl-sft : https://huggingface.co/posts/evdcush/646521189747912
In this post