Швидкий спосіб: синхронізація аудіо з губами в Seedance 2.0
Відео демонструє спосіб синхронізації аудіо з губами в Seedance 2.0, використовуючи AI-інструменти, такі як Suno, для генерації аудіо та створення голосових персонажів. Це дозволяє створювати музичні відео з AI-згенерованими персонажами, що відкриває нові можливості для креативного контенту.
Ключові тези
- Використання Suno для генерації аудіо з промовою
- Створення відео з аудіо для сумісності з Seedance
- Синхронізація губ AI-персонажів з кастомним аудіо
Швидке створення прототипів музичних відео за лічені хвилини • Можливість створення унікальних персонажів та голосів за допомогою AI • Економія часу та ресурсів на традиційному виробництві відеоконтенту
Якість ліпсингу поки що далека від ідеалу, але це показує напрямок розвитку AI-інструментів для створення контенту. Потрібно більше контролю над стилем та виразом персонажів.
Опис відео▼
Leave my salty pancake flaps dripping off the edge of your Sunday laugh. Butter on the corners, syrup in your lap. Can't help smiling. >> Hello my friends and how are you doing? Today I want to present to you a little hack for seed dance on how you can lip sync both songs and normal spoken word. But before that, I also want to invite you to my discord where we have a lot of amazing people. There's like talk about model training, videoi, confui. People are sharing their artworks and I try to hang out there a little bit every day. And also if you want to, you can follow me actually on Twitter where we recently had a lot of discussion about how valid AI is. And of course, I created this little fun thing here. And yeah, Oscar winning artists are now also using AI in their projects. There's a lot of cool stuff going on. So, if you want to um you can follow me there. But let's get back here to how this hack, how this trick actually works. Now, first of all, you need a song with some lyrics in there. For that, you could use Sunu or any kind of other thing. By the way, here's another little hack you can do on Sunnu for spoken word. This is not just for music because you can also say for example here in this case I said spoken word courtroom style audiobook delivery and then try to avoid music and you can then write the text and here is what that sounds like. >> The truth of the matter is you did take Rick's charger and did you give it back? No, Morty, you did not give it back. >> So you can see that is pretty cool. Also, when I scroll up here, you can see now you can create voice personas out of uploaded voices or also of what the AI has created for you. Now, the way you do this is you download the track from here or any kind of other source you have and then you turn it into a video that is just black with the audio in there so that you have the audio track but in video format because right now you can't really upload audio files to seedance in audio format. One thing that is really important about the video is that it has the same length as the output you generate with seed dance which means 5, 10 or 15 seconds because otherwise seed dance will try to figure out what to do with the rest and by that cut up the audio in strange ways. Now the second thing you do is to upload an image as a source and then you can actually give them a name here and there just by clicking on that naming it and then with the add sign you can call on that material and then tell the prompt what to do. So for in my in my example, I'm saying use the song for the given video vit 15 and use the character for grand 3 to create a music video of the granny singing that song. Now you can do that. You can also, by the way, do it just without the image if you want to. Then of course you have less control over the style, over the output, but it will also look more realistic. So watch this result real quick. >> Laugh. Butter on the corners, syrup in your lap. >> And that was it already for today with the tricks and the hacks. Let me know what you think or if you have any other advice on how to use C dance. See you on Axe or in Discord and thanks for watching. Bye.




