I asked AI to make a music video for Infected Mushroom
I used a variety of AI models to create a music video for the track Bliss on Mushrooms (feat. Miyavi), by Infected Mushroom & Bliss. The exciting part about working with AI models to produce visuals is that the technology is advancing at such a breakneck speed, new tools are coming out faster than I can keep up. This is the first time I've been able to use Dalle2 and Stable-Diffusion, and like many others in the AI art space, I've been OBSESSED. We are living in the future and it feels like magic that I'm just one person and I'm able to do this with the resources available. It isn't magic though, it's thanks to the amazing and selfless contributions of the open source community.
What parts are done by me vs the AI? Just like in my previous AI generated video using Disco Diffusion, I am manually keyframing many elements to sync up with the music. The camera motion, video inputs, cuts, noise and strength scheduling, etc, are all still controlled by me. We are still not at the point where I can input a song, press a button, and get a result like this... YET. It is only a matter of time until we get there in the future, and I have plans to further improve the scalability of this process. Eventually it will take 2 days for me to do this, rather than 2 months!
Are you interested in making your own AI music videos? I’ve created a free post on patreon documenting all the resources I used to make this video so you can try it yourself. Here is the link:
https://www.patreon.com/posts/72825385
Want to see the exact settings and prompts I used to create this video? I've posted all of them here: https://www.patreon.com/posts/72829815
This is the longest music video I've posted on this channel, and it took me over 2 months of work to finish! If you'd like to support me and get your name featured at the end of each video in a mini game, here is a link to my patreon: https://www.patreon.com/doodlechaos
My social media:
Twitter: https://twitter.com/doodlechaos
Discord: https://discord.com/invite/7FCrWAzDY7
Tiktok: https://www.tiktok.com/@doodlechaos
Instagram Shorts: https://www.instagram.com/doodlechaos_shorts/
Email: contact@doodlechaos.com
Music:
Infected Mushroom & Bliss - Bliss on Mushrooms (feat. Miyavi) [Monstercat Release] : https://www.youtube.com/watch?v=ceYKKNXFpSE
End Screen Music:
lofi geek - Monster: https://www.youtube.com/watch?v=CfYYsKWAGLo
Art Credits:
Abandoned Warehouse Model by Aurélien Martel - https://sketchfab.com/3d-models/abandoned-warehouse-interior-scene-1d5285f2e0fd4211a27c8042496d5959
Apple 2 Computer On Desk by Hank-Ball - https://www.cgtrader.com/free-3d-models/electronics/computer/apple-2-computer-on-desk
For a few frames in 6:10 - 6:16 I used Greg Rutkowski's name in the prompt for Dalle2. For Greg's style influencing this section, I wish to properly credit him for his amazing art. https://twitter.com/GrzegorzRutko14
Input Videos Credit:
Techno Viking Video - https://www.youtube.com/watch?v=UjCdB5p2v0Y
Headbanger at Festival - https://www.youtube.com/watch?v=moorsjQznp4
Видео I asked AI to make a music video for Infected Mushroom канала DoodleChaos
What parts are done by me vs the AI? Just like in my previous AI generated video using Disco Diffusion, I am manually keyframing many elements to sync up with the music. The camera motion, video inputs, cuts, noise and strength scheduling, etc, are all still controlled by me. We are still not at the point where I can input a song, press a button, and get a result like this... YET. It is only a matter of time until we get there in the future, and I have plans to further improve the scalability of this process. Eventually it will take 2 days for me to do this, rather than 2 months!
Are you interested in making your own AI music videos? I’ve created a free post on patreon documenting all the resources I used to make this video so you can try it yourself. Here is the link:
https://www.patreon.com/posts/72825385
Want to see the exact settings and prompts I used to create this video? I've posted all of them here: https://www.patreon.com/posts/72829815
This is the longest music video I've posted on this channel, and it took me over 2 months of work to finish! If you'd like to support me and get your name featured at the end of each video in a mini game, here is a link to my patreon: https://www.patreon.com/doodlechaos
My social media:
Twitter: https://twitter.com/doodlechaos
Discord: https://discord.com/invite/7FCrWAzDY7
Tiktok: https://www.tiktok.com/@doodlechaos
Instagram Shorts: https://www.instagram.com/doodlechaos_shorts/
Email: contact@doodlechaos.com
Music:
Infected Mushroom & Bliss - Bliss on Mushrooms (feat. Miyavi) [Monstercat Release] : https://www.youtube.com/watch?v=ceYKKNXFpSE
End Screen Music:
lofi geek - Monster: https://www.youtube.com/watch?v=CfYYsKWAGLo
Art Credits:
Abandoned Warehouse Model by Aurélien Martel - https://sketchfab.com/3d-models/abandoned-warehouse-interior-scene-1d5285f2e0fd4211a27c8042496d5959
Apple 2 Computer On Desk by Hank-Ball - https://www.cgtrader.com/free-3d-models/electronics/computer/apple-2-computer-on-desk
For a few frames in 6:10 - 6:16 I used Greg Rutkowski's name in the prompt for Dalle2. For Greg's style influencing this section, I wish to properly credit him for his amazing art. https://twitter.com/GrzegorzRutko14
Input Videos Credit:
Techno Viking Video - https://www.youtube.com/watch?v=UjCdB5p2v0Y
Headbanger at Festival - https://www.youtube.com/watch?v=moorsjQznp4
Видео I asked AI to make a music video for Infected Mushroom канала DoodleChaos
Показать
Комментарии отсутствуют
Информация о видео
Другие видео канала
![If Minecraft was a Rhythm Game | Fly Away](https://i.ytimg.com/vi/UuV_OCPq-xg/default.jpg)
![Chaos League LIVE (Type in Chat to Play!) [Meta Twist: Greedy King] - V2.7 #14](https://i.ytimg.com/vi/KJt4_uI2R7Q/default.jpg)
![Chaos League LIVE (Type in Chat to Play!) - V2.7 #13](https://i.ytimg.com/vi/F2JfbXW301I/default.jpg)
![Chaos League LIVE (Type in Chat to Play!) - V2.4 #10](https://i.ytimg.com/vi/-AoyaN77R0o/default.jpg)
![Chaos League LIVE (Type in Chat to Play!) - V2.3 #6](https://i.ytimg.com/vi/ErvyCwL_FEo/default.jpg)
![Chaos League LIVE (Type in Chat to Spawn) V2.2 Alpha Test #5](https://i.ytimg.com/vi/T3rGYWzlyHM/default.jpg)
![BeatCraft 7 Community Server Opening Announcement #musicsync #beatcraft #minecraft](https://i.ytimg.com/vi/W-MvtgRQ-AU/default.jpg)
![Chaos League LIVE (Type in Chat to Spawn) - V0.9 New Recruit Mechanic!](https://i.ytimg.com/vi/84XmeW-ve3Q/default.jpg)
![Chaos League LIVE (Type in Chat To Spawn!) - V0.8 New Command!](https://i.ytimg.com/vi/LLXaQimNfFA/default.jpg)
![They said I couldn’t livestream while sleeping, so I built a game to stream for me](https://i.ytimg.com/vi/BE_bCUbauB0/default.jpg)
![Team Marble Battle - Multiplying Mayhem (Chaos League S1 Finale)](https://i.ytimg.com/vi/eIJpAK5u9kQ/default.jpg)
![Last chance to join!](https://i.ytimg.com/vi/Rv3TTeZmvns/default.jpg)
![I #synchronized a race track to music in #trackmania](https://i.ytimg.com/vi/aaQBbsZO0Aw/default.jpg)
![I Synchronized a Race Track to Music - Trackmania PF #4](https://i.ytimg.com/vi/af1uoEbHleo/default.jpg)
![Marbles vs Music - Visualizer Bars Battle Royale](https://i.ytimg.com/vi/U6ywtNVQYqQ/default.jpg)
![Elytra Dreams - 360° VR Edition | Minecraft Music Sync](https://i.ytimg.com/vi/jFZBjWUsIok/default.jpg)
![Can you escape me?](https://i.ytimg.com/vi/NRqzqg7vDuw/default.jpg)
![Minecraft, but I soar through 1,000,000,000 blocks with NO LAG (Music Sync)](https://i.ytimg.com/vi/4XiJxSQiHVU/default.jpg)
![Marble race, but each marble is a real person!](https://i.ytimg.com/vi/YVjXf1zRI3I/default.jpg)
![Are you feeling lucky?](https://i.ytimg.com/vi/LM68JX949ac/default.jpg)
![Minecraft Music Sync - Once in a While by Corticus (360° VR Edition) [128 Chunk Render Distance]](https://i.ytimg.com/vi/NDZHkbdC8x8/default.jpg)