This year, we have witnessed a true revolution in generative AI, as artificial intelligence has firmly entered the field of digital illustration, opening the doors to a new way of generating concepts and digital images. MidJourney has been the most revolutionary in this sector of using artificial intelligence to create synthetic images effectively. In this article, we want to discuss how to take this technology to the next level by animating static images generated by MidJourney.
In this tutorial, John Draper shows us how to effectively animate an image generated in MidJourney.
Step 1: Generating Images with MidJourney:
Start by generating your character and scene using AI-based tools like MidJourney. After generating the image, select the one that fits your project and enlarge it for better quality. Download the image to your computer.
Step 2: Refining the Image in Adobe Firefly:
Open the generated image in Photoshop. Here, you can use AI-based tools like Adobe Firefly to remove unwanted elements or perfect the image. Clean up the image as needed and save it as a background image.
Step 3: Creating a 3D Depth Map with Midas:
To achieve a 3D effect, let’s generate a depth map using the tool Midas. Simply upload your cleaned background image, and it will quickly create a ready-to-use depth map. Download the generated depth map for later use in After Effects.
Step 4: AI Voice-Over Dubbing with Elevenlabs:
Enhance your animation with a realistic voice-over. Use platforms like elevenlabs.io to generate AI-based voiceovers. Input your script, select a voice actor, and customize settings. Once satisfied, download the voiceover audio to incorporate into your animation.
Step 5: Lip Sync and Head Animation with D-ID:
Bring your character’s lip sync and head movement to life with D-ID AI Video software. Upload the voiceover, and the software will create an animated avatar that synchronizes lip movement with the audio. Download the animated character video for use in your project.
Step 6: Background Removal and More with Runway ML:
Use Runway ML to refine your character. Remove any remaining background elements and enhance their appearance. This tool offers powerful background removal capabilities.
Step 7: Create the 3D Scene in After Effects:
Combine all your assets in Adobe After Effects to create a dynamic 3D scene. Use the clean background texture, depth map, and animated character to build your scene. Set up a camera and add some camera movement in 3D space to play with the parallax of foreground and background elements in the scene.
Step 8: Add Realistic Lens Flare and Dust Effects:
Enhance the realism of the scene by adding bright lens flares and dust particles. Create light sources as guides for lens flares in a separate composition. Use the Optical Flares plugin by Video Copilot to add realistic bright flares. For dust particles, import a suitable clip and adjust speed, scale, and opacity to fit the scene.
Step 9: Final Touches and Export:
Perfect your scene by adjusting colors, brightness, and contrast. You can experiment with different settings to achieve the desired visual style. Add any additional animations or effects if necessary. Once satisfied, export your animation to obtain the final result.
MidJourney images are visually engaging and dynamic resources that can become even more immersive when animated.