Generative Visual Effects
With Gen-3 Alpha Image to Video, it’s now possible to turn still frames from live action footage into Generative Visual Effects (GVFX) shots, which you can then comp back into your main live action plate for seamless effects.
Step 1 - Source or film footage
The first step is to either source or capture your footage. You can use anything from videos shot on your phone to high-end produced video. While it’s possible to do GVFX with all types of movement, the simplest approach is to use shots with a steady, locked-off camera. This means you can avoid needing to do any complex tracking or masking.
Step 2 - Select a frame to transform
Scrub through your video’s timeline and find the moment where you’d like the effect to begin. Export a full resolution image of that frame.
Remember, be mindful of objects or subjects occluding the space in which you’d like to create your effect, as they may require additional masking.
Remember, be mindful of objects or subjects occluding the space in which you’d like to create your effect, as they may require additional masking.
Step 3 - Generate your visual effects
Take your high resolution frame and bring it into Gen-3 Alpha Image to Video. Now, all you need to do is prompt for the effect you’re looking for.
Whether you want to transform a character or object, introduce new elements or adjust stylistic elements, the possibilities are endless.
Whether you want to transform a character or object, introduce new elements or adjust stylistic elements, the possibilities are endless.
Step 4 - Comp your footage back together
Now you can take your original footage along with your generated video and comp the two shots together in your editing software of choice.
Depending on the complexity of your shot, you may choose to mask characters or structures to further sell the effect of your shot, or simply append your GVFX footage to the end of you sequence.
For complex masking, try using our Remove Background tool.
Depending on the complexity of your shot, you may choose to mask characters or structures to further sell the effect of your shot, or simply append your GVFX footage to the end of you sequence.
For complex masking, try using our Remove Background tool.
Step 5 - Finishing touches
Like traditional VFX, the best way to bring together your GVFX shot is to do a final pass with color correction, a bit of noise and some additional camera movement to seamlessly blend your two shots together.