Text To Image Flowers
The goal was to create a video of colorful flowers flying in the air, that can be used as a close up cut durint the flower toss in a wedding video. Using ai for this was the simplest way to do this, and given how good text to image models are these days, it was the first option, before going down the image to image route. Using RunwayML Gen-3 Alpha and the below prompt, gave some interesting results:
An FPV camera angle: the camera is attached to a vibrant bouquet of colorful pastel flowers, capturing their rapid ascent as they're thrown into the air at a wedding. The camera spins with the bouquet, creating dynamic motion blur in the background—a soft, swirling mix of bright sunlight, blurry figures of wedding guests, and the white building in the distance. The focus remains on the flowers, which are clear and vibrant, while the blurred background emphasizes the fast, chaotic motion of the toss. The sunny sky adds a bright, celebratory feel to the scene.
The important thing was to try to nail the type of flowers and their colors to match as much as possible to the real flowers in the video. Although this could have been done using for example IP adapters in ComfyUI, this above output from RunwayML (only 5th try of generating) seemed to be close enough to the target look. Adding a bit of color grading, motion blur and vignette effect in DaVinci Resolve made it blend in nicely with the real footage.