Adobe improves professional video work with the help of AI in Premiere Pro

The new generative AI video tools coming to Premiere Pro, and which Adobe is presenting at NAB 2024, they promise to streamline workflows and unlock new creative possibilities, from zooming in on a shot to adding or removing objects in a scene.

The Generative Artificial Intelligence coming to Premiere Pro this year will allow users to streamline editing of all videos, including inserting or removing objects in a scene or expanding an existing clip.

These new editing workflows will be powered by a new video model which will join the model family Firefly, which includes image, vector, layout, and text effects models. Adobe continues to develop Firefly AI models in categories where it has deep expertise, such as image, video, audio and 3D, and will integrate these models into Creative Cloud and Adobe Express.

Adobe has also advanced its vision of incorporate third-party generative AI models directly into Adobe applications like Premiere Pro. Creative Cloud has always had a broad ecosystem of partners and plugins, and this evolution expands Premiere Pro as the most flexible and extensible professional video tool that adapts to any workflow. Adobe customers want choice and endless possibilities when creating and editing world-class entertainment and audiovisual content.

Early explorations show how professional video editors could, in the future, take advantage of OpenAI and Runway video generation, integrated into Premiere Pro, to generate B-rolls for editing in your projects. It also shows how Pika Labs could be used with the Generative Zoom tool to add a few seconds to the end of a shot.

Third party models

By offering new generative AI capabilities with Adobe Firefly and a variety of third-party models, Adobe is giving customers access to a range of new capabilities without having to abandon the workflows they use every day in Premiere Pro.

“Adobe is reimagining every step of the video creation and production workflow to give creators new power and flexibility to bring their vision to life,” says Ashley Still, Senior Vice President of Creative Product Group at Adobe. “By putting generative AI innovations at the center of Premiere Pro workflows, we are solving real problems that video editors experience every day, while giving them more space to focus on their work.”

Adobe has also announced that the audio workflow powered by AI in Premiere Pro, including new fade controls, clip badges, dynamic waveforms, AI-powered category tagging, and more.