Premiere Pro to integrate generative AI capabilities through Firefly, OpenAI's Sora & more

Adobe plans to incorporate generative AI capabilities into Adobe Premiere Pro by leveraging its Adobe Firefly AI model and partnering with AI companies like OpenAI's Sora, Pika Labs, and Runway. The Firefly video features will enable users to modify video clips with natural language prompts, generate additional content, and automatically tag videos with Adobe's Content Credentials for transparency.

The new features, Generative Extend, Object Addition & Removal, and Text to Video, will provide users more editing flexibility. Generative Extend will allow users to add frames for smoother transitions, Object Addition & Removal will enable seamless object replacement, and Text to Video will facilitate the creation of new footage from text prompts or reference images. Additionally, the integration with OpenAI's Sora will allow users to generate high-resolution, photorealistic images and videos from text commands.

Adobe also plans to roll out enhanced audio workflow tools in Premiere Pro in May. The company has not yet announced the release date for the new generative video editing tools or finalized pricing details. However, it is expected that the tools will be available later this year and will likely utilize Adobe's existing generative credits system, which is linked to the Adobe Creative Cloud subscription level and renews monthly.