Adobe Premiere Pro’s Upcoming Generative AI Features
Since 2023, Adobe Creative Cloud users have experimented with generative fill and other generative AI features in apps like Photoshop, Lightroom and more. To no one’s surprise, these AI features, powered by Adobe Firefly, will soon be implemented into video editing. 
Adobe Premiere Pro is adding these generative AI tools to its arsenal. In the not-so-distant past, these tools broke ground in apps like Photoshop to give creatives the flexibility to remove or add objects in photos. Whether you find it fascinating, convenient, perplexing, or ethically questionable, video editing is about to enter a new era.
Let’s take a glimpse at three major features of Adobe Firefly for video: Generative Extend and Generative Object Addition and Removal.
Generative Extend: Filling Those Gaps
Oftentimes, videographers need a few more seconds in their footage. Extra wiggle room can be helpful for rhythm, holding a beat, or finessing a transition. Similarly, with audio, additional room tone or audio provides the flexibility to isolate distracting sounds or to enhance an immersive experience. 
The new Generative Extend supports these needs in post. With a simple click and drag at the beginning or end of a clip, Generative Extend intelligently generates additional footage. It can also be used for audio, except for clips with music or dialogue. This tool will be an additional icon found alongside your timeline.
As with anything, it’s a work in progress. This feature struggles with clips that contain complex, contextual changes. It also lags if a subject’s movement is not consistent in the footage. One thing to consider: Generative Extend is applicable for footage that does not exceed 1920×1080 resolution at 30 frames per second. Also, footage can only be extended by a few seconds for the time being.
Generative Object Addition and Removal: Curate your Vision
Every filmmaker or content creator accidentally films unwanted objects or people. It’s inevitable, especially if you are wearing several hats while managing various aspects of production. 
Generative Object Addition and Removal removes objects in videos, from distracting artifacts to camera gear and props. It can also generate new objects in scenes requiring additional details to tell the story.
Object removal will use AI-based smart masking to quickly and precisely identify and outline objects for removal. Object Addition in Premiere Pro, combined with Adobe’s Firefly video model, can add or tweak objects in video footage. Similar to Photoshop’s Generative AI features, users provide a text prompt, click “Generate,” and voila. Hopefully, you get what you asked for, instead of additional fingers or melty-shape-mishaps. 
What this Means for Editors
Whether you find it creepy or convenient, Adobe Premiere Pro’s upcoming generative AI features will unlock workflows to combat tedious tasks. Additionally, the technology widens creative versatility and the ability to address shortcomings.
The future of video editing and AI is becoming more clear. To learn more about Adobe’s Firefly and other ways it can help ideate video projects, check out this review by Premiere Gal.
Of course, these advancements raise questions surrounding ethics and accessibility. As you use these tools to elevate your storytelling, be sure to ask hard questions to preserve the integrity and honesty of your craft.