Generative Extend overview

Experience the power of Adobe Firefly generative AI in Adobe Premiere Pro. Extend clips to cover a transition, hold on a reaction shot, or hit an audio cue – even generate missing ambient sound.

The Generative Extend tool, powered by Adobe Firefly, lets editors add those extra few frames to tell their story their way. Just click and drag to seamlessly add a few more frames to the beginning or end of a video or audio clip – to hold on to a character reaction for an extra beat, create a smoother transition, extend background sounds, or hide an unwanted camera movement. An internet connection is required to access Generative Extend as it utilizes a cloud AI model.

Current media requirements

Video 

These requirements are on the source media. 

Video Source Media Resolution:

16:9 Aspect Ratio (Landscape/Standard):

• Minimum: 640×360 (360p).
• Maximum: 3840×2160 (4K UHD) or 4096×2160 (4K Cinema).
• Native resolutions supported by AI Model: 1280×720, 1920×1080, 3840×2160, 4096×2160.

9:16 Aspect Ratio (Portrait/Vertical):

• Minimum: 360×640 (360p portrait).
• Maximum: 2160×3840 (4K portrait) or 2160×4096 (4K Cinema portrait).
• Native resolutions supported by AI Model: 720×1280, 1080×1920, 2160×3840, 2160×4096.

When your clip's resolution doesn't match the natively supported resolutions, extensions are automatically generated at the nearest higher supported resolution. Your original clip remains unchanged.

Video Source Media Frame Rate and Bit Depth:

• Frame Rate: Source clips can be 12-60 fps, but extensions above 30 fps are generated at 30 fps.
• Bit Depth: Source clips can be 8-bit, 10-bit, or 16-bit, but extensions are generated in 8-bit.
• Color Space: Source clips can be SDR or HDR, but extensions are generated in SDR.
• Your original clip remains unchanged in its native format.

Audio

• Generative Extend cannot create or extend spoken dialog. During extension, existing dialog will be muted to preserve the integrity of the original speech content.
• Due to the complexity of musical structures and potential copyright concerns, clips containing music are not eligible for extension.
• Currently, only mono and stereo audio are supported. Surround sound and 5.1 audio formats are not compatible with Generative Extend.

Managing generated content 

When you use Generative Extend, the AI-generated media is combined with your original clip to create a new clip in the Project panel. Each extension is saved as an H264 MP4 or .wav file in the Captured and Generated scratch disk assigned in your project settings. To set this location open Project Settings > Scratch Disks. Here, you can specify a new location for your generated media, allowing you to manage your storage according to your workflow and space requirements. 

Ongoing development and limitations

Generative Extend is the first application of generative AI for editors inside video editing software. It's an exciting tool to help many editors solve a common editing pain point, but this is just the beginning. We know that many workflows require higher-quality outputs and robust turnover processes. In the coming months, we'll expand the range of media types that can benefit from Generative Extend, including formats and color space. We're also working on reviewing the advanced workflow to make passing projects to other creatives seamless. 

Additionally, some limitations are known in this iteration with the following features:

• Generative Extend can only be applied to the beginning or the end of a clip, not both.
• Speech to Text transcription, Text-Based Editing, and Captioning
• Media Intelligence
• Markers 
• Modify clip properties (Audio Channels, Color, Interpret Footage, Timecode) and speed adjustments
• Timecode and user-entered metadata 
• Interchange formats (XML, AAF, EDL, OMF) 
• Replace with After Effects Composition and Edit in Audition workflows 
• Multicam Source Sequences 
• Productions

Privacy and data usage 

Your media is never used to train Adobe's AI model. It's solely used to create the requested extension, ensuring your content remains private and under your control. Learn more about our generative AI commitments.