On the Adobe Firefly homepage, go to the Audio module and select Voice to sound effects (beta).
Learn how to use the Voice to sound effects feature to generate sound effects using your voice as a guide.
Try it in the app
Generate sound effects by using text prompts in a few simple steps.
With Voice to sound effects (beta), you can use your voice to guide the generation of sound effects. When you combine your recorded voice, which indicates when the sound effect should occur in the timeline and how loud it should sound, along with a text prompt, Firefly refers to the energy and timing of your voice to generate sound effects that match the dynamics of your recording.
Learn to combine your recorded voice with a text prompt, syncing the energy and timing of your voice to create sound effects.
Using Voice to sound effects (beta) can be beneficial for precisely timing sound effects to match actions, ensuring they align perfectly with intended events in the timeline. This approach helps avoid the inefficiencies of working with sound clips that are either too long or too short to match the actions and events in the video or audio timeline.
Recording your voice is only used to guide the timing and energy of the generated sound effect. This feature does not generate speech or sung lyrics.
Original silent video
Video generated using the Text to Video feature. Prompt used: "A lion lets out a powerful roar, its gaze fixed on the horizon."
Video with recorded voice performance
Video with the voice performance recorded to control the timing and energy of the sound effect.
Video with generated sound effect
Video with the generated sound effect for the prompt “Lion roaring” with the voice performance used to control the timing and energy.
-
-
On the Generate Sound Effects page, select Upload media to upload a video or audio file that you want to use for composing sound effects.
Select the Upload media option to upload a file in .mp4, .mp3, .mov, .wav, or .aac format. Select the Upload media option to upload a file in .mp4, .mp3, .mov, .wav, or .aac format. -
Position the playhead at the point in the timeline where you want to add the sound effect.
Navigate through the timeline and place the playhead at the exact spot where you want to add the sound effect. Navigate through the timeline and place the playhead at the exact spot where you want to add the sound effect. -
Under the Voice performance section, you can upload an audio file from your device or use Record voice to start recording.
Note:You can record your voice for up to 30 seconds or the duration of the video, whichever is shorter, and within the allowed limit.
-
The Recording indicator gets activated, and you can begin recording once the three-second countdown ends.
Record your voice to add a rough guide and indicate what the final generated variations should sound like. Record your voice to add a rough guide and indicate what the final generated variations should sound like. Use the play button in the Voice recording section to listen to the recording.
-
In the prompt field, you'll see an indication that a voice recording has been added. Enter a text prompt describing the sound effect to be used alongside the recording to generate sound effect variations.
For example, to get a lion roar timed to your video, enter the text prompt "lion roaring" and then record yourself roaring in sync with your video.
Tip:Explore some effective text prompt writing techniques for sound effects generation.
Add a text prompt to be used in combination with your recorded voice and generate sound effect variations. Add a text prompt to be used in combination with your recorded voice and generate sound effect variations. -
Select Generate and select one of the generated sound effect variations to insert it at the playhead's position in the timeline.
Select one of the generated sound effect variations and insert it at the playhead position. Select one of the generated sound effect variations and insert it at the playhead position. Tip:To replace a sound effect in the timeline, first select the existing sound effect, then select a replacement from the generated variations.
-
You can edit the generated clip using the available options - mute or adjust the volume. You can also download, rename, or delete it.
Use the available editing options to edit the generated sound effects within the timeline directly. Use the available editing options to edit the generated sound effects within the timeline directly. Tip:To trim a generated sound effects clip, drag the trim handles at either end inward to shorten it. After trimming, move the clip along the timeline to reposition it as needed.
-
If you want to add another layer of sound effect to the timeline, select the Add Audio Track option, and follow the same process of generating it using the Prompt bar.
Use Add Audio Track to generate another sound effect and add it to the timeline along with the existing ones. Use Add Audio Track to generate another sound effect and add it to the timeline along with the existing ones. Note:Currently, a maximum of five audio tracks are supported in addition to the uploaded media track.
-
Use the Play icon to preview your composition and the Download option to download the result.