User Guide Cancel

Create prototypes using voice commands and playback

Search
XD

XD

Open app
  1. Adobe XD User Guide
  2. Introduction
    1. What's new in Adobe XD
    2. Common questions
    3. Design, prototype, and share with Adobe XD
    4. Color Management
    5. System requirements
      1. Hardware and software requirements
      2. Adobe XD, Big Sur, and Apple silicon | macOS 11
    6. Workspace basics
    7. Change app language in Adobe XD
    8. Access UI design kits
    9. Accessibility in Adobe XD
    10. Keyboard shortcuts
    11. Tips and tricks
  3. Design
    1. Artboards, guides, and layers
      1. Get started with artboards
      2. Use guides and grids
      3. Create scrollable artboards
      4. Work with layers
      5. Create scroll groups
    2. Shapes, objects, and path
      1. Select, resize, and rotate objects
      2. Move, align, distribute, and arrange objects
      3. Group, lock, duplicate, copy, and flip objects
      4. Set stroke, fill, and drop shadow for objects
      5. Create repeating elements
      6. Create perspective designs with 3D transforms
      7. Edit objects using Boolean operations
    3. Text and fonts
      1. Work with drawing and text tools
      2. Fonts in Adobe XD
    4. Components and states
      1. Work with components
      2. Work with nested components
      3. Add multiple states to components
    5. Masking and effects
      1. Create a mask with shapes
      2. Work with blur effects
      3. Create and modify gradients
      4. Apply blend effects
    6. Layout
      1. Responsive resize and constraints
      2. Set fixed padding for components and groups
      3. Create dynamic designs with stacks
    7. Videos and Lottie animations
      1. Work with videos
      2. Create prototypes using videos
      3. Work with Lottie animations
  4. Prototype
    1. Create interactive prototypes
    2. Animate prototypes
    3. Object properties supported for auto-animate
    4. Create prototypes with keyboard and gamepad
    5. Create prototypes using voice commands and playback
    6. Create timed transitions
    7. Add overlays
    8. Design voice prototypes
    9. Create anchor links
    10. Create hyperlinks
    11. Preview designs and prototypes
  5. Share, export, and review
    1. Share selected artboards
    2. Share designs and prototypes
    3. Set access permissions for links
    4. Work with prototypes
    5. Review prototypes
    6. Work with design specs
    7. Share design specs
    8. Inspect design specs
    9. Navigate design specs
    10. Review and comment design specs
    11. Export design assets
    12. Export and download assets from design specs
    13. Group sharing for enterprise
    14. Back up or transfer XD assets
  6. Design systems
    1. Design systems with Creative Cloud Libraries
    2. Work with document assets in Adobe XD
    3. Work with Creative Cloud Libraries in Adobe XD
    4. Migrate from linked assets to Creative Cloud Libraries
    5. Work with design tokens 
    6. Use assets from Creative Cloud Libraries
  7. Cloud documents
    1. Cloud documents in Adobe XD
    2. Collaborate and coedit designs
    3. Coedit documents shared with you
  8. Integrations and plugins
    1. Work with external assets
    2. Work with design assets from Photoshop
    3. Copy and paste assets from Photoshop
    4. Import or open Photoshop designs
    5. Work with Illustrator assets in Adobe XD
    6. Open or import Illustrator designs
    7. Copy vectors from Illustrator to XD
    8. Plugins for Adobe XD
    9. Create and manage plugins
    10. Jira integration for XD
    11. Slack plugin for XD
    12. Zoom plug-in for XD
    13. Publish design from XD to Behance
  9. XD for iOS and Android
    1. Preview on mobile devices
    2. Adobe XD on mobile FAQ
  10. Troubleshooting
    1. Known and fixed issues
      1. Known issues
      2. Fixed issues
    2. Installation and updates
      1. XD appears as not compatible on Windows
      2. Error code 191
      3. Error code 183
      4. Issues installing XD plugins
      5.  Prompt to uninstall and reinstall XD on Windows 10
      6. Issues with preferences migration
    3. Launch and crash
      1.  XD crashes when launched on Windows 10
      2.  XD quits when you sign out of Creative Cloud
      3. Issue with subscription status on Windows
      4. Blocked-app warning when launching  XD on Windows
      5. Crash dump generation on Windows
      6. Crash log collection and sharing
    4. Cloud documents and Creative Cloud Libraries
      1. Issues with XD cloud documents
      2. Issues with linked components
      3. Issues with libraries and links
    5. Prototype, publish, and review
      1. Unable to record prototype interactions on macOS Catalina
      2. Issues with publish workflows
      3. Published  links do not appear in browsers
      4. Prototypes do not render correctly in browsers
      5. Commenting panel suddenly showing up on shared links
      6. Unable to publish libraries
    6. Import, export, and working with other apps
      1. Import and export in XD
      2. Photoshop files in XD
      3. Illustrator files in XD
      4. Export to After Effects from XD
      5. Sketch files in XD
      6. Third-party apps not visible in Export

Learn how to design and prototype using voice commands, speech playback, and audio playback.

You can use voice commands to trigger an interaction between artboards or component states, or for playing speech, audio, video, or Lottie.

Set Voice as the trigger, and enter the voice command. As action type, choose Transition, Auto-Animate, Overlay, Scroll To, Previous Artboard, Audio Playback, Speech Playback, Video Playback, or Lottie Playback. For example, if you are integrating voice search in a mobile app, you can use Voice and Speech Playback to automatically transition between artboards.

Add a voice command to a prototype

  1. Switch to Prototype mode.

  2. To define an interaction, click the blue connector on the source object, component state, or artboard. Set the following options in the Property Inspector:

    • Trigger: Set to Voice.
    • Command: Enter the voice command as text.
    • Action: Set to Transition.
    • Destination: Set the destination artboard or component state.
    • Animation: Set animations based on the available options.
    • Easing: Set easing based on the available options.
    • Duration: Set the duration in seconds.
    Set voice triggers
    Set voice triggers for artboards

    A. Set Trigger to Voice B. Enter voice command as text 

    Set voice triggers for component states
    Set voice triggers for component states

    A. Set Trigger to Voice B. Enter voice command as text C. Set Destination to a component state 

  3. To define more than one interaction for an object, component state, or artboard:

    1. Select it and click + on it. Alternatively, click + in the Property Inspector.
    2. Set the properties in the Property Inspector.

     You can apply Tap, Drag, Hover, and Time triggers only once, and Voice, Keys & Gamepad many times. 

    2
    Use multiple triggers to define more interactions

  4. To view the changes you have updated, select the Desktop Preview button .

  5. To preview the transition to the next artboard or component state, hold down the spacebar and repeat the voice command. 

Add playback to a prototype

Add an audio playback

Use the Audio Playback action to add sound effects to your prototypes. For example, an audio confirmation after the successful delivery of an email. You can import an audio as an MP3 or a WAV file.

To add audio playback on an object or artboard, perform the following steps:

  1. In Prototype mode, select the object or the artboard.

  2. In the Property Inspector, set the following options:

    • Click + to add the interaction. 
    • Trigger: Set to Tap.
    • Action: Set to Audio Playback, and then browse and add the audio file. 

     Auto-play of audio works on Safari only if you have enabled auto-play in Safari settings. To enable auto-play for XD prototype links, see Enable auto-play of sound on Safari.

Add multiple actions on a single trigger

You can add a non-transitional action such as an Audio Playback with a primary transitional action such as Transition or Auto-Animate on a single trigger. For example, a mouse-clicking sound when you transition from one artboard to another.

To add multiple actions to your prototype, perform the following steps:

  1. In Prototype mode, select the object or the artboard on which you want to add multiple actions. 

  2. In the Property Inspector, set the following options:

    • Click + to add the interaction. 
    • Trigger: Set to Tap.
    • Set the first Action + button (transitional action) to Transition, Auto-Animate, Overlay, Scroll To, or Previous artboard. 
    • Set the second Action + button (non-transitional action) to Audio Playback or Speech Playback. 
    multiple-actions
    Set multiple actions to an object or an artboard

     The second Action + button in the Property Inspector is enabled only when you set Tap as the trigger. In addition, if you set a non-transitional action such as Audio Playback or Speech Playback as the first action, the second Action + button is not enabled.

Add a speech playback

To add speech playback on an object or an artboard, perform the following steps:

  1. Drag a wire from the source artboard to the destination artboard.

  2. To add a speech playback, in the Property Inspector, set the following options:

    • Trigger: Set to Time.
    • Delay: Set the time delay (in seconds) to define when the speech playback should start. 
    • Action: Set it to Speech Playback.
    • Voice: Choose a voice for the speech playback.
    • Speech: Type in the text you want for the speech playback.
    Use speech playback
    Use speech playback

    A. Set Trigger to Time B. Set time delay in seconds C. Set Action to Speech Playback D. Set Voice  E. Type in the text for the speech playback 

  3. To preview the changes, click the Desktop Preview button .

  4. To preview the speech playback transition to the next artboard, hold down the spacebar and repeat the voice command. 

    Preview speech playback
    Preview speech playback

Add a voice narration to a prototype

  1. In Prototype mode, select the Home screen where the start of the flow is set and click the Desktop Preview button.

  2. Select the drop-down arrow next to the record button and select Enable Microphone (macOS). If you are on Windows, enable microphone through an OS-level control in Gamecenter. When recording, watch out for the red icon that flashes on the interface.

  3. Save the recording as an MP4 file, and share it with your stakeholders or post it in social media. 

     This doesn't directly capture audio output from XD, such as speech playback. The mic overhears or records the output depending on the user setup (the system mic would hear the system speakers play the speech playback).

Share and review the prototype or design specs link on the web

  1. In the desktop app, click the Share icon at the upper right and choose Design Review(for prototypes) or Development(for design specs).

  2. When previewing a prototype on a:

    • Desktop or laptop: Hold down the spacebar.
    • Adobe XD Mobile app (iOS/Android): Use a long press gesture anywhere on the screen. Place your finger on the screen (without moving it) and use the voice command before lifting your finger back.
    • Mobile browser on a smartphone: Hold down the microphone icon in the lower right-corner of the screen.

  3. When previewing design specs, developers can read or view the voice commands and speech playback as text. 

     Design specs do not support voice interactions.

Enable auto-play of sound on Safari

By default, auto-play of sound is disabled on Safari. To enable auto-play of sound on XD prototype links, follow the steps given below:

  1. Open an XD prototype link on Safari.
  2. On the macOS menu bar, navigate to Safari > Preferences.
  3. In the Websites tab, select Auto-Play in the left pane.
  4. In the Allow the websites below to automatically play media window, choose Allow All Auto-Play next to xd.adobe.com

This setting ensures that sound on XD prototype links works automatically in future.

Enable auto-play of media on Safari
Enable auto-play of media on Safari

Enable sound on Chrome

When running a prototype on Chrome, if you get an error that there was a problem with the playback action, enable sound in Chrome settings.

Follow the steps given below to enable sound on XD prototype links in Chrome settings:

  1. In the Chrome address bar, type chrome://settings/content/sound. Press Enter.
  2. In the Customized behaviors section, click Add next to Allowed to play sound, and add https://xd.adobe.com.

This setting ensures that audio plays on XD prototype links in the future.

Enable sound for XD prototype links in Chrome settings
Enable sound for XD prototype links in Chrome settings

Troubleshoot voice interactions using notifications

You can now troubleshoot voice triggered interactions during prototype previews on the desktop or web. Stakeholders, who review the design specs can also use this feature to better understand how to interact with your prototype in Adobe XD.

Before talking to your prototype during preview, ensure that the Show Notifications menu option is checked. By default, this menu option is in checked state when you launch Adobe XD.

Show notifications
Show notifications for voice prototype

Each command you speak to XD is matched against all the voice triggers present on that current artboard or component state. If no match is found, you receive a notification stating No match found for: {the command you spoke}. Seeing what XD heard helps you determine why a match is not being made each time you speak.

There can be different reasons a match can’t be found. Perhaps the voice command spoken isn’t being used in any interactions on that artboard or component state. Or maybe the speech-to-text service is returning an unexpected result.

For example, you may decide to add the phrase two dollars as a voice command in an interaction. But when spoken, the speech-to-text service may return a result of $2.00. Because numerals replaced words in the notification, you will now know to change the interaction to use numerals instead of words.

More like this

 Adobe

Get help faster and easier

New user?

Quick links

View all your plans Manage your plans
View quick links
Hide quick links

Legal Notices    |    Online Privacy Policy