Response AI

Overview

The Response AI Step allows Voiceflow's AI Assist to generate contextual speech or text responses, in real-time, as your users interact with your Assistant. Instead of adding a specific response to a flow in your Assistant, you can instead outline a prompt for the response you'd like to provide, and any variables you'd like the prompt to include. 

This will create a dynamic experience for users, by leveraging LLMs to generate informational content for your users' question, or simply giving some variety to how your Assistant can respond. 

The Response AI Step is an experimental feature leveraging Large Language Models (LLMs) and should not be used in production use cases for business critical applications because of its potential to generate misleading or false information. For that reason, you will be required to opt-in to use this functionality.

Turn the Generate Step On/Off

The Response AI Step can be turned on and off in assistant settings under the AI Assistant tab.

Adding a Response AI Step to your Assistant

Once enabled, you can find the Response AI Step in your Assistant's Steps Menu, under the Talk section. The step can be added into your assistant anywhere that you might add a Text or Speak Step. Once you have placed your step, you can configure it in the Editor. 

To configure your generative response, in the Prompt field, provide a description for the type of response you'd like the AI to generate. Be sure to include any variables you want it to include in the prompt. 

Under the Settings icon in the Editor, you will be able to configured your desired response length (to a maximum of 2048 characters) and set the TTS voice used for it (on Voice assistants only.)

Testing your Generated Responses

You can test your prompt using the Preview button, which will ask you to provide an example variable value if you have included one. 

When you run your assistant in the Test Tool or in Sharable Prototypes, any Generate Steps you have configured will be active, generating their response content dynamically. 

The Response AI Step is still an experimental feature, and for this reason and is not recommended to be used for serious production use cases.