Set AI

Overview

The Set AI Step allows you to dynamically set variables in your Assistant based on a prompt that you provide. These variables get set in real-time on the runtime of each session with your Assistant. 

The Set AI is an experimental feature leveraging Large Language Models (LLMs) and should not be used in production use cases for business critical applications because of its potential to generate misleading or false information. For that reason, you will be required to opt-in to use this functionality.

Turn the AI Steps On/Off

The AI Steps, including the Set AI, can be turned on and off in assistant settings under the AI Assistant tab.

Adding an Set AI to your Assistant

Once enabled, you can find the Set AI Step in your Assistant's Steps Menu, under the AI section. The step can be added into your assistant anywhere. Once you have placed your step, you can configure it in the Editor. 

To configure your variable, in the Prompt field, provide a description for the type of function you'd like the AI to run for you. You can leverage variables from your project within this prompt, to make it dynamic. 

From the Apply To field, select the variable you wish to map the AI's response to.

You can add multiple prompts to the same step, these prompts will run in parallel, so you cannot leverage the variable outputted from one prompt if another. If you wish to do this, you can use two sequential Set AI Steps, the generation time for you results will just take a bit longer. 

Testing your Generated Variables

You can test your prompt using the Preview button, which will ask you to provide an example variable value if you have included one. 

When you run your assistant in the Test Tool or in Sharable Prototypes, any Set AI Steps you have configured will be active, generating their response content dynamically. 

The Set AI Step is still an experimental feature, and for this reason and is not recommended to be used for serious production use cases.