# AI output reviews

Relay.app's built-in human-in-the-loop tools make it very easy to ensure that a person first reviews the output of an AI step before the workflow proceeds.

## Setting up AI output review in the editor

In the **Behavior** section of every AI step, there's a question '**Should a person review the AI output?**' that lets you turn on human-in-the-loop AI output reviews.

### 1. Select the review conditions

<div align="left"><figure><img src="/files/7i7vefGIR27Nmu0YruyC" alt="" width="375"><figcaption><p>Human AI output reviews are available for all AI steps</p></figcaption></figure></div>

By default, the option to require a human review is turned off for newly created steps. To turn it on, toggle this setting to either

* **Yes, always** if you want the AI output to be **reviewed every time** by a person before continuing the run. Note that if this workflow runs very frequently, you'll also get many review requests that need to be acted on
* **Only if at least one output field is empty**
* **Only if all output fields are empty**
* **Only if AI cannot generate a valid output**

### 2. Choose the mechanism to notify the reviewer

<div align="left"><figure><img src="/files/Bo7uD40PQuWOsjz4Wa35" alt="" width="375"><figcaption><p>Select the medium to notify the reviewer</p></figcaption></figure></div>

Next, select the medium the reviewer should receive the notification on.

### 3. Select the reviewer (assignee)

<div align="left"><figure><img src="/files/zgm30MMW120VeykT9Nu9" alt="" width="351"><figcaption><p>The assignee should be a collaborator of the Workflow</p></figcaption></figure></div>

The assignee for the reviews should be a collaborator in your workflow. [Learn more about collaborators](/workflows/sharing-workflows.md#collaborators)

### 4. Personalize the notifications and reminders

<div align="left"><figure><img src="/files/rWhucQMzzwuXZ2iWuQl6" alt="" width="375"><figcaption><p>Optionally, personalize the review notifications and reminders</p></figcaption></figure></div>

Finally, you may personalize the notification message that's sent every time a human review is needed. You may also set a due date and configure reminder notifications for when the assignee didn't review the AI output in time.

## Reviewing AI outputs

Every time someone is notified to review the output of the AI, they have the following options:

* **Approve the AI output as-is**. After the approval, the run will continue with the next step(s) in the workflow.
* **End the workflow run right away**. If based on the AI output the assignee decides the workflow run shouldn't continue, they can end it right away, skipping all following steps.
* **Manually edit/override the AI output** (i.e. tweak values). They will be taken to the run view where they can edit values in the *Input* tab before approving the updated values.
* **Re-prompt the AI**. A new output will be generated based on updated one-off instructions/clarifications in the prompt. The assignee will be notified again when the new output is ready for review (they'll have the same options again).


---

# Agent Instructions: Querying This Documentation

If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question.

Perform an HTTP GET request on the current page URL with the `ask` query parameter:

```
GET https://docs.relay.app/human-in-the-loop/ai-output-reviews.md?ask=<question>
```

The question should be specific, self-contained, and written in natural language.
The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.

Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.