Use this article to find the Human in the loop report, understand what each chart and metric shows, and know what to check in the first days and weeks after turning on a Human in the Loop rule.

Create Human in the loop report

To create a new Human in the loop report, click on the + icon at the top of your Reports section, then select the Human in the loop template.

You can also create your own custom report from scratch on the Advanced or Expert plan.

Use Human in the loop report template to see

Total loops: conversations where Fin held Fin's reply to ask a teammate.
Resolution rate of loops: loops that ended in a Fin resolution.
Performance funnel: breaks down loops by teammate, then by how each one ended: resolved or taken over.
Outcomes: The outcomes chart shows three outcomes, each as a share of all loops:
- Approved original draft
- Input led to new answer
- Take over
These three outcomes don't add up to 100%. The rest are loops where time ran out, the question is still waiting, or the customer moved on.
Volume over time: loops per week.
Human in the loop by teammate: for each teammate: loops, total time spent, average time to action, inputs, approvals, take overs, and resolution rate.

Note: This report can also be found in Fin AI Agent > Train > Escalations using the report icon.

Understand chart data

Hover over the information icon at the top of a chart to see reporting period, report level filters, metrics, and metric level filters applied to each chart.

Customize the Human in the loop report template

The Human in the loop report template is fully customizable, enabling you to add more charts from the chart library, or remove charts you don't need in this report. All charts can be resized and moved around to where you want them.

Learn more about customizing reports.

Filter by Human in the loop rules

Filter by rule with Human in the loop rules applied to compare topics. Drill in to any chart to see the conversations.

Tip: Give a new rule about a week of conversations (more if your volume is low) before you judge the results or change the threshold.

What to look at, and when

Use this table to check the report at the right points after turning on a Human in the loop rule, and what to do if the numbers look off.

When	Look at	If…	Do this
Days 1–3	Total loops	Zero	Check the troubleshooting list in Ask a teammate for help with Fin's replies (Human in the Loop).
Week 1	Loops that ended with no approval, input, or take over	A big share	Nobody's answering in time: assign an owner or lengthen the time limit.
Week 1	Take over vs. Input led to new answer	Take over is higher	Show the team Give Fin an answer, and check that Fin's drafts are good.
After about a week	Approved original draft	Most loops	Lower the threshold one step, then check again in two weeks.
After about a week	Take over	Most loops on one rule	Fin's drafts aren't useful on that topic: add content, or switch the rule back to hand over.
Any time	Rules with zero loops	Never fired	Turn those rules off.
Monthly	Fin's resolution rate for the rule's audience, before vs. after	Up or down	More automation, or narrow the rule.

💡Tip

Need more help? Get support from our Community Forum
Find answers and get help from Intercom Support and Community Experts

Human in the loop reporting