See weekly product updates for Fin AI Agent & Intercom Helpdesk.
AI
Fin
New feature

Fin Evals: Test every change to Fin before it reaches customers

Kim avatar
Shared by Kim •

Evals is now available to every Fin customer. You can test how Fin handles realistic, multi-turn conversations at scale, so you know how it will behave before a customer ever sees it.

  • End-to-end coverage: Each Eval tests everything Fin does in a real conversation: drawing on Content, following Guidance, running Procedures and Skills, and using data connectors.
  • Simulated customers, automated scoring: AI plays the customer and acts as the judge, scoring every conversation against the checks you set.
  • Catch regressions before they go live: Save your most important scenarios and rerun them after any change, including inside a Release.
  • Get started: Go to Fin AI Agent > Test > Evals to build your first Eval, or ask Fin Operator to build and run one for you.