Releases is currently in closed beta. If you're interested in early access, please fill out this beta request form.
What are Releases?
As Fin becomes a bigger part of your customer support, managing changes becomes more complex. Content, guidance, procedures and other configuration all work together, which means even small updates can have unexpected effects. Releases give you a structured way to manage those changes.
Releases let you safely prepare and deploy changes to your Fin configuration in a dedicated workspace. Instead of publishing edits directly to your live Fin configuration, every change is added to a release.
With Releases, you can:
Bundle related changes into a single release.
Collaborate with teammates before changes go live.
Validate changes using Preview and Evals before deployment.
Deploy with confidence by publishing immediately or gradually rolling out changes with a phased rollout or A/B test against your current live Fin version.
Common use cases for Releases
Prepare for a product launch | If you're launching a new product or feature, you can prepare everything ahead of time in a single release. For example, you might update Help Center articles, add new guidance, create a procedure for the new feature, and adjust other parts of your Fin configuration.
Once everything is ready, you can publish it all together or first roll it out gradually with a phased rollout or A/B test. |
Improve how Fin answers customer questions | If you're reorganizing your content to help Fin provide better answers, you can group all of those changes into a release and compare the new configuration against your current live setup.
This lets you measure whether the updated content improves answer quality before rolling it out more broadly. |
Replace informational answers with automated resolution | You might currently rely on Help Center content to answer refund questions before handing customers off to your support team.
With a Release, you can introduce a new procedure that enables Fin to process refunds end-to-end, then roll it out gradually — using a phased rollout or A/B test — to compare the new procedure against your existing content-based experience before deploying it to everyone. |
Creating a Release
A Release holds the changes. You add items to it, edit them safely, and remove anything you no longer want live with Fin as part of that Release. Nothing here touches your live Fin until you go live or run an experiment.
To create your first Release, go to Fin AI Agent > select "Service" from the dropdown at the top of the nav and beneath that dropdown click on "Fin Main". Click on Create Release.
Give it a descriptive name and description — something that says what's changing, like "Refund processing changes". The description is internal for you to easily identify what's in the Release.
Now you can add changes to your Release. For example, select "Content" to test a help article, "Guidance" or "Escalation Guidance" to test behavioral rules, or "Procedure" to test a multi-step flow.
Once you've added a change, it will appear in your list of changes in the Release.
You can easily see the exact changes that were made per item by clicking on the item and viewing the diffs:
Add, edit & delete train items in a Release
To add/edit/delete more items as part of a Release, inside the Release, click on Add more changes. You can add, edit, and delete the following item types inside a Release:
Content (Public Articles, Internal Articles, and Snippets)
Guidance
Escalation Guidance
Procedures
See what's changing
The Release overview lists every item in the Release, so you can easily overview it and make further changes if needed.
Each item in the Release overview is marked with an indicator showing the type of change:
+1 — New content added that did not previously exist in the workspace
-1 — Content that has been deleted from the workspace
Pencil icon — Content that already existed in the workspace and has been edited
Switch between Releases and Main Fin
If you want to switch to different Releases, simply use the switcher on the top left of the page in the nav. You can also create new Releases from there and switch to "Main Fin", which is your live production version of Fin.
Preview
Before anything reaches a live conversation, preview the release to see exactly how Fin behaves with your changes applied.
The preview runs Fin with your Release's changes applied, so you see the real behaviour customers would get.
Preview conversations don't touch your live Fin and aren't charged.
Use it to sanity-check every change before you go live or start an experiment.
Tip: Test the exact question a customer would ask to trigger your change, and confirm Fin responds the new way.
Note: Preview conversations appear in your live Inbox during testing. This is expected behavior, not a bug — they're real conversations Fin is responding to as part of the preview. They won't affect your reporting or billing.
Run Evals on a Release
In order to use this particular feature, you need access to the Evals beta. Running Evals inside a Release requires being opted into the Fin Evals closed beta. If you don't see the option yet, submit a beta request to get access.
Preview tells you how Fin handles one question you type yourself. Evals let you run a whole set of saved test conversations against your Release and get an automatic pass/fail result for each one — so you can check a change hasn't broken Fin's behaviour elsewhere before it reaches customers.
An Eval is a themed group of Simulations (realistic, multi-turn test conversations with criteria you define). When you run one against a Release, every Simulation runs with your Release's changes applied instead of your live Fin Main configuration. Nothing touches live conversations.
For more on how Evals, Simulations and scoring work, see Fin Evals [beta].
Creating an eval on a Release
To get started, open the Release you want to test. On the Release overview page, find the Evals section and click See Evals.
Pick the Eval you want to run — either an existing one you've built up as a regression suite, or a new one created for this change.
Run it. Every Simulation in the Eval runs against your Release, and you'll get back a pass/fail result, the full conversation transcript, the event log showing Fin's thinking, and the outcome for each Simulation.
Review any failures, make further changes inside the Release, and re-run the Eval to confirm the fix.
Tip: Run Evals before setting a Release live or starting an experiment. Preview is best for spot-checking a specific question; Evals are best for confirming the Release hasn't regressed anything you've already tested.
Permissions
To set a release live or start and end a rollout, a teammate needs the "Can manage Automation settings and inbound Workflows" permission.
Go live & roll out gradually
When your changes preview well, you decide how they reach customers.
Click Rollout release on the Release overview page, then choose one of two options: Merge to main to publish immediately to all customers, or Roll out gradually to run a phased rollout or an A/B test before it goes to everyone.
Merge to main
Merging to main publishes your changes to Fin Main immediately, applying them to all relevant conversations. Choose this when you're confident in the change and want it in effect everywhere.
Roll out gradually
Select Roll out gradually to test your changes against a share of conversations before committing fully. Choose between two rollout types:
Phased rollout — Release to a percentage of conversations, monitor how it performs, and increase the percentage when you feel confident.
A/B test — Split traffic against Fin Main and measure a metric for statistical significance. Best when you need proof a number moved.
Setting up a phased rollout
After choosing Phased rollout, configure:
Name — defaults to the release name and today's date; edit it to describe the rollout.
Audience — who the rollout applies to (defaults to Everyone).
Traffic split — choose what percentage of conversations use the new release (defaults to 10%); the rest stay on Main Fin.
Results analysis — optionally identify conversations related to the release's changes for easier measurement, and add filters to narrow further. When you turn this on and add filters (for example, a topic or a Fin attribute), results only compare conversations where your changes could make a difference. We recommend using it whenever your changes only apply to some conversations. Otherwise, unrelated conversations can hide the real impact or produce a result that's down to chance.
Click Start phased rollout to begin — the rollout starts immediately and appears under Active rollout in the Release's Rollouts tab.
Viewing rollout results
Once a rollout is running, open the Release's Rollouts tab. Active rollouts appear under Active rollout, and completed ones under Past rollout.
Here's what the results of a phased rollout look like. You can easily drill into the conversations that were touched by the release and compare them to the ones in Fin Main for spot checking.
Here's what the results of an a/b test rollout look like. You can easily see:
Result label: a short verdict on whether the release made a measurable difference.
Estimated effect: how much the release changed resolution rate, in percentage points (pp), with a 95% confidence range. The chart shows this range. The dot is the estimate, the bar is the range, and the line in the middle marks zero (no change).
Conversation volume: how many conversations went to the release and how many went to Main Fin. Expected split means traffic is being divided in line with your traffic split setting, so the comparison is fair.
Resolution rate: the resolution rate for the release (purple bar) next to Main Fin (grey bar).
Significant results:
Inconclusive results:
Regressing results:
Reporting on Releases using Custom Reports
You can also create your own custom reports. Simply add Release and Experiment filters to custom reports in the Reports section to compare performance across experiment variants.
Roll back
Ending a rollout
To stop a Release rollout affecting customers, end the rollout. New conversations immediately return to your current live setup.
Go to the Release containing the rollout you want to stop.
Open the Rollouts tab, then click the … (ellipsis) menu next to the rollout name.
Select End rollout.
Note: Once a rollout has started, you cannot adjust its rollout percentage — you can't ramp it up (e.g. 20% → 60%) or down mid-flight. The only way to change the share of traffic is to end the rollout and start a new one at the percentage you want. To stop a rollout entirely, select End rollout from the … menu.
Rolling back changes from a merged release
Once a release has been merged into Fin Main, you can roll back its changes from the release itself.
This still uses each item's version history in Fin Main — the release just takes you there directly for every item it changed, instead of you finding and opening each one yourself.
Note: Rollback isn't currently supported for escalation guidance, snippets, internal articles, evals, or deleted items.
To roll back changes from a merged release:
Open the release you want to roll back from Releases.
Click Roll back changes in the top right of the release.
In the Roll back changes from this release dialog, review the list of changes included in the release.
Click the revert icon next to an item to roll that item back to the version it was before the release.
How to test Fin config in one Salesforce environment
Background
Fin for Salesforce connects to more than one Salesforce organization. One workspace can hold a live organization and one or more test organizations. Each connected organization is an environment.
What a release adds
You can already scope a workflow to one environment. Open Deploy, open a workflow such as Salesforce cases, then set Environment on the trigger. The default is All environments.
That picker controls which workflow runs. It does not change the content, the guidance, or the procedures that Fin reads. Fin reads the same live configuration in every environment.
A release changes the configuration itself. A release pins a different version of each entity in it, for one audience only. The entity keeps its identifier, so you do not copy it. One audience and one percentage control the whole group, and you can roll back.
Why it works
Fin writes the environment onto each conversation. The environment is a system-defined conversation attribute. An audience rule can read this attribute.
A release rollout takes one audience. The rollout applies the release only to conversations that match the audience.
How it works
Step 1 — Confirm the environment is connected
Open Connect. Find the organization in Connect Fin to a test organization. The status must be Connected.
Step 2 — Open the audience list
Open Settings. In the Data group, select Audiences.
Step 3 — Make an audience for the environment
Create a new audience. Give it a name that holds the environment name.
Select Add audience rule. Select Environment in the Conversation data group.
Select the environment that you want to test. Then select Save.
Step 4 — Start a gradual rollout
Open your release. Select Rollout release. Then select Roll out gradually.
Important: Do not select Merge to main — this will apply the changes to Fin Main directly.
Step 5 — Select the audience and set the split to 100%
Keep the type as Phased rollout.
In Audience, select the audience from step 3.
In Traffic split, move the slider to 100%. The panel must show 100% Release (treatment) and 0% Main Fin (control).
Select Start phased rollout.
Step 6 — Test
Start a new conversation in the test organization. Fin answers with the configuration in the release.
Start a conversation in the live organization. Fin answers with Fin Main.
FAQs
What is "Fin Main"?
What is "Fin Main"?
Fin Main is your live production version of Fin. Anything inside a Release doesn't impact Fin Main until you set an experiment live or set the Release live to 100%.
What can I add, edit, or delete inside a Release?
What can I add, edit, or delete inside a Release?
You can add, edit, and remove Content, Guidance, Escalation Guidance, and Procedures inside a Release. Support for additional entity types — including Attributes and Data Connectors — is still in progress and coming soon.
What happens if two releases modify the same item?
What happens if two releases modify the same item?
If two releases include changes to the same piece of content, guidance, procedure, or other supported entity, the changes are not merged together. When you publish a release, its version of the entity replaces the currently live version. For example, if Release A and Release B both edit the same piece of guidance, publishing Release B after Release A will overwrite the guidance with the version from Release B.
Can I save changes mid-edit inside a Release?
Can I save changes mid-edit inside a Release?
Changes are not auto-saved inside a Release editor. If you refresh the page or navigate away before saving, any unsaved edits will be lost. Save frequently as you work.
Need more help? Get support from our Community Forum
Find answers and get help from Intercom Support and Community Experts


























