{"id":14792,"date":"2018-03-14T15:53:17","date_gmt":"2018-03-14T15:53:17","guid":{"rendered":"http:\/\/blog.intercom.com\/?p=14792"},"modified":"2020-07-30T12:57:01","modified_gmt":"2020-07-30T11:57:01","slug":"how-to-run-a-successful-beta","status":"publish","type":"post","link":"https:\/\/www.intercom.com\/blog\/how-to-run-a-successful-beta\/","title":{"rendered":"How to run a successful beta in 7 steps"},"content":{"rendered":"<p class=\"opening_paragraph\">Prior to joining Intercom as a Product Manager, I had never run a structured beta. When it came to finally running my first one, I was surprised to find very little information online that could help me.<\/p>\n<p>I&#8217;ve run a lot of successful betas now but I learned my craft through tribal Intercom knowledge, built up by other Product Managers over the years.<\/p>\n<p>The content I did find online was overly prescriptive and too focused on the specifics that weren\u2019t going to be relevant to a wider audience with different products. To address that deficit, I\u2019ve put together a guide on how we run betas here at Intercom.<\/p>\n<p>Short on time? Here are the key takeaways:<\/p>\n<ul>\n<li><strong>Understand the problem that you\u2019re trying to solve<\/strong><br \/>\nThis will pinpoint why you\u2019re running a beta and help to define what you want to learn as early as possible. This should be done before you even create a build plan.<\/li>\n<li><strong>Paint a picture of what success looks like<\/strong><br \/>\nDecide how you will measure it so you can assess whether or not you are solving the problem adequately.<\/li>\n<li><strong>Consider who should get access<\/strong><br \/>\nStart small with early adopters who already experience the problem you\u2019re trying to solve. Broaden the audience over time to include users who haven\u2019t asked for the feature.<\/li>\n<li><strong>Decide how you\u2019re going to pitch<\/strong><br \/>\nWork on how you\u2019ll pitch and describe the solution in a way that makes the most sense for your users.<\/li>\n<li><strong>Get feedback direct from your customers<\/strong><br \/>\nJump on customer calls and send targeted messages based on usage of the beta to gather feedback. Create one source of truth that keeps this up to date and organized.<\/li>\n<li><strong>Evaluate the findings<\/strong><br \/>\nYou should evaluate all of your learnings and feedback against the problem you set out to solve. Decide whether or not you are holding something of value back from non-beta customers or if it falls short of the bar you set out to exceed.<\/li>\n<li><strong>Decide when to ship<\/strong><br \/>\nSet a timeline to make a final call on whether and when you will ship the feature you&#8217;re testing \u2013\u00a0this is a crucial forcing function to avoid becoming paralyzed by the mountain of feedback.<\/li>\n<\/ul>\n<h2 id=\"step-1-why-should-you-run-a-beta\">Step 1: Why should you run a beta?<\/h2>\n<p>One of the biggest pitfalls Product Managers continuously make is planning a beta as the feature approaches customer readiness. That\u2019s too late \u2013 you\u2019re likely asking the question \u201cWill we beta this?\u201d because you feel you should be. Instead, asking yourself, \u201cWhat do I want to learn as early as possible?\u201d should be your starting point.<\/p>\n<p class=\"quote\">Start with why and everything else will fall into place.<\/p>\n<p>For any project that contains uncertainty you should be considering whether you will release an early version to a group of users from the outset. At Intercom, we scope small. It can feel uncomfortable but there\u2019s always a version that can be released early that you can begin to learn from.<\/p>\n<p>The answer to \u201cWhat do I want to learn as early as possible?\u201d will inform how you roll out the final feature, not just your beta. Start with why and everything else will fall into place, like who will get access, when do they get access, and what they will get access to.<\/p>\n<p>Not every feature you build will require a beta. We have shipped new functionality that didn\u2019t allow for or justify the overhead of running a beta. An example of this was enabling customers to capture an email and replace the standard conversational reply on outbound messages.<\/p>\n<p><img decoding=\"async\" src=\"https:\/\/intercom.com\/blog\/wp-content\/uploads\/2018\/03\/Screen-Shot-2018-03-13-at-12.48.09.png\" alt=\"Intercom Newsletter\" \/><\/p>\n<p>Our new feature required considerable volume and we were working under tight timelines so we decided it would be better to release and learn rather than run a half-baked beta. As a form of QA, we worked alongside our Content team to dogfood the new feature on our blog and see how it performed in a short period to decide whether it was worthy of release or not.<\/p>\n<p>Betas are not for finding bugs. Betas can be a great safeguard against bugs but it\u2019s dangerous to release things to beta that you are not confident in your QA efforts on.<\/p>\n<h2 id=\"step-2-what-does-a-successful-beta-look-like\">Step 2: What does a successful beta look like?<\/h2>\n<p>You need to define what success will look like for you by outlining what metrics are relevant and need to be measured. You should also set targets for these as a benchmark.<\/p>\n<p class=\"quote quote-left\">Success metrics are essential for comparing progress to.<\/p>\n<p>Success metrics are essential to having something tangible in place to compare progress to, inform actions, provide a mechanism to fight for during the beta and post release, and prompt important questions.<\/p>\n<p>When the new reports for our Inbox product were in beta, we gave users the ability to switch between the old-style reports that were available to all of our customers and the new reports that were only available to those in the beta.<\/p>\n<p>We had adoption and engagement metrics in place with targets we wanted to hit. These metrics suggested a large cohort of customers switched directly back to the old reports on every login. To learn the real reason why this was, we decided to remove access from the old reports once we were confident that the new reports were doing what they should.<\/p>\n<p>We learned two things very quickly from this:<\/p>\n<ul>\n<li>The majority of customers switched back to the old reports out of habit<\/li>\n<li>Two specific insights our old reports were enabling in a better way were being catered for poorly in our new design<\/li>\n<\/ul>\n<p>We iterated on our new reports design and then were in a much better place to rollout and replace reports in a more informed and confident way.<\/p>\n<h2 id=\"step-3-who-should-you-invite-to-your-beta\">Step 3: Who should you invite to your beta?<\/h2>\n<p>You need early adopters who are likely to get started with the new feature or product right away and be all right with something that could be a little rough around the edges. To find these people, we start with <a href=\"https:\/\/www.intercom.com\/blog\/building-empathy-in-a-product-team\/\" target=\"_blank\" rel=\"noopener noreferrer\">conversation records of customers<\/a> who have requested the feature or experienced the problem we aim to solve.<\/p>\n<p class=\"quote\">Your solution should be the only incentive needed.<\/p>\n<p>You should always start with a small rollout and then increase the audience based on adoption and feedback. Unless there is a risk or downside to the beta, such as breaking a primary workflow, you should opt in apps and notify them, rather than asking if they want to be included. Asking if they want to be included is just an additional step that creates a hurdle. Of course, this varies wildly as a rule of thumb depending on your business.<\/p>\n<p>As your beta matures, add a random selection of other users who haven\u2019t experienced the issue or requested the feature to ensure you aren\u2019t only receiving feedback from a biased group.<\/p>\n<p>Incentives are built in to many beta programs but if you feel like you need one to get usage, you should ask yourself two things: Do you know who needs this? And does anyone need this?<\/p>\n<p>The solution should be good enough as an incentive in and of itself or else something is wrong. We scope our betas to include at least some customer value, otherwise where is the hook?<\/p>\n<h2 id=\"step-4-how-to-communicate-your-beta-to-your-customers\">Step 4: How to communicate your beta to your customers?<\/h2>\n<p>When it comes to beta messaging at Intercom, we rely primarily on messages sent via our own <a href=\"https:\/\/www.intercom.com\/blog\/messages\">Intercom messenger<\/a>. We use tags to manage beta participants and send messages that are contextual to them being in the product. The other major benefit is that customers can start conversations, ask questions and provide feedback via this message.<\/p>\n<p>Here\u2019s what you should include in your message:<\/p>\n<ol>1. Stress to the customer that it is a beta in order to set expectations.<\/ol>\n<ol>2. Describe the problem.<\/ol>\n<ol>3. Describe what the solution is and where they can find it. Be visual.<\/ol>\n<ol>4. State that you need feedback in order to improve the feature and are building the most impactful solution.<\/ol>\n<p><img decoding=\"async\" src=\"https:\/\/intercom.com\/blog\/wp-content\/uploads\/2018\/03\/Screen-Shot-2018-03-13-at-13.20.22.png\" alt=\"Intercom Messenger\" \/><\/p>\n<h2 id=\"step-5-how-to-get-feedback-on-your-beta\">Step 5: How to get feedback on your beta<\/h2>\n<p>Specifying that you\u2019re running a beta in order to capture feedback should be enough to kickstart organic feedback loops. People who offer feedback without being prompted are invaluable. You shouldn\u2019t underestimate the importance of jumping on calls with these customers early on. You don\u2019t need to conduct state of the art user research sessions, just ask for a few minutes of their time.<\/p>\n<p class=\"quote quote-left\">Be careful not to burn bridges with customers.<\/p>\n<p>Before the call, you should review what they have and haven\u2019t done then jot down the qualitative questions you care about them answering the most. Invite an engineer and designer involved in the work to listen in and make sure to capture every piece of feedback.<\/p>\n<p>You can\u2019t rely solely on proactive feedback. Usage metrics are crucial for feeding into whether the project is a success or not and will help inform the questions you ask. Sending a message requesting feedback to people who don\u2019t use the feature is a waste. Only a small set of customers will use the feature and provide quality feedback so it\u2019s important not to burn bridges. Targeting your messages is key to getting the most out of feedback opportunities and keeping on the good side of your beta users.<\/p>\n<h2 id=\"step-6-making-sense-of-beta-feedback\">Step 6: Making sense of beta feedback<\/h2>\n<p>It\u2019s crucial to capture every insight and information point during the beta process. Product Managers often fall into the trap of tracking some feedback on Post-its, lodging others in their brains\u2019 feedback depository and spreading the rest between different scraps of paper and Google docs. You\u2019ll hate yourself when it comes to crunch time and you need to make decisions.<\/p>\n<p>One of the best ways to consistently track all of the qualitative feedback is to create a spreadsheet before ever adding a beta customer. Remain disciplined about adding EVERYTHING in here, even duplications of feedback or questions about the beta.<\/p>\n<p>You can then <a href=\"https:\/\/www.intercom.com\/blog\/customer-feedback-strategy\/\" target=\"_blank\" rel=\"noopener noreferrer\">codify your feedback<\/a> to make it as useful as possible. Below is an example of how to codify beta feedback:<\/p>\n<ul>\n<li><strong>Column 1<\/strong> &#8211; Original feedback or comment<\/li>\n<li><strong>Column 2<\/strong> &#8211; Type (e.g. feature request, blocker, comprehension, usability, improvement)<\/li>\n<li><strong>Column 3<\/strong> &#8211; Summary. This is my concise version of their feedback<\/li>\n<li><strong>Column 4<\/strong> &#8211; Reason. The issue, cause or problem actually being expressed<\/li>\n<\/ul>\n<p><img decoding=\"async\" class=\"small\" src=\"https:\/\/intercom.com\/blog\/wp-content\/uploads\/2018\/03\/Feedback.png\" alt=\"feedback\" \/><\/p>\n<p>Once you\u2019ve gathered a significant amount of data, this method of storing feedback will help you easily communicate the patterns and findings to anyone who is interested.<\/p>\n<p>When it comes to dealing with feedback, there are some core principles to keep in mind:<\/p>\n<ul>\n<li>Always chase for the why<\/li>\n<li>The majority of feature requests should be considered and acted on post release, unless there is a worrying trend and the problem you set out to face wasn\u2019t actually the most important problem<\/li>\n<li>Look out for patterns of the same question &#8211; either the UI or logic is confusing, or this will help inform what info product education docs should provide<\/li>\n<\/ul>\n<h2 id=\"step-7-is-your-feature-ready-to-ship\">Step 7: Is your feature ready to ship?<\/h2>\n<p>Your success metrics and qualitative feedback will ultimately dictate what and when you should release. However, setting a timeline for when you will make that all-important call is great as a forcing function for actions. This can vary depending on the complexity of what you are betaing and the certainty of the solution, so there\u2019s no rule of thumb here.<\/p>\n<p class=\"quote\">Set yourself a timeline as a forcing function.<\/p>\n<p>When we launched the new Respond Reports from beta, there was a mountain of feedback. In an ideal world, it would have been great to bundle these into what we launched. However, this would have delayed replacing an existing report with a better reporting feature for the 95% of customers not in the beta. So it made sense to release what we had and benchmark the other requests and feedback for iteration and improvement in the near future.<\/p>\n<p>Before making your final decision, you should step back and ask yourself some questions:<\/p>\n<ul>\n<li><strong>Do you feel confident that you have solved the problem enough to warrant releasing your feature?<\/strong> Use measures of success and a general sense of qualitative feedback to guide you.<\/li>\n<li><strong>Is it replacing something that exists already?<\/strong> If it\u2019s better than what is currently available to everyone, you should probably ship it as soon as possible.<\/li>\n<li><strong>Does your marketing team want to announce at a particular time or in a particular way?<\/strong><\/li>\n<\/ul>\n<p>As with most processes, how you run your betas will evolve with your business. At Intercom, we\u2019re always learning and iterating with each additional feature.<br \/>\n<a href=\"https:\/\/www.intercom.com\/blog\/books\/product-management?utm_medium=ii-blog&amp;utm_source=Books-CTA&amp;utm_campaign=20180314-RunningBetas&amp;utm_content=Image-footer\"><img decoding=\"async\" class=\"small\" src=\"https:\/\/intercom.com\/blog\/wp-content\/uploads\/2018\/03\/CTA.png\" alt=\"Books CTA\" \/><\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Prior to joining Intercom as a Product Manager, I had never run a structured beta. When it came to finally running my first one, I was surprised to find very little information online that could help&hellip;<\/p>\n","protected":false},"author":260,"featured_media":14826,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"category":[5],"tags":[614,2480,2482,86,62,2481],"coauthors":[559],"class_list":["post-14792","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-product-and-design","tag-beta","tag-betas","tag-codifying-feedback","tag-customer-feedback","tag-product-management","tag-running-a-beta"],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v27.5 (Yoast SEO v27.5) - https:\/\/yoast.com\/product\/yoast-seo-premium-wordpress\/ -->\n<title>How to run a successful beta in 7 steps - The Intercom Blog<\/title>\n<meta name=\"description\" content=\"Running betas is never easy so here&#039;s a handy guide on how to run an effective beta in 7 steps, using tribal Intercom knowledge built up by product managers over the years.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.intercom.com\/blog\/how-to-run-a-successful-beta\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"How to run a successful beta in 7 steps\" \/>\n<meta property=\"og:description\" content=\"Running betas is never easy so here&#039;s a handy guide on how to run an effective beta in 7 steps, using tribal Intercom knowledge built up by product managers over the years.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.intercom.com\/blog\/how-to-run-a-successful-beta\/\" \/>\n<meta property=\"og:site_name\" content=\"The Intercom Blog\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/intercominc\" \/>\n<meta property=\"article:published_time\" content=\"2018-03-14T15:53:17+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2020-07-30T11:57:01+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.intercom.com\/blog\/wp-content\/uploads\/2018\/03\/How-to-run-a-successful-beta.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1968\" \/>\n\t<meta property=\"og:image:height\" content=\"932\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Nicholas Sainsbury\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@NickLesains\" \/>\n<meta name=\"twitter:site\" content=\"@intercom\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Nicholas Sainsbury\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"10 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/www.intercom.com\\\/blog\\\/how-to-run-a-successful-beta\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.intercom.com\\\/blog\\\/how-to-run-a-successful-beta\\\/\"},\"author\":{\"name\":\"Nicholas Sainsbury\",\"@id\":\"https:\\\/\\\/www.intercom.com\\\/blog\\\/#\\\/schema\\\/person\\\/21a3d124dd33c78c4a8d90f650c12259\"},\"headline\":\"How to run a successful beta in 7 steps\",\"datePublished\":\"2018-03-14T15:53:17+00:00\",\"dateModified\":\"2020-07-30T11:57:01+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/www.intercom.com\\\/blog\\\/how-to-run-a-successful-beta\\\/\"},\"wordCount\":2109,\"publisher\":{\"@id\":\"https:\\\/\\\/www.intercom.com\\\/blog\\\/#organization\"},\"image\":{\"@id\":\"https:\\\/\\\/www.intercom.com\\\/blog\\\/how-to-run-a-successful-beta\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/www.intercom.com\\\/blog\\\/wp-content\\\/uploads\\\/2018\\\/03\\\/How-to-run-a-successful-beta.jpg\",\"keywords\":[\"beta\",\"betas\",\"codifying feedback\",\"Customer Feedback\",\"product management\",\"running a beta\"],\"articleSection\":[\"Product &amp; Design\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/www.intercom.com\\\/blog\\\/how-to-run-a-successful-beta\\\/\",\"url\":\"https:\\\/\\\/www.intercom.com\\\/blog\\\/how-to-run-a-successful-beta\\\/\",\"name\":\"How to run a successful beta in 7 steps - The Intercom Blog\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.intercom.com\\\/blog\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/www.intercom.com\\\/blog\\\/how-to-run-a-successful-beta\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/www.intercom.com\\\/blog\\\/how-to-run-a-successful-beta\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/www.intercom.com\\\/blog\\\/wp-content\\\/uploads\\\/2018\\\/03\\\/How-to-run-a-successful-beta.jpg\",\"datePublished\":\"2018-03-14T15:53:17+00:00\",\"dateModified\":\"2020-07-30T11:57:01+00:00\",\"description\":\"Running betas is never easy so here's a handy guide on how to run an effective beta in 7 steps, using tribal Intercom knowledge built up by product managers over the years.\",\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/www.intercom.com\\\/blog\\\/how-to-run-a-successful-beta\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/www.intercom.com\\\/blog\\\/how-to-run-a-successful-beta\\\/#primaryimage\",\"url\":\"https:\\\/\\\/www.intercom.com\\\/blog\\\/wp-content\\\/uploads\\\/2018\\\/03\\\/How-to-run-a-successful-beta.jpg\",\"contentUrl\":\"https:\\\/\\\/www.intercom.com\\\/blog\\\/wp-content\\\/uploads\\\/2018\\\/03\\\/How-to-run-a-successful-beta.jpg\",\"width\":1968,\"height\":932,\"caption\":\"Running a successful beta\"},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/www.intercom.com\\\/blog\\\/#website\",\"url\":\"https:\\\/\\\/www.intercom.com\\\/blog\\\/\",\"name\":\"The Intercom Blog\",\"description\":\"Articles and Podcasts on Customer Service, AI and Automation, Product, and more\",\"publisher\":{\"@id\":\"https:\\\/\\\/www.intercom.com\\\/blog\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/www.intercom.com\\\/blog\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/www.intercom.com\\\/blog\\\/#organization\",\"name\":\"The Intercom Blog\",\"url\":\"https:\\\/\\\/www.intercom.com\\\/blog\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/www.intercom.com\\\/blog\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/www.intercom.com\\\/blog\\\/wp-content\\\/uploads\\\/2019\\\/08\\\/Intercom-logo-sq-black-trans.png\",\"contentUrl\":\"https:\\\/\\\/www.intercom.com\\\/blog\\\/wp-content\\\/uploads\\\/2019\\\/08\\\/Intercom-logo-sq-black-trans.png\",\"width\":1000,\"height\":1000,\"caption\":\"The Intercom Blog\"},\"image\":{\"@id\":\"https:\\\/\\\/www.intercom.com\\\/blog\\\/#\\\/schema\\\/logo\\\/image\\\/\"},\"sameAs\":[\"https:\\\/\\\/www.facebook.com\\\/intercominc\",\"https:\\\/\\\/x.com\\\/intercom\",\"https:\\\/\\\/www.instagram.com\\\/intercom\\\/\",\"https:\\\/\\\/www.linkedin.com\\\/company\\\/2491343\",\"https:\\\/\\\/www.pinterest.ie\\\/intercom\\\/\",\"https:\\\/\\\/www.youtube.com\\\/channel\\\/UCJG0MvLP03kyzzAkD-w98aQ\",\"https:\\\/\\\/en.wikipedia.org\\\/wiki\\\/Intercom_(company)\"]},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/www.intercom.com\\\/blog\\\/#\\\/schema\\\/person\\\/21a3d124dd33c78c4a8d90f650c12259\",\"name\":\"Nicholas Sainsbury\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/a53312255781a43b4d2a5fca95adeed3b217db67451b87f79759c29d73d822da?s=96&d=mm&r=pg34d9de771d17f5cb7b4a314ce98bb0b7\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/a53312255781a43b4d2a5fca95adeed3b217db67451b87f79759c29d73d822da?s=96&d=mm&r=pg\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/a53312255781a43b4d2a5fca95adeed3b217db67451b87f79759c29d73d822da?s=96&d=mm&r=pg\",\"caption\":\"Nicholas Sainsbury\"},\"sameAs\":[\"https:\\\/\\\/x.com\\\/NickLesains\"],\"url\":\"https:\\\/\\\/www.intercom.com\\\/blog\\\/author\\\/nicklesains\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"How to run a successful beta in 7 steps - The Intercom Blog","description":"Running betas is never easy so here's a handy guide on how to run an effective beta in 7 steps, using tribal Intercom knowledge built up by product managers over the years.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.intercom.com\/blog\/how-to-run-a-successful-beta\/","og_locale":"en_US","og_type":"article","og_title":"How to run a successful beta in 7 steps","og_description":"Running betas is never easy so here's a handy guide on how to run an effective beta in 7 steps, using tribal Intercom knowledge built up by product managers over the years.","og_url":"https:\/\/www.intercom.com\/blog\/how-to-run-a-successful-beta\/","og_site_name":"The Intercom Blog","article_publisher":"https:\/\/www.facebook.com\/intercominc","article_published_time":"2018-03-14T15:53:17+00:00","article_modified_time":"2020-07-30T11:57:01+00:00","og_image":[{"width":1968,"height":932,"url":"https:\/\/www.intercom.com\/blog\/wp-content\/uploads\/2018\/03\/How-to-run-a-successful-beta.jpg","type":"image\/jpeg"}],"author":"Nicholas Sainsbury","twitter_card":"summary_large_image","twitter_creator":"@NickLesains","twitter_site":"@intercom","twitter_misc":{"Written by":"Nicholas Sainsbury","Est. reading time":"10 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.intercom.com\/blog\/how-to-run-a-successful-beta\/#article","isPartOf":{"@id":"https:\/\/www.intercom.com\/blog\/how-to-run-a-successful-beta\/"},"author":{"name":"Nicholas Sainsbury","@id":"https:\/\/www.intercom.com\/blog\/#\/schema\/person\/21a3d124dd33c78c4a8d90f650c12259"},"headline":"How to run a successful beta in 7 steps","datePublished":"2018-03-14T15:53:17+00:00","dateModified":"2020-07-30T11:57:01+00:00","mainEntityOfPage":{"@id":"https:\/\/www.intercom.com\/blog\/how-to-run-a-successful-beta\/"},"wordCount":2109,"publisher":{"@id":"https:\/\/www.intercom.com\/blog\/#organization"},"image":{"@id":"https:\/\/www.intercom.com\/blog\/how-to-run-a-successful-beta\/#primaryimage"},"thumbnailUrl":"https:\/\/www.intercom.com\/blog\/wp-content\/uploads\/2018\/03\/How-to-run-a-successful-beta.jpg","keywords":["beta","betas","codifying feedback","Customer Feedback","product management","running a beta"],"articleSection":["Product &amp; Design"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/www.intercom.com\/blog\/how-to-run-a-successful-beta\/","url":"https:\/\/www.intercom.com\/blog\/how-to-run-a-successful-beta\/","name":"How to run a successful beta in 7 steps - The Intercom Blog","isPartOf":{"@id":"https:\/\/www.intercom.com\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.intercom.com\/blog\/how-to-run-a-successful-beta\/#primaryimage"},"image":{"@id":"https:\/\/www.intercom.com\/blog\/how-to-run-a-successful-beta\/#primaryimage"},"thumbnailUrl":"https:\/\/www.intercom.com\/blog\/wp-content\/uploads\/2018\/03\/How-to-run-a-successful-beta.jpg","datePublished":"2018-03-14T15:53:17+00:00","dateModified":"2020-07-30T11:57:01+00:00","description":"Running betas is never easy so here's a handy guide on how to run an effective beta in 7 steps, using tribal Intercom knowledge built up by product managers over the years.","inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.intercom.com\/blog\/how-to-run-a-successful-beta\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.intercom.com\/blog\/how-to-run-a-successful-beta\/#primaryimage","url":"https:\/\/www.intercom.com\/blog\/wp-content\/uploads\/2018\/03\/How-to-run-a-successful-beta.jpg","contentUrl":"https:\/\/www.intercom.com\/blog\/wp-content\/uploads\/2018\/03\/How-to-run-a-successful-beta.jpg","width":1968,"height":932,"caption":"Running a successful beta"},{"@type":"WebSite","@id":"https:\/\/www.intercom.com\/blog\/#website","url":"https:\/\/www.intercom.com\/blog\/","name":"The Intercom Blog","description":"Articles and Podcasts on Customer Service, AI and Automation, Product, and more","publisher":{"@id":"https:\/\/www.intercom.com\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.intercom.com\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.intercom.com\/blog\/#organization","name":"The Intercom Blog","url":"https:\/\/www.intercom.com\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.intercom.com\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/www.intercom.com\/blog\/wp-content\/uploads\/2019\/08\/Intercom-logo-sq-black-trans.png","contentUrl":"https:\/\/www.intercom.com\/blog\/wp-content\/uploads\/2019\/08\/Intercom-logo-sq-black-trans.png","width":1000,"height":1000,"caption":"The Intercom Blog"},"image":{"@id":"https:\/\/www.intercom.com\/blog\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/intercominc","https:\/\/x.com\/intercom","https:\/\/www.instagram.com\/intercom\/","https:\/\/www.linkedin.com\/company\/2491343","https:\/\/www.pinterest.ie\/intercom\/","https:\/\/www.youtube.com\/channel\/UCJG0MvLP03kyzzAkD-w98aQ","https:\/\/en.wikipedia.org\/wiki\/Intercom_(company)"]},{"@type":"Person","@id":"https:\/\/www.intercom.com\/blog\/#\/schema\/person\/21a3d124dd33c78c4a8d90f650c12259","name":"Nicholas Sainsbury","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/a53312255781a43b4d2a5fca95adeed3b217db67451b87f79759c29d73d822da?s=96&d=mm&r=pg34d9de771d17f5cb7b4a314ce98bb0b7","url":"https:\/\/secure.gravatar.com\/avatar\/a53312255781a43b4d2a5fca95adeed3b217db67451b87f79759c29d73d822da?s=96&d=mm&r=pg","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/a53312255781a43b4d2a5fca95adeed3b217db67451b87f79759c29d73d822da?s=96&d=mm&r=pg","caption":"Nicholas Sainsbury"},"sameAs":["https:\/\/x.com\/NickLesains"],"url":"https:\/\/www.intercom.com\/blog\/author\/nicklesains\/"}]}},"jetpack_featured_media_url":"https:\/\/www.intercom.com\/blog\/wp-content\/uploads\/2018\/03\/How-to-run-a-successful-beta.jpg","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/www.intercom.com\/blog\/wp-json\/wp\/v2\/posts\/14792","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.intercom.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.intercom.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.intercom.com\/blog\/wp-json\/wp\/v2\/users\/260"}],"replies":[{"embeddable":true,"href":"https:\/\/www.intercom.com\/blog\/wp-json\/wp\/v2\/comments?post=14792"}],"version-history":[{"count":0,"href":"https:\/\/www.intercom.com\/blog\/wp-json\/wp\/v2\/posts\/14792\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.intercom.com\/blog\/wp-json\/wp\/v2\/media\/14826"}],"wp:attachment":[{"href":"https:\/\/www.intercom.com\/blog\/wp-json\/wp\/v2\/media?parent=14792"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.intercom.com\/blog\/wp-json\/wp\/v2\/category?post=14792"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.intercom.com\/blog\/wp-json\/wp\/v2\/tags?post=14792"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/www.intercom.com\/blog\/wp-json\/wp\/v2\/coauthors?post=14792"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}