{"id":26351,"date":"2024-09-30T10:32:47","date_gmt":"2024-09-30T10:32:47","guid":{"rendered":"https:\/\/refiner.io\/docs\/?post_type=knowledgebase&p=26351"},"modified":"2026-03-19T11:02:34","modified_gmt":"2026-03-19T11:02:34","slug":"a-b-testing-for-in-app-surveys","status":"publish","type":"knowledgebase","link":"https:\/\/refiner.io\/docs\/kb\/advanced-options\/a-b-testing-for-in-app-surveys\/","title":{"rendered":"A\/B Testing for In-App Surveys"},"content":{"rendered":"\n\n\n

Introduction<\/h2>\n\n\n\n

A\/B testing is a method to compare two (or more) versions of a survey to see which performs better. For surveys, “better” usually means achieving a higher response rate.<\/p>\n\n\n\n

While Refiner doesn\u2019t yet offer a full A\/B testing suite, you can still set up a simple A\/B test for Web and Mobile App surveys with just a few steps.<\/p>\n\n\n\n

Create a variation<\/h2>\n\n\n\n

Start by duplicating your existing survey. Open the original survey, click on the three-dots menu, and select the duplication option. <\/p>\n\n\n

\n
\"\"<\/figure><\/div>\n\n\n

Name the first survey \u201cVariation A\u201d and the duplicate \u201cVariation B.\u201d The duplicate will be created in draft mode, and it is important to leave it that way until you have finished making your changes.<\/p>\n\n\n\n

Make changes to variation<\/h2>\n\n\n\n

Next, edit the duplicate survey. This is where you introduce the variation you want to test. You might change the wording of a question, add or remove a question, or adjust the design of the survey. <\/p>\n\n\n\n

Keep the changes small and focused so you can clearly identify which adjustment affects the results. If you change too many elements at once, it becomes difficult to know what caused an improvement in response rates. <\/p>\n\n\n\n

The targeting audience and trigger event settings should remain identical to the original survey for now<\/p>\n\n\n\n

Exclude variations from Target Audience<\/h2>\n\n\n\n

When two or more surveys are eligible to be shown to a user, Refiner randomly selects one of them. This randomization is what makes the A\/B test possible. <\/p>\n\n\n\n

However, without some adjustments, a user could see both versions at different times. To prevent this, you need to exclude users who have already seen Variation A from being eligible for Variation B, and exclude users who have seen Variation B from being eligible for Variation A. <\/p>\n\n\n\n

This is done using the \u201cPast Interactions<\/a>\u201d filter, where you activate the option and specify that users who have already seen the other survey should be excluded. Simply activate the option and choose the other survey variation in the “Exclude users that saw a survey” section. Do this for both survey variations.<\/p>\n\n\n

\n
\"\"<\/figure><\/div>\n\n\n

Let the test run<\/h2>\n\n\n\n

Once both variations are ready, publish them. Over time, both surveys will start collecting responses. You can check the user details panel<\/a> to confirm that each user sees only one of the two versions. <\/p>\n\n\n\n

When both variants were shown a couple of hundred times (we recommend at least 1,000 survey views<\/a>), you can start comparing the results by creating an ad-hoc dashboard<\/a> for both of your surveys. If one of your variation has a significantly higher response rate, you can choose them them as a winner of your test.<\/p>\n\n\n

\n
\"\"<\/figure><\/div>","protected":false},"excerpt":{"rendered":"

Introduction A\/B testing is a method to compare two (or more) versions of a survey to see which performs better. For surveys, “better” usually means achieving a higher response rate. While Refiner doesn\u2019t yet offer a full A\/B testing suite, you can still set up a simple A\/B test for Web and Mobile App surveys […]<\/p>\n

Read More…<\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"open","template":"","knowledgebase_tag":[],"class_list":["post-26351","knowledgebase","type-knowledgebase","status-publish","hentry","knowledgebase_cat-advanced-options"],"acf":[],"featured_image_urls_v2":{"full":"","thumbnail":"","medium":"","medium_large":"","large":"","1536x1536":"","2048x2048":"","ab-block-post-grid-landscape":"","ab-block-post-grid-square":"","gb-block-post-grid-landscape":"","gb-block-post-grid-square":""},"post_excerpt_stackable_v2":"

Introduction A\/B testing is a method to compare two (or more) versions of a survey to see which performs better. For surveys, “better” usually means achieving a higher response rate. While Refiner doesn\u2019t yet offer a full A\/B testing suite, you can still set up a simple A\/B test for Web and Mobile App surveys with just a few steps. Create a variation Start by duplicating your existing survey. Open the original survey, click on the three-dots menu, and select the duplication option. Name the first survey \u201cVariation A\u201d and the duplicate \u201cVariation B.\u201d The duplicate will be created in…<\/p>\n","category_list_v2":"","author_info_v2":{"name":"Moritz Dausinger","url":"https:\/\/refiner.io\/docs\/author\/user\/"},"comments_num_v2":"0 comments","yoast_head":"\nA\/B Testing for In-App Surveys<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/refiner.io\/docs\/kb\/advanced-options\/a-b-testing-for-in-app-surveys\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"A\/B Testing for In-App Surveys\" \/>\n<meta property=\"og:description\" content=\"Introduction A\/B testing is a method to compare two (or more) versions of a survey to see which performs better. For surveys, “better” usually means achieving a higher response rate. While Refiner doesn\u2019t yet offer a full A\/B testing suite, you can still set up a simple A\/B test for Web and Mobile App surveys [...]Read More...\" \/>\n<meta property=\"og:url\" content=\"https:\/\/refiner.io\/docs\/kb\/advanced-options\/a-b-testing-for-in-app-surveys\/\" \/>\n<meta property=\"og:site_name\" content=\"Refiner Documentation\" \/>\n<meta property=\"article:modified_time\" content=\"2026-03-19T11:02:34+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/refiner.io\/docs\/wp-content\/uploads\/2024\/09\/Screenshot-2024-09-30-at-12.07.55-1024x445.png\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/refiner.io\/docs\/kb\/advanced-options\/a-b-testing-for-in-app-surveys\/\",\"url\":\"https:\/\/refiner.io\/docs\/kb\/advanced-options\/a-b-testing-for-in-app-surveys\/\",\"name\":\"A\/B Testing for In-App Surveys\",\"isPartOf\":{\"@id\":\"https:\/\/refiner.io\/docs\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/refiner.io\/docs\/kb\/advanced-options\/a-b-testing-for-in-app-surveys\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/refiner.io\/docs\/kb\/advanced-options\/a-b-testing-for-in-app-surveys\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/refiner.io\/docs\/wp-content\/uploads\/2024\/09\/Screenshot-2024-09-30-at-12.07.55-1024x445.png\",\"datePublished\":\"2024-09-30T10:32:47+00:00\",\"dateModified\":\"2026-03-19T11:02:34+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/refiner.io\/docs\/kb\/advanced-options\/a-b-testing-for-in-app-surveys\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/refiner.io\/docs\/kb\/advanced-options\/a-b-testing-for-in-app-surveys\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/refiner.io\/docs\/kb\/advanced-options\/a-b-testing-for-in-app-surveys\/#primaryimage\",\"url\":\"https:\/\/refiner.io\/docs\/wp-content\/uploads\/2024\/09\/Screenshot-2024-09-30-at-12.07.55.png\",\"contentUrl\":\"https:\/\/refiner.io\/docs\/wp-content\/uploads\/2024\/09\/Screenshot-2024-09-30-at-12.07.55.png\",\"width\":1316,\"height\":572},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/refiner.io\/docs\/kb\/advanced-options\/a-b-testing-for-in-app-surveys\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/refiner.io\/docs\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"A\/B Testing for In-App Surveys\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/refiner.io\/docs\/#website\",\"url\":\"https:\/\/refiner.io\/docs\/\",\"name\":\"Refiner Documentation\",\"description\":\"\",\"publisher\":{\"@id\":\"https:\/\/refiner.io\/docs\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/refiner.io\/docs\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/refiner.io\/docs\/#organization\",\"name\":\"Refiner Documentation\",\"url\":\"https:\/\/refiner.io\/docs\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/refiner.io\/docs\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/refiner.io\/docs\/wp-content\/uploads\/2022\/11\/cropped-Group-8.png\",\"contentUrl\":\"https:\/\/refiner.io\/docs\/wp-content\/uploads\/2022\/11\/cropped-Group-8.png\",\"width\":400,\"height\":61,\"caption\":\"Refiner Documentation\"},\"image\":{\"@id\":\"https:\/\/refiner.io\/docs\/#\/schema\/logo\/image\/\"}}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"A\/B Testing for In-App Surveys","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/refiner.io\/docs\/kb\/advanced-options\/a-b-testing-for-in-app-surveys\/","og_locale":"en_US","og_type":"article","og_title":"A\/B Testing for In-App Surveys","og_description":"Introduction A\/B testing is a method to compare two (or more) versions of a survey to see which performs better. For surveys, “better” usually means achieving a higher response rate. While Refiner doesn\u2019t yet offer a full A\/B testing suite, you can still set up a simple A\/B test for Web and Mobile App surveys [...]Read More...","og_url":"https:\/\/refiner.io\/docs\/kb\/advanced-options\/a-b-testing-for-in-app-surveys\/","og_site_name":"Refiner Documentation","article_modified_time":"2026-03-19T11:02:34+00:00","og_image":[{"url":"https:\/\/refiner.io\/docs\/wp-content\/uploads\/2024\/09\/Screenshot-2024-09-30-at-12.07.55-1024x445.png"}],"twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/refiner.io\/docs\/kb\/advanced-options\/a-b-testing-for-in-app-surveys\/","url":"https:\/\/refiner.io\/docs\/kb\/advanced-options\/a-b-testing-for-in-app-surveys\/","name":"A\/B Testing for In-App Surveys","isPartOf":{"@id":"https:\/\/refiner.io\/docs\/#website"},"primaryImageOfPage":{"@id":"https:\/\/refiner.io\/docs\/kb\/advanced-options\/a-b-testing-for-in-app-surveys\/#primaryimage"},"image":{"@id":"https:\/\/refiner.io\/docs\/kb\/advanced-options\/a-b-testing-for-in-app-surveys\/#primaryimage"},"thumbnailUrl":"https:\/\/refiner.io\/docs\/wp-content\/uploads\/2024\/09\/Screenshot-2024-09-30-at-12.07.55-1024x445.png","datePublished":"2024-09-30T10:32:47+00:00","dateModified":"2026-03-19T11:02:34+00:00","breadcrumb":{"@id":"https:\/\/refiner.io\/docs\/kb\/advanced-options\/a-b-testing-for-in-app-surveys\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/refiner.io\/docs\/kb\/advanced-options\/a-b-testing-for-in-app-surveys\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/refiner.io\/docs\/kb\/advanced-options\/a-b-testing-for-in-app-surveys\/#primaryimage","url":"https:\/\/refiner.io\/docs\/wp-content\/uploads\/2024\/09\/Screenshot-2024-09-30-at-12.07.55.png","contentUrl":"https:\/\/refiner.io\/docs\/wp-content\/uploads\/2024\/09\/Screenshot-2024-09-30-at-12.07.55.png","width":1316,"height":572},{"@type":"BreadcrumbList","@id":"https:\/\/refiner.io\/docs\/kb\/advanced-options\/a-b-testing-for-in-app-surveys\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/refiner.io\/docs\/"},{"@type":"ListItem","position":2,"name":"A\/B Testing for In-App Surveys"}]},{"@type":"WebSite","@id":"https:\/\/refiner.io\/docs\/#website","url":"https:\/\/refiner.io\/docs\/","name":"Refiner Documentation","description":"","publisher":{"@id":"https:\/\/refiner.io\/docs\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/refiner.io\/docs\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/refiner.io\/docs\/#organization","name":"Refiner Documentation","url":"https:\/\/refiner.io\/docs\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/refiner.io\/docs\/#\/schema\/logo\/image\/","url":"https:\/\/refiner.io\/docs\/wp-content\/uploads\/2022\/11\/cropped-Group-8.png","contentUrl":"https:\/\/refiner.io\/docs\/wp-content\/uploads\/2022\/11\/cropped-Group-8.png","width":400,"height":61,"caption":"Refiner Documentation"},"image":{"@id":"https:\/\/refiner.io\/docs\/#\/schema\/logo\/image\/"}}]}},"_links":{"self":[{"href":"https:\/\/refiner.io\/docs\/wp-json\/wp\/v2\/knowledgebase\/26351","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/refiner.io\/docs\/wp-json\/wp\/v2\/knowledgebase"}],"about":[{"href":"https:\/\/refiner.io\/docs\/wp-json\/wp\/v2\/types\/knowledgebase"}],"author":[{"embeddable":true,"href":"https:\/\/refiner.io\/docs\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/refiner.io\/docs\/wp-json\/wp\/v2\/comments?post=26351"}],"version-history":[{"count":7,"href":"https:\/\/refiner.io\/docs\/wp-json\/wp\/v2\/knowledgebase\/26351\/revisions"}],"predecessor-version":[{"id":27513,"href":"https:\/\/refiner.io\/docs\/wp-json\/wp\/v2\/knowledgebase\/26351\/revisions\/27513"}],"wp:attachment":[{"href":"https:\/\/refiner.io\/docs\/wp-json\/wp\/v2\/media?parent=26351"}],"wp:term":[{"taxonomy":"knowledgebase_tag","embeddable":true,"href":"https:\/\/refiner.io\/docs\/wp-json\/wp\/v2\/knowledgebase_tag?post=26351"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}