Response Collection Speed

Introduction

Soliciting your users with too many popup surveys within a short time frame is something you might want to avoid. Besides providing a bad user experience, surveying users too often ultimately leads to low response rates and poor data quality.

The same is true for your team. Collecting too many survey responses at once might not be necessary or overwhelm your team. And sometimes, a couple of survey responses might be enough after all.

In short: timing matters when it comes to contextual in-product surveys!

Refiner offers various options that give you full control over how often a survey is shown to your users.

On this page we go through each option and explain how you can use it to guarantee the best survey experience to your users, and your team.

Limit number of responses per survey

Sometimes you might want to collect only a certain number of survey responses and then stop the survey once this number is reached.

In the Targeting tab in the survey editor, you can enable the option “Limit Responses” and set the number of responses you are aiming for. When enabled, Refiner stops showing your survey once the number is reached.

This option does not limit the speed at which Refiner is showing the surveys and is technically not a “throttling” mechanism (see below). Surveys are still shown to users in your Target Audience as fast as possible.

Throttle collection speed

By default, Refiner tries to collect survey responses as fast as possible. You can enable our throttling option and control how fast survey responses should be collected.

Throttling options are available per survey, per user, or per environment level.

Throttle by survey

You have two options to enable survey throttling on a “per survey” level.

  1. You can enable a global option in the settings of your environment, which applies to all surveys as a default value.
  2. You can also set specific throttle settings for each survey individually in the survey editor

When both, the global option and the individual survey throttling option, are enabled at the same time, the settings in the survey editor has higher priority and overwrites the global settings.

Global option

You can also enable survey throttling globally for all surveys in your Refiner environment under SETTINGS > SURVEY SETTINGS.

Activating global throttling comes in handy when you are running multiple survey campaigns in and you want to set a default behaviour for all of them.

When enabled, Refiner limits the number of surveys views and collected survey responses for each survey in your environment.

The following parameters parameters are available for throttling per survey.

  • Time Frame: This parameter defines how far we will look into the past when determining if a survey can be shown or if we wait a little longer
  • Max. survey responses: Determines how many survey responses you want to collect in the given time frame.
  • Max. survey views: Determines after how many survey views in the given time frame we should stop serving surveys.

Individual survey setting

You can enable throttling in the “Targeting” tab of your survey. You can choose how often the survey will be shown and how many survey responses are collected in a given time frame.

If one of the two numbers are reached, the survey will be temporarily paused.

This image has an empty alt attribute; its file name is Screenshot-2022-08-09-at-08.01.33-1024x559.png

The available parameters for this throttling option are:

  • Time Frame: This parameter defines how far we will look into the past when determining if a survey can be shown or if we wait a little longer
  • Max. survey responses: Determines how many survey responses you want to collect in the given time frame.
  • Max. survey views: Determines after how many survey views in the given time frame we should stop serving surveys.

Throttle collection per user

When you are running multiple surveys in parallel with overlapping target audiences, you might want to throttle survey views and responses on a “per user” level to guarantee a good user experience.

If enabled, the number of survey views and collected responses is limited for each individual user. You can for example decide that a user should never see more than one survey per week, no matter how many survey campaigns are currently activated.

You can activate throttling per user in the global settings of your environment under SETTINGS > SURVEY SETTINGS.

The available parameters for this throttling option are:

  • Time Frame: This parameter defines how far we will look into the past when determining if a survey can be shown or if we wait a little longer
  • Max. survey responses: Determines how many survey responses you want to collect in the given time frame.
  • Max. survey views: Determines after how many survey views in the given time frame we should stop serving surveys.
  • Wait Time between surveys: The minimum amount of minutes that need to pass between two survey views.

Throttle survey for entire environment

Throttling surveys is not just useful on a “per survey” level. Sometimes you might want to control the speed of data collection globally, taking into account all surveys.

A popular use-case for global throttling is to make sure that your team doesn’t get overwhelmed with too much data and can follow up timely on each response (e.g. feedback received from a NPS survey)

You can enable the global throttling option in the settings of your environment under SETTINGS > SURVEY SETTINGS.

Disclaimer

Please note that the global and per survey throttling options should be considered as approximate methods. On high traffic websites and apps, it can happen that you’ll see slightly more survey views and responses than indicated in your settings. We recommend to start throttling with lower numbers and work your way up.

Was this helpful? Let us know with a quick a vote