Survey Throttling

Introduction

Soliciting your users with too many surveys within a short time frame is something you might want to avoid. Besides providing a bad user experience, surveying users too often ultimately leads to low response rates and poor data quality.

The same is true for your team. Collecting too many survey responses at once might not be necessary or overwhelm your team.

And sometimes, you just need to a certain number of survey responses, for example if you are running product research surveys and want to get a quick opinion on a new feature.

Our survey throttling options are a great way to control how fast survey responses are collected, while still making sure that you get all the data you need.

Limit number of survey responses

In some scenarios, you want to collect a certain number of survey responses and then stop the survey once this number is reached.

In the Targeting tab in the survey editor, you can enable the option “Limit Responses” and set the number of responses you are aiming for. When enabled, Refiner stops showing your survey once the number is reached.

This option does not limit the speed at which Refiner is showing the surveys and is technically not a “throttling” mechanism. Surveys are shown your users in your Target Audience as fast as possible.

Throttle collection speed per survey

In most scenarios, throttling on a survey level is the only throttling you need.

When enabled, Refiner limits the number of surveys views and collected survey responses in a given time frame for a specific survey.

There are two places where you can activate throttling on a survey level.

The first option is located directly in the survey editor in the “Targeting” tab. This option applies directly to the survey in question and does not affect other surveys in your environment.

In addition, you can also define a global value that applies to all surveys in your environment. You can find the option under SETTINGS > SURVEY SETTINGS.

When both, the global option and the individual survey throttling option, are enabled at the same time, the settings in the survey editor has higher priority and overwrites the global settings.

The following parameters parameters are available for throttling per survey.

  • Time Frame: This parameter defines how far we will look into the past when determining if a survey can be shown or if we wait a little longer
  • Max. survey responses: Determines how many survey responses you want to collect in the given time frame.
  • Max. survey views: Determines after how many survey views in the given time frame we should stop serving surveys.

Throttle survey speed globally

Throttling surveys is not just useful on a “per survey” level. Sometimes you might want to control the speed of data collection globally, taking into account all surveys.

A popular use-case for global throttling is to make sure that your team doesn’t get overwhelmed with too much data and can follow up timely on each response (e.g. feedback received from a NPS survey)

You can enable the global throttling option in the settings of your environment under SETTINGS > SURVEY SETTINGS.

The available parameters for this throttling option are:

  • Time Frame: This parameter defines how far we will look into the past when determining if a survey can be shown or if we wait a little longer
  • Max. survey responses: Determines how many survey responses you want to collect in the given time frame.
  • Max. survey views: Determines after how many survey views in the given time frame we should stop serving surveys.

Throttle collection per user

When you are running multiple surveys in parallel with overlapping target audiences, you might want to throttle survey views and responses on a “per user” level to guarantee a good user experience.

If enabled, the number of survey views and collected responses is limited for each individual user. You can for example decide that a user should never see more than one survey per week, no matter how many survey campaigns are currently activated.

You can activate throttling per user in the global settings of your environment under SETTINGS > SURVEY SETTINGS.

The available parameters for this throttling option are:

  • Time Frame: This parameter defines how far we will look into the past when determining if a survey can be shown or if we wait a little longer
  • Max. survey responses: Determines how many survey responses you want to collect in the given time frame.
  • Max. survey views: Determines after how many survey views in the given time frame we should stop serving surveys.
  • Wait Time between surveys: The minimum amount of minutes that need to pass between two survey views.

Please note that the global and per survey throttling options should be considered as approximate methods. On high traffic websites and apps, it can happen that you’ll see slightly more survey views and responses than indicated in your settings. We recommend to start throttling with lower numbers and work your way up.

Was this helpful? Let us know with a quick a vote