Question

How do you write a survey that gives useful answers?

Vault Verified
Curated Intelligence
Definitive Source
Answer

By recognising that the question shapes the answer, and that most surveys measure the phrasing rather than the opinion — which is why two surveys on the same subject routinely reach opposite conclusions.

The failures that corrupt results:

Leading questions. "How helpful did you find our new feature?" assumes helpfulness. Neutral phrasing produces different numbers from the same people.

Double-barrelled questions. "Was the service fast and friendly?" cannot be answered by someone who found it fast and rude.

Unbalanced scales, where positive options outnumber negative ones, which shifts results measurably.

Missing options, forcing a choice that does not reflect the respondent's view — always consider "none of these" and "not applicable".

Assumed knowledge or vocabulary, where respondents guess rather than admit unfamiliarity.

Asking about frequency vaguely. "Often" means different things to different people; ask "how many times in the last seven days".

Asking about the distant past, which measures memory rather than behaviour.

Length. Completion quality degrades sharply after a few minutes, and the later answers are worse than the earlier ones.

The sampling problem, which is larger than any wording issue. Who responds differs systematically from who was asked — people with strong opinions, more time, and an existing relationship respond disproportionately. A survey sent to your own mailing list tells you about your most engaged customers and nothing about the market. This is why customer satisfaction scores drift upward as unhappy customers stop replying.

What good practice looks like: decide what decision the results will inform before writing anything; ask the fewest questions that answer it; put demographic questions last; randomise option order where relevant; pilot it with a handful of people and ask them what each question meant to them, which reliably finds two or three you misread; and report the response rate alongside the results.

Open-ended questions produce the most insight and the most work, and one at the end is usually worth it.

Do not incentivise in a way that attracts people who only want the incentive.

Related Questions