You can use customer surveys to improve a product or service, measure customer satisfaction, improve customer retention, provide data for business decisions, and more. And while it seems simple, there is an art and science to writing survey questions.

To start, the goal of writing a survey question is for every potential respondent to interpret it in the same way, be able to respond accurately and be willing to answer. To do this you must put yourself in the shoes of those you plan to survey – in this case, your customers. As you create and evaluate your questions you should continually check in and remind yourself, “I am not the one answering this question, my customer is.”

Now, rules and principles for how to do anything, no matter how well-intended, should not be considered absolute. With that bit of warning, I (and several before me) have found the following guiding principles for writing survey questions extremely useful.

 

Principle 1

Choose simple over specialized words.

Do this by finding synonyms that are likely to be understood by more people. For example replace candid with honest, leisure with free time, subnational region with area of the country.

A rule of thumb: when a word exceeds 6 or 7 letters, chances are a shorter and easily understood word can be substituted.

 

Principle 2

Choose as few words as possible to pose the question.

The problem with long questions is the fact that when people read questions they attempt to be efficient, and give uneven attention to each word. So if you don't want important words to get missed, remove the unimportant or redundant ones.

Bad: Were you very satisfied, somewhat satisfied, somewhat dissatisfied, very dissatisfied or did you feel neutral with your online checkout experience?

  • very satisfied
  • somewhat satisfied
  • somewhat dissatisfied
  • very dissatisfied
  • neutral

Good: Which of the following best described how you felt about your online checkout experience?

  • very satisfied
  • somewhat satisfied
  • somewhat dissatisfied
  • very dissatisfied
  • neutral
  •  

Principle 3

Ask questions in complete sentences.

While it’s tempting to meet the goal of minimizing words by using incomplete sentences, don’t. People often provide surprisingly erroneous answers to when you do not use complete sentences to ask questions.

Bad: Number of products purchased _____

Good: How many products did you purchase? ______

 

Principle 4

Avoid vague qualifiers when more precise estimates can be obtained.

Although customers may be able to more easily answer this question:

Bad: How often did you buy a product from our website in the last year?

  • Never
  • Rarely
  • Occasionally
  • Regularly

Enormous variation will exist in what respondents mean by these answers. A better option would be:

Good: How often did you buy a product from our website in the last year?

  • Not at all
  • A few times
  • About once a month
  • Two to three times a month
  • About once a week
  • More than once a week

Principle 5

Avoid specificity that exceeds the respondent’s potential for having an accurate, ready-made answer.

For example, we are asking the person to spend a lot of unnecessary time trying to come up with a calculated answer in the bad version of the question below. We can take away some of that burden by giving them some answer options like in the good version.

Bad: About how many books did you purchase in the last year?_____

Good: About how many books did you purchase in the last year?

  • less than 5
  • 6-10
  • 11-20
  • 21-30
  • 30 or more

start collecting valuable consumer
insight
today. Check out our Express by
campaign creators Customer Feedback
Package for HubSpot.

 

Principle 6

Use equal numbers of positive and negative response options.

This is important to help avoid biasing your customer in one direction or another. People will interpret the middle option as the neutral point, regardless of how you label it.

For example, many customers will incorrectly assume “somewhat satisfied” is the middle of the scale in the bad version of the question below.

Bad: How satisfied or dissatisfied were you with the packaging your product arrived in?

  • Completely satisfied
  • Mostly satisfied
  • Somewhat satisfied
  • Neither satisfied nor dissatisfied
  • Dissatisfied

Whereas, they will correctly assume that “Neither satisfied nor dissatisfied” is the middle of the scale in the good version.

Good: How satisfied or dissatisfied were you with the packaging your product arrived in?

  • Completely satisfied
  • Somewhat satisfied
  • Neither satisfied nor dissatisfied
  • Somewhat dissatisfied
  • Completely dissatisfied

Principle 7

Distinguish undecided from neutral by placing this option at the end of the scale.

That's right, having a neutral opinion is not the same as having no opinion at all.

Good: To what extent do you agree or disagree with this statement “The sales associates at this company were helpful.”

  • Strongly agree
  • Agree
  • Neither agree nor disagree
  • Somewhat agree
  • Strongly disagree
  • No opinion

Principle 8

State both sides of a response scale in the question.

It may seem funny or unnatural to do this but is helps avoid biasing your customer in one direction.

Bad: How satisfied were you with the quality of the product?

Good: How satisfied or dissatisfied were you with the quality of the product?

Principle 9

Develop answer categories that are mutually exclusive.

I see this principle violated all the time when answer choices are a range of numbers. For example, how would I answer the question below if my friend shared a Facebook Ad on social media? 

Which one of these sources did you first learn about our company from?

  • Website
  • Social Media
  • A friend
  • An advertisement

Principle 10

Avoid asking respondents to say yes in order to mean no.

Bad: Do you favor or oppose not allowing companies to add you to email lists without your explicit permission?

  • Yes
  • No

What did you just ask me?!

Good: Do you favor or oppose allowing companies to add you to email lists without your explicit permission?

  • Yes 
  • No

Principle 11

Avoid double-barreled questions.

Essentially don't ask someone two questions in one. For example, how would I answer the bad version below if I was satisfied with my product but not the packaging? In this case you need to ask about the product and packaging separately.

Bad: Were you satisfied with the product and it’s packaging?

Good:

  1. Were you satisfied with the product?
  2. Were you satisfied with the product’s packaging? 

It all comes back to your customer

I hope you find these principles helpful. But remember, question writing is not performed in a vacuum. Remind yourself to evaluate your questions from your customer's perspective, ask others to read your questions and provide feedback. If you need help gathering valuable insight, feedback, and testimonials from your customers, check out our Express by Campaign Creators Customer Feedback Package for HubSpot.

Get Customer Feedback Package Now

Information contained in this blog was derived from: Dillman, D.A. (2007). Mail and Internet Surveys: The Tailored Design Method, 2nd edition.

Originally published February 10, 2017, updated May 21, 2020
Tags: ECommerce Marketing Thrive Online