IT Policies

Beware of carefully engineered, manipulative customer service surveys

Have you ever thought that you have been manipulated into answering survey questions to reflect a predetermined outcome? Be careful how your help desk surveys are worded.

We’ve all filled in customer satisfaction surveys, and I think you’ll agree that they are mostly designed to fit the company’s needs and not to allow the customer to express how they really feel.

--------------------------------------------------------------------------------------------------

I became aware of this some years ago when the help desk I was working on ran a survey to find out what was most important to its customers.

The result was that what the customer wanted most was to have his or her call answered within three rings. Nothing was said about quality, resolution, professionalism, or even talking to a real person. Getting the call picked up was the thing.

I was not surprised when an ACD system followed hot on its heels. The survey was worded so that the desired result was obtained.

Think of the last survey you completed; have you seen anything like this?

“When you last called the Help desk, were you:

1 Pleased

2 Delighted

3 Ecstatic

4 Overcome with joy

5 Speechless with Bliss

If you weren’t totally delighted with the experience, you will have picked the poorest option “Pleased,” and this will appear in the post-survey report that 98% of respondents were pleased with the experience.

When the ACD supplier designed the survey for their product, their thought process probably went something like this:

"How can we make the survey produce the answer that best suits our needs?"

Answer: By creating the environment that forces the respondent to give the answer we want.

I will exaggerate to illustrate the point:

Question 1

When calling the help desk would you prefer:

1. That the call be answered within three rings.

2. That a crazed psychopath hold you down and pull out your fingernails with rusty pliers.

3. That a thousand seal pups be cruelly slaughtered.

I know that is probably not accurate, but you see what I mean. What I’m trying to say is this: if you want to gauge opinions accurately, you need to allow the respondent to give his or her view and not restrict the respondent to a set script of answers.

Worse than this, you will find that some of these surveys will have required fields and that you can’t pass on to the next question until you have ticked one of the boxes, even though none of them apply. Badly designed scripts mean that the data supplied is not a true reflection of the customer’s real feelings or opinions.

Given the weight placed on the results of such work for IT service provision, wouldn’t it be better if such questionnaire information was better?

If you have any horror stories about customer survey work, please let me know.

3 comments
Lee77
Lee77

I am often stumped with the first question 'How pleased were you with how your problem was resolved?' when my problem WASN'T resolved.

steve
steve

Not only customer service surveys are shams, most surveys I am seeing these days on the web will either subtly, or not so subtly, direct you to a desired result. I wonder if they track the number of surveys not taken or started and never completed. I'll often start a survey, then quit when I notice that either they are trying to direct me to a desired result or that I cannot give my true opinion in response to a question or the topic of the survey. If allowed, I'll point the deficiency out, but never get a straight answer back, or, more often, get no answer.

DarkWaterSong
DarkWaterSong

Your points are well founded because not only is hard to offer a non-biased survey, it is hard to get the answers you actually want! My company sends out a simple email form asking customers to rate 5 areas of service on a 1 to 4 scale and has a section for any additional feed back. Once customer send the form back with no numbers, because she though that she would be expressing her displeasure with our support rather than rating it! As for taking one of these things, if the form is not clear or I can not select what I feel I stick to the comments section. If there is not a comments section, I created one.