Showing posts with label Customer satisfaction surveys.. Show all posts
Showing posts with label Customer satisfaction surveys.. Show all posts

Tuesday, April 26, 2016

When the VoC is screaming



When the VoC is screaming

Today I received an on-line satisfaction survey from a company that I use regularly.  They are a well-informed “partner” of ours, in the sense that we use their product on a regular basis, and the quality of our program is in part linked to the quality of their product.  That is exactly the type of company to which I will respond.  

These days, every time you go to a store, every time you go to a hotel, every time you travel, you get another survey request, most of which I have found best to ignore, because responding just leads to more surveys.  So I, like I am sure most of you, limit the number of satisfaction surveys that I complete.  I suspect that many of you go one step further and delete them all.

So I open up the survey and the first page has 3 straightforward single answer demographic type questions designed to get some basic information but nothing that could be construed as personal or invasive.  A good start.  The second and third pages are a little longer, but clear in intend with a request for multiple answers, if appropriate.  This is followed by another 4 pages with single questions only.  

And then we hit page 8 and all of a sudden things change.  Now we have 2 grids, each with 5 rows and 6 columns, with a complex set of instructions.  Further both grids are marked as must be completed in order to proceed.  I look to the top of the page to see how far I am into the survey to make a guesstimate on how much more time I am going to have to commit to the survey, but there is not guide provided. 

And my attitude towards this survey starts to change, in a real hurry.  I have three choices.  I can either quit not bother any longer, or I can continue on, row-by-row, or I can send a message.  

And I decide that this is message time.  So I fill in the two grids by random choice just so that I can get to the next page, of which I ultimately discover there are 5 more, all of which get the same sort of treatment.  

On the second to last page I find a text box, in which I comment, “send out crap surveys, get crap information”.  (I found the text box by ultimately getting to the last page and looking for the “Many thanks.  Please leave any additional comments here” box, which did not exist).  Then I hit the “previous” button to find an available text box.

Maybe they read my comment, probably they will not.  What is more likely is that some analyst looks at the collective compiled data, does a bunch of cross-cuts, creates a report which someone reads (or not) and the world goes on.
 The problem with this is that Quality Managed companies actually do need to be able to get information from their customers in order to find out how if they are meeting their needs and requirements.  It is a Crosbyesque as you can get.  

You can get information in a number of ways, one of which is on-line surveys.  There are a lot of other choices, but if done well and carefully, on-line surveys provide a combination of immediacy and directness and distribution that few other choices can provide.  

So if you are going to send out surveys, the least you should do if create them in a manner that optimizes the opportunity for good information and reduces the opportunity for bad information.  

In previous writings [http://www.medicallaboratoryquality.com/2011/06/satisfaction.html ] , I created a number of recommendations to increase your potential for good information, which include:

a.    Focus them to a single issue
b.    Limit the survey to only a few questions , best is to keep it to 5-6 and NEVER more than 10,
c.     Make the questions as uncomplicated as possible.

d.    Pre-test the questions to reduce (you can never avoid) ambiguity and
e.    Make sure that it can always be completed in 3 minutes or less.
f.      Never require an answer. That is a guaranteed invitation to bogus information.
g.    Decide in advance which slice of your audience you are interested in and then only focus your energy on that group. General send-outs are a total waste of time.

Now, some 5 years later, these still seem to be very useful rules to live by, although I would probably now raise the recommendation to limit the questions to 9-10 and never more than 12, provided that you don’t break the 3 minute rule.

In our programs, we continue to rely heavily on our surveys for information from clients, and course participants, and organization members. 

There is no doubt that when performed properly on-line surveys are extremely useful.  When performed improperly they are not only a waste of time and energy, they result in poor information and potential poor decision making.


Sunday, November 3, 2013

Hearing from the consumer - and getting it WRONG



I received another electronic customer satisfaction survey yesterday.  Perhaps some of you received it as well.  It was from the International Organization for Standardization (ISO).  I suspect I received it because about four months ago (maybe 5!) I purchased a standard from their on-line book store.  The experienced reinforced much that I have come to know and understand about ISO.  

Their survey presented a perfect picture of what happens when polar opposites try to come together; the outcome was not pretty. 
 
ISO is a unique organization.  On the one side it is a formal international body governed by formal rules of protocol and diplomacy.  With regard to bringing countries to the table, they are excellent.  

While some may complain about their propensity to spend a lot of other people’s money by having meetings in very expensive locations (some think ISO stands for International Sightseeing Organization), I understand the pressures they are under to be seen to be geographically fair.  Personally I think the UN model of having one or two identified fixed locations would be significantly more effective, but then again I am not privy to the cost analyses that they must have undergone.  

When it comes to writing documents, ISO has to be sensitive to nuances of language and culture, and at the same time create documents that meet the intent of the committee and all the countries represented that created the intended standard.  This takes a true mastery of editorial skills and talents.

On the other side ISO is an organization that tries to generate revenue from the sale of their documents, and this requires a whole different set of skills and talents.  From what I have seen over the last 20 years, ISO is tragically inept on consumer interest and marketing.  And they never seem to get better.

The survey that they sent me was a perfect case-in-point.   It reminded me of a reference in the bible that refers to four sons, one wise, one wicked, one simple and one who does not know how to ask a question. ISO has a lot in common with that last son.  

 It was clear that the people that wrote they survey had little concept about customer service or customer time.  They certainly have no idea about how to generate an effective customer satisfaction survey.  The questions were obtuse, difficult to mark, and there were far too many.  Worse upon worse, when one got bored with the questions, it was not allowed to pass by hyper-repetitive sections;  every question required an answer, or you could not move on.  

 So the outcome was inevitable; either they will get many people giving up and quitting in the middle, or they will get people who filled in the survey with gibberish.  Either way they lose.  

I wrote on this subject a couple years ago.  [see:  http://www.medicallaboratoryquality.com/2011/06/satisfaction.html ], and it comes up regularly.  I used to think that organizations that send out waste-of-time surveys were just old and clunky.  I no longer think that is the case.  

I suspect these are arrogant behemoths that are so involved in their own value and importance, they are oblivious they waste consumer time and value.  Sad commentary about an organization that hosts COPOLCO, ISO’s Committee on Consumer Policy which it says is responsible for promoting consumer interests in standardization.    From where I am sitting, there is little evidence that ISO remotely cares about their consumers.  And that is a real shame.

In recent experience I can say I get many surveys from companies that have cottoned-on to the better approach; the send out succinct surveys without mandatory answers.  These are companies that understand the things that ISO writes about, continual improvement, quality management, and consumer interest.

With regret this is that is NOT what is happening with ISO itself.  The word dinosaur comes to mind