I was thumbing through the latest London Time Out magazine… actually not thinking about work for a change and then there it was. An insert to take part in the latest Time Out survey. Red rag and bull are the words that spring to mind.
So I had a nosey and followed the link.
Let’s just say I was someway from being impressed by such a large company. It’s obvious from this survey that there are a number of pitfalls in putting together an online survey, so by critiquing the Time Out survey, perhaps you’ll pick up some tips and ideas and avoid repeating mistakes, attaining poor click-through rates and actually damaging the perception of your product, service and company.
1. Design…. it’s left justified and looks messy, it has a token TimeOut logo in the top right corner but the fonts, margins, buttons don’t match… it looks cheap, naff, poorly thought through and subsequently hinders the professional Time Out brand (pity that).
2. Personal pet hate… the survey starts by trawling for information instead of opinion. The options are two lengthy and it makes the survey feel huge (which it turns out to be.)
3. Questions of frequency… it asks if people are subscribing or frequency of buying Time Out. Now fair play if thats used to group responses so those who don’t subscribe are analysed together… but otherwise, whats the point. Imagine the results…. 28% of people who responded are subscribers. So? Is that good? Does that mean subscribers saw the link in their magazine… and if someone “never” buys Time Out or visits TimeOut.com… how did they find the survey? You can see the flaws in thinking.
4. Scoring/ ranking options. The options are quite leading. By using words (which don’t always correlate or fit together), you have the potential issue of leading your participant. Try and use numeric scoring where possible. It’s just consistent and everyone knows what numbers mean and how to interpret them.
5. Fishing…. the penultimate point of note (and there could be plenty more)… As you look at the questions, you wonder the value of the participant. Which drink do I like? How much do I spend going out, eating out, theatre? Whose benefit is that for? Is that data going to be sold to third parties to build a profile of who I am (the fact iPad’s are being offered as prizes suggests so!) and mean I get hammered with spam? Thats proven late in the survey when asked about when my home insurance is due, what car you drive, household income. You could argue that it’s to build a profile of it’s audience, but all too often there are data selling companies who encourage organisations to survey their customers/ members and then sell the data to external companies. Beware!
6. The final point….. size. The survey is huge. It’s too much. It’s too extensive and many of the questions are pointless and will struggle to generate information of value for Time Out. The survey would have been much better if they had used branching. Give the recipient the option of selecting what is relevant to them. That way the participant is more likely to complete the full survey (beceause it’s relevant) and the survey will be shorter. And the survey results will be more credible. How many people “fly tick” something when a prize or reward is attached? 58 questions and 18 pages (long pages at that)… way too long.
The nutshell (I’ve noticed I say that a lot) is the survey is poor. It doesn’t look good, it doesn’t inspire the participant, it’s lengthy and potentially damages the integrity and perception of a well known organisation from data farming.
Come on TimeOut…. you can do better than this.

