SODA adds a dash of mobile fizz to Confirmit platform

The prize for Confirmit is a dedicated app for online/offline mobile interviews, to integrate with its other web-browser offerings

Not one but two technology acquisitions in the same week: Confirmit, providers of one of the most widely used web interviewing platforms for research agencies, announces it is buying mobile survey specialist Techneos, while Kantar Group acquires panel and technology provider GMI.

Robert Bain covered the GMI acquisition in a blog piece in Research Live. My focus here is on Confirmit and what it plans to do with SODA, Techneos’s flagship software product for both self-completion and interviewer-administered surveys on smartphones and handheld devices.

Confirmit’s chief technology officer Pat Molloy tells me: “The basic plan is the same as with Pulse Train… to bring the functions of Techneos SODA and all the best features into our Confirmit Horizons platform.” Techneos will be rebranded as Confirmit in the New Year, and Confirmit will be adding to Techneos’ development resources in Vancouver to start work on building an integrated platform. Existing SODA users will see development continue on the existing SODA platform in the short term, but eventually it will mean a switch to Confirmit for them.

“We hope we’ll do a good enough job that existing SODA users will want to move over. We are not going to mothball SODA for a considerable time,” says Molloy. “But eventually we will want to roll those customers over at no charge on to the new platform.”

Confirmit has recently added pretty advanced support for mobile research on smartphones into its flagship Horizon software. What it lacked was a dedicated app for mobile that could be run natively on the mobile device – surveys were still delivered via the device’s web browser and required a stable internet connection. Using an app offers many different benefits. I’m presenting a paper at the forthcoming ASC Conference in Bristol on the very subject (and will share the link to the paper after the event). There are pros and cons in each approach, but an app allows for much greater sophistication in survey design.

Techneos has been providing mobile apps before we even understood the term – starting with its interviewer-only Entryware product, originally designed for Palm Pilots. Techneos had appeared to lag behind on mobile self-completion until it brought out SODA at the end of 2008, which was a big leap forward.

Entryware, however, will be left to wither on the vine, on the premise that SODA provides most of its functions. This will be unwelcome news for any Entryware customers that have not yet switched to SODA, as they will be faced with two migrations.

iPads and ZIP codes: a trap for the unwary traveller

Any visitor to the United States gets used to being asked for their ZIP code, or being confronted with forms in which only an American address will fit. Normally there’s a way round it – after all, you don’t really need to be a US citizen to purchase groceries, fill up the tank of your car or register at a hotel.  You would also imagine you don’t need to be an American citizen to indulge in a little cellular data communications from your iPad – but you would be wrong.

I took my UK-bought iPad to the States last year. The folk at Apple UK advised me that none of the carriers had roaming packages in place. Even if they did, it would be much cheaper to buy a mini-SIM for the iPad in the USA from AT&T. At that time, AT&T had the monopoly.

The first stop on my quest was the Apple Store in New York. The orange-shirted dude at this cathedral of aspirant computing apologised that he could not sell me one – the only mini-SIMs they had were installed within the iPads on sale – and sent me down the road to the AT&T store.

As luck would have it, the A&T store had one – their last one. It was $30 plus tax. “Just put it in and then complete the sign-up online”, the assistant directed. “Choose a plan, enter your credit card details and you’re away.”

Being away was the very next problem I hit. Back at my friend’s place, I slipped in the SIM and started the sign-up process. The AT&T logo appeared and the company’s gnomic new strapline “Rethink Possible”. Then familiar US address – street, city, state and ZIP – scrolled into view. With drop-down for country and no check-box for “international”, the form made a 100% assumption that you were an American. Mindful that credit card companies are wont to stop your card if you enter a wilfully incorrect address, it was a case of Rethink Unavoidable.

Back at the AT&T store, after a very long wait, I got to speak to a customer service agent who told me there was no way I could do it unless I had a US address “for security reasons”. He was making it up. It was a large store, so I circled the displays and then approached another counter. This time, the assistant was more biddable and telephoned customer support, and after a very long wait, they advised that I buy a “prepaid credit card”. Such things do exist, I learned. They feature heavily in the twilight world of the uncreditworthy. They don’t sell them at AT&T: they sell them at drugstores. I lost interest – four hours on a fruitless pursuit was enough for one trip.

Now, on my next trip to the US, it was time to have another go. After all, it would be useful to get email and Google maps when on the road. A drugstore sold me a $50 prepaid VISA card for $54 plus tax. This was getting expensive too.

It was time to activate. The address where I was staying seemed to fit, and AT&T sent me a message to say “activation successful”. And then another one immediately to say “authorization failed”. I called AT&T’s 800 number, explained my problem, and got escalated – twice. Yes it was possible, but no-one could understand why it wasn’t working. Multiple ZIP codes were suggested for me to try. We even looked up the ZIP code of the drugstore, to no avail. “Success” it said, then moments later “failed”.

Eventually, in one very long period on hold, I checked the pre-pay card firm’s website to verify my card was still active. It was. I noticed there, you could optionally register your cards with – what else? – a US address. Any US address, it seemed. I entered the address in Phoenix where I was staying, tried again, and it worked. I even passed on this handy hint to the AT&T specialists, who were grateful for the advice. “That’s a new one on us” they said cheerily.

They also admitted they could see no reason why international credit cards could not be used – after all, I paid for the SIM with my UK Visa.  An unintended consequence or deliberate policy? We all blamed the tech team that designed the form. I was surfin’ and I’d broken no rules.

A final tip for the unwary – if you are visiting the USA, don’t buy a rechargeable pre-pay credit card. While that might seem more convenient than the disposable one I got, the registration process asks for something a bit more challenging – a social security number. Making one of those up is likely to get you deported.

Mobile research growing up fast

Hands holding out a collection of mobile phonesGlobalpark, organisers of the 2011 Mobile Research Conference asked me to chair day two of the event. I decided, rather ambitiously, to close the conference with a round-up of all the presentations that day. Here, in prose, is what I verbalised at the end of long day of very interesting presentations.

Don’t be surprised if you don’t recognise many of the names here. It is true to say that the early adopters of this method are not necessarily the usual suspects – there were some familiar firms present – but as the industry as a whole continues to see only problems with mobile research, it was illuminating to hear from those who are not only convinced of the value of mobile research, but are developing expertise, best practice and clients hungry for more.

Though organised by Globalpark, the event was software vendor agnostic, with examples from rival software providers presented too. In a few sentences for each session, here is what came up:

Bruce Hoang (Orange Advertising Network) – presented a multi-country study of mobile media consumption by mobile data users in the UK, France, Spain and Poland – countries with marked differences is adoption and usage. He has concluded that Web-optimised sites are more popular with consumers in mature markets than using apps to access content. “The web browser in the mobile device is the killer app” according to Bruce. He advocates sticking to web browser-based surveys on the mobile as it most closely aligns with respondents’ preferences and experiences.

Guy Rolfe (Kantar Operations) – asserted that Mobile apps for surveys definitely have their place. Kantar find participants are willing to download survey apps, which can enrich their survey experience. In parallel with this, many consumer product manufacturers and retailers are now creating lifestyle apps that capture a lot of useful data which are proving to be very popular with consumers – they don’t have a research purpose at their heart but the data they collect they could be very useful to researchers, if they can get their hands on it.

Jeroen de Rooij (ValueWait) – presented a lifestyle case study that proved it possible to use mobile research to ask 60-question-long surveys, with modest incentives, if you do it with care. The survey also asked respondents to email in pictures after completing the survey, and a very high proportion were willing to go to this effort.

Peter Lynn (University of Essex) – explained that from a social science and statistical perspective, the focus of scientific survey literature has tended to emphasise the negative – seeing mobile samples as a problem. This needs to be questioned. If you take a Total Quality perspective, there are many areas in which mobile samples are no better or worse than others – coverage may be better. There is also a one to one relationship between respondent and phone unlike landlines. Other sources of error are reduced, e.g. people are more willing to answer some kinds of questions, it avoids recall error, being in the moment, and overall, the responses are not otherwise fundamentally different from other modes. It’s strength surely lies in complementing other modes.

Michael Bosnjak (Free University of Bozen-Bolzano) and Sven Scherrer (Globalpark) – took us through some early results of study on how useful voice capture and voice recognition might be in overcoming the Achilles’ Heel of mobile research – capturing lengthy verbatim responses. Low response and high drop-off is often observed in mobile surveys when these questions get asked. The study pitched standard touch-screen entry with voice capture and voice recognition. From the preliminary results presented, voice did not come out well from a respondent perception point of view. Touch screen entry was preferred over voice entry – voice recognition was the least preferred and the spread of responses indicated a divergence of opinions here. Interestingly, respondents seemed to warm to those methods, particularly voice capture, when asked about it 5 days later. The actual effect on the data has not been measured yet – those results are due out soon.

Justin Bailey (The Nielsen Company) and Sean Conry (Techneos) — presented a case study on using BlackBerry Curve devices with a recruited panel of South Africans during the period of the world cup showed the extent to which low response really does not need to be a feature of survey based research. The study was monitoring media and advertising consumption and some brand recognition over the period of the World Cup. Very high response rates were sustained throughout an extended survey. Pictures were collected too, and Nielsen ended with a library of 60,000 submitted pictures. The case study offered a real feel-good moment for mobile research.

Thaddeus Fulford Jones (Locately) – has created a panel of mobile phone users in the US who are willing to allow the firm to capture location data and use this to model actual behavior. You can learn about the extent to which consumers do go to some outlets and often will drive past rivals in order to reach them. Raw location data is used to identify locations such as retailers, leisure destinations and other important consumer touchpoints. It tends to be most powerful when combined with other data to provide context. Location data also reveal useful temporal data – e.g. how long people really have spent in a store or even waiting at the checkout.

Hannu Verkasalo (Zokem) – spoke of  “on-device measurement” or using the mobile phone for passive data gathering. What came out was just how much you can measure passively, free from the response bias of a survey, when using a mobile device, from sites accessed, search terms entered and time spent on different activities to location data – what was accessed at home, at work or on the road. He also revealed  the very different ways that people consume mobile content on mobile devices compared to the web, and again the different profile of apps versus browsers in the content that people access. Hannu’s prognosis is that the mobile app is in the ascendant – which contradicted Bruce Hoang’s earlier analysis.

AJ. Johnson (IPSOS Mori) – chaired a panel session entitled “Debunking the myths of mobile research” and asserted that research needs to treat mobile very differently. People will be engaged, if you approach them via mobile research, but as researchers we have to be very transparent, open and honest with respondents.

Paul Berney (Mobile Marketing Association) – challenged research to take greater interest in mobile research. Mobile is the natural home of the digital native – the under 30’s who have grown up knowing nothing other than the internet and the mobile phone. It’s already changing the way that retailers are working and it fundamentally changes the engagement model for brands. It is a mistake to think that mobile is about the technology – it’s about people. Mobile is a two-way channel and if we don’t go there with our research, then others will.

To round up, a few common themes to emerge across the event that struck me as fresh:

  1. Mobile surveys can be a bit longer than we may have first thought. 8-12 questions is a common-sense length, but examples were presented of 30 and 60 questions, and much longer, when over an extended period. But is trying to push up the limit the start of the same slippery slope that has led to the downfall of online research?
  2. The experience in emerging markets and less mature markets is very different. The penetration of mobile is so high in emerging markets that it far exceeds every other channel except face-to-face – it is the natural equivalent of online research.
  3. In developed economies, there is an assumption that mobile research is a replacement for online. In reality, it seems to supplement it, and it is more of a replacement for telephone, face to face.
  4. Mobile research is not one thing – it’s a multimodal channel in its own right, embracing self completion, interview-administered, quantitative or qualitative, visual, textual, voice and image, or passive, observational, which can be augmented with location or temporal data.
  5. The sphere of mobile research is changing fast and it is continuing to evolve. It is not something that research can afford to ignore.