Archive for July, 2006

Online Surveys Require Sound Research Practices

Auto Date Monday, July 17th, 2006

In this internet-centric business environment, where online survey software packages are a dime a dozen, some organizations are opting to plan, design, execute, and analyze e-mail-based research keyboard.jpginitiatives in-house. However, unless those organizations have experienced research professionals on staff, many become frustrated during the process and, in the end, are highly disappointed with the results.

Certainly, when your target audience is likely to be online and e-mail addresses are available, an online survey may be a viable alternative to the telephone methodology. In addition to accommodating longer questionnaires, online research enables faster data collection and is less expensive to execute. It can also result in more precise feedback, since participants can see the questions and take time answering them at their own convenience.

But, it’s important to remember that an online survey does not imply “do it yourself” research. Some of the risks associated with conducting online surveys without research experts at your side include:

  • A biased survey. Because the company is highly vested in the success of a product or program, they often inadvertently decide upon questions that they like most, causing misleading, incomplete or inaccurate results.
  • An ineffective questionnaire design. Problems with clarity, specific wording, and survey structure are very common among inexperienced researchers. For example, one company asked customers to identify their top-two most-preferred methods of receiving information from a list of options. But, because of unclear wording, most customers picked more than one option for both their most-preferred and second-most preferred methods.
  • An inaccurate or incomplete analysis. Experienced research professionals are trained in the numerous techniques of statistical analysis. Without this expertise, it’s very unlikely the research report will be completely accurate or reveal the insights that can truly drive measurable improvements. Top analysis mistakes revolve around sample size and misdirected causality.

Of course, organizations face these risks when they attempt any type of market research on their own – not just online surveys. But, most aren’t even tempted to take on hundreds of calls for a phone survey or to recruit and conduct a focus group.

The bottom line is effective research requires specialized expertise – regardless of whether it’s implemented via e-mail, telephone, mail, or face-to-face.

Maximizing Research Response Rates

Auto Date Sunday, July 9th, 2006

An ever-present challenge in market research is maximizing survey response rates. In fact, voicemails, caller id, gatekeepers and spam blockers are so pervasive, that it’s common for the response rate to be less than 10 percent of the study’s sample size. Here are some must-haves for achieving an adequate population of completed surveys.

  • A Quality List: Optimally, the list is 5 to 10 times larger than the reasonable sample size established for the study, is tightly aligned to the target audience, includes names and titles, and has been recently cleaned and updated.
  • Well-Prepared Interviewers: Even highly experienced interviewers must be trained for each and every study. It’s critical they have a solid understanding of the study’s purpose, the content they’re attempting to collect, industry-unique terms and acronyms, and so forth. They should also know how to effectively respond to anticipated questions folks may ask before agreeing to participate, including how their contact information was obtained and for whom the research is being conducted (which can’t be revealed in blind studies).
  • A Persuasive but Brief Intro: What interviewers say in their introduction – and how they say it – is essential to getting the cooperation of potential respondents. They must succinctly convey the purpose of the study and how long the interview is likely to take as well as pose screener questions to ensure the person meets the target audience parameters. At the same time, they must quickly establish a rapport and trust level with the person. Appropriately using the person’s name and referencing their job function helps, as does assuring the person that their identity will remain anonymous in the research reports. (In some cases, interviewers may even need to summarize the research firm’s established anonymity and confidentiality policies and processes.)
  • A Pursuit for Referrals: Interviewers must know how to unobtrusively request replacement names when they are not able to complete an interview with the original contact on the list. This includes asking the original contact if that person doesn’t fit the target audience requirements, or asking the gatekeeper if the original contact is no longer with the organization.

Ask probing questions within each of these areas when you’re evaluating research firms, as their ability to maximize response rates will directly affect the success and cost of your study.