Amplitude Research® Article
Survey hosting can mean different things to different people. At one end of the spectrum it can refer to an ASP offering its market research software where users can program and administer their own surveys. At the other end of the spectrum it can refer to a full-service survey solution where the survey company's professional staff programs and administers the research on its own platform. This article describes differences in each approach and discusses some of the key considerations in the selection of a survey hosting vendor.
There is a limited number of survey and market research companies using their own research software to conduct surveys. End user clients of hosted solutions should note that the survey vendor might not be the actual developer of the software and/or could be hosting its surveys on another vendor's platform. Many survey companies license their survey software from a 3rd party vendor specializing in survey engine development and install the software on their own platform. Other companies license the use of hosted solutions on another vendor's platform to circumvent the need for software installation and ongoing hosting. In the case of licensed software, if the software developer does not provide a detailed roadmap of the installation requirements, the survey software alone might not provide an adequate solution. Relevant factors can include: processing power of the hardware; proper selection and configuration of application servers (if needed); database selection and configuration; and the amount of available bandwidth.
In evaluating the best choice of vendor in the survey hosting space, here are five considerations. Some of which are more important than others depending on your specific requirements:
Regardless of whether you select an ASP or a full-service solution, you should identify the requirements needed for your survey projects and determine whether the software can meet those needs. For example, if you expect to use such features as skip logic, branching, piping, percent tables, etc., then you want to select a vendor that offers these features.
Similarly, if you expect a large volume of respondents and/or use questionnaires which are long (such as 15 minutes or longer), make sure that the software has the capacity to handle this with fast page views and error-free data collection.
If you require custom programming of question types or programming logic to meet your survey needs, make sure that the vendor can provide a custom solution. If the survey company is not the developer of the software and does not have its own IT development staff, there might be limitations on the custom features it can offer. Before selecting a vendor, ask for a general cost estimate on the development and deployment of your custom survey solutions.
You will want a vendor that can provide responsive technical support. If you select an ASP model, you may have questions on different stages of the user process. A full-service approach passes the responsibility of deployment and administration onto the vendor.
Just as important as your own technical support is the technical support provided to survey participants. There needs to be a process to promptly respond to their questions, collect and remove incorrect email addresses from the system, and manage unsubscribes. If you adopt an ASP approach that does not provide tech support for participants, be sure to designate several persons at your organization to handle support and make sure they are appropriately trained to answer technical questions.
The field of survey data collection generally requires as close to perfection as possible in every step of the process to produce a reliable data set. One of the most important considerations in deciding whether an ASP approach will best meet your needs is your ability (and availability) to program, administer, and monitor the survey. This can depend on such factors as the complexity of the survey instrument; length of the instrument; number of participants; and time in the field. Your own (or staff members') survey expertise is also important, as is the ease of use of the ASP interface. It is important to carefully examine the processes of each ASP vendor to make certain that you are comfortable choosing it as your solution.
Programming and administration of market research surveys can require special expertise. Screening questions need to be properly programmed to terminate non-qualifying participants and quota stops may be needed to prevent excess completes in particular cells (manual monitoring is possible but it can require constant attention). In addition, panel vendors providing survey sample may require interaction with their own platform. Some will accept recording of IDs for each respondent; while others will require the insertion of redirect links. Make sure that the hosted software correctly interfaces with the sample providers you like to use.
Another important consideration for market research surveys is the ability of the survey hosting platform to provide respondent filtering. This can take many forms at different vendors. At a minimum, you will want to be able to remove the data of respondents who provide incomplete, contradictory, or straight-lined responses. The availability of respondent timers is also a nice feature because it allows you to identify and remove respondents who rushed through the questionnaire. It is also helpful if the platform allows you to record each respondent's ID against his/her responses and use this information to re-sample those respondents, if needed.
In summary, when evaluating the concept of survey hosting, it is important to determine which model - ASP or full-service - will best meet your needs and fully price out each vendor based on your specific requirements. Start with your underlying software needs to determine which solutions meet all or most of your requirements. Consider your programming and administration requirements and decide if you or a member of your staff has the desire, time, and ability to self-administer the survey. A properly administered survey can be a time-consuming process.
Marc I. Tillman is a member of the professional services staff at Amplitude Research, Inc., a full-service online survey company headquartered in Boca Raton, Florida, that builds its own survey engines. Please visit Amplitude's survey hosting page to learn more about its service offerings.
Our blue-chip client list represents all different types of industries and markets including global Fortune 500 companies, government agencies, privately-held organizations, colleges and universities, ad agencies, consulting firms, non-profits, and other research companies.