TF3: "Web surveys and mixed modes in representative samples"

WG1 Research agenda II: Probability based web and mixed mode surveys - how do we minimize non-coverage and non-response. Cost, incentives etc.

Task force leader: Andrea Guðbjörg Jónsdóttir and Knut Kalgraff Skjåk
Task force members: open to all.

Ulf (can not attend Ljubljana meeting)

Aim/Central research questions are:

Administration of mixed modes

Measurement errors associated with different types of data collection methods in surveys.

Explorations and explanations of specific mode effects in different types of web surveys,

Measurement of mode effects in different data collection methods,

Evidence of mode effects when comparing web to other survey methods (a meta-analysis of experimental studies measuring mode effect),

Effects of mixed mode on response rates,

Web surveys and cultural differences: Collection of ideas for future joint research projects/experiments where the same experiments would be performed in different countries. This would add an additional dimension to mode effect studies - the dimension of cultural differences in mode effects.


Organisation/planning:
At the Ljubljana 2012 November meeting we would like to organize a 2 hours working meeting of the WebDataNet experts on mixed-mode to discuss the above issues. Work on a special journal issue on mixed-mode could start. The editor, the collection of ideas for papers and timetable could be set.

Planned outcome:

• A special journal issue on mixed mode / web surveys.
• Joint research projects on mode effects and cultural differences.

This is an extract by Katja Lozar taken from the tentative TF on Web Surveys and cultural differences, now integrated as one of the research lines within the TF Web surveys and mixed modes in representative samples:

We would like to take the advantage of WebDataNet as a large international network to start a discussion on the eventual cultural differences impacting on the success of measures for improving web survey data quality. There is a lot of research and also good results on how different measures (such as incentives, questionnaire design, wording of invitations, timing of reminders etc.) improve data quality in web surveys. However, most of the experimental research on these issues is done within one country/culture/nation only. It is reasonable to expect that certain measures might work differently in different countries/cultures. The WebDataNet members that come from different countries could explore on this issues in several ways:

• Collect evidence on cultural specifics on the measures to improve (Web) survey data quality from their countries.
• Discuss on the possible joint research experiments where the same measures would be used in different countries in order to explore on cultural differences.

Planned outcome: A joint research paper on cultural differences in measures for improving web survey data quality.

Check out this article from the International Journal of Internet Science that is relevant to the topic of this TF: www.ijis.net/ijis2_1/ijis2_1_shih_pre.html

Members of this TF may be interested in the below call for papers.

**********
Dear Colleagues,

The 5th European Survey Research Association (ESRA) conference will take place in Ljubljana, Slovenia from July 15-19, 2013.
www.europeansurveyresearch.org/conference

We are organising a session titled “Is it worth mixing modes? New evidence on costs and survey error on mixed-modes surveys” and we invite you to consider contributing a presentation to the session.

Survey designers face a continuous tension between minimizing survey error and keeping costs low (Groves, 1989). A strategy that has been pursued to reduce costs is the use of mixed modes of data collection, using cheaper modes early in the process, and reserving more efficient and expensive modes to increase response rates and coverage.

A considerable amount of research has tried to assess the impact of using mixed modes of data collection on data quality in terms of response error and measurement error. This body of research typically compares response distributions and response rates across modes but fails to report the effect of the mode design on actual comprehensive costs and on timeliness. However, mixed mode survey implementations may not be as efficient as first thought. With the current technological tools, the costs associated with the production of equivalent questionnaires across modes, equivalent contact forms, equivalent data protocols, and other fieldwork documents might be an underestimated burden. Further to this, findings about the effects on response rates and measurement effects are far from conclusive, and the field is in need of new evidence linking total survey error and survey costs.

In this session we invite studies that address challenges and lessons learned from the implementation of mixed mode designs, with an emphasis on the link between survey error and costs. Papers submitted for this session will ideally include evidence of the effect of the use of mixed-modes on:

- costs, time, and other resources;

- coverage error;

- response rates and/or response bias;

- measurement error.


Please submit an abstract of not more than 250 words via the ESRA website, www.europeansurveyresearch.org/conference/, by January 13, 2013. You will be asked to select an area of survey methodology when you submit the abstract. Please select "Survey mode".

Four papers will be accepted for the 90 minute session. It may be possible to add a second session on the same topic if there is a strong interest. You will be notified in early February 2013 regarding the status of your submission.

Please forward this request for submissions to others who may be interested in this session. Do not hesitate to contact us if you have any queries about the session.

Thank you,

Ana Villar, City University London

Peter Lynn, University of Essex, UK




*************************************
Peter Lynn ( This e-mail address is being protected from spambots. You need JavaScript enabled to view it )
Professor of Survey Methodology (www.iser.essex.ac.uk/people/plynn)

Institute for Social and Economic Research (ISER)
University of Essex, Colchester, UK CO4 3SQ
tel: +44 (0)1206 874809; fax: +44 (0)1206 873151

Dear Lozar Manfreda, being a fresh member of the Action (Ljubliana will be my first meeting) I am not really sure where I could fit in, but from what I read I believe that WG1 or 2 would suit me more and the TF "Web Surveys and cultural differences" may be appropriate to join. So, if it is fine, please consider me as a member of the TF.
Thanking you in advance,

Petroula Mavrikiou

Knut Kalgraff Skjåk prepared the following agenda for the Ljubljana meeting 12 and 13 November 2012.

Agenda for the TF3 "Web surveys and mixed modes in representative samples" meeting
4th Webdatanet MC & WGs meeting, Ljubljana, Nov 13, 13.45-15.30.

1. Round-table presentation of projects.
Important keywords:
-Research questions - for example coverage, sampling, measurement errors, mode effects, response rates, response bias
-Data source(s)
-Research design
-Time schedule
-Planned outcome

2. TF3 project matrix - who is doing what when and eventually with whom

3. Coordinated outcome, publications

4. Overall time schedule 2013 - 2015

5. Action points and reporting up to the Mannheim meeting in March 2013