scieee Science in your language
[en] (orig)

Switching a cross-national face-to-face panel survey to alternative data collection modes: Challenges and insights from the Survey of Health, Ageing and Retirement in Europe (SHARE)

Author: Bergmann, Michael
Publisher: Zenodo
DOI: 10.5281/zenodo.17710114
Source: https://zenodo.org/records/17710114/files/2025_06_12_ModeEffects_SHARE.pdf
Swi ching a c oss-na ional ace- o- ace panel su ey o al e na i e
da a collec ion modes: Challenges and insigh s om he Su ey
o Heal h, Ageing and Re i emen in Eu ope (SHARE)
Michael Be gmann
Dublin
June 12 h 2025
1. Impac o mode swi ch (CAPI →CATI) du ing he Co id-19 pandemic
a. pa icipa ion
b. da a quali y ( ep esen a i eness, compa abili y)
c. su ey cos s
2. Lessons lea ned & ou look
a. SHARE Sel -comple ion Ques ionnai e (SCQ)
Con en
Michael Be gmann | 13 June 2025
Pa icipa ion – 1s SHARE Co ona Su ey
Michael Be gmann | 13 June 2025
Indi idual esponse/ e en ion a es (AAPOR, RR4; excl. households wi hou alid elephone numbe s)
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Pa icipa ion – 2nd SHARE Co ona Su ey
Michael Be gmann | 13 June 2025
Indi idual esponse/ e en ion a es (AAPOR, RR4; excl. households wi hou alid elephone numbe s)
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Rep esen a i eness:
Who does/does no espond in a ce ain mode?
Michael Be gmann | 13 June 2025
AMEs o pa icipa ion in SCS1
•A couple o signi ican di e ences in
he p obabili y o pa icipa e in he
elephone su ey (socio-economic
cha ac e is ics, heal h- ela ed ac o s,
di icul ies du ing he in e iew)
•O e all, mode a e di e ences
(mos ly below 5%-poin s)
•Small p opo ion o explained
a iance (R²=5.7%; wi hou coun y
dummies: R²=2.2%)

Rep esen a i eness:
Who does/does no espond in a ce ain mode?
Michael Be gmann | 13 June 2025
AMEs o pa icipa ion in SCS2
•Ve y simila pic u e (age di e ences
a e a bi mo e p onounced)
•O e all, s ill mode a e di e ences
(mos ly below 5%-poin s)
•Small p opo ion o explained
a iance (R²=5.9%; wi hou coun y
dummies: R²=2.3%)
Compa abili y o Da a:
How is a ques ion answe ed in a ce ain mode?
Michael Be gmann | 13 June 2025
Tols up Wes e e al. (2023). Longi udinal changes in men al heal h ollowing he i s COVID-19 lockdown in Eu ope.
h ps://doi.o g/10.1515/9783111135908-008
Mode e ec s o ue changes be ween
Wa e 8 (CAPI) and SCS1 (CATI)?
Compa abili y o Da a:
How is a ques ion answe ed in a ce ain mode?
Michael Be gmann | 13 June 2025
Di e ence be ween
CAPI and CATI
(AMEs in %-poin s)
Wa e 8 CAPI
(2019/20)
SCS1 CATI
(2020)
Wa e 9 CAPI
(2021/22)
Household
income (<750 €) 11.0 11.9 11.6
Household
income (>=4000 €) 12.0 7.7*** 10.7**
Household
income (don’ know & e usal) 16.0 22.3*** 19.4***
Household
income (don’ know) 9.9 6.8*** 11.2**
Household
income ( e usal) 7.3 17.4*** 10.1***
•Unde ep esen a ion o households wi h high income in CATI
•Highe i em non- esponse in CATI, especially o e usals
Da a: SHARE Wa es 8 and 9 (CAPI) and SHARE COVID-19 Su ey 1 (CATI), elease 9.0.0 (n=122,630).
No e: Household incomes a e ppp-adjus ed o allow compa abili y ac oss coun ies. Reg essions include con ols o
di e ences in sample composi ion: age ca ego ies (60-69, 70-79, 80+; e e ence: 50-59), gende , educa ional le el (ISCED
le el 3+4, ISCED le el 5+6; e e ence: ISCED le el 0-2), li ing alone, li ing in an u ban a ea, bo n ab oad, and coun y
dummies. Resul s a e weigh ed; signi icance le el: ***: p<.001, **: p<.01, *: p<.05.
Disclaime : Su ey cos s a e di icul o compa e, bu e en mo e so he e due o he
change/amendmen o con ac s wi h al eady p ocu ed su ey agencies du ing Co id-19!
Su ey Cos s
Michael Be gmann | 13 June 2025
A g. o al cos s pe
in e iew (in €)
Sha e o o al cos s
pe
in e iew (CATI/CAPI)
CAPI Wa e 8
124 €
CAPI Wa e 9
120 €
CATI SCS1
65 € 53%
CATI SCS2
61 € 51%
•A i s sigh CATI seems much cheape han CAPI
•Howe e , i has o be conside ed ha in e iew du a ion was much sho e o CATI han
o CAPI (~20-25min s. 70-80min)
•Huge a ia ion ac oss coun ies (26-77% o CAPI cos s)
No e: Cos s a e pu chasing powe pa i ies (PPP) adjus ed.
Su ey cos s o 22
SHARE-ERIC coun ies
(based on p ocu emen )