Challenges Conducting Cognitive Interviews in Low and Middle Income Countries: A Case Study with Older Adults in Lebanon

Alexandra Abi Nassif American University of Beirut, Lebanon
Mayssan Kabalan American University of Beirut, Lebanon
Carlos Mendes de Leon Georgetown University of Health, USA
Julie de Jong ICF International, USA
Frederick Conrad * University of Michigan, USA

* Corresponding author
Note: A. Abi Nassif & M. Kabalan contributed equally to this work.


The global increase in population ageing, especially in Low and Middle Income Countries (LMICs), has created greater need for population-based surveys that document the health and social requirements of older adults in this context. The surveys fielded in response to this need ask questions adapted from ongoing surveys in High Income Countries; hence it is important to pretest the adapted questions for interpretability and cultural appropriateness using methods such as cognitive interviewing. The aim of this paper is to highlight challenges in the administration of cognitive interviews in LMICs with older adults, based on our pretest of a new population …


, , , , , ,

No Comments

A myriad of options: Validity and comparability of alternative international education variables

Silke L. Schneider GESIS - Leibniz Institute for the Social Sciences, Germany
Julian Urban GESIS - Leibniz Institute for the Social Sciences & Trier University, Germany


Education is a key variable in survey-based research, impacting various outcomes and serving as a cornerstone in social stratification research. However, measuring education in cross-national surveys is challenging due to the complexity and variability of educational systems across countries. For comparative research, the education variable does not only need to be valid, but also comparable across countries, which implies a similar degree of validity in different countries. Simultaneously, education measures need to be parsimonious, especially for self-administered surveys. This study, expanding on previous research, evaluates the validity and comparability of 16 alternative education coding specifications using nearly 400 dependent variables …


, , , , , , , , , ,

No Comments

The MAUP Effect: Spatial Scale and the Reliability of Segregation Indices

Hinrich Wildfang FOM University of Applied Sciences, Germany


This research note examines the implications of the modifiable areal unit problem (MAUP) for the measurement of ethnic segregation in Hamburg, Germany, utilizing 2011 census data and a simulation-based approach that incorporates 10 distinct spatial operationalizations. The results indicate that spatially adjusted global segregation estimates demonstrate a marked resilience to MAUP, despite the correlations between German and foreign populations exhibiting pronounced volatility, which undermines the reliability and comparability of the findings. Moreover, local segregation measures are found to be acutely sensitive to scale and zoning choices, particularly in areas distinguished by heterogeneous distributions of characteristics. In contrast, regions exhibiting homogeneous …


, , , ,

No Comments

Mitigating Fraud in Incentivized Online Surveys: Lessons from Facebook Recruitment in Nigeria

Arnim Langer KU Leuven, Belgium
Lucas Leopold KU Leuven, Belgium
Bart Meuleman KU Leuven, Belgium & University of Bremen, Germany
Line Kuppens University of Amsterdam, The Netherlands
Abhishegh Menon KU Leuven, Belgium


In this paper we document our experience with conducting the Perceptions of Inequality and Redistribution Survey (PIRS), which is an online, multi-round survey conducted among Nigerian adults who were recruited via a Facebook ad campaign. The paper discusses our initial and unsuccessful recruitment strategy as well as our subsequent revised strategy in which we were able to effectively address the problems and pitfalls which caused our initial recruitment strategy to be unsuccessful. By discussing both strategies in detail, we provide original methodological and practical insights into how best to conduct online surveys with compensation in low- and middle-income countries (LMICs) …


, , , ,

No Comments

Examining Predictors of Unsuccessful Mail Delivery for a National Address-Based Sample During the COVID-19 Pandemic

Raphael Nishimura University of Michigan, USA
Rebecca Gatward - University of Michigan, USA
Brady T. West University of Michigan, USA
Htay-Wah Saw University of Michigan, USA


Many surveys have changed modes because of the COVID-19 pandemic. Surveys using mailed letters and/or reminders may have been adversely affected by staff shortages affecting the delivery times of the United States Postal Service (USPS). In this study, we analysed daily USPS mail delivery reports for each of 21 National Distribution Centers (NDCs) for two specific mailings that were sent to a national probability sample of addresses in 2020. We linked concurrent aggregate rates of COVID-19 infection and mortality to each of the NDCs and examined the variability in cumulative delivery rates across the NDCs as a function of these …


, , , ,

No Comments

Does matching interviewer and respondent gender improve data quality and reduce social desirability bias? Evidence from a mobile phone survey in India

Payal Hathi University of California, Berkeley, USA
Diane Coffey University of Texas at Austin, USA
Amit Thorat Jawaharlal Nehru University, India
Amanda Nagle University of Texas at Austin, USA


Gender matching between interviewers and respondents has been used to improve survey quality. Research on interviewer gender effects from the United States and Europe finds that men respondents are sometimes more likely to report conservative attitudes to men interviewers than women interviewers. This study from a phone survey in India does not find that men report significantly different social attitudes to men and women interviewers. This suggests that in places where conservative and patriarchal social attitudes are widespread and accepted, common phenomena such as social desirability and gender performance may operate differently than in western contexts. We additionally find that …


, , , ,

No Comments

Who chooses a QR code over a URL to access a web screener in a national probability survey of older adults, and the impact on data quality

Andrew L. Hupp University of Michigan, USA
Heather M. Schroeder University of Michigan, USA
Brady T. West University of Michigan, USA
Eva Leissou - University of Michigan, USA
David R. Weir University of Michigan, USA


There has been limited research on the impact of the inclusion of a quick response code (QR) code option on recruitment to a web screening survey, and on data quality when a screening instrument can be either self-administered or interviewer-administered. As part of a screening effort to recruit a new birth cohort to a long-standing panel study, an area probability sample of households was randomly assigned to one of two data collection protocols: web-first with in-person follow-up, or in-person first, with nonresponding cases followed up via the web. Both treatment arm protocols included a mailed letter, either as an invitation …


, , , ,

No Comments

Effects of mode and incentives on response rate, sample composition, and costs – experience from a self-administered mixed-mode survey of movers

Manuela Schmidt University of Bonn, Germany
Alice Barth University of Bonn, Germany
Jörg Blasius - University of Bonn, Germany


Using incentives to reduce unit nonresponse in surveys is an established practice, with prepaid incentives being particularly effective in increasing participation rates. In this paper, we investigate how incentives affect participation rates and sample composition in an offline-recruited mixed-mode survey (concurrent paper/web and push-to-web), using an experimental design. We conducted a survey on residential satisfaction and reasons for moving place, sampling residents who moved away from two urban neighborhoods in Cologne, Germany, between 2018 and 2022. Addresses were provided by Cologne’s Office for Urban Development and Statistics, including information on the residents’ age and gender. Of a random sample of …


, , , ,

No Comments

Except where otherwise noted, content on this site is licensed under a Creative Commons Attribution 4.0 International License. Creative Commons License