Comparing panel retention among Ukrainian and other refugees in a German probability-based panel: Evidence from a decomposition analysis

Johannes Schütt DIW Berlin, Germany
Elena Sommer DIW Berlin, Germany


Despite the rise in global refugee migration, probability panels surveying refugees remain rare. The German IAB-BAMF-SOEP Survey of Refugees, conducted annually since 2016, provides valuable panel data for research. In 2023, following Russia’s invasion of Ukraine, a sample of Ukrainian refugees was added, along with a refreshment sample of refugees from other countries. This paper examines household-, individual-, and interview-related determinants of panel retention across these two groups of refugees. As a proof of concept, we apply the Kitagawa-Blinder-Oaxaca decomposition to assess whether it offers analytical insight for comparative panel retention analysis beyond standard group-indicator regression by separating compositional from …


, , , ,

No Comments

Comparing the ‘Most Important Problem’ Measure of Issue Salience and Google Trends: Methodological Lessons from the Field

Julia Weiss GESIS-Leibniz Institute for the Social Sciences, Germany
Barbara Binder GESIS-Leibniz Institute for the Social Sciences, Germany


Survey-based measures such as the ‘most important political problem’ (MIP) question are a central tool for studying public issue salience, but they are costly to field frequently and provide only temporally sparse snapshots. Digital trace data, e.g. Google Trends, are therefore increasingly discussed as a low-cost, high-frequency alternative or complement. However, systematic evidence on how closely search data align with survey-based measures remains limited. This paper presents a methodological comparison of survey-reported issue salience and Google search interest using German Longitudinal Election Study (GLES) surveys and matching Google Trends data from the same field periods. We document a comprehensive procedure …


, , , ,

No Comments

Change of mode, change of bias? An analysis of differences in migrant survey participation following mode changes in the Austrian Social Survey (SSA) and the Austrian segment of the European Social Survey (ESS)

Nikita Kvir Johannes Kepler University of Linz, Austria
Dimitri Prandner Johannes Kepler University of Linz, Austria


Migrants are a diverse and potentially disadvantaged minority group which makes them hard-to-reach and hard-to-survey. As migrant research often relies on general population survey studies, it is important to understand the potential consequences of these surveys shifting from traditional face-to-face to mixed-mode interviews for the composition of migrant samples. By comparing the Austrian segment of the European Social Survey (ESS) and the Social Survey Austria (SSA) to the official Austrian microcensus (MZ) from the years 2016 to 2023, we find that shares of respondents with a migration backgrounds are significantly lower in both social surveys, irrespective of data collection mode. …


, , , , , , ,

No Comments

Editorial – Advancing Comparative Research: Toward a Methodological Framework for Valid Comparative Inference

Heinz Leitgöb Leipzig University, Germany; Goethe University Frankfurt, Germany
Stefanie Kley Hamburg University, Germany
Katharina Meitinger Utrecht University, The Netherlands
Natalja Menold Dresden University of Technology, Germany


This editorial presents ideas for a comprehensive quality framework for survey-based comparative research to improves the validity of comparative inferences. We synthesize insights from causal inference validity, research on bias in cross-cultural measurement, the total survey error perspective, test and measurement theory, and the estimands approach. With a particular emphasis on measurement-related aspects, the editorial reflects the thematic focus of the contributions in this special issue.


No Comments

Should We Worry About Problematic Response Behaviour in Social Media Surveys? Understanding the Impact of Social Group Cues in Recruitment

Zaza Zindel Bielefeld University, Germany


Social media advertising has become a common tool for participant recruitment, especially when targeting hard-to-reach or underrepresented populations. A common strategy to boost engagement is the use of social group cues – textual or visual references to religion, gender identity, or ethnicity. While these cues can enhance recruitment efficiency, their impact on response data quality remains poorly understood. This study investigates how social group cues affect problematic response behaviour in a Facebook-recruited survey on labour market experiences in Germany. Respondents were recruited via four distinct ad conditions: two referencing Muslim identity, and two with neutral framing. Seven indicators were used …


, , , , ,

No Comments

Measurement Invariance and Maximal Reliability: Exploring a Potential Link

Tenko Raykov Michigan State University, USA
Natalja Menold Dresden University of Technology, Germany


A procedure for examining group differences in predictability of latent constructs with social measurement instruments is outlined. The method is developed within the framework of latent variable modeling and is widely applicable with popular software. The approach is based on the notions of maximal reliability and optimal linear combination that have been receiving increased attention over the past several decades. The procedure is readily employed for point and interval estimation of the population discrepancy in construct predictability using the instrument components. The discussed method is related to the study of measurement invariance and is illustrated with numerical data.


, , , , , ,

No Comments

The Relationship Between Measurement Error, Representation Bias, Language, and Country: A Comparative Analysis Using the European Social Survey (Rounds 5 to 7)

Lydia Repke GESIS - Leibniz Institute for the Social Sciences, Germany
Barbara Felderer GESIS - Leibniz Institute for the Social Sciences, Germany


Survey researchers recognize that total survey error consists of multiple components, broadly pertaining to error sources and biases along the measurement process on the one hand and representation on the other hand. However, the relationship between these different error sources remains less well understood. Drawing on 1,452 estimates of measurement error from large-scale MTMM experiments in the European Social Survey, covering 24 countries and 21 languages, we investigate the relationship between measurement error, representation bias, country, and language. Our findings indicate a positive association between measurement error and representation bias. Measurement error is very similar across languages within the same …


, , , ,

No Comments

From Face-to-Face to Push-to-Web: Methodological Lessons from the Transition of the “Social Survey Austria”

Matthias Penker University of Graz, Austria
Anja Eder University of Graz, Austria
Markus Hadler University of Graz, Austria


Numerous national and international survey programs, including general population surveys, have been shifting their mode of data collection from face-to-face to self-completion designs. Push-to-web designs are a particularly promising approach that, however, also introduces methodical challenges. In this paper, we address several of these challenges by providing in-depth empirical analyses of selection and measurement effects from a cross-sectional and longitudinal perspective (time trends across years and survey modes). We use data from the Social Survey Austria (SSA) 2018, 2023 and 2024, including questions from the Austrian implementation of the International Social Survey Programme (ISSP). The survey transitioned from Computer-Assisted Personal …


, , , ,

No Comments

Except where otherwise noted, content on this site is licensed under a Creative Commons Attribution 4.0 International License. Creative Commons License