{"id":20157,"date":"2025-03-18T14:51:15","date_gmt":"2025-03-18T13:51:15","guid":{"rendered":"https:\/\/surveyinsights.org\/?p=20157"},"modified":"2025-03-24T16:11:10","modified_gmt":"2025-03-24T15:11:10","slug":"does-matching-interviewer-and-respondent-gender-improve-data-quality-and-reduce-social-desirability-bias-evidence-from-a-mobile-phone-survey-in-india","status":"publish","type":"post","link":"https:\/\/surveyinsights.org\/?p=20157","title":{"rendered":"Does matching interviewer and respondent gender improve data quality and reduce social desirability bias? Evidence from a mobile phone survey in India"},"content":{"rendered":"<h1><strong>Introduction<\/strong><\/h1>\n<p>The survey methods that produce high quality data in one setting may not have the same consequences in others. In societies with conservative gender norms, survey administrators often match the gender of interviewers and respondents in order to influence survey participation and the quality of responses (Hersh et al 2021). In the United States and Europe, where it is not the default to match interviewer and respondent gender, gender matching has been investigated as an experimental tool to improve participation rates and question-level responses rates, and to reduce social desirability bias (Bittmann 2022; Catania et al 1996; Lipps 2010; West et al 2020).<\/p>\n<p>This paper adds to that literature an investigation of <em>not<\/em> gender matching interviewers and respondents in Rajasthan, India where, due to patriarchal gender norms, it would otherwise be the default. Men respondents were randomly assigned to either a man interviewer or a woman interviewer. In Rajasthan, it would be considered socially unacceptable for men interviewers to ask women respondents for an interview, so we did not test this combination.<\/p>\n<p>We undertook this study because, although it is more difficult to recruit women than men as interviewers in this context, we found that it was easier to retain women than men, so training costs would be lower with an all-women team. Due to the novelty of a woman interviewer requesting an interview with a man in this context, we also expected that women interviewers would produce higher response rates, thereby reducing follow-up costs.<\/p>\n<p>The primary contribution of this study is to assess the benefits of matching women interviewers to men respondents (or the disadvantages of not doing so) in Rajasthan so that they can be considered by other survey administrators designing surveys in similar contexts. It also provides a new way to study the data quality produced by women interviewers as compared to men interviewers in a context where responses collected by men and women would otherwise not be comparable because the gender of the respondents would be different. To our knowledge, this is the first to study gender matching in a phone survey in India.<\/p>\n<p>&nbsp;<\/p>\n<h1><strong>Background<\/strong><\/h1>\n<p><strong><em>Literature Review<\/em><\/strong><\/p>\n<p>Interviewer matching based on gender has been studied most extensively in the United States and Europe, with inconsistent results. West et al. (2020) find that women interviewers in a phone survey in Germany have higher participation rates from both men and women respondents, while Bittmann (2022) finds that, in face-to-face surveys across European countries, matching interviewers and respondents by gender increases item non-response for women but decreases it for men. In phone surveys in the United States, Kane &amp; McCauly (1993) and Huddy et al. (1997) find that men respondents report more egalitarian gender attitudes to women interviewers than to men interviewers. The authors posit that men respondents may try to be more polite to women interviewers than to men interviewers and may try to give responses that conform to more egalitarian gender norms in their interactions with women. In contrast, Catania et al (1996) find that in phone surveys in the United States, question content interacts with the gender of the interviewer. Respondents are more likely to feel comfortable answering sensitive questions to gender-matched interviewers for some questions but not all.<\/p>\n<p>Interviewer gender effects have also been studied, though less extensively, in places with stronger patriarchal norms. For instance, in a face-to-face survey in Morocco, Benstead (2014) finds that men respondents report more egalitarian views to women interviewers than to men interviewers. They also find that men interviewers are less likely to record non-response. The authors posit that the former is likely a manifestation of social desirability bias and the latter may be due to power differences between men and women. Flores-Macias &amp; Lawson (2008) explore interviewer gender effects on questions about public policy in a phone survey in Mexico. They find no effect of interviewer gender on item non-response, but find that men respondents in Mexico City reported more egalitarian attitudes on gender-sensitive questions to women interviewers than to men interviewers. The authors raise the possibility that these effects might arise if women interviewers remind respondents of egalitarian views they already hold. However, they do not rule out differential social desirability bias as an explanation.<\/p>\n<p>&nbsp;<\/p>\n<p><strong><em>Study context<\/em><\/strong><\/p>\n<p>Rajasthan, a state in western India, is arguably a more patriarchal context than the settings of the studies described above: the 2011 Census of India found that there were only 888 girl children aged zero to six for every 1000 boys, resulting from son preference that leads to sex-selective abortion (Hesketh &amp; Xing 2006, Jha et al 2006) and higher mortality among girl children than boy children (Dutta et al 2022, Pennington et al 2003, Sekher &amp; Hatti 2005). India\u2019s 2015 Demographic and Health Survey, called the National Family Health Survey, found that only 57% of adult women in Rajasthan are literate, compared with 85% of men; and that only 29% of women were employed in the year before the survey, compared to 75% of men (IIPS &amp; ICF 2017). In 2022, the National Crime Records Bureau data ranked Rajasthan 4th highest out of 28 Indian states for First Information Reports filed in crimes against women cases.\u00a0Although social scientists urge caution in interpreting these data (Rukmini 2022), in part because they do not capture the full extent of crimes against women (Sharma &amp; Gupta 2024), this is nevertheless consistent with other indicators about gender in Rajasthan.<\/p>\n<p>Although Rajasthan is a highly patriarchal society, people are also aware of government, civil society, and international efforts to improve women\u2019s status and promote equality. For example, in the 1990s, the central government of India implemented high-profile affirmative action policies that reserve seats in political office for women. Many development programs focus on women\u2019s empowerment. Studying interviewer effects in this context may shed new light on the effects of gender matching on data collection efficiency and quality and the workings of social desirability bias.<\/p>\n<p>&nbsp;<\/p>\n<p><strong><em>Experiment and research questions<\/em><\/strong><\/p>\n<p>The experiment analyzed here takes place within the Social Attitudes Research India (SARI) survey, a mobile phone survey that assessed social attitudes and discriminatory behaviors of adults in 2016-17. We randomly assigned men and women interviewers to interview men in a subsample of the larger survey which otherwise matched interviewer and respondent gender. We investigate whether, when interviewing men, women and men interviewers produce different overall response rates, response rates for socially marginalized populations, refusal rates, item nonresponse rates, and sample representativeness. We also investigate whether men give different answers to men and women interviewers on questions related to the status of women.<\/p>\n<p>We hypothesize that, as in previous studies, social desirability norms would result in male respondents reporting more egalitarian attitudes to female interviewers compared to male interviewers. Additionally, we expect that female interviewers will perform better on data collection measures like response and refusal rates compared to male interviewers because of the novelty that sampled men would feel in speaking to a woman on the phone in this context. On other performance metrics, we expect female interviewers to perform worse than male interviewers because of their lack of experience: historically, in this context, women have not had access to employment and generally have less professional and education experience.<\/p>\n<h1><\/h1>\n<h1><strong>Data<\/strong><strong>,<\/strong> <strong>measures<\/strong><strong>, and analysis<\/strong><\/h1>\n<p><strong><em>The Social Attitudes Research, India (SARI) survey<\/em><\/strong><\/p>\n<p>Social Attitudes Research, India (SARI) is a mobile phone survey designed to collect data from adults who live in India and who are between the ages of 18 and 65.\u00a0 Data have been collected in Delhi, Uttar Pradesh, Rajasthan, Mumbai, Maharashtra, Bihar, and Jharkhand. Except for the men who were interviewed by women in the Rajasthan survey, respondents in each of these samples were interviewed by a person of the same gender.<\/p>\n<p>SARI uses random digit dialing to recruit a random sample of households with at least one mobile phone owner. In each place-specific mobile circle in India, the Department of Telecommunications issues a certain number of 5-digit \u201cseries\u201d to each phone company to use as the first 5 digits of the phone numbers they sell to consumers. SARI generates potentially active phone numbers by concatenating the five-digit series (listed in proportion to the number of subscribers to that phone company) with five randomly generated digits to form 10-digit mobile phone numbers. Approximately 50% of phone numbers generated in this way are active, as opposed to not in use, switched off, or out-of-range. Interviewers call these numbers in a random order.<\/p>\n<p>The data analyzed here were collected between August 2016 and May 2017 by eight interviewers. They interviewed 2,738 men in Rajasthan, out of whom 1,143 were interviewed by men and 1,595 were interviewed by women. In Rajasthan, most respondents took the survey in Hindi, however, some respondents took the survey in Marwari or Bagdi.\u00a0 Marwari and Bagdi surveys were administered by the subset of interviewers who are native speakers.<\/p>\n<p>Since individuals from some demographic groups are more likely to respond to the survey than others, we weight our results using statistical weights created from the population data for the state of Rajasthan provided in the 2011 India Census. Weights account for the intersection of sex, place (urban\/rural), education, and age. For a more complete description of SARI\u2019s methodology see Hathi et al (2020).<\/p>\n<p>We present the results about social attitudes using non-response weights because we are evaluating response bias and want to account for respondent composition differences. Our analyses of survey process measures and sample demographic composition do not use non-response weights because we are evaluating the differences in the respondent pool that interviewers are able to achieve. We note that results about social attitudes that do not use weights are very similar.<\/p>\n<p>Analyses were conducted using Stata, version 15.0 and R 4.4.1.<\/p>\n<p>&nbsp;<\/p>\n<p><strong><em>Experimental Condition<\/em><\/strong><\/p>\n<p>Phone numbers were randomly assigned to men or women interviewers. Women interviewers alternated the weeks in which they were assigned to interview men and women. Since this was a random digit dial survey, interviewing a man or a woman was achieved by conducting a within-household random selection of a particular respondent by gender. At the beginning of the call, the interviewer asks the person who answers the phone to list all of the men or women in the household, depending on the sex of the respondent who he\/she is supposed to interview.\u00a0 Survey respondents are selected randomly from the household listing by Qualtrics software. Within-household respondent selection ensures that even individuals who do not own their own mobile phones have a chance to be interviewed.<\/p>\n<p>&nbsp;<\/p>\n<p><em><strong>Data quality measures<\/strong> <\/em><\/p>\n<p>We compare the following measures of data quality for the respondents interviewed by women and the respondents interviewed by men:<\/p>\n<p><strong>Response rate<\/strong>. We calculate the response rate following AAPOR Response Rate 2 (AAPOR, 2023). This is the number of surveys in which the respondent answers at least a third of the questions, divided by the number of mobile numbers that are valid when the interviewer first calls them. The interviewer level response rates are compared using <em>t<\/em>-tests with Welch\u2019s approximation for differences in means. The sample size for these tests is eight as interviewers are the unit of analysis. As robustness tests, we also use permutation tests to compare mean rates between men and women interviewers. Permutation tests do not make assumptions about the distributions of response rates (i.e. normality).<\/p>\n<p><strong>Refusal rate<\/strong>. Cases when the person who answers the phone declines to participate on behalf of the household, or when a respondent is selected from among appropriate-gender household members, but that person refuses to participate, are in the numerator of the refusal rate. The denominator is the number of phone numbers that are valid on the first call attempt. Interviewer-level refusal rates are compared using <em>t<\/em>-tests for differences in means with Welch\u2019s approximation. The sample size for these tests is eight because the interviewer is the unit of analysis. We again use permutation tests to compare the mean rates between the men and women interviewers.<\/p>\n<p>We note that the refusal rate does not equal one minus the response rate for two reasons. First, some interviews are completed after \u201crefusal conversion.\u201d Refusal conversion is when, about a month after someone refuses household member listing, a different interviewer (of the same gender as the first interviewer) calls back to explain the survey to whomever answers the phone and to try again to complete household member listing and select a respondent of the originally assigned gender. These interviews are included in the numerators of both the response rate and the refusal rate. Second, an interview would be counted in the numerators of both the response rate and the refusal rate if the respondent completed more than one third of the survey and then refused.<\/p>\n<p><strong>Item nonresponse rate. <\/strong>For each respondent, we count the total number of missing responses across the nine questions that had the most overall item nonresponse in the survey<a href=\"#_ftn1\" name=\"_ftnref1\"><sup>[1]<\/sup><\/a>. We assess differences in total item nonresponse across these questions by interviewer gender. Interviewers are trained to ask a question twice if a respondent does not initially understand, and to create an environment in which respondents feel comfortable answering frankly.<\/p>\n<p>To test for differences in item nonresponse by interviewer gender, we conduct a multilevel poisson regression on the count of nonresponse across nine questions, with interviewer gender as a second level predictor variable, to assess whether men and women interviewers differ in the volume of nonresponse.<\/p>\n<p>As a robustness check, we run a series of multilevel logistic regressions with a binary outcome of nonresponse for each individual question. We include interviewer gender as a second level predictor variable to account for respondents being clustered within interviewers.<\/p>\n<p><strong>Age heaping rate<\/strong>. Age heaping occurs when respondents report their ages as a round number ending in a \u201c5\u201d or \u201c0.\u201d It is a common problem in surveys in low- and middle-income countries where people do not always know their dates of birth. Interviewers with lower rates of heaping probe respondents in ways that help them record exact ages, rather than accepting approximations. While some respondents do in fact have an age that is a round number, a statistically significant difference in the percent of round ages collected by men and women interviewers demonstrates a difference in data quality. We conduct a <em>t<\/em>-test with Welch\u2019s approximation to compare the percent of age-heaped responses between men and women interviewers. As a robustness check, we conduct multilevel logistic regression using age heaping as the outcome variable and the gender of the interviewer as a level two predictor to account for respondents being clustered within interviewers.<\/p>\n<p><strong>Representativeness &#8211; age and education distributions<\/strong>. We compare the distribution of age and education among respondents in the SARI samples recruited by men and women interviewers to the Census 2011 data for the state of Rajasthan. This allows us to assess whether men and women interviewers recruit participants with different ages or education levels, on average. This is useful to know because, across Indian states, older respondents and less educated respondents have been more difficult for SARI interviewers to recruit. To test for differences in sample representativeness in the respondent samples gathered by men and women interviewers, we use Kolmogorov-Smirnov tests for the equality of distributions.<\/p>\n<p><strong>Representativeness &#8211; marginalized groups<\/strong>. Across the places that the SARI survey was conducted, Dalit and Muslim participants tended to be more difficult to recruit than higher-caste and Hindu participants. Dalits belong to the most oppressed castes in Indian society and have traditionally been expected to perform the most menial and degrading work, such as cleaning feces and garbage. They have faced widespread discrimination based on their association with these jobs (Desai et al 2010, NCRB 2022, Thorat &amp; Neuman 2012, Thorat &amp; Joshi 2020). Muslims are a religious minority in India who often face discrimination and, sometimes, violence (Maizland 2024).\u00a0 Because of their marginalized group identities, we believe that Muslims and Dalits may be more suspicious of the interviewers and the purpose of the study.<\/p>\n<p>SARI asked respondents about caste group and religious affiliation in separate questions. Interviewers who make sample members feel comfortable and safe answering the survey are better able to recruit respondents from these marginalized groups. Gathering more responses from Dalit and Muslim sample members also increases precision around estimates improves sample representativeness.<\/p>\n<p>We calculate the percent of respondents that are Dalit and Muslim for each interviewer. We conduct t-tests with Welch\u2019s approximation and permutation tests to compare the average percent of Dalit and Muslim respondents between men and women interviewers.<\/p>\n<p>&nbsp;<\/p>\n<p><strong><em>Socially Desirable Responses<\/em><\/strong><\/p>\n<p>We also investigated whether women interviewers collected more socially desirable (less gender conservative) responses from men respondents than men interviewers. Table 1 details the social attitudes questions that were asked to men respondents; conservative responses are bolded.<\/p>\n<p>To provide context on the cultural practices that the second question references: \u201cGhunghat or pallu\u201d is when a woman places the end of her sari over her head or head and face in order to show deference and modesty in front of men. \u201cPardah\u201d is when a woman rarely leaves the house and covers herself when she does leave.\u00a0 Practicing \u201cburkha\u201d is when a woman wears a loose-fitting dark cloth over her head and body, or head, face, and body when outside the home. Following the India Human Development Survey (Desai, Vanneman, &amp; NCAER 2005 &amp; 2012), we ask Hindu respondents about \u201cghunghat or pallu\u201d and Muslim respondents about \u201cpardah or burkha.\u201d<\/p>\n<p>We test for differences in conservative responses on gender equality items reported to men and women interviewers. First, we calculate the proportion of conservative responses to each gender item for each interviewer. Then we use <em>t<\/em>-tests with Welch\u2019s approximation to compare the mean conservative proportion for women interviewers and men interviewers. As a robustness check, we conduct multilevel logistic regression using a binary response to questions on gender equality (conservative response or not conservative response) as the outcome variable and the gender of the interviewer as a level two predictor to account for respondents being clustered within interviewers.<\/p>\n<p><em>Table 1.\u00a0 Social attitudes questions, response options, and sample sizes<\/em><\/p>\n<p><a href=\"https:\/\/surveyinsights.org\/wp-content\/uploads\/2024\/09\/Table_1-1.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-20626\" src=\"https:\/\/surveyinsights.org\/wp-content\/uploads\/2024\/09\/Table_1-1.png\" alt=\"\" width=\"550\" height=\"371\" srcset=\"https:\/\/surveyinsights.org\/wp-content\/uploads\/2024\/09\/Table_1-1.png 972w, https:\/\/surveyinsights.org\/wp-content\/uploads\/2024\/09\/Table_1-1-300x202.png 300w, https:\/\/surveyinsights.org\/wp-content\/uploads\/2024\/09\/Table_1-1-768x518.png 768w\" sizes=\"auto, (max-width: 550px) 100vw, 550px\" \/><\/a><br \/>\n<em>Notes: <\/em><sup>a<\/sup> Conservative responses are highlighted in bold.\u00a0 <sup>b<\/sup> This question is only asked to married respondents.\u00a0 Hindus were asked about practicing \u201cghughat or pallu\u201d and Muslims were asked about practicing \u201cpardah or burkha.\u201d<\/p>\n<p>&nbsp;<\/p>\n<p><strong><em>Limitations of the analysis<\/em><\/strong><\/p>\n<p>We note three main limitations of this analysis. First, our study includes a small sample size of eight interviewers. In assessing differences in survey outcomes between men and women interviewers using statistical tests, the small number of interviewers complicates statistical inference. Although this should be considered when assessing results, we provide additional analyses as robustness checks to verify our findings.<\/p>\n<p>Second, we do not have detailed personal information about each interviewer, such as their age or level of education. Knowing these details would allow us to assess with greater certainty whether differences in interviewer outcomes were due to the gender of the interviewer, other salient personal characteristics, or interviewer skill. Accessing this employee data as researchers is not common but could be implemented in future studies.<\/p>\n<p>Third, this experiment included only men respondents. Ideally, to fully understand interviewer effects, we would have been able to compare interviewer outcomes with women respondents also. However, it was not culturally appropriate to ask women to respond to questions posed by a man interviewer.<\/p>\n<h1><\/h1>\n<h1><strong>Results<\/strong><\/h1>\n<p><strong><em>Data quality outcomes<\/em><\/strong><\/p>\n<p><strong>Response and refusal rates<\/strong>.\u00a0 Figure 1 shows unweighted response rates on the left and refusal rates on the right for men and women interviewers. Each point represents an individual interviewer, with women interviewers in pink and men interviewers in blue.<\/p>\n<p><em>Figure 1. Response rates (left) and refusal rates (right) for four women interviewers interviewing men compared with four men interviewers interviewing men<\/em><\/p>\n<p><strong><a href=\"https:\/\/surveyinsights.org\/wp-content\/uploads\/2024\/09\/Figure_1-1.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-20628\" src=\"https:\/\/surveyinsights.org\/wp-content\/uploads\/2024\/09\/Figure_1-1-843x1024.png\" alt=\"\" width=\"350\" height=\"425\" srcset=\"https:\/\/surveyinsights.org\/wp-content\/uploads\/2024\/09\/Figure_1-1-843x1024.png 843w, https:\/\/surveyinsights.org\/wp-content\/uploads\/2024\/09\/Figure_1-1-247x300.png 247w, https:\/\/surveyinsights.org\/wp-content\/uploads\/2024\/09\/Figure_1-1-768x932.png 768w, https:\/\/surveyinsights.org\/wp-content\/uploads\/2024\/09\/Figure_1-1.png 972w\" sizes=\"auto, (max-width: 350px) 100vw, 350px\" \/><\/a>\u00a0<\/strong><strong>\u00a0<\/strong><\/p>\n<p>Response rates are statistically significantly higher for women interviewers interviewing men than for men interviewers interviewing men (44.4% vs. 37.0%, n=8, ; difference in response rate: 7.4 percentage points, 95% CI: (4.4pp, 10.4pp); Welch\u2019s t-test <em>p<\/em>&lt;0.05, permutation test <em>p<\/em>&lt;0.05).\u00a0 Refusal rates are lower for women interviewers than men interviewers, but the difference is not statistically significant (8.9% vs. 22.7%, n=8; difference in refusal rate: -13.8 percentage points, 95% CI (-35.9pp, 8.3pp), Welch\u2019s t-test <em>p<\/em>=0.15, permutation test <em>p<\/em>=0.05). To put these response and refusal rates in context, a study of the Pew Research Center\u2019s 2012 phone surveys in the US found an average response rate of 9% (Kohut et al., 2012). Thus, response rates for SARI are quite high.\u00a0 Although most recent assessments of phone survey participation no longer report refusal rates, we note that Groves &amp; Fultz\u2019s 1985 research on economic attitudes found refusal rates from a landline phone survey of 22% for men interviewers and 17% for women interviewers.<\/p>\n<p><strong>Item nonresponse.<\/strong> The proportion of item nonresponse for the nine sensitive questions with the most overall item nonresponse in the survey ranged from 2.1% to 6.1%. Results from a multilevel poisson regression assessing whether men and women interviewers differ in <em>how many<\/em> nonresponses they get across these nine questions show that although men interviewers have more item nonresponse than women interviewers, there is no statistically significant difference (incidence rate ratio = 1.9, 95% CI: (0.7, 5.0), <em>p<\/em>=0.20. Multilevel logistic regression results for individual questions show that with the exception of the question of whether a man\u2019s spouse practiced ghungat\/pallu or pardah\/burkha (OR = 2.1, 95% CI: (1.0, 4.2), <em>p<\/em>&lt;0.05), having been interviewed by a man rather than a woman does not predict item non-response.<\/p>\n<p><strong>Age heaping rate.<\/strong> In analysis of the unweighted age data, we find that men interviewers received an average of 38.3% age-heaped responses, while women interviewers received an average of 39.2% age heaped responses. The difference between these rates is not statistically significant (difference in percent of age heaped responses: 0.9 percentage points, n=8; 95% CI (-11.5pp, 12.9 pp), Welch\u2019s <em>t<\/em>-test <em>p<\/em>=0.84). Results from a multilevel logistic model of age heaping on interviewer gender confirm that there is no statistically significant difference in age heaping (OR = 0.9, 95% CI (0.7, 1.3), <em>p<\/em>=0.59).<\/p>\n<p><strong>Representativeness &#8211; age and education distributions.<\/strong> Next, we compare the demographics of men respondents recruited by women interviewers to those recruited by men interviewers, starting with age and education. Using unweighted cumulative distribution functions, the two panels in Figure 2 compare whether the age (top) and education (bottom) samples collected by men and women interviewers are coming from different distributions.\u00a0 The distributions are quite closely overlapping across all ages, suggesting that the two samples do in fact come from the same age distribution.\u00a0 Similarly, there is close overlap between the samples in the education distribution. For both age and education distributions, we also perform Kolmogorov-Smirnov tests to check the equality of the two distributions.\u00a0 We find no evidence that the cumulative distribution functions of age and education differ by the gender of the interviewer: the KS test does not result in rejecting the null hypothesis that the two samples of age (n=8, <em>p<\/em>=0.52) and educational attainments (n=8, <em>p<\/em>=1.00) come from the same distribution.<\/p>\n<p><em>Figure 2. Cumulative Distribution Functions for age (top) and education (bottom)<\/em><\/p>\n<p><a href=\"https:\/\/surveyinsights.org\/wp-content\/uploads\/2024\/09\/Figure_2.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-20630\" src=\"https:\/\/surveyinsights.org\/wp-content\/uploads\/2024\/09\/Figure_2-677x1024.png\" alt=\"\" width=\"400\" height=\"605\" srcset=\"https:\/\/surveyinsights.org\/wp-content\/uploads\/2024\/09\/Figure_2-677x1024.png 677w, https:\/\/surveyinsights.org\/wp-content\/uploads\/2024\/09\/Figure_2-198x300.png 198w, https:\/\/surveyinsights.org\/wp-content\/uploads\/2024\/09\/Figure_2-768x1162.png 768w, https:\/\/surveyinsights.org\/wp-content\/uploads\/2024\/09\/Figure_2.png 804w\" sizes=\"auto, (max-width: 400px) 100vw, 400px\" \/><\/a><\/p>\n<p><em>Note:<\/em> We use a Kolmogorov-Smirnov test to test the equality of the two distributions for age and for education.\u00a0 For both variables, the KS test does not allow us to reject the null hypothesis that the two samples of ages come from the same distribution.<\/p>\n<p>&nbsp;<\/p>\n<p><strong>Representativeness &#8211; hard-to-reach groups<\/strong>. Figure 3 shows that, on average, women interviewers conducted a higher proportion of their interviews with Muslim men than men interviewers did (11.0% vs. 8.1%, n=8; difference in reaching Muslim respondents: 2.9 percentage points, 95% CI:(1.0pp, 4.9pp); Welch\u2019s <em>t<\/em>-test <em>p<\/em>&lt;0.05, permutation test <em>p<\/em>&lt;0.05). Women conducted an average of 15.5% interviews with Dalit men, compared to an average of 19.5% for men interviewers, but this difference is not statistically significant (n=8; difference in reaching Dalit respondents: -4.0 percentage points 95% CI:(-10.4pp, 2.6pp), Welch\u2019s <em>t<\/em>-test <em>p<\/em>=0.20, permutation test <em>p<\/em>=0.17).<\/p>\n<p><em>Figure 3. Fraction of respondents that were Dalit and Muslim:\u00a0 four men versus four women interviewers<\/em><\/p>\n<p><em> <a href=\"https:\/\/surveyinsights.org\/wp-content\/uploads\/2024\/09\/Figure_3.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-20631\" src=\"https:\/\/surveyinsights.org\/wp-content\/uploads\/2024\/09\/Figure_3-833x1024.png\" alt=\"\" width=\"350\" height=\"430\" srcset=\"https:\/\/surveyinsights.org\/wp-content\/uploads\/2024\/09\/Figure_3-833x1024.png 833w, https:\/\/surveyinsights.org\/wp-content\/uploads\/2024\/09\/Figure_3-244x300.png 244w, https:\/\/surveyinsights.org\/wp-content\/uploads\/2024\/09\/Figure_3-768x944.png 768w, https:\/\/surveyinsights.org\/wp-content\/uploads\/2024\/09\/Figure_3.png 944w\" sizes=\"auto, (max-width: 350px) 100vw, 350px\" \/><\/a><\/em><\/p>\n<p>&nbsp;<\/p>\n<p><strong><em>Response Quality Outcome<\/em>s<\/strong><em><strong>\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0<\/strong> <\/em><\/p>\n<p><strong>Outcomes related to social desirability<\/strong>. Figure 4 shows the proportions of conservative responses to men versus women interviewers on questions related to the status of women. Reported attitudes are similar across the two groups: with the exception of support for affirmative action for women, men and women interviewers did not get significantly different responses. For example, 45.6% of respondents told men interviewers that the women in their household eat last, compared to 46.7% of respondents who were asked the same question by women interviewers. For the item on support for affirmative action, men interviewers received conservative responses to the question 16.5% of the time and woman interviewers received conservative responses 8.7% percent of the time (n=8; difference in conservative response to support for affirmative action: -7.8 percentage points, 95% CI: (-14.9pp, -0.6pp),\u00a0 Welch\u2019s <em>t<\/em>-test\u00a0 <em>p<\/em>&lt;0.05). Results from multilevel logistic regressions of each attitude on interviewer gender confirm that men and women interviewers only get statistically significantly different responses for reported attitudes about support for affirmative action for women.\u00a0 For that regression, the odds ratio on being reporting a conservative response when being interviewed by a man was 1.8 (95% CI: (1.3, 2.5), <em>p<\/em>&lt;0.05).<\/p>\n<p><em>Figure 4. The interviewer-level proportion of men who report conservative gender attitudes on four questions<\/em><\/p>\n<p><a href=\"https:\/\/surveyinsights.org\/wp-content\/uploads\/2024\/09\/Figure_4.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-20632\" src=\"https:\/\/surveyinsights.org\/wp-content\/uploads\/2024\/09\/Figure_4-1024x577.png\" alt=\"\" width=\"650\" height=\"367\" srcset=\"https:\/\/surveyinsights.org\/wp-content\/uploads\/2024\/09\/Figure_4-1024x577.png 1024w, https:\/\/surveyinsights.org\/wp-content\/uploads\/2024\/09\/Figure_4-300x169.png 300w, https:\/\/surveyinsights.org\/wp-content\/uploads\/2024\/09\/Figure_4-768x433.png 768w, https:\/\/surveyinsights.org\/wp-content\/uploads\/2024\/09\/Figure_4.png 1362w\" sizes=\"auto, (max-width: 650px) 100vw, 650px\" \/><\/a><\/p>\n<h1><\/h1>\n<h1><strong>Discussion<\/strong><\/h1>\n<p>The goal of this study is to understand the consequences of not gender matching interviewers to respondents in a patriarchal context in which interviewer gender matching is the norm. Overall, we find that when interviewing men respondents, women interviewers have higher response rates than men interviewers, and are better able to reach some minority populations. On all other measures including rates of refusal, item non-response, accuracy of age and education distributions, and age heaping, we find no statistically significant differences between men and women interviewers. Additionally, we find similar reported attitudes by men respondents to both women and men interviewers on questions about the status of women.<\/p>\n<p>Why might women interviewers have more success on some indicators of data collection quality, like higher response rates and achieving greater survey cooperation from minority populations? This may be due to the way men respondents react to women interviewers, or it may be due to higher skill among women interviewers. One limitation of this study is that we cannot separate these two possibilities definitively.\u00a0 However, in a context in which women interviewers are likely to have less survey-relevant work experience compared to their men counterparts, and where there are limited men-women interactions outside of one\u2019s own family, the more likely explanation may be that men may be more interested in talking to a woman on the phone than in talking to a man.<\/p>\n<p>In contrast to some prior research which found that men tend to report more egalitarian and less conservative attitudes to women interviewers, we found that to be true for only one of the four questions we analyzed.\u00a0 Further, the difference was small.\u00a0 We posit that this context, where gender discrimination is severe and conservative social attitudes towards women are highly prevalent, it may not be seen as socially desirable to report egalitarian attitudes and behaviors, and therefore men do not change their answers to conform to what may be more palatable for women interviewers to hear.\u00a0 Johnson &amp; van de Vijver (2003) suggest that social desirability is most important for issues that are contested within a given context.\u00a0 If women\u2019s lower social status is relatively uncontested, men may not be conscious of their privilege and women\u2019s relative lack of privilege, negating the need to change one\u2019s reported beliefs based on the position or characteristics of the interviewer.\u00a0 Men may report their attitudes without worrying about political correctness in a society where women\u2019s lower status is generally accepted.<\/p>\n<p>We conclude that there were no appreciable benefits of gender matching in this context, and that future survey rounds would be justified in hiring all-women survey teams. Women interviewers are a must for interviewing women and are able to achieve as high or higher quality results with men respondents as men interviewers.\u00a0 Other survey administrators may find these results useful when fielding surveys in gender-conservative settings.<\/p>\n<p><strong>\u00a0<\/strong><\/p>\n<p><strong>\u00a0<\/strong><\/p>\n<p>&nbsp;<\/p>\n<p><strong>\u00a0<\/strong><\/p>\n<p><strong>Endnote<\/strong><strong><br \/>\n<\/strong><\/p>\n<p><a href=\"#_ftnref1\" name=\"_ftn1\"><\/a>[1] These questions are: (1) In your opinion, is your family poor, labor class, middle-class or comfortable? (2) In your opinion, should there be a law stopping high caste and low caste people from marrying each other? (3) In your opinion, do you support or oppose with having reservations based on caste? (4) In your opinion, do you support or oppose with having reservations for women? (5) In your opinion, should a young girl or boy select a spouse\/life partner for him\/herself or should his\/her parents select a spouse\/life partner for him\/her? (6) If a close relative or someone in your family married someone from a Harijan or Dalit caste would you oppose it or not? (7) Does your wife wear ghunghat or pallu \/ pardah or burkha? (8) Does anyone in your family believe in\/practice untouchability? (9) In your opinion, should a married woman, whose husband earns well, work outside the home or not?<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Introduction The survey methods that produce high quality data in one setting may not have the same consequences in others. In societies with conservative gender norms, survey administrators often match the gender of interviewers and respondents in order to influence survey participation and the quality of responses (Hersh et al 2021). In the United States [&hellip;]<\/p>\n","protected":false},"author":5002,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[1],"tags":[1077,1078,1076,83,512],"class_list":["post-20157","post","type-post","status-publish","format-standard","hentry","category-uncategorized","tag-gender-attitudes","tag-india","tag-interviewer-gender","tag-social-desirability","tag-survey-methods"],"acf":[],"_links":{"self":[{"href":"https:\/\/surveyinsights.org\/index.php?rest_route=\/wp\/v2\/posts\/20157","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/surveyinsights.org\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/surveyinsights.org\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/surveyinsights.org\/index.php?rest_route=\/wp\/v2\/users\/5002"}],"replies":[{"embeddable":true,"href":"https:\/\/surveyinsights.org\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=20157"}],"version-history":[{"count":38,"href":"https:\/\/surveyinsights.org\/index.php?rest_route=\/wp\/v2\/posts\/20157\/revisions"}],"predecessor-version":[{"id":20711,"href":"https:\/\/surveyinsights.org\/index.php?rest_route=\/wp\/v2\/posts\/20157\/revisions\/20711"}],"wp:attachment":[{"href":"https:\/\/surveyinsights.org\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=20157"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/surveyinsights.org\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=20157"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/surveyinsights.org\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=20157"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}