{"id":21909,"date":"2026-10-01T14:01:57","date_gmt":"2026-10-01T13:01:57","guid":{"rendered":"https:\/\/surveyinsights.org\/?p=21909"},"modified":"2026-10-01T14:09:02","modified_gmt":"2026-10-01T13:09:02","slug":"collecting-location-data-in-web-based-surveys-challenges-and-lessons-from-self-reported-census-tracts","status":"publish","type":"post","link":"https:\/\/surveyinsights.org\/?p=21909","title":{"rendered":"Collecting Location Data in Web-Based Surveys: Challenges and Lessons from Self-Reported Census Tracts"},"content":{"rendered":"<h1><strong>1 Introduction<\/strong><\/h1>\n<p>Public opinion studies in the social sciences often benefit from collecting location data from survey participants, as geographic context plays a significant role in informing and shaping perceptions of social and environmental issues. Proximity data has gained momentum, particularly in risk perception studies examining environmental and technological hazards and it further supplements the broader environmental psychology and public opinion literature (e.g. Egan &amp; Mullin, 2012; Feddersen et al., 2016). Studies in this area often link participants\u2019 location data to attitude and behaviour questions. Many studies also examine perceptions of proximity (e.g. Gadekar &amp; Brand\u00e3o, 2025; Moore &amp; Kestens, 2011). Perceived proximity, however, does not always align closely with objective measures of distance (Lackey &amp; Kaczynski, 2009). One method of collecting geographic information involves through self-report, which requires respondents to be both willing and able to accurately report their location. Automated location collection offers an alternative by reducing respondent burden and allowing geographic information to be obtained even when respondents cannot provide a usable address or location identifier (Felderer &amp; Blom, 2022). Automated approaches, such as IP-based or device-derived location data, however, raise important ethical and methodological considerations related to privacy, informed consent, and respondents&#8217; willingness to share digital information (Couper &amp; Singer, 2013; Singer, 2011; Struminskaya et al., 2021). Consequently, identifying privacy-preserving methods for collecting geographically precise survey data remains an important methodological challenge (Vaske, 2011; Wardropper et al., 2021). These challenges are heightened by growing public concerns about the erosion of privacy on digital platforms, which can make participants more reluctant to share location information or lead them to provide incomplete or inaccurate data. One approach to addressing these challenges is to collect aggregate location data by asking for state, county, or city information, though these units are often too broad to capture the precision needed for social science analysis.<\/p>\n<p>A common solution is to ask participants for their ZIP (Zone Improvement Plan) code, the standard postal code used in the United States, which is generally easy for respondents to recall and provides a finer level of geographic detail than city- or state-level information. Although ZIP codes do not provide neighbourhood-level precision, they are often sufficient for studies that do not require highly localized spatial analyses. For example, Wei et al., (2025) mapped survey respondents&#8217; ZIP codes to the nearest weather stations to examine how local weather conditions influence public perceptions of global warming, which demonstrates that broader geographic units can be appropriate when neighbourhood-level data are unnecessary. Although ZIP codes offer a less intrusive alternative to collecting precise addresses, they present several challenges for scientific research. ZIP code boundaries are designed for mail delivery rather than social, geographical, or demographic analysis, which limits their precision and alignment with meaningful community or neighbourhood boundaries (Grubesic, 2008; Grubesic &amp; Matisziw, 2006). As a result, populations within a single ZIP code can be highly heterogeneous, obscuring important differences. ZIP codes also change over time, and participants may provide inaccurate or outdated information, further reducing data reliability. In addition, many demographic, and environmental and health datasets in the United States are organized by census tracts rather than ZIP codes, making it difficult to integrate ZIP code data with other sources.<\/p>\n<p>Census tracts provide more precise geographic information than ZIP codes because they represent smaller, more uniform areas. Unlike ZIP codes, which vary widely in size and often lack geographic consistency, census tracts are standardised and designed to capture more precise, neighbourhood-level data. For example, in the United States, ZIP codes in urban and suburban areas may include 4,000 people, whereas a census tracts or block groups typically include 1,500 individuals (Henry &amp; Boscoe, 2008). States such as Nevada illustrate this issue particularly well, as ZIP code boundaries often span vast, sparsely populated regions that bear little resemblance to standardised census geographies, making spatial analyses of distance and exposure prone to error (Figure 1). Even though census tract codes are more appropriate for scientific research, these are generally not information that individuals know from memory or routinely use, and many may not know how to retrieve them. For example, the U.S. Postal Service provides a user-friendly ZIP code lookup web tool that allows individuals to enter a residential or business address and immediately obtain the corresponding ZIP code (USPS, 2026). In contrast, locating a census tract typically requires navigating specialized government databases or mapping tools that are less familiar to the general public and may require additional geographic knowledge to use effectively. As a result, using ZIP codes, which are routinely used by individuals, often remains the more practical approach for data collection in social sciences.<\/p>\n<p>&nbsp;<\/p>\n<p><a href=\"https:\/\/surveyinsights.org\/wp-content\/uploads\/2025\/12\/Figure_1.png\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-22752\" src=\"https:\/\/surveyinsights.org\/wp-content\/uploads\/2025\/12\/Figure_1.png\" alt=\"\" width=\"400\" height=\"400\" srcset=\"https:\/\/surveyinsights.org\/wp-content\/uploads\/2025\/12\/Figure_1.png 880w, https:\/\/surveyinsights.org\/wp-content\/uploads\/2025\/12\/Figure_1-300x300.png 300w, https:\/\/surveyinsights.org\/wp-content\/uploads\/2025\/12\/Figure_1-150x150.png 150w, https:\/\/surveyinsights.org\/wp-content\/uploads\/2025\/12\/Figure_1-768x768.png 768w\" sizes=\"auto, (max-width: 400px) 100vw, 400px\" \/><\/a><\/p>\n<p><strong><em>Figure 1.<\/em> <\/strong>Comparison of U.S. Census tract and ZIP Code Tabulation Area (ZCTA) geographic extents across California and Nevada. (A) Census tract boundaries for the full study area, with state boundaries shown in black. (B) ZCTA boundaries for the same extent. (C) Detailed image of census tracts corresponding to the red box shown in panel A. (D) ZCTAs within the same extent, corresponding to the red box shown in panel B.<\/p>\n<p>&nbsp;<\/p>\n<p>Several studies have primarily focused on respondents&#8217; willingness to share geographic information in digital settings with limited attention to the methodological challenges associated with collecting and validating self-reported location identifiers (e.g. Chan et al., 2017; Di Matteo et al., 2018; Toepoel &amp; Lugtig, 2014). However, even if survey respondents are willing to share more precise geographic location, there might be barriers to obtain this information with researchers. In this study, we examined the extent to which individuals could successfully retrieve and report their census tract numbers, a method designed to enhance location accuracy while maintaining respondent privacy. Our goal is to quantitatively evaluate the feasibility of collecting self-reported census tract information in survey research and to compare its performance with more commonly used geographic identifiers such as ZIP codes.<\/p>\n<p>This study addresses that gap by systematically evaluating respondents&#8217; ability to provide census tract information, documenting the practical challenges associated with data collection and processing, and comparing census tract and ZIP code-based approaches with respect to geographic precision, data quality, respondent burden, and privacy protection. In doing so, we provide empirical evidence regarding the trade-offs researchers face when selecting geographic identifiers for survey-based research. In the sections that follow, we provide a practical roadmap for collecting and processing self-reported census tract information in survey research. We first describe our procedures for collecting location data, including the instructions provided to respondents to guide them through the process. We then outline our data-cleaning steps, including identifying and correcting human errors, organizing responses, and conducting validity checks. Next, we compare self-reported ZIP codes and self-reported census tracts to evaluate the accuracy of self-reported census tract and ZIP code identifiers. Finally, we discuss the implications of these findings in light of collecting geographic information while balancing privacy, precision, and respondent burden in spatial analysis.<\/p>\n<p><strong>\u00a0<\/strong><\/p>\n<h1><strong>2 Methods<\/strong><\/h1>\n<h2><strong>2.1 Survey design and data collection<\/strong><\/h2>\n<p>This study was conducted as part of a broader project examining public perceptions of environmental and technological risks associated with lithium mining in California and Nevada, United States. The broader project consisted of a survey of 62 questions (including the informed consent and eligibility screening questions) designed to measure respondents&#8217; perceptions of lithium mining developments, including perceived risks, benefits, environmental impacts, and environmental justice concerns associated with the industry in the region. While the full survey addressed these topics, the present study focuses exclusively on analysing geographic questions requesting census tract and ZIP code information.<\/p>\n<p><em>Ethics approval<\/em><\/p>\n<p>The study was approved by the Institutional Review Board, reference number [2314583-2], of the authors\u2019 institution. Participation was voluntary, and respondents could skip any questions they did not wish to answer.<\/p>\n<p><em>Recruitment and eligibility<\/em><\/p>\n<p>Two screening questions were used to verify eligibility: participants were required to be at least 18 years old and reside in California or Nevada. Participants received $3.00 for completing the survey (equivalent to an hourly rate of approximately $15.00), consistent with Prolific&#8217;s fair-pay guidelines (Prolific, 2025). Data were collected between May 8 and June 24, 2025, using the Qualtrics survey platform (Qualtrics, 2026), with participants recruited and screened through the Prolific crowdsourcing platform.<\/p>\n<p><em>Geographic information collection<\/em><\/p>\n<p>Two questions in the survey required participants to self-report their geographic location. The first question (Appendix Figure A1) required participants to provide their census tract, and included visual instructions on how to retrieve it from the US Federal Financial Institutions Examination Council (FFIEC) Geocoding\/Mapping System (Federal Financial Institutions Examination Council, 2024), a government-affiliated website that generates multiple geographic identifiers, including state, county, and census tract codes, from a full residential mailing address. The FFIEC platform was chosen over the U.S. Census Bureau\u2019s lookup tool (United States Census Bureau, 2026) due to its simpler user interface.<\/p>\n<p>The second question related to geographic location asked participants to provide their ZIP codes with no additional instructions as that information is usually known to adults. To reduce nonresponse, participants were reminded that their responses would be analysed and reported only in aggregate form. Census tract codes were collected as the primary geographic measure of a participant location, offering more localized geographic information that could be linked to demographic and environmental datasets used in the main study. In contrast, ZIP codes were collected as a secondary data point to capture participants\u2019 general geographic location and to cross-check the accuracy of their self-reported census tracts. Comparing these two measures allowed us to evaluate the trade-offs between analytical precision and ease of reporting in the context of proximity-based risk perception research.<\/p>\n<h2><strong>2.2 Data preparation<\/strong><\/h2>\n<p>Initial data cleaning focused on ensuring response quality and consistency. Duplicate submissions were identified using Prolific Participant IDs and Qualtrics metadata and subsequently removed. Two attention-check items were embedded within the survey to assess respondent attentiveness and data quality. To maximize data quality, respondents who failed either attention check were excluded from further analysis. A major challenge in preparing the dataset was standardising the formatting of census tract numbers in survey data. Several formatting and data-entry issues emerged during data preparation. Responses varied considerably in format, possibly because participants retrieved census tract information from an external website and either manually entered or copied and pasted the results into the survey. Common problems included invalid entries (e.g., geographic information other than the requested census tract identifier, missing responses, entries including leading spaces, formatting inconsistencies, and typographical errors such as multiple decimal points or the substitution of the letter \u201cO\u201d for the numeral zero). In addition, some respondents provided partial or full mailing addresses rather than census tract identifiers. Because the nature of these errors varied substantially across respondents, individual responses were manually reviewed primarily to identify and correct obvious formatting and transcription errors. The formatting issues, mentioned here, were specific to the self-reported census tract data and did not occur with ZIP codes, likely because participants could recall their postal codes from memory.<\/p>\n<p><em>Exclusions<\/em><\/p>\n<p>Of the 784 survey responses, 80 were excluded during preliminary data screening because they did not meet the study&#8217;s inclusion or data quality criteria. Most exclusions resulted from missing geographic information, including blank census tract and ZIP code fields (n = 59). Additional exclusions included low-quality responses characterized by unusually short completion times (under approximately 4.5 minutes) combined with consecutive identical or missing responses across multiple matrix items (n = 4), survey abandonment or excessive completion times exceeding 2.5 hours (n = 4), invalid geographic entries that initially appeared plausible but were determined during manual review to contain formatting errors, incomplete information, or nonstandard geographic identifiers (n = 4), address-based responses that did not conform to the study protocol for self-reported census tract identifiers (n = 6), and other exclusions resulting from participant-reported errors encountered while retrieving census tract information (n = 3). Following preliminary data screening, 704 responses were retained for subsequent geospatial analyses. Figure 2 illustrates the geographic identifier validation workflow, including data collection, preliminary data screening, and geospatial validation.<\/p>\n<p><a href=\"https:\/\/surveyinsights.org\/wp-content\/uploads\/2025\/12\/Figure_2.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-22754\" src=\"https:\/\/surveyinsights.org\/wp-content\/uploads\/2025\/12\/Figure_2.jpg\" alt=\"\" width=\"350\" height=\"420\" srcset=\"https:\/\/surveyinsights.org\/wp-content\/uploads\/2025\/12\/Figure_2.jpg 480w, https:\/\/surveyinsights.org\/wp-content\/uploads\/2025\/12\/Figure_2-250x300.jpg 250w\" sizes=\"auto, (max-width: 350px) 100vw, 350px\" \/><\/a><\/p>\n<p><strong><em>Figure 2.<\/em><\/strong> Geographic identifier validation workflow. Overview of the collection, cleaning, and validation procedures for self-reported census tract identifiers and ZIP codes.<\/p>\n<h2><strong>2.3 Geospatial validation<\/strong><\/h2>\n<p><em>Reference datasets<\/em><\/p>\n<p>Geospatial validation of survey responses consisted of matching respondents&#8217; self-reported census tract and ZIP code to official, government-provided geographic reference datasets. Official census tract boundaries for California and Nevada were obtained from the U.S. Census Bureau&#8217;s 2024 Topologically Integrated Geographic Encoding and Referencing (TIGER\/Line) Census Tracts shapefiles, the Bureau&#8217;s official digital geographic boundary files (tl_2024_06_tract.shp for California and tl_2024_32_tract.shp for Nevada). State boundaries were obtained from the 2024 TIGER\/Line States shapefile (tl_2024_us_state.shp), and ZIP Code Tabulation Area (ZCTA) boundaries \u2014 census-defined geographic areas that approximate U.S. Postal Service ZIP code service areas \u2014 were obtained from the 2024 TIGER\/Line ZCTA shapefile (tl_2024_us_zcta520.shp) (U.S. Census Bureau, 2024c, 2024b, 2024a).<\/p>\n<p><em>Census tract and ZIP code matching and validation<\/em><\/p>\n<p>We used R software (R Core Team, 2024; version 4.2), with the <em>tidyverse<\/em> (Wickham et al., 2019), <em>sf (Pebesma, 2018)<\/em>, and <em>spatialEco<\/em> (Evans &amp; Murphy, 2025) packages, to import, manipulate, and compare self-reported geographic identifiers against the official reference datasets described above. To facilitate data manipulation, the California and Nevada census tract shapefiles were merged into a single layer using the Merge tool in ArcGIS Pro (version 3.6) (ESRI, 2026); the national ZCTA shapefile was retained in full, without clipping to California and Nevada, because a self-reported ZIP code could correspond to a ZCTA outside the two-state study area (e.g., due to respondent relocation or data-entry error).<\/p>\n<p>Self-reported census tract values were validated using a sequential, three-step matching procedure designed to account for common, predictable deviations from the official tract-number format. At each step, only responses that had not already matched in a preceding, stricter step were carried forward for evaluation. First, reported tract values were compared directly to the Census-formatted tract name field (NAME; e.g., &#8220;35.19&#8221;) in the TIGER\/Line reference dataset using exact string matching (R&#8217;s <em>%in% <\/em>operator). Second, for responses that did not match exactly, leading zeros were removed from the reported value (e.g., &#8220;0032.08&#8221; \u2192 &#8220;32.08&#8221;) and the result was compared to NAME. Third, for responses still unmatched, the decimal point was removed from the reported value to reconstruct the six-digit format used in the official tract code field (e.g., &#8220;0032.08&#8221; \u2192 &#8220;003208&#8221;) and compared to TRACTCE. Responses that did not match at any of the three steps were classified as invalid. For each respondent, we recorded which step (if any) produced a match in a categorical variable (exact match, leading zeros removed, decimal removed, or no match) and appended the corresponding official tract identifiers from the matched reference record \u2014 the TIGER tract name and the six-digit TRACTCE code \u2014 to the survey dataset.<\/p>\n<p>Self-reported ZIP codes were validated using an analogous sequential procedure against the ZCTA5CE20 field of the national ZCTA reference dataset. Reported ZIP codes were first compared directly using exact string matching. For responses that did not match, a leading zero was restored where applicable (e.g., &#8220;2138&#8221; \u2192 &#8220;02138&#8221;) and the response was re-compared. For responses still unmatched, an appended ZIP+4 suffix, if present, was removed (e.g., &#8220;89701-1234&#8221; \u2192 &#8220;89701&#8221;) and the response was compared a final time. As with tract validation, a categorical match-type variable and the standardised official ZCTA identifier from the matched record were retained for each respondent.<\/p>\n<p>We calculated the overall proportion of valid tract and ZIP responses at each stage of the matching procedure and summarized final match rates across respondent demographic characteristics. Because overall match rates were high, and some demographic categories included few respondents, we report subgroup match rates alongside sample sizes and interpret them descriptively rather than through formal significance testing. The complete R script is available in Appendix A2.<\/p>\n<h1><\/h1>\n<h1><strong>3 Results <\/strong><\/h1>\n<p><em>Sample characteristics <\/em><\/p>\n<p>The final sample consisted of 704 respondents, including 373 men (53%), 326 women (46.3%), and 4 respondents who identified as non-binary or a third gender (0.6%). Educational attainment was relatively high, with 310 respondents (44%) holding a bachelor&#8217;s degree and 129 (18.3%) holding a graduate or professional degree. The sample was predominantly White\/Caucasian (59.8%), with 18.8% identifying as Hispanic. Most respondents were employed full-time (53.1%), or part-time (16.9%) with the remaining participants representing a range of employment statuses. Annual household income was broadly distributed across income categories, with no single category accounting for more than 21% of respondents. Political affiliation was relatively balanced across Democratic, Republican, and Independent affiliations, with Lean Democratic (25.3%) and Independent (23.7%) representing the largest groups.<\/p>\n<p><em>Census tract validation<\/em><\/p>\n<p>Geographic validation of self-reported census tracts proceeded through a sequential, three-step matching procedure. Exact string matching against the official TIGER tract name field identified 198 valid matches (28.1%). Removing leading zeros from unmatched responses and re-comparing against the same field increased the cumulative match rate to 571 (81.1%). Removing the decimal point from remaining unmatched responses and comparing against the six-digit official tract code field increased the cumulative match rate to 649 (92.2%) (Table1). The remaining 55 responses (7.8%) did not match a valid census tract identifier under any step and were classified as invalid.<\/p>\n<p><strong>Table 1. Validation of self-reported census tract identifiers against Census TIGER\/Line reference data<\/strong><\/p>\n<p><a href=\"https:\/\/surveyinsights.org\/wp-content\/uploads\/2025\/12\/Table_1-1.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-22765\" src=\"https:\/\/surveyinsights.org\/wp-content\/uploads\/2025\/12\/Table_1-1-1024x525.png\" alt=\"\" width=\"700\" height=\"359\" srcset=\"https:\/\/surveyinsights.org\/wp-content\/uploads\/2025\/12\/Table_1-1-1024x525.png 1024w, https:\/\/surveyinsights.org\/wp-content\/uploads\/2025\/12\/Table_1-1-300x154.png 300w, https:\/\/surveyinsights.org\/wp-content\/uploads\/2025\/12\/Table_1-1-768x393.png 768w, https:\/\/surveyinsights.org\/wp-content\/uploads\/2025\/12\/Table_1-1-1536x787.png 1536w, https:\/\/surveyinsights.org\/wp-content\/uploads\/2025\/12\/Table_1-1.png 1999w\" sizes=\"auto, (max-width: 700px) 100vw, 700px\" \/><\/a><\/p>\n<p><em>ZIP code validation<\/em><\/p>\n<p>Validation of self-reported ZIP codes followed an analogous procedure. Exact matching against the official ZCTA identifier field identified 678 valid matches (96.3%) (Table2). No additional responses were recovered by restoring a dropped leading zero. Removing an appended ZIP+4 suffix from remaining unmatched responses recovered 6 additional matches, increasing the cumulative match rate to 684 (97.2%). The remaining 20 responses (2.8%) did not match a valid ZCTA under any step.<\/p>\n<p><strong>\u00a0<\/strong><\/p>\n<p><strong>Table 2. Validation of self-reported ZIP codes against Census ZIP Code Tabulation Area (ZCTA) reference data<\/strong><\/p>\n<p><a href=\"https:\/\/surveyinsights.org\/wp-content\/uploads\/2025\/12\/Table_2_1-1.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-22768\" src=\"https:\/\/surveyinsights.org\/wp-content\/uploads\/2025\/12\/Table_2_1-1-1024x415.png\" alt=\"\" width=\"700\" height=\"284\" srcset=\"https:\/\/surveyinsights.org\/wp-content\/uploads\/2025\/12\/Table_2_1-1-1024x415.png 1024w, https:\/\/surveyinsights.org\/wp-content\/uploads\/2025\/12\/Table_2_1-1-300x122.png 300w, https:\/\/surveyinsights.org\/wp-content\/uploads\/2025\/12\/Table_2_1-1-768x312.png 768w, https:\/\/surveyinsights.org\/wp-content\/uploads\/2025\/12\/Table_2_1-1-1536x623.png 1536w, https:\/\/surveyinsights.org\/wp-content\/uploads\/2025\/12\/Table_2_1-1.png 1999w\" sizes=\"auto, (max-width: 700px) 100vw, 700px\" \/><\/a><\/p>\n<p><em>Demographic patterns<\/em><\/p>\n<p>Match rates were generally high and comparatively stable across demographic subgroups, though some patterns emerged (Appendix Table A1). ZIP code validation exceeded 98% for nearly all respondent characteristics. In terms of Race, rates were slightly lower for those who identified Black or African American (89%, <em>n<\/em>=82) and Other (94%, <em>n<\/em>= 34). Census tract match rates showed a similar trend, where most respondents groups achieved similar validation rates. Census tract match rates were highest among respondents with some college or an associate degree (95.2%, <em>n<\/em> = 189) and lowest among those with a high school diploma or equivalent (87.5%, <em>n<\/em> = 72). No consistent patterns were observed across income, political affiliation, or ideological groups. Several demographic categories with very small sample sizes (e.g., Native Hawaiian or Pacific Islander, n = 3; less than high school education, n = 1) produced match rates of 0% or 100% that are not interpretable given the limited number of respondents and are reported for completeness rather than as evidence of a subgroup effect. Given the overall high validity of self-reported geographic identifiers and the small size of several subgroups, we interpreted demographic patterns descriptively rather than through formal statistical testing.<\/p>\n<p>Among the 59 respondents who did not provide usable location information because they left the geographic fields blank or otherwise chose not to share their location (excluding invalid geographic entries), we examined demographic patterns in non-response. Because this group was small, we are cautious about drawing conclusions for demographic subgroups with few respondents. Gender distributions, however, remained sufficiently represented to permit a descriptive comparison. Women accounted for 56% of non-responses, compared with 31.7% among men and 11.7% among respondents with missing or unspecified gender.<\/p>\n<h1><\/h1>\n<h1><strong>4 Discussion <\/strong><\/h1>\n<p>In this study, we examined whether asking respondents to locate and manually enter their census tract codes could serve as a privacy-preserving method for collecting precise geographic information without requiring respondents to disclose their residential addresses or relying on device-derived paradata. Results from this cross-sectional study suggest that collecting self-reported census tract codes can serve as a viable privacy-preserving method for obtaining geographic information. However, successful implementation depends on addressing challenges faced by both researchers and survey participants. An important methodological takeaway is that geographic validation discrepancies may not always reflect respondent error. During the exploratory analyses, we noticed that many initially unmatched census tract identifiers became valid matches after accounting for differences in identifier formatting, particularly the presence or absence of leading zeros. A substantial portion of the data wrangling required in this study stemmed from a mismatch between the format displayed by the geocoding tool respondents used and the format needed to match Census reference data. Respondents looked up their tract using the Federal Financial Institutions Examination Council (FFIEC) Geocoding\/Mapping System, which displays tract identifiers with a decimal point and inconsistent leading zeros \u2014 closer to the TIGER\/Line NAME field (e.g., &#8220;218.14,&#8221; no leading zeros, decimal retained) than to the six-digit, zero-padded TRACTCE field (e.g., &#8220;021814,&#8221; no decimal) used elsewhere in the reference data. This produced varied respondent entries: &#8220;218.14&#8221; matched NAME directly; &#8220;0032.08&#8221; required only that its leading zero be dropped to match NAME (&#8220;32.08&#8221;); and &#8220;0106.00&#8221; happened to reproduce the correct TRACTCE value once its decimal was removed (&#8220;010600&#8221;), since its leading zero was, in this case, actually part of the official code rather than a formatting issue. Had the FFIEC tool displayed the standardised six-digit TRACTCE code directly, we could simply have instructed respondents to enter six digits including leading zeros, avoiding this ambiguity entirely. Researchers should be aware that apparent validation failures may sometimes reflect inconsistencies across official data systems rather than inaccuracies in participant responses. Even when respondents accurately report their census tract as displayed by one official source, an exact match may fail against another official reference that uses a different formatting convention. These findings highlight the importance of implementing standardised formatting and preprocessing procedures when validating self-reported geographic identifiers.<\/p>\n<p>Additionally, the process itself could present a labour-intensive process of data cleaning and validation. Unlike ZIP codes, census tract identifiers are not information that most individuals routinely know or use. As a result, when respondents are required to retrieve and manually enter the identifier, to process can introduce an added respondent burden and increase human error in retrieval and transcription errors. Prompting participants to retrieve unfamiliar census tract identifiers may also create confusion or heightened anxiety compared to more familiar indicators such as ZIP codes (Couper et al., 2008; Kunz &amp; Gummer, 2025). In contrast, ZIP codes, which are also collected through self-report in this study, may continue to provide a simpler and more familiar geographic reference for participants, with more than 96% of responses successfully validated in this study.<\/p>\n<p>We intentionally did not rely on automatically collected location-related paradata, such as IP addresses or GPS coordinates, to assign respondents&#8217; geographic locations. Although paradata can reduce certain types of human error, they may introduce other sources of measurement error. For example, IP-based geolocation can produce inaccurate location estimates because of VPNs, proxy servers, mobile networks, and internet routing \u00a0(Godinho et al., 2020; Prolific, 2026). Popular online survey platforms also acknowledge that IP-derived location data are often insufficient for identifying the neighbourhood-level residential location needed to determine a participant&#8217;s census tract. For example, Qualtrics estimates respondent location using IP addresses, which, according to the company, are generally accurate only to the city level within the United States and, in many cases, only to the country level internationally (Qualtrics, n.d.). Although some survey platforms offer offline applications capable of collecting precise GPS coordinates from GPS-enabled devices, this functionality is unavailable when respondents complete surveys on desktop or laptop computers.<\/p>\n<p><em>Implications for Future Research<\/em><\/p>\n<p>Despite the challenges identified in this study, future work should focus on developing standardised collection and validation procedures, along with more intuitive lookup interfaces, to improve the accuracy of self-reported census tract data while preserving respondent privacy. This recommendation is also supported by prior research demonstrating that respondents are more willing to voluntarily provide geographic information than to permit its automatic collection (Felderer &amp; Blom, 2022). Consistent with this perspective, the findings of the present study suggest that respondents are willing and able to provide geographic information that is familiar to them, as evidenced by the high validation rate for self-reported ZIP codes. Although validation of self-reported census tract codes was more challenging, exploratory analyses indicated that many apparent mismatches reflected formatting inconsistencies rather than inaccurate reporting, highlighting the importance of standardised collection and validation procedures.<\/p>\n<p>The present study did not comprehensively examine why some respondents successfully reported valid census tract identifiers while others did not. Previous research examining respondents&#8217; willingness to share geographic information has found that both methodological and respondent characteristics influence location disclosure. For example, greater willingness to disclose geographic information has been associated with higher educational attainment, nonminority status (Olmsted-Hawala &amp; Nichols, 2019), male gender, larger household size, and greater survey experience (Ochoa G\u00f3mez, 2022). Methodological factors, such as placing location questions toward the end of a survey, have also been shown to increase respondents&#8217; willingness to disclose geographic information (Olmsted-Hawala &amp; Nichols, 2019). Because the location nonresponse group in this study was small, we limited descriptive comparisons to gender, where the observed pattern was consistent with previous research. Women accounted for a larger share of respondents who did not provide location information than men. Future research should build on these findings by examining the underlying causes of both location nonresponse and invalid location reporting. Such work should investigate respondent-level factors (e.g., educational attainment, digital literacy, and privacy concerns) as well as methodological factors (e.g., lookup tools, survey instructions, interface design, and data formatting conventions) that may influence the successful reporting and validation of census tract identifiers. Improved understanding of these factors could increase the accuracy of self-reported geographic information while reducing reliance on automated location data collection.<\/p>\n<h1><\/h1>\n<h1><strong>5 Limitations<\/strong><\/h1>\n<p>Current study employed a cross-sectional survey design; therefore, the findings reflect the responses of the study sample and should not be interpreted as representative of the broader population. The survey captured respondents&#8217; behaviour and perceptions at a single point in time. Future studies employing repeated measures could examine the consistency of self-reported census tract identifiers and determine whether respondents&#8217; ability to retrieve and report their census tract improves with repeated attempts. In addition, the study sample was more highly educated than the general U.S. population.<\/p>\n<p>Another limitation is that the study did not determine why some self-reported census tract identifiers failed validation after the sequence of operations we performed. Invalid entries may have resulted from retrieval errors, transcription or formatting errors, misunderstanding of the survey instructions, or intentionally inaccurate reporting due to privacy concerns. Consequently, the specific reasons underlying unsuccessful validation could not be identified. Finally, the present study evaluated only one approach to self-reported census tract retrieval, in which participants used the FFIEC Geocoding\/Mapping System to locate and report their census tract. Consequently, the findings reflect the feasibility of this specific retrieval method and may not generalize to alternative lookup interfaces. Future research should directly compare these methods to determine their relative accuracy, usability, and data quality.<\/p>\n<h1><\/h1>\n<h1><strong>6 Conclusions<\/strong><\/h1>\n<p>Online surveys offer distinct advantages over other modes of data collection, including greater speed, convenience, and cost-effectiveness. Random-digit-dial phone surveys now face sharply declining response rates alongside the reduced prevalence of landlines, while mail surveys are both slow and resource-intensive. At the same time, growing concerns about digital privacy make participants less willing to share sensitive information such as home addresses in online settings, which raises the risk of nonresponse. Passive location data collection through digital trace data also raises important methodological and ethical concerns related to respondent privacy and informed consent (Couper &amp; Singer, 2013; Felderer &amp; Blom, 2022). In this study, we sought to balance these challenges by collecting census tract and ZIP code data rather than full addresses, or passive data collection, providing researchers with spatial detail while reducing the intrusiveness of the request.<\/p>\n<p>Taken together, our findings show that self-reported census tract data can achieve high validity, 92.2% of responses matched an official tract, but only after a systematic standardisation procedure was applied to reconcile inconsistent respondent formatting with the official census tract code. ZIP codes, by contrast, required minimal standardisation to reach an even higher match rate (97.2%), pointing to a clear trade-off between the finer spatial resolution that census tracts can offer and the additional processing burden required to make that resolution usable. Previous research has focused largely on respondents&#8217; willingness to share location data rather than the methodological challenges faced by researchers. Future research should investigate the factors contributing to invalid census tract reporting and identify strategies to improve reporting accuracy and validation.<\/p>\n<p>Moving forward, we encourage the field to develop clearer guidance, more intuitive mapping interfaces, and standardised spatial workflows that support both novice and experienced researchers. Our results suggest that even a small mismatch between the format displayed by a commonly used, publicly available geocoding tool and the format used in official census reference files can meaningfully increase the processing burden required to validate self-reported geographic data. Thus, an ideal interface to retrieve codes should provide the standardised six-digit tract code directly, rather than a decimal-formatted approximation, would likely reduce both respondent confusion and downstream analytic effort.<\/p>\n<p>Bringing these issues into broader scholarly conversation will help strengthen the integration of geographic context in public opinion research. Expanding beyond ZIP codes to incorporate scalable solutions can offer richer geographic context for analysing public sentiment. As online surveys continue to evolve, methodological transparency and privacy-protective practices will remain essential for building trust and generating robust spatial insights.<\/p>\n<p><strong>Author Contribution:<\/strong> The\u202fauthors\u202fconfirm\u202fsole\u202fresponsibility for the study conception, data analysis, interpretation of results, and writing of the manuscript.<\/p>\n<p><strong>Competing Interests<\/strong><\/p>\n<p>The authors report there are no competing interests to declare.<\/p>\n<p><strong>Funding<\/strong><\/p>\n<p>This research was supported by the Reynolds School of Journalism, Center for Advanced Media Studies.<\/p>\n<p><strong>Ethics Approval and Consent to Participate<\/strong><\/p>\n<p>This study was approved by the host university\u2019s Institutional Review Board (IRB), and informed consent was obtained from all participants.<\/p>\n<p><strong>Consent for Publication<\/strong><\/p>\n<p>Not applicable<\/p>\n<p><strong>Data availability<\/strong><\/p>\n<p>De-identified or aggregated data may be made available from the corresponding author upon reasonable request.<\/p>\n<p>&nbsp;<\/p>\n<h2>Appendix A<\/h2>\n<p><a href=\"https:\/\/surveyinsights.org\/wp-content\/uploads\/2025\/12\/Figure_A1_page27_2.pdf\">Figure A1. Survey instructions for collecting self-reported geographic information<\/a><\/p>\n<p><a href=\"https:\/\/surveyinsights.org\/wp-content\/uploads\/2025\/12\/Table_A1_1.pdf\">Table A1. Census tract and ZIP code match rates by respondent characteristics (N = 704)<\/a><\/p>\n<h2>Appendix A2<\/h2>\n<p><a href=\"https:\/\/surveyinsights.org\/wp-content\/uploads\/2025\/12\/Appendix_A2_R_script_zip_census_tract_matches.pdf\">R script used for geographic validation and spatial analyses<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>1 Introduction Public opinion studies in the social sciences often benefit from collecting location data from survey participants, as geographic context plays a significant role in informing and shaping perceptions of social and environmental issues. Proximity data has gained momentum, particularly in risk perception studies examining environmental and technological hazards and it further supplements the [&hellip;]<\/p>\n","protected":false},"author":5078,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[1],"tags":[90,1202,1200,1201,780],"class_list":["post-21909","post","type-post","status-publish","format-standard","hentry","category-uncategorized","tag-data-quality","tag-geolocation","tag-privacy","tag-spatial-data","tag-survey-research"],"acf":[],"_links":{"self":[{"href":"https:\/\/surveyinsights.org\/index.php?rest_route=\/wp\/v2\/posts\/21909","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/surveyinsights.org\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/surveyinsights.org\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/surveyinsights.org\/index.php?rest_route=\/wp\/v2\/users\/5078"}],"replies":[{"embeddable":true,"href":"https:\/\/surveyinsights.org\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=21909"}],"version-history":[{"count":28,"href":"https:\/\/surveyinsights.org\/index.php?rest_route=\/wp\/v2\/posts\/21909\/revisions"}],"predecessor-version":[{"id":22829,"href":"https:\/\/surveyinsights.org\/index.php?rest_route=\/wp\/v2\/posts\/21909\/revisions\/22829"}],"wp:attachment":[{"href":"https:\/\/surveyinsights.org\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=21909"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/surveyinsights.org\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=21909"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/surveyinsights.org\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=21909"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}