Skip to main content

Why Strong Sample Frames Are Essential for Quality Survey Data

Innovation Brief
satellite image of San Antonio, Texas

Author

Ned English

Associate Director 

January 2026

NORC’s innovations in frame design ensure that hard-to-survey populations are included in studies and inform public understanding.

An important part of my job is figuring out how research studies can target a specific kind of person, often defined by geography, demographics, or some other factor. To do that, we need to consider the best way to create a comprehensive list or sample frame for any population of interest.


Sample Frame Methodology

Explore Our Work


I’ve been interested in this issue since early in my career when we needed to identify hard-to-survey households across multiple languages and levels of literacy for a neighborhood health survey. I learned that designing sample frames provides the opportunity for creativity and outside-the-box thinking since you need to integrate multiple pieces of information from various sources.

Sample frames are such a basic ingredient in social science research that they are often taken for granted. A frame determines the universe of households, individuals, or businesses that may be included in a study, implicitly shaping research outcomes. Without a well-constructed sample frame that includes nearly all our target population, even the most robust sampling and data collection designs may be called into question or potentially lead to misleading research conclusions.

Sampling frames determine whose voices get to influence policy.

Inclusion in a sampling frame determines who may be part of a given study, and thus whose experiences shape public understanding and policy. As such, we’d ideally have a perfect list of all households, people, or organizations in the actual population for a given area, providing “full coverage” of that population.

In reality, it rarely is possible to create such a perfect frame for a number of reasons, including household mobility, database aging, and limitations in linking datasets. Any efforts to maximize coverage and “fill in” people who may be missing are fundamentally efforts to enhance survey representation.

NORC has a long history of investing in sampling frame enhancements.

High population coverage is essential to representative data collection studies, which is why NORC has a history of investing in efforts to understand and enhance sample frames. NORC’s foundational research continues to influence how sampling frames are built and evaluated (O’Muircheartaigh, et al., 2006).

We were among the first to geocode address lists instead of constructing address frames from scratch, which was fundamental to the design of multi-mode address-based studies (O’Muircheartaigh, et al., 2005; Harter, et al., 2010). We have led the adoption of Geographic Information Systems (GIS) technology to facilitate multi-state sample designs and to understand the nuances of sample frame coverage, specifically where address lists needed enhancement or augmentation to ensure representation (English, et al., 2009; Eckman, et al., 2012).

One area that sets NORC apart is our National Frame, a comprehensive address database, containing current and historical address information across socio-social environments. While the National Frame serves as backbone for high-profile national studies such as the General Social Survey, the Survey of Consumer Finances, and AmeriSpeak®, its modular design and comprehensive coverage make it equally valuable for more focused or local research initiatives. Consequently, projects obtain the same statistical rigor and representation without unnecessary costs.

Another example of specialized survey frames is the National Survey of Early Care and Education (NSECE), the definitive study of the availability and use of early care and education in the United States. NSECE uses GIS to create a custom sample frame of households that are within a convenient distance of geocoded child care providers, allowing us to collect data that help us understand the needs of families and the child care workforce. NSECE shows how we can be creative to capture specialized populations of interest, in this case, families who may need child care and providers who are near them.

“Our sample frame innovations allow us to reach populations beyond traditional methods, from rural households to transient urban communities.”

Associate Director, Methodology & Quantitative Social Sciences

“Our sample frame innovations allow us to reach populations beyond traditional methods, from rural households to transient urban communities.”

NORC has continued to extend sample frame methodological research by investing in and integrating newer technologies and approaches. Our research has advanced topics including using aerial imagery to develop address lists in rural areas through remote listing and how best to efficiently target hard-to-survey populations with Big Data Classifiers (English, et al., 2025; Dutwin, et al., 2023). Such innovations allow us to reach populations beyond traditional methods, from rural households to transient urban communities. By combining technological advancement with methodological rigor, we ensure that our frames remain current, comprehensive, and flexible.


Sample Frame Methodology

Explore Our Work


References

O’Muircheartaigh, C., English, N., Eckman, S., Upchurch, H., Garcia Lopez, E. and Lepkowski, J. Validating a Sampling Revolution: Benchmarking Address Lists Against Traditional Field Listing. 2006 Proceedings of the American Statistical Association, AAPOR Survey Research Methods Section [CD ROM], Alexandria, VA: American Statistical Association.

O'Muircheartaigh, C., Eckman, S., English, N., Lepkowski, J. and Heeringa, S. Comparison of Traditional Listings and USPS Address Database as a Frame for National Area Probability Samples. Presented At American Association for Public Opinion Research Conference, May 2005, Miami Beach, FL.

Harter, R., Eckman, S., English, N. and O’Muircheartaigh, C. 2010. “Applied Sampling for Large-Scale Multi-Stage Area Probability Designs.” In Handbook of Survey Research, Second Edition, P. Marsden and J. Wright, eds. Elsevier.

English, N., O’Muircheartaigh, C., Latterner, M., Eckman, S. and Dekker, K. “Modeling the Need for Traditional vs. Commercially Available Address Listings for In-Person Surveys: Results from a National Validation of Addresses (Summary)." Survey Practice, June 2009.

Eckman, S. and English, N. 2012. Creating Housing Unit Frames from Address Databases: Geocoding Precision and Net Coverage Rates Field Methods. 24(4): 399-408 https://journals.sagepub.com/doi/abs/10.1177/1525822x12445141.

Sample Frame Methodology, norc.org.

English, N. and Fiorio, L. “How NORC Developed a More Accurate & Affordable Survey Sampling Method Using Satellite Imagery,” norc.org, May 2025.

Dutwin, D., Coyle, P., Bilgen, I. and English, N.  2023. “Leveraging Predictive Modeling from Multiple Sources of Big Data to Improve Sample Efficiency and Reduce Survey Nonresponse Error.” Journal of Survey Statistics and Methodology; smad016, https://doi.org/10.1093/jssam/smad016.


Suggested Citation

English, N. (2025, December 23). Why Strong Sample Frames Are Essential for Quality Survey Data. [Web blog post]. NORC at the University of Chicago. Retrieved from www.norc.org.


Tags

Research Divisions

Departments, Centers & Programs



Experts

Explore NORC Research Science Projects

Analyzing Parent Narratives to Create Parent Gauge™

Helping Head Start build a tool to assess parent, family, and community engagement

Client:

National Head Start Association, Ford Foundation, Rainin Foundation, Region V Head Start Association

America in One Room

A “deliberative polling” experiment to bridge American partisanship

Client:

Stanford University