Skip to main content

Mixed-Mode Survey Design: Reaching People Where They Are

Expert View
A person in a green sweater uses a tablet while sitting on a couch. A dog is partially visible in the background.

Author

Ipek Bilgen

Principal Research Methodologist

Methodology & Quantitative Social Sciences

Director

Center for Panel Survey Sciences

October 2026

As response rates decline and communication habits evolve, mixed-mode designs help keep surveys representative and accessible.

Throughout my career, the survey research landscape has continually evolved in response to a changing world, and the pace of that change has accelerated dramatically over the past couple of decades. Response rates have been declining for decades, budgets and timelines continue to tighten, and the way people communicate has fundamentally changed: landlines have nearly disappeared, mail is often discarded or goes unopened, unknown numbers go to voicemail, and a survey request is just one more email or text competing for attention.

Accordingly, no single survey mode is adequate for reaching most target populations anymore. That’s why mixed-mode design, which strategically combines multiple ways of reaching sample members and collecting their responses, has become a cornerstone of modern survey research.

Why One Survey Mode Isn’t Enough

The logic behind mixed-mode survey design is straightforward, even if the execution isn’t. Mixed-mode approaches are important because:

  • Web-only designs exclude people with limited internet access or lower digital literacy.
  • Phone-only designs miss the growing share of households without landlines and people who do not answer calls from unknown numbers.
  • Mail-only designs lose anyone who doesn’t open an unfamiliar envelope.

By offering multiple ways for respondents to be contacted and to respond, mixed-mode surveying improves representation. It also reduces nonresponse bias by giving people accessible and convenient ways to participate. Meeting people where they are and making it easier for them to respond is often the difference between a respondent sample that resembles the population and one that doesn’t.

“Meeting people where they are and making it easier for them to respond is often the difference between a respondent sample that resembles the population and one that doesn’t.”

Principal Research Methodologist, Methodology & Quantitative Social Sciences

“Meeting people where they are and making it easier for them to respond is often the difference between a respondent sample that resembles the population and one that doesn’t.”

Contact vs. Data Collection

When designing studies, it helps to treat contact and data collection as two separate levers that work together rather than a single design choice. Contact is about how we reach out to and motivate sample members to respond, whether by mail, email, text, phone, or in-person outreach. Data collection is about how people complete the survey, whether through the web, paper questionnaire, phone interview, or in-person interview.

There are three commonly used design strategies for combining contact modes, data collection modes, or both.

  1. Sequential designs introduce one mode at a time, typically starting with a lower-cost option like email or mail before escalating to phone or in-person modes for nonrespondents.
  2. Concurrent designs offer multiple modes at once, which makes sense when a field period is too short to sequence modes or simply to accommodate respondent preference.
  3. Within-mode strategies allow respondents to move between modes mid-interview, such as switching to a self-administered module for sensitive questions during an otherwise interviewer-led interview, to encourage more honest reporting by allowing respondents to answer sensitive questions privately.

The Tradeoff to Consider

Mixed-mode designs come with tradeoffs. While they can increase response rates, improve representation, and reduce nonresponse bias, they can also introduce measurement differences across modes. The same person may answer questions differently depending on whether an interviewer is present or whether a question is read aloud versus presented on a screen.

Research has shown, for instance, that survey participants tend to give more socially desirable answers in the presence of an interviewer. This is a design consideration that deserves careful attention. That said, the accumulated evidence is consistent: concerns about mode effects are typically outweighed by the gains in representation from reaching more of the target population.

Rather than avoiding mixed-mode designs, researchers should deliberately plan for these differences through careful instrument development and testing across modes. In practice, many mode-related differences can be mitigated through deliberate questionnaire design choices, such as standardizing question wording and presentation across modes and using self-administered formats for sensitive questions. Rigorous testing before fielding helps ensure respondents interpret and answer questions consistently across modes.

“Concerns about mode effects are typically outweighed by the gains in representation from reaching more of the target population.”

Principal Research Methodologist, Methodology & Quantitative Social Sciences

“Concerns about mode effects are typically outweighed by the gains in representation from reaching more of the target population.”

Examples from Our Research

We’ve seen firsthand, across a wide range of NORC studies, how effective mixed-mode designs can be. We recently examined two randomly assigned mixed-mode sequences in the 2022 and 2024 General Social Survey (GSS), one that began with face-to-face interviewing and followed up nonrespondents by web, and another that started with a push-to-web approach and reserved face-to-face interviewing for a subsample of nonrespondents.

Looking only at respondents who completed the GSS survey in their initially offered mode, we found that about 30 percent of the survey estimates differed significantly between the face-to-face first and web-first approaches. But once the full mixed-mode sequences, including nonresponse follow-up, were considered, those differences dropped to less than 5 percent, no more than would be expected by chance. At the same time, the web-first approach proved substantially more cost-effective. This example highlights both the value of mixed-mode designs and the importance of evaluating the full sequence rather than any single mode in isolation.

Our AmeriSpeak® research shows a related lesson. With AmeriSpeak, a probability panel designed to be representative of the U.S. population, a mixed-mode design is woven throughout the panel lifecycle. Recruitment relies on mail, text, phone, and in-person outreach, while registration and data collection are offered by web, phone, and computer-assisted personal interviewing, which is in-person interviewing that uses a digital device to ask questions and record responses.

After recruitment, survey invitations arrive mainly by email and phone, with text messaging used in some studies and mail on rare occasions. Data collection itself is typically conducted by web or phone. The mode mix changes based on the specific needs and objectives of each project: building trust, encouraging registration, and securing survey participation each require a different approach.

Separate AmeriSpeak research on in-person nonresponse follow-up (NRFU) also shows just how much is at stake in getting this right. We found that adding in-person NRFU recruitment substantially improved representativeness across several hard-to-reach groups, reducing absolute error against Census benchmarks from 5.6 percent to 1.0 percent among adults ages 18 to 24 and from 5.4 percent to 1.2 percent among Hispanic panelists. In other words, the additional mode didn’t just offer a more convenient option for sample members but materially changed who ended up represented in the panel.

Designing with Purpose

These examples show that there is no universally optimal mixed-mode design. Effective designs are tailored to the population, the study goals, and the stage of participation. Success comes not from offering more modes, but from using the right combination of modes at the right time. Mixing modes requires matching a deliberate combination of contact and data collection strategies to a study’s specific target population, topic, timeline, and budget.

As communication habits keep shifting and pressure on budgets keeps rising, that kind of tailored, evidence-based design, grounded in real experiments rather than a one-size-fits-all playbook, is what will keep surveys representative, credible, and sustainable for years to come.


Mixed-Mode Survey Methods

Explore Our Work

The General Social Survey

Related Project


Sources

Bilgen, I., Hansen, C., & Dutwin, D. (2024). Mixing Modes in Probability‑Based Multi‑Purpose Panels. NORC Center for Panel Survey Sciences Research Brief.

Bilgen, I., & Dutwin, D. (2023). Nonresponse Follow‑up Impact on Panel Sample Composition and Representativeness. NORC Center for Panel Survey Sciences.

Wells, B. M., Christian, L., Bautista, R., Lafia, S., & Davern, M. (2026). Exploring Web and Face-to-Face Sequential Data Collection Designs in the General Social Survey (GSS Methodological Report No. 140, updated July 2026). NORC at the University of Chicago.


Suggested Citation

Bilgen, I. (2026, October 7). Mixed-Mode Survey Design: Reaching People Where They Are. [Web blog post]. Retrieved from www.norc.org.


Tags

Research Divisions



Solutions

Experts

Explore NORC Research Science Projects

Analyzing Parent Narratives to Create Parent Gauge™

Helping Head Start build a tool to assess parent, family, and community engagement

Client:

National Head Start Association, Ford Foundation, Rainin Foundation, Region V Head Start Association

America in One Room

A “deliberative polling” experiment to bridge American partisanship

Client:

Stanford University