Skip to main content

Can You Trust Panel Surveys? Transparency Is Key.

Research Brief
Person looking at charts on a tablet

Authors

David Dutwin
Executive Director & Senior Vice President, AmeriSpeak

April 2025

Our “12 Pillars of Panel Transparency” framework helps researchers evaluate survey panels by providing clear guidance on recruitment, methodology, and data quality.

As director of AmeriSpeak®, I’ve observed how methodological transparency directly impacts research integrity. In our field, the difference between reliable insights and questionable conclusions often hinges on transparent practices.

“The difference between reliable insights and questionable conclusions often hinges on transparent practices.”

Executive Director & Senior Vice President, AmeriSpeak

“The difference between reliable insights and questionable conclusions often hinges on transparent practices.”

Many researchers face challenges evaluating panel quality because providers’ disclosures frequently lack sufficient detail for proper assessment. This gap in information can compromise research validity.

Our 12 Pillars of Panel Transparency framework addresses this concern by providing researchers with a comprehensive evaluation structure. These touchpoints cover critical areas from recruitment sampling and methodology to response rates and data quality controls—all essential elements for assessing potential biases.

By understanding these key transparency dimensions, researchers can better evaluate panel representativeness, identify limitations, and contextualize findings appropriately. This knowledge empowers more informed methodological decisions and ultimately strengthens research outcomes.

Transparency isn't just good practice—it’s fundamental to scientific integrity.



Main Takeaways

  • Methodological transparency is essential to maintaining research integrity and ensuring reliable insights.
  • Researchers often struggle to assess panel quality because many providers’ disclosures lack the necessary detail.
  • Transparent practices strengthen research outcomes and contribute to scientific integrity.



Suggested Citation

Dutwin, D. (2025, April 9). Can You Trust Panel Surveys? Transparency Is Key.   [Web blog post]. NORC at the University of Chicago. Retrieved from https://www.norc.org.


Tags

Research Divisions

Departments, Centers & Programs



Experts

Explore NORC Research Science Projects

Analyzing Parent Narratives to Create Parent Gauge™

Helping Head Start build a tool to assess parent, family, and community engagement

Client:

National Head Start Association, Ford Foundation, Rainin Foundation, Region V Head Start Association

America in One Room

A “deliberative polling” experiment to bridge American partisanship

Client:

Stanford University