A New, Cost-Effective Method to Improve the Quality of Language Translation for Survey Research
Authors
Barbara Fernandez
Associate Director, Health Care Programs
Lisa Lee
Principal Research Methodologist, Methodology & Quantitative Social Sciences
April 2025
Based on a literature review and interviews with translation experts, we developed a language translation approach for survey projects with short timelines and small budgets.
We’ve been conducting surveys for 25+ years. We know how important it is for data quality to get full participation from survey respondents, even those with limited English-language ability. We’ve also seen low participation rates among segments of a target population when survey materials aren’t translated or are not properly translated.
This happens because best-practice translations are expensive, take a long time to develop, and involve large teams. Depending on the size and characteristics of the population, nonresponse and nonresponse bias can be introduced when research respondents are unable to participate, and it might not be possible to disaggregate the data because of small numbers and the need to protect respondents’ confidentiality.
If translations are not done well, the data itself are at risk of measurement errors, as respondents may interpret questions and response options differently based on the translation and thus respond differently.
We wanted to develop a translation approach for projects with smaller budgets and limited time. Additionally, well-translated survey materials help ensure the voices of people affected by policy and program decisions are reflected in the data that inform those decisions.
As we recently published in Survey Practice, we conducted a scan of the literature and collected input from seven translation experts to develop a practical, collaborative approach with translation vendors that researchers can use to include key components of a high-quality, committee translation approach.
For the literature review, we identified relevant articles in academic journals and reports from federal agencies and research organizations. We identified experts from individuals in marketing, academic, governmental, and nongovernmental research institutions in the United States and Europe who had published in this topic area, as well as referrals from colleagues.
The foundations of this approach are:
- A thorough vetting of the translation vendor to ensure they have the necessary expertise and experience and are willing to collaborate in the process of reviewing and adjudicating the translation
- Assembling an internal team with the linguistic and research experience to serve as reviewers and adjudicators of the translations
- Providing background materials on the study, population, mode, languages, and topics to all members of the translation team
- Conducting a three-step process that includes a first review, adjudication, and a second review
- Documenting the entire process for transparency
Main Takeaways
- Researchers should not assume that small budgets or limited timelines prevent them from including high-quality translations.
- Selecting a translation vendor by asking pertinent questions allows you to identify a translator that has the qualifications and experience your project needs.
- Don’t assume that someone can provide insightful feedback just because they speak the language. Select a review team that has the in-language skills and the research expertise.
- You can save time and increase the quality of translations if you provide translators and reviewers background information on the project’s purpose, goals, population, mode, language, and topics.
- As part of your technical reports, document the translation process for transparency.
Policy Implications
We hope that by providing translation guidance for smaller projects, we can help health policy makers get better data to make informed decisions.
Suggested Citation
Fernandez, B. and Lee, L. (2025, April 10). A New, Cost-Effective Method to Improve the Quality of Language Translation for Survey Research. [Web blog post]. NORC at the University of Chicago. Retrieved from https://www.norc.org.
