Skip to main content

Improving the Institutional Transformation Assessment

A person sits on a stool reading a book between two library shelves
Adding a state policy rubric to enhance a self-assessment tool for colleges
  • Client
    Bill & Melinda Gates Foundation
  • Dates
    2018 - 2019

Problem

An assessment tool for college administrators needed an added feature.

College administrators use the Institutional Transformation Assessment (ITA), an inquiry and learning tool, to help them better understand their institutions’ strengths and challenges, and from there, prioritize their improvement efforts. However, there was room to improve the tool by developing an additional rubric to assess how prepared institutions are to work with state policymakers.

Solution

NORC was hired to help improve the Institutional Transformation Assessment.

In 2018, the Bill & Melinda Gates Foundation contracted NORC at the University of Chicago to provide technical assistance to increase the tool’s validity and reliability. Following these improvements, the Gates Foundation and ITA designers and stakeholders requested a supplemental state policy rubric for the ITA. In 2019, NORC partnered with HCM Strategists to create the state policy rubric and assessment metrics.

Result

The new rubric helps administrators assess how well their colleges work with state policymakers.

NORC researchers improved the following:

  • The content validity of the state policy rubric: All relevant topics of interest were evaluated and key topics were included.
  • The construct validity of the state policy rubric: Appropriate rubric criteria were included in order to measure variations in the key constructs.
  • Measurement clarity: Each dimension in the state policy rubric is clearly articulated and measurable.

Explore NORC Education Projects

2023 American Law School Faculty Study

Reviewing law school policies and understanding the career pathways of law school teaching faculty

Client:

Association of American Law Schools

2024 National Survey of Early Care and Education

Examining early care and education after major disruption

Client:

Office of Planning, Research, and Evaluation in the Department of Health and Human Services