Article Text

PDF
Assessing content validity and user perspectives on the Team Check-up Tool: expert survey and user focus groups
  1. Jill A Marsteller1,2,
  2. Yea-Jen Hsu1,
  3. Kitty S Chan1,
  4. Lisa H Lubomski2
  1. 1Department of Health Policy and Management, Johns Hopkins University Bloomberg School of Public Health, Baltimore, Maryland, USA
  2. 2Johns Hopkins Medicine Armstrong Institute for Patient Safety and Quality, Baltimore, Maryland, USA
  1. Correspondence to Dr Jill A Marsteller, Health Policy and Management, Johns Hopkins University Bloomberg School of Public Health, 624 North Broadway, Room 433 Baltimore, MD 21205, USA; jmarste2{at}jhu.edu

Abstract

Objective This study assesses content validity and user feedback on the Team Check-up Tool (TCT), an instrument used for measuring dynamic context of quality improvement (QI) teams and their implementation of QI activities.

Methods We conducted two focus groups and one larger feedback session with TCT users to assess feasibility, importance of areas of inquiry and barriers to use. A panel of eight QI experts evaluated the item-by-item content (content validity) of TCT by rating the relevance of each item to implementation success. We calculated item-level and scale-level content validity using the content validity index (CVI).

Results Scale-level CVI was 0.872. Highly rated items included implementation of recommended interventions, educational activities, team review of performance data, team sharing of performance data with staff and specific barriers to progress. Four items were rated relatively low: presentation of performance data to the hospital/health system board; manner of provision of feedback of data to staff; to what other units the team attempted to spread and turnover of QI team members. Items identified in user focus groups as important included whether there were events distracting staff from the initiative, number of team meetings and turnover of QI team members. Focus groups also identified barriers to the completion of the tool, including lack of feedback and response fatigue during stable activity periods.

Conclusion The findings support the conclusion that the TCT measures meaningful areas of context and implementation in team-based QI initiatives, particularly intervention activity tracking, review and sharing of performance data and team progress barriers. We offer a modified instrument with a framework for real-time measurement of important elements of implementation and context of QI teams based on the findings.

  • Continuous quality improvement
  • Teams
  • Implementation science

Statistics from Altmetric.com

Request permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.