Table 3

List of the desirable characteristics of review criteria and mean importance and feasibility ratings, ordered by importance rating

Mean rating
CharacteristicImportanceFeasibility
Criteria are described in unambiguous terms6.75.6
Criteria are based on a systematic review of research evidence6.65.0
The validity of identified research is rigorously appraised6.55.5
Criteria include clear definitions of the variables to be measured6.55.9
Criteria explicitly state the patient populations to which they apply6.45.9
Criteria are capable of differentiating between appropriate and inappropriate care6.35.0
Criteria are linked to improving health outcomes for the care being reviewed6.34.7
Criteria explicitly state the clinical settings to which they apply6.25.8
The collection of information required for criteria based review minimises demands on staff6.26.4
The method of selecting criteria is described in enough detail to be repeated6.15.8
Criteria are accompanied by clear instructions for their use in reviewing care6.16.0
The systematic review used to guide the selection of criteria is up to date6.05.4
Criteria are pilot tested for practical feasibility6.05.1
Criteria include aspects of care that are relevant to patients6.04.9
The collection of information for criteria based review is acceptable to those patients whose care is being reviewed6.05.2
The bibliographic sources used to identify research evidence are specified5.96.3
In selecting criteria, decisions on trade-offs between outcomes from different treatment options are stated5.94.5
The collection of information required for criteria based review minimises demands on patients5.95.3
The method of synthesising evidence and expert opinion is made explicit5.85.3
Criteria are prioritised according to the quality of supporting evidence5.84.9
Criteria are prioritised according to their impact on health outcomes5.84.5
The criteria used to assess the validity of research are stated5.65.8
Similar criteria should emerge if other groups review the same evidence5.54.6
The collection of information for criteria based review is acceptable to those staff whose care is being reviewed5.54.8
Expert opinion is included in the process of developing review criteria5.35.5
Criteria used in previous quality reviews of the same clinical topic are considered for inclusion5.35.8