Article Text

Download PDFPDF

075 The Use of GRADE Methods in the World Health Organization (Who) Public Health Guidelines (PHG): Distribution of Strength of Recommendations and Confidence in Estimates of Effect
  1. P Elias1,
  2. S Norris2,
  3. J Brito3,
  4. R Stoltzfus4,
  5. L Bero5,
  6. B Djulbegovic6,
  7. I Neumann1,7,
  8. V Montiori3,
  9. G Guyatt1
  1. 1McMaster University, Hamilton, Canada
  2. 2World Health Organization, Geneva, Switzerland
  3. 3Mayo Clinic, Rochester, MN, USA
  4. 4Cornell University, Ithaca, USA
  5. 5Universtity of California, San Francisco, USA
  6. 6University of South Florida, Tampa, USA
  7. 7Pontificia Universidad Catolica de Chile, Santiago, Chile


Background A perception exists that expert guideline panellists are sometimes reluctant to offer weak/conditional/contingent recommendations. GRADE guidance warns against strong recommendations when confidence in estimates of effect is low or very low (low or very low quality evidence), suggesting that such recommendations may seldom be justified.

Objectives To characterise the distribution of strength of recommendations and confidence in estimates of effect in WHO guidelines that have used the GRADE approach and graded strength of recommendations and confidence in effect estimates.

Methods We reviewed guidelines listed in the WHO guidelines database as of November 2012. We identified those that use GRADE and, in these guidelines, examined the distributions of strong and weak and associated confidence in estimates of effect (high, moderate, low, and very low).

Results We identified 116 WHO guidelines; 48 (41.3%) referred to GRADE methods, and 43 (37%) utilised GRADE and provided both a strength of recommendation and confidence in estimates grading. These 43 guidelines included 456 recommendations, of which 290 (63.6%) were strong and 166 (36.4%) were conditional/weak. Of the 290 strong recommendations, 97 (33.4%) were based on evidence warranting low confidence in estimates of effect and 63 (21.7%) on evidence warranting only very low confidence.

Discussion Strong recommendations based on low or very low confidence in effect estimates are very frequently made in WHO guidelines. Further study to determine the reasons for such recommendations is warranted.

Implications for Guideline Developers/Users Guideline authors should provide a clear, compelling rationale for any strong recommendations based on low confidence estimates.

Statistics from

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.