Abstract
Background: Performance measurement and quality of care in community pharmacy settings is problematic because of the lack of formal patient registration and the resultant risk of selection bias. Although simulated patients have been used for teaching and education purposes, particularly in medical settings, their use as a research tool requires exploration in other health settings. The purpose of this paper is to describe how we used simulated patients to measure professional performance of community pharmacy staff.
Method: Sixty pharmacies participated in a randomised controlled trial (RCT) to evaluate the effectiveness and efficiency of two guideline implementation strategies in the community pharmacy setting. The primary outcome measure for the study was derived from assessment forms completed by simulated patients following covert visits to participating pharmacies.
Results: Of the 420 simulated patient visits scheduled, 384 (91%) were completed. Nine visits were reported by pharmacy staff using reply-paid postcards, four of which concurred with known SP visits. Each detected visit was made by a different SP. In a post-intervention survey, 26 (52%) pharmacists stated they had been apprehensive about the use of simulated patients as part of the study, however, 41 (82%) pharmacists agreed that SP visits were an acceptable research method to use in a community pharmacy setting.
Discussion: Simulated patients are a feasible method of assessing professional performance in community pharmacy settings and overcome the methodological problems of other measurement methods. Further research is needed to assess the reliability and validity of simulated patients.
Similar content being viewed by others
References
Royal Pharmaceutical Society of Great Britain. Bibliography: Prescription only medicines reclassified to pharmacy only medicines. London: RPSGB, 2001.
Mobey N, Wood A, Edwards C, Jepson MH. An assessment of the response to symptoms in community pharmacies. Pharmaceut J 1986; 237: 807.
Anonymous. More “consumer” research. Pharmaceut J 1991; 251.
Goodburn E, Mattosinho S, Mongi P, Waterston A. Management of childhood diarrhoea by pharmacists and parents: is Britain lagging behind the third world? BMJ 1991; 302: 440–3.
Anonymous. Counter advice. Consumers are still not receiving the right advice when buying medicines from pharmacists. WHICH 1999; 22–5.
Scottish Department Executive. Report on the council meeting of the Royal Pharmaceutical Society. Pharmaceut J 1992; 248: 219.
Sinclair HK, Bond CM, Lennox AS, Winfield AJ. The sale of nicotine replacement therapies from community pharmacies. Tobacco Control 1995; 4: 338–43.
Last JM. A dictionary of epidemiology. Oxford: Oxford University Press, 1995.
Finn A, Kayande U. Unmasking a phantom: a psychometric assessment of mystery shopping. J Retailing 1999; 75: 195–217.
Watson MC, Bond CM, Grimshaw JM, Mollison J, Ludbrook A, Walker AE. Educational strategies to promote evidence-based community pharmacy practice: A cluster randomised controlled trial (RCT). Fam Pract 2002; 19: 529–36.
Education group for guidelines on evaluation. Guidelines for evaluating papers on educational interventions. BMJ 1993; 318: 1265–7.
Rethans J, Saebu L. Do general practitioners act consistently in real practice when they meet the same patient twice? BMJ 1997; 314: 1170–3.
Saebu L, Rethans J. Management of patients with angina pectoris by GPs: a study with standardized (simulated) patients in actual practice. Fam Pract 1997; 14: 431–5.
Peabody J, Luck J, Glassman P, Dresselhaus T, Lee M. Comparison of vignettes, standardised patients, & chart abstraction: a prospective validation study of 3 methods for measuring quality. J Am Med Assoc 2000; 283: 1740–2.
Madden J, Quick J, Ross-Degnan D, Kafle K. Undercover care-seekers: simulated clients in the study of health provider behaviour in developing countries. Soc Sci Med 1997; 10: 1465–82.
Degnan DR, Soumerai S, Goel P, Bates J, Makhulo J, Dondi et al. The impact of face-to-face educational outreach on diarrhoea treatment in pharmacies. Health Plan Policy 1996; 11: 308–18.
Krska J, Greenwood R, Howitt E. Audit of advice provided in response to symptoms. Pharmaceut J 1994; 252: 93–6.
Neto ACA, Benrimoj SI, Kavanagh DJ, Boakes, RA. Novel educational training program for community pharmacists. Am J Pharmaceut Educ 2000; 64: 302–7.
Neto ACA, Kelly F, Benrimoj SI. Shaping practice behaviour: novel training methodology. Int J Pharm Pract 2001; 9: 203–10.
Norman GR, Neufeld VR, Walsh A, Woodward CA, McConver GA. Assuring physician's performances by using simulated patients. J Med Educ 1985; (60): 925–34.
Hazelkorn H, Robins L. Actors Play patients: using surrogate patients to look into private practice. Public Health Rep 1996; 111: 129–32.
Silvestre A, Gehl M, Encandela J, Schelzel G. A participant observation study using actors at 30 publicly funded HIV counselling & testing sites in pennsylvania. Am J Public Health 2000; 90: 1096–9.
Gallagher T, Lo B, Chesney M, Christensen K. How do physicians respond to patients' requests for costly, unindicated services. J Gen Intern Med 1997; 12: 663–38.
Hutchinson B, Woodward C, Norman G, Abelson J, Brown J. Provision of preventive care to unannounced standardised patients. Can Med Assoc J 1998; 158: 185–93.
Rubin Z. Designing honest experiments. Am Psychol 1973; 28: 445–8.
Gallagher TH, Lo B, Chesney M, Christensen K. How do physicians respond to patients' requests for costly, unindicated services. J Gen Intern Med 1997; (12): 663–8.
Rubin Z. Designing Honest Experiments. Am Psychol 1973; (28): 445–8.
Beullens J, Rethans JJ, Goedhuys J, Buntinx F. The use of standardized patients in research in general practice. Fam Pract 1997; 14(1): 58–62.
Yelland MJ. Standardized patients in the assessment of general practice consulting skills. Med Educ 1998; 32: 8–13.
Morrison LJ, Colman AM, Preston CC. Mystery customer research: cognitive processes affecting accuracy. J Market Res Soc 1997; 39(2): 349–61.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Watson, M.C., Skelton, J.R., Bond, C.M. et al. Simulated patients in the community pharmacy setting – Using simulated patients to measure practice in the community pharmacy setting. Pharm World Sci 26, 32–37 (2004). https://doi.org/10.1023/B:PHAR.0000013467.61875.ce
Issue Date:
DOI: https://doi.org/10.1023/B:PHAR.0000013467.61875.ce