rss
Qual Saf Health Care 19:e9 doi:10.1136/qshc.2008.029975
  • Original research

The Patients Preferences Questionnaire for Angina treatment: results and psychometrics from 383 patients in primary care in England

  1. G Rowe3
  1. 1Department of Primary Care and Population Sciences, University College London, London, UK
  2. 2Bristol Heart Institute, University of Bristol, Bristol, UK
  3. 3Consumer Science, Institute of Food Research, Norwich, UK
  1. Correspondence to Professor Ann Bowling, Department of Primary Care and Population Sciences, University College London, Hampstead Campus, Rowland Hill Street, London NW3 2PF, UK; a.bowling{at}ucl.ac.uk
  • Accepted 13 April 2009
  • Published Online First 8 March 2010

Abstract

Objectives To develop a psychometrically valid Patient Preferences Questionnaire for Angina treatment (PPQA).

Setting Seven general practices across England in 2007.

Subjects Convenience sample of 383 patients with diagnosed angina.

Method Postal self-administered questionnaire survey using the full-length PPQA. This comprised 54 items about the three main treatment modalities for angina: medication, angioplasty and coronary artery bypass grafting.

Results The full PPQA was reduced to 18 items, six for each of the three subscales (treatment modalities), by standard psychometric methods. The reduced PPQA was psychometrically sound and valid, although confirmatory factor analyses with a larger sample are required.

Conclusion The PPQA is a potentially useful instrument to help clinicians understand patients' angina treatment preferences.

Treatments for angina range from conservative medical management to more or less invasive revascularisation procedures, with differing profiles of costs, benefits and risks.1–4 Despite standards in the UK for the provision of revascularisation,5 wide variations continue to be documented. For example, analyses of the Hospital Episode Statistics database of all NHS admissions in England showed that, although revascularisation rates increased dramatically, inequities in access to coronary artery bypass graft (CABG) surgery and percutaneous coronary intervention (angioplasty) existed for women and older people.4 However, there is no robust evidence suggesting that women are less likely to benefit from treatment, and some trial evidence has reported good revascularisation outcomes in people aged >75 years compared with outcomes with medical treatment.6 The reasons behind treatment allocation are not clear, although common justifications for inequitable treatment of older people include perceived lack of benefit, the belief that treatments for older people represent an inappropriate use of scarce resources and the perception that such patients do not want more invasive treatments.7 Elder7 argues that the question should not be whether an older person will benefit more or less than a younger person from a specific treatment but whether a patient of any age will benefit more from a specific treatment compared with usual care, at an affordable (ie, cost-effective) price.

It is unknown whether lower rates of cardiac intervention among older people and women reflect differences in cardiac patients' expectations and responses to illness, or variations in supply.8 ,9 Limited evidence suggests that older patients are as prepared as younger patients to accept invasive cardiovascular treatments where appropriate.10 ,11 There is also only limited evidence on whether women prefer less-invasive approaches than men.12–14 Thus, although individual patients may hold different attitudes to treatments, evidence of such differences is sparse.15 Such information is needed to inform decision-making, particularly when treatment alternatives exist with varying benefit-to-risk profiles.

Eliciting patients' preferences for treatment/health care is fraught with methodological challenges. Methods are not standardised: investigators use a wide range of approaches, from utility measures (eg, standard gambles, discrete choice experiments) to single-item questions about preferences. Moreover, neither the information given to patients before eliciting a choice nor the methods of presentation have been standardised. Most publications of randomised controlled trials with patient preference arms do not even specify how patients' treatment preferences were measured.16 The clinical and health literature on patients' preferences is also conceptually limited and devoid of sociopsychological theory.

Aims and methods

The aim of this research was to assess the psychometric properties of a new Patient Preferences Questionnaire for Angina treatment (PPQA), establishing its reliability and validity.

Development of the questionnaire

Conceptual work to identify specific domains of treatment preferences is underdeveloped; thus, no conceptual model existed to inform the development of a questionnaire on patients' preferences for treatment for angina (a preference being defined as a choice made after informed deliberation). A questionnaire was therefore developed based on research with patients with angina in primary care settings; this research used repertory grid analysis, which elicited patients' underlying attitudes towards each treatment choice.17 ,18 This research indicated a wide range of underpinning attitudes, related to perceived risks, side effects, benefits, effectiveness, fears, confidence, significant others' experiences, aesthetics and convenience. The resulting preferences questionnaire aimed to incorporate each of these “constructs” within three treatment domains for angina: medication, angioplasty, CABG surgery. This resulted in 49 attitude statements, which make up the full-length PPQA, each measured with five-point Likert scales (strongly agree to strongly disagree). The attitude items included ones about treatment for angina with medication (16 items), CAGB (19), angioplasty (14) and five general items. The instrument was initially tested on a convenience sample of cardiac inpatients11 ,19 (see Box 1).

Box 1

Original, full-length patients preferences questionnaire (bold items form the final three subscales)

  • Medication items (n=16):

  • 1.Medication would be good to control symptoms

  • 4.The side effects of medication are worse than those from angioplasty

  • 5.I prefer medication as it's easy even if it's less effective than surgery

  • 8.Having to carry medication when outside the home would be troublesome

  • 10.I'm constantly afraid of forgetting my medication

  • 16.With medication, the side effects are often worse than the condition

  • 21.I like to be in control of my own medication

  • 26.Taking medication would be a real hassle

  • 31.Medication doesn't really solve the problem

  • 37.Organising regular prescriptions with any medication can be a nuisance

  • 38.Medication is not usually very risky

  • 41.It's easy to get used to most medication

  • 44.The side effects of medication are worse than those from surgery

  • 48.Most medication is very difficult to understand

  • 50.I prefer medication even if it is less effective than angioplasty

  • 54.Medication would help me to lead an active life

  • Surgery items (n=19):

  • 2.Surgery would prolong my life

  • 6.Surgery would improve my ability to do the things I'd like to do

  • 7.I'd put off having surgery

  • 9.Once you've had surgery there's no going back

  • 11.I'm too old to have surgery

  • 13.The pain of surgery would not put me off having it

  • 14.Scars from surgery would not bother me

  • 15.I am frightened of surgery

  • 18.Surgery would improve my well-being

  • 19.Surgery gives the best chance of cure

  • 23.I hate the idea of being cut open

  • 30.Overall surgery is a good thing

  • 34.I would only consider surgery if my condition worsened

  • 36.The balance of risks and benefits of surgery seem better than the risks and benefits of medication

  • 43.Surgery gets the treatment over with quickly

  • 46.I'd have surgery if I could avoid being a burden on others in the long term

  • 47.People who have surgery seem to do well

  • 49.Surgery is a last resort

  • 53.Having a general anaesthetic is just too risky

  • Angioplasty items (n=14):

  • 3.Once you've had angioplasty there's no going back

  • 12.Angioplasty would improve my well-being

  • 17.I would only consider angioplasty if my condition worsened

  • 20.Angioplasty would improve my ability to do the things I'd like to do

  • 24.Angioplasty gives you the best chances of a cure

  • 25.Overall, angioplasty is a good thing

  • 27.Angioplasty gets the treatment over with quickly

  • 28.The balance of risks and benefits of angioplasty seem better than the risks and benefits of medication

  • 29.I'm frightened of angioplasty

  • 32.People who have angioplasty seem to do well

  • 39.Angioplasty is a last resort

  • 45.I'm too old to have angioplasty

  • 51.Angioplasty would prolong my life

  • 52.I'd put off having angioplasty

A patient information booklet described the risks and benefits of four angina treatments (medication to prevent symptoms recurring, medication to prevent symptoms and reduce heart attack risk, angioplasty, and CABG) and the implications of no treatment. The booklet was based on British Heart Foundation literature and information from collaborating cardiologists and surgeons. Patients were instructed to read the information sheet and the booklet before ranking the four treatments in order of preference, and then completing the attitude statements. Core items from the Coronary Revascularisation Outcome Questionnaire (CROQ)20 were used to measure the impact of angina on the patient's life. Other questions measured strength of treatment preference, treatment acceptability, preferred mode of decision-making21 and sociodemographic characteristics.

The sample

The Medical Research Council General Practice Research Framework has a network of research general practices across Britain, representing approximately 1% of the British population. The target sample, recruited from this, was adult patients with angina. Patients were identified by the participating practice staff using computer searches of their prescribing records to select all patients (aged 18+) currently prescribed medication for angina (nitrate or glyceryl trinitrate spray/tablets/patch, etc) plus a β-blocker, calcium channel blocker, aspirin or clopidogrel (excluding patients only taking the latter). Exclusion criteria were patients who had undergone angiography, CABG or PTCA, patients who were already “flagged” as not wishing to be contacted about research, and those whom doctors decided it would be inappropriate to approach. Patients were sent a personally addressed letter signed by their doctors inviting them to complete the questionnaire, a consent form, the information leaflet, a booklet about the study and reply-paid envelope to return the questionnaire and the consent form to the research team.

The Medical Research Council General Practice Research Framework approached 97 general practices, of which 15 expressed interest, 24 declined and 58 failed to respond. Seven practices finally undertook patient identification, covering County Durham (1 practice), Cleveland (1), Kent (2), Cornwall (1) and Devon (2). They provided a list of 708 patients, of whom 383 (54%) responded. The number of reminders was limited to one by the research ethics committee that approved the study.

Analysis/item selection

Rigorous scientific procedures of psychometric testing were adopted to assess item redundancy, scaling, reliability, validity and factor structure of the PPQA.22–25 Additional analyses (frequency distributions, means, χ2 tests) examined the associations between preferences scale scores and patients' sociodemographic and health status characteristics.

Results

Response

Of 708 questionnaires mailed, 383 (54%) were returned completed after one reminder and 25 (4%) were returned blank (14 gave no reason, 2 denied having angina, 5 declined to participate, 3 stated the person had died, 1 stated the person had Alzheimer's disease). In addition, two patients telephoned saying they did not have angina (refuting their doctors' diagnosis). Of those responding, almost half were aged 75+ (48%), 41% were female and most (99%) were white. Twenty-seven per cent claimed their angina had caused them trouble in the past 4 weeks (“some”, “quite a lot”, “a lot”).

Scaling acceptability and reliability (homogeneity)

Item response rate was 90–94%, except for two items with non-response of more than 10%, which were eliminated (items 9 and 12: see Box 1). Item endorsement did not exceed 80% for any item, only for combinations of categories (eg, “strongly agree” plus “agree”). Item means should be close to the midpoint (2.5 on five-point scales); thus, items <1.25 and >3.75 should be removed. All item means were in an acceptable range. With the skewness statistic, 0 represents a perfectly normal distribution, although it is rarely achieved with patient-based questionnaires. The skew thus judged as acceptable for all items (±1.00).

Item–item correlations were used to eliminate items on grounds of redundancy or non-homogeneity. No item–item correlation exceeded the threshold of >0.70. Six of the medication items, nine of the surgical items and four of the angioplasty items had weak correlations with three or more other items and were eliminated. In addition, items were dropped if their correlations with the total scale score were ≤0.20.25–27 They were also eliminated depending on their influence on Cronbach's α for the scale (by removing each item in turn).

Consideration of all these criteria for scaling and homogeneity resulted in the items shown in bold in Box 1 being selected for inclusion in three 6-item subscales (medication, angioplasty, CABG surgery). All negatively worded items were reverse-coded before Cronbach's α was calculated (as varying directions in the coding can influence the result) and before summing to form the subscale scores (low scores=most positive preferences; high scores=most negative preferences). Table 1 shows the final subscale score distributions. Attitudes were most negative towards the two more invasive treatments, angioplasty and CABG surgery. The subscale shows that 41% of respondents scored ≥18 (mid-point of the scale) for angioplasty compared with 39% for CABG and 22% for medication.

Table 1

Subscale distributions

Tables 2a–c show that thresholds for inclusion were met for item–item and item–total correlations, means, Cronbach's α's and skew for the retained items.

Table 2a

Medication items: item–item correlations (homogeneity)

Table 2b

Angioplasty items: item–item correlations (homogeneity)

Table 2c

Surgery items: item–item correlations (homogeneity)

The final subscales achieved acceptable Cronbach's α's >0.70 (table 3). All subscale–total correlations were statistically significant (Spearman's rank order: angiography–total: 0.806, p<0.01; CABG–total: 0.689, p<0.01; medication–total: 0.335, p<0.01). Items correlated more highly with their own subscales than with the other two subscales, confirming their homogeneity as well as their convergent and discriminant validity. Item–item correlations for each subscale are shown in table 3.

Table 3

Reliability (homogeneity)

Test–retest correlations at 4 weeks for all subscale items with a small volunteer subsample (n=10) ranged between Spearman's r of 0.325 and a perfect correlation of 1.00; 11 of the 18 item correlations were >0.50.

Validity

Table 4 shows that correlations were in the expected directions: respondents who scored worst on the CROQ symptoms and psychosocial functioning scales were more likely to express preferences for the most invasive procedure (CABG) and less likely to express preferences for the least invasive treatment (medication). There were no associations with angioplasty (widely considered to be the mid-level procedure with respect to invasiveness) and the CROQ variables.

Table 4

Convergent and discriminant validity correlations (Spearman's rank order)

The subscale–subscale correlations were acceptable, with medication being the weakest (not unexpectedly, as all patients were already taking medication but had not experienced angiography or surgery, and thus might feel positive towards it regardless of their feelings for the other treatments).

The surgery subscale was highly significantly associated with all CROQ subscales except physical functioning, in support of its construct validity: as might be expected, more positive attitudes towards surgery were associated with greater impact of the condition on life. It was not associated with age or sex. The associations with medication were the reverse (only statistically significant for CROQ psychosocial functioning and symptoms), as would also be expected (except for physical functioning, where there was no association). The mid-level invasive treatment subscale (angioplasty) was not significantly associated with the CROQ subscales.

Table 5 adds further support to the construct validity of the subscales as strength of preference and degree of acceptability of each treatment correlated significantly, in the expected directions, with each one.

Table 5

Validity correlations

Exploratory factor analysis was used to explore attitude dimensions underlying the questionnaire, using the criteria that the correlation matrix should reveal many coefficients >0.30, the Kaiser–Meyer–Olkin Measure of Sampling Adequacy should exceed >0.6028 ,29 and Bartlett's Test of Sphericity should be statistically significant at p=0.001 to support the factorability of the correlation matrix (suggesting factor analysis is appropriate).30 Eigenvalues should be >1.0 to support the construct validity of the scale. Factor analysis of the 18 items that make up the three subscales produced four factors accounting for 57% of the total variation between patients. Factor 1 comprised mainly CABG surgery items, component 2 comprised mainly angioplasty items and components 3 and 4 comprised mainly, but overlapping, medication items.

Discussion

The PPQA was shown to be reliable and valid with our sample, although its factor structure requires further confirmation with a larger representative sample of patients with cardiovascular disease in primary and secondary care. The analyses strongly support the psychometric properties of the angioplasty and surgery preference subscales, whereas medication was the weakest. This is unsurprising as medication can be popular because of its low invasiveness and does not exclude positive attitudes towards more invasive treatments.

The preference subscales showed that attitudes were most negative towards the two more invasive treatments: angioplasty and CABG surgery. More positive attitudes towards CABG surgery, and more negative attitudes towards medication, were associated with greater impact of the condition on life. The CABG subscale (although not the others) was highly significantly associated with greater severity of disease on all CROQ subscales except ADL, in support of its construct validity.

The UK NHS modernisation plan included setting up the Expert Patients' Programme, which aimed to involve people more in their health care, increasing patient choice. Development of knowledge on patients' preferences for treatment could inform policy and shared decision-making between patients and doctors, empower patients, strengthen patient choice and thereby patients' adherence to treatment, with implications for treatment effectiveness. The increasing use of evidence-based medicine has been described as marking a paradigm shift in clinical practice.31 Patient-centred medicine has similarly been described as a “Copernican Revolution”.32 ,33 The development of the PPQA contributes to the growing body of evidence-based patient choice, by providing an instrument through which patients' relative preferences for treatments can be established, along with indicators of their rationales for choice.

Acknowledgments

We would like to thank staff at the Medical Research Council General Practice Research Framework for facilitating the study and recruiting the practices, and the practice staff who sampled the patients and despatched our questionnaire packs and reminders. AB would like to thank Professor Paul Dieppe, formerly director of MRC HSRC, for funding her time for managing, analysing and writing up the study, and Ms Corinne Ward for managing the questionnaire mailing, and reminders, with the practices, checking in replies, coding, data entry and management on SPSS. Ethical consent for the study was given by London MREC, and the R&D and Clinical Governance sections of the PCTs within each practice area.

Footnotes

  • Funding Medical Research Council Health Services Research Collaboration.

  • Competing interests None.

  • Patient consent Obtained.

  • Provenance and peer review Not commissioned; externally peer reviewed.

References

Free sample

This recent issue is free to all users to allow everyone the opportunity to see the full scope and typical content of BMJ Quality & Safety.
View free sample issue >>

Email alerts

Don't forget to sign up for content alerts so you keep up to date with all the articles as they are published.