Notes
Article history
The research reported in this issue of the journal was commissioned and funded by the HTA programme on behalf of NICE as project number 07/62/01. The protocol was agreed in January 2008. The assessment report began editorial review in September 2008 and was accepted for publication in October 2008. The authors have been wholly responsible for all data collection, analysis and interpretation, and for writing up their work. The HTA editors and publisher have tried to ensure the accuracy of the authors’ report and would like to thank the referees for their constructive comments on the draft document. However, they do not accept liability for damages or losses arising from material published in this report.
Declared competing interests of authors
None
Permissions
Copyright statement
© 2009 Queen’s Printer and Controller of HMSO. This monograph may be freely reproduced for the purposes of private research and study and may be included in professional journals provided that suitable acknowledgement is made and the reproduction is not associated with any form of advertising. Applications for commercial reproduction should be addressed to: NETSCC, Health Technology Assessment, Alpha House, University of Southampton Science Park, Southampton SO16 7NS, UK.
2009 Queen’s Printer and Controller of HMSO
Chapter 1 Background
Description of health problem
Stable angina
Angina is the term used to describe symptoms that indicate inadequate perfusion of the heart (ischaemia), and it is characterised by discomfort in the chest, shoulder, back, arm or jaw. Angina symptoms are highly subjective and there is little correlation between these and the extent of cardiac ischaemia. 1 This condition is most commonly caused by coronary artery atherosclerotic disease, whereby atherosclerotic plaques impede blood flow to the heart. Risk factors include hypertension, overweight and elevated serum cholesterol levels. Other less common causes of angina include valvular heart disease, uncontrolled hypertension and endothelial dysfunction not associated with atherosclerosis. The severity of angina can be indicated using the Canadian Cardiovascular Society (CCS) class scale. There are three types of angina: stable, unstable or variant. 2,3
There are approximately 95,000 new cases of angina in the UK each year, around 52,000 cases in men and 43,000 in women, with an estimated 5% of men and 3% of women aged 35 and over having experienced angina. 4 Estimates for 65- to 74-year-olds are 6–16% of men and 3–10% of women. 2 The studies on which these figures are based did not distinguish between the different types of angina. It has been estimated that in 2000 the cost of National Health Service (NHS) health care that could be directly attributed to angina was £669 million, and the largest proportion of this cost was hospital admission, particularly in relation to revascularisation procedures. 5
Stable angina is defined as angina symptoms that have followed a predictable pattern over 2 months. 2 This type of angina is triggered by activities that increase oxygen demand, such as exercise, stress, cold weather and eating. The pain is usually relieved by rest or medication. 6
Stable angina is managed primarily through education and lifestyle advice, drug therapy and vascular surgery. Glyceryl trinitrate is used for immediate relief and prevention of angina symptoms before exertion. Beta-blockers, calcium channel blockers, potassium channel activators and long-acting nitrates are used singly or in combination to alleviate angina symptoms in the long term. As patients with angina due to coronary heart disease (CHD) have an increased risk of cardiovascular disease (CVD) events, they may also receive preventative drug treatment such as antiplatelet therapy, lipid lowering therapy and angiotensin converting enzyme (ACE) inhibitors. Additionally, coronary revascularisation may be used to relieve symptoms in selected high risk patients with particular coronary anatomy, but may not necessarily improve mortality compared with medical management. 7 The techniques currently used are percutaneous coronary intervention (PCI) or coronary artery bypass grafting (CABG). 6
A number of patients exhibit angina that is not ideally controlled with the (apparently) optimal dose of medication and has also exhausted all coronary revascularisation options. This is termed refractory stable angina; the numbers of those affected by it are unknown; however, a Swedish investigation carried out in 1998 suggested that 5–15% of patients referred for coronary angiography may have had refractory stable angina. 8 Although some studies have shown that symptoms of angina that initially seems refractory are improved by optimising drug regimens, some patients remain incapacitated by their angina pain. 8 The Scottish Intercollegiate Guidelines Network (SIGN) guidelines for management of refractory angina recommend that, initially, rehabilitative, educational and cognitive behavioural methods should be employed. 6 Other therapeutic options which could then be considered include spinal cord stimulation (SCS), transcutaneous electrical nerve stimulation (TENS), left stellate ganglion blockade, endoscopic thorascopic sympathectomy, angiogenesis, opioids and surgical transmyocardial revascularisation, although there is little evidence of the effectiveness of these methods. 6,8
Heart failure
Heart failure is symptomatic of the inability of the heart to precisely respond to the physiological demands for increased cardiac output. It may arise through a cardiac or non-cardiac disorder. The most common cause of heart failure is myocardial dysfunction, most frequently the type in which left ventricular contraction is reduced. The majority of cases are due to CHD, usually with a history of myocardial infarction. Other cases are due to non-ischaemic cardiomyopathy, which has a variety of causes such as hypertension, alcohol excess and idiopathic dilated cardiomyopathy. A classification system for the severity of heart failure has been produced by the New York Heart Association (NYHA). 9,10
Heart failure can be chronic or acute. Chronic heart failure is characterised by symptoms such as exertional breathlessness and fatigue, signs of fluid retention and signs of any underlying cardiac disorder. The term acute heart failure is mainly used to describe acute (cardiogenic) dyspnoea and signs of pulmonary congestion including pulmonary oedema. Data from the Heart of England Screening Study suggest that more than 3% of people in the UK aged 45 years and over have definite or probable heart failure,4 and the Hillingdon Heart Failure Study estimated that approximately 40% of people die within 1 year of initial diagnosis. 11 Heart failure has been shown to have a detrimental effect on quality of life (QoL) when compared with the general population. 12 The areas most affected were physical function, role limitation due to physical function, social functioning, energy and health perception. 12
In order to prevent the progression of heart failure, a number of pharmacological therapies are used. The main classes of these are ACE inhibitors, beta-blockers, angiotension receptor blockers, aldosterone antagonists, diuretics, loop diuretics with metolazone, and digoxin. Patients with chronic heart failure often have underlying CVD and commonly have other conditions, such as renal impairment or angina, for which they receive additional treatment. 9
Description of technology under assessment
Enhanced external counterpulsation (EECP) is a device that can be used in stable angina to relieve angina symptoms. Although it is widely used in North America, use of this technique in Europe is limited. 8 To date, it has been utilised in chronic stable angina patients who are not suitable for coronary revascularisation or those who have chosen not to undergo revascularisation. 6,13 If effective, EECP may offer a therapeutic alternative that does not involve the risks carried by surgery. However, the role of EECP has not yet been well defined. 13 Despite heart failure previously being a contraindication for EECP, the use of EECP in mild heart failure has recently been investigated following positive outcomes in patients with both angina and heart failure in two small studies. 14
EECP is a non-invasive device in which three paired pressure cuffs are wrapped around the patient’s calves, lower thighs and upper thighs, and are inflated in this order during diastole. These cuffs deflate simultaneously at the onset of systole, thus releasing the pressure. Coronary perfusion pressure is improved through diastolic augmentation, which improves afterload reduction, and increased venous return, which in turn increases cardiac output. The release of pressure during systole also decreases peripheral vascular resistance, thereby enhancing systolic unloading and decreasing cardiac workload. Throughout this process, the patient is connected to an electrocardiogram (ECG) monitor and a finger plethysmograph, to measure changes in arterial blood flow. The R wave of the ECG is used as the trigger for inflation and deflation. The course of treatment typically involves 35 sessions each lasting 1 hour over a 7-week period. 13 The timing between EECP sessions can vary in clinical practice, depending on patient preference and tolerance for the therapy. This treatment regimen has been developed empirically, and alternatives have not yet been investigated. There appear to be few adverse effects associated with this treatment but those reported are related to the equipment used, i.e. leg and back pain, abrasion of skin, bruising, blistering, oedema and paraesthesia. 13
Previous systematic reviews
A recent review of EECP by the Ontario Ministry of Health and Long-Term Care summarised data derived from two randomised controlled trials (RCTs) and a number of case series and registry data to evaluate the efficacy of EECP for refractory stable angina and heart failure. For angina, a number of outcomes were investigated using data from one RCT, the Multicenter Study of Enhanced External Counterpulsation (MUST-EECP) trial (n = 139), one comparative study with age and gender matched controls (n = 40), nine sets of registry data that varied in size from 249 to 4592 patients and seven case series involving 23–1532 patients. The effects of EECP on heart failure were assessed using data from one RCT, the Prospective Evaluation of EECP in Congestive Heart Failure (PEECH) trial (n = 187), four sets of registry data ranging from 127 to 1958 patients and one case series (n = 32). 14
The RCTs indicated that EECP may be beneficial in both chronic stable angina and heart failure. The other studies (registry data and case series) also suggest that EECP may improve patient outcomes. Angina patients were reported to decrease nitroglycerin use, experience a reduction in angina symptoms and show an improvement in angina class and in QoL. Improved left ventricular ejection fraction (LVEF), NYHA functional class, decreased rate of exacerbation and improved QoL were reported in heart failure patients. However, there were numerous methodological limitations to the registry data and case series, such as lack of comparison group, conclusions based on subjective assessment and lack of completion of the case series study for heart failure. Overall, this review concluded that there was insufficient evidence to support the use of EECP in refractory stable angina CCS III–IV or heart failure. Adverse events (AEs) were also reported in eight studies (five registry studies, n = 10,969, and three case series, n = 2662) for angina and five studies for heart failure (four registry studies, n = 3193, and one case series, n = 32). The AEs reported in studies that investigated EECP for angina included serious cardiac events and major adverse cardiac events (MACEs), musculoskeletal and skin trauma, myocardial infarction (MI), angina, chest pain or silent ischaemia, ECG change, arrhythmia, revascularisation procedures and death. When reported, the AE rate ranged from 3% to 40%. In the studies that investigated EECP for heart failure, the AEs reported included MACEs, death, PCI and incidence of all-cause hospitalisations, and rates ranged from 5% to 72%. 14
The search end date for this review was March 2006. It was unclear how extensive the searches were, as the search strategy was not available. Also, only English language articles were included, and it was unclear whether unpublished studies were sought. Therefore, we conducted new searches for evidence rather than update this earlier review.
Definition of decision problem
There is a question regarding whether EECP should be a more widely available therapy within the NHS and whether further research should be conducted in order to help in the making of that decision. This report presents our technology assessment of EECP for stable angina and heart failure. The primary objectives were (1) to determine the clinical effectiveness and cost-effectiveness of EECP compared with usual care and placebo for chronic stable angina and heart failure and (2) to undertake analyses of the expected value of information (EVI) to assess the potential value of future research on EECP.
Chapter 2 Assessment of clinical effectiveness
Methods for reviewing clinical effectiveness
The systematic review of the evidence for clinical effectiveness was undertaken following the general principles recommended in the Centre for Reviews and Dissemination (CRD) Report 4. 15
Search strategy
Searches were undertaken during November and December 2007 to identify published and unpublished relevant clinical and cost-effectiveness literature. MEDLINE, MEDLINE In-process, EMBASE, CINAHL, Cochrane Database of Systematic Reviews, CENTRAL, DARE and Inside Conferences were searched. The National Research Register, ClinicalTrials.gov, Current Controlled Trials Meta Register and the US Food and Drug Administration website were searched as well as the website of the main EECP manufacturer, Vasomedical. The searches were limited to material produced since 1980. No language or geographical restrictions were applied. Update searching was conducted in March 2008 on selected databases. Full details of the search strategies are reported in Appendix 1. In addition, the main manufacturer was contacted for relevant information.
Titles and abstracts were examined for relevance by two researchers, and all potentially relevant papers were ordered. Full papers were independently examined for relevance by two researchers based on the inclusion criteria below. Disagreements were resolved by consensus.
Inclusion and exclusion criteria
Studies were included in the review if they met the following criteria:
-
Population Patients with chronic stable angina or heart failure.
-
Intervention EECP using the prescribed dose of 35 hours of treatment over a continuous period without significant breaks (usually once or twice daily over 4–7 weeks).
-
Comparator treatment Usual care (drugs, cardiac rehabilitation, revascularisation) or placebo (sham EECP). Dose comparison trials were also eligible, if available.
-
Outcomes Mortality due to CHD, all-cause mortality, and morbidity measures such as hospitalisation, change in angina severity classification (CCS classification), change in heart failure severity classification (NYHA classification), diuretic dose (in heart failure), exercise duration on treadmill, time to 1-minute ST segment depression, peak oxygen consumption [volume of oxygen uptake (VO2)] and health-related quality of life (HRQoL).
-
Study design Randomised controlled trials were eligible for inclusion. It was anticipated that very few randomised studies would be available; therefore, the following study designs were also included: non-randomised controlled trials, cohort studies with a contemporaneous control group (i.e. not historical controls) and case–control studies. Studies without a control group, such as case series, were not included. Reports published as meeting abstracts were also excluded when insufficient methodological details were reported to allow critical appraisal of study quality and this information could not be obtained from the authors.
Data extraction
The data extracted included patient characteristics (age, sex, baseline disease severity, comorbidities), details of intervention and comparator, adherence, length of follow-up and study quality (see below). Authors of the included RCTs were contacted for further information but this was not available.
Data were extracted by one researcher using a standardised data extraction form in Evidence for Policy and Practice Information (EPPI)-Reviewer, and were checked by a second. Discrepancies were resolved by discussion, and, if necessary, a third opinion was sought.
Study quality
The quality of studies of clinical effects were assessed based on criteria specific to the different included study designs using criteria and guidance from CRD Report 415 and Deeks et al. 16 The criteria assessed were method of randomisation, allocation concealment, how participants were allocated in non-randomised studies, similarity at baseline, blinding of outcome assessment and use of intention-to-treat (ITT) analysis (see Appendix 3 for a full list of criteria).
Methods of analysis/synthesis
Key study characteristics, patient outcomes and study quality were summarised in narrative and tables. Given the limited number of studies available, the diversity of study designs, patient characteristics and outcomes assessed, it was not feasible or appropriate to pool the studies statistically. The results of studies were therefore discussed in a narrative synthesis.
Results of the review of clinical effectiveness
Quantity and quality of research available
The literature searches identified 327 potentially relevant references. Titles and abstracts were screened in duplicate, and 167 full papers were ordered for further assessment (Figure 1). At the full-paper screening stage, 157 papers were excluded. Sixty-nine of these were excluded because they were reports of case series or EECP registries and did not have a control group (see Appendix 2 for a list of these excluded papers). Five studies reported in 10 papers met the review inclusion criteria.
Study characteristics
The included studies consisted of one RCT,17 three non-RCTs of EECP for chronic stable angina18–20 and one multicentre RCT of EECP for heart failure21 (Table 1). Both randomised controlled trials (MUST-EECP and PEECH)17,21 and a further study19 reported receiving sponsorship from Vasomedical, the EECP manufacturer. As a result of the variation in study design, clinical characteristics and outcomes assessed, it was not feasible or appropriate to pool the studies statistically. The studies are discussed below in a narrative synthesis grouped by clinical condition and then study design.
Study design | Stable angina | Heart failure | |||
---|---|---|---|---|---|
Randomised controlled trial | Non-randomised controlled studies | Randomised controlled trial | |||
Arora et al., 199917 MUST-EECP | Barsheshet et al., 200818 | Holubkov et al., 200219 | Shechter et al., 200320 | Feldman et al., 200621 PEECH | |
Comparator | Sham-EECP | Usual care | PCI | Usual care | Usual care |
Number of participants | EECP 72 | EECP 15 | EECP 323 | EECP 20 | EECP 93 |
Control 67 | Control 10 | Control 448 | Control 20 | Control 94 | |
Length of follow-up | End of treatment (also 12 months for HRQoL only) | End of treatment | 12 months | End of treatment | 6 months |
Quality assessmenta | |||||
Randomised | Yes | No | No | No | Yes |
Allocation concealment | Yes | No | No | No | Yes |
Participant blind | Yes | No | No | No | No |
Outcome assessment blind | Yes | No | No | No | Yes |
ITT analysis | Partialb | No | No | No | Yes |
Results of studies of enhanced external counterpulsation for stable angina
Randomised controlled trial
Study characteristics and quality
The objective of the MUST-EECP trial conducted by Arora et al. 17 was to assess the safety and efficacy of EECP in patients with chronic stable angina. Participants were randomised to EECP of 35 1-hour sessions at a pressure of 300 mmHg, or sham EECP. Sham EECP was similar to EECP, with the exception that suboptimal pressure of 75 mmHg was used. This was described by the authors as insufficient to alter patient blood pressure, but sufficient to preserve the appearance and feel of EECP treatment. Only patients with a CCS classification between I and III, documented evidence of coronary artery disease and an exercise treadmill test positive for ischaemia were eligible for inclusion. There was no requirement that patients should be refractory to standard antianginal medication. In addition to excluding patients with class IV angina, patients with overt congestive heart failure or unstable angina, or who had experienced a myocardial infarction or undergone coronary artery bypass grafting in the previous 3 months were excluded. Further exclusion criteria were also applied (see data extraction tables, Appendix 4). The trial population (n = 139) was predominantly male (87%) and Caucasian (76%) with a mean age of 63 years. Patients were of CCS classification class I (26%); class II (50%); and class III (23%). Most patients were being treated with nitrates (80%). Other antianginals were calcium channel blockers (58%) and beta-blockers (74%). Aspirin was taken as an antithrombotic by 89% of patients. Further details are given in Appendix 4.
Several outcomes were assessed related to exercise duration, QoL and medication use (see Table 2). Assessments were at baseline and followed the completion of the 35 EECP sessions. The study was powered (80%) to detect a 45-second difference in exercise duration between the groups, based on a between-patient standard deviation of 87 seconds, and using a two-sided test with 0.05 level of significance. QoL was assessed in a 12-month follow-up study using the 36-item short form health survey (SF-36) and the Quality of Life Index (QLI), Cardiac Version III. 22 Participants in the original study were given the HRQoL questionnaires at the end of treatment to complete at their convenience and return by mail. Twelve months after completion of treatment, participants in the original study were mailed the HRQoL questionnaires for completion. Follow-up telephone calls were made to maximise return of the questionnaires. Useable questionnaires were available from 51% of the original study sample.
Outcome | EECP | Control | p-value (between groups) | Between group mean difference (MD)/relative risk (RR) (95% CI)a |
---|---|---|---|---|
Numbers randomised | 72 | 67 | ||
Numbers treated | 71 | 66 | ||
Numbers withdrawn | 12 | 1 | ||
Exercise duration (seconds): mean change (SE) |
n = 57 42 (11) |
n = 58 26 (12) |
p > 0.31b |
MD –16.00 ( –47.79 to 15.79) |
Time to ≥ 1-mm ST segment depression (seconds): mean change (SE) |
n = 56 37 (11) |
n = 56 –4 (12) |
p = 0.01a |
MD 41.00 ( 9.10–73.90) |
Angina episodes/day: mean change (SE) |
n = 71 –0.11 (0.21) |
n = 66 0.13 (0.22)c |
p < 0.09d |
MD –0.24 ( –0.84 to 0.36) |
NTG use/day: mean change (SE) |
n = 71 –0.32 (0.12) |
n = 66 –0.10 (0.12)c |
p > 0.1d |
MD –0.22 ( –0.55 to 0.11) |
Adverse event | n = 71 | n = 66 | ||
Patients with AE, n | 39 | 17 | p < 0.001 |
RR 2.13 (1.35–3.38) |
Withdrawal due to AE, n | 9 | 1 | ||
Device-related AE, n | 37 | 10 | p < 0.001 | |
Non-device-related AE, n | 33 | 15 | p < 0.005 |
Summary details of the quality assessment of this study are reported in Table 1, and the full quality assessment is available in Appendix 3 (based on the main study). The MUST-EECP trial was a seven-centre, double-blind RCT. Treatment allocation was administered centrally and allocation was concealed. The intervention and control group were not balanced at baseline for duration of angina and history of previous MI; the intervention group had a considerably longer duration of angina and a higher proportion of previous MI. The study was designed to blind participants and investigators processing and collecting data; it was not possible to blind those administering the treatment. Although ITT analyses (excluding two patients who withdrew prior to first treatment) were reported, this was not reported for all outcomes; ITT was not reported for time to ST segment depression and exercise duration, which was the outcome that the trial was powered to detect. There is therefore the possibility that the treatment effect was overestimated for these outcomes, given the greater number of patients who dropped out from the EECP arm (18%) than left the control group (3%).
In addition to some weaknesses in the internal validity of the trial, there are also limitations on the generalisability of the results of the trial. The substantial exclusion criteria and the large proportion of participants with class I or II disease limit the extent to which the findings can be generalised to all patients with refractory stable angina. The patient population included in the MUST-EECP trial may not have exhibited angina that is as severe as that found in some patients referred for EECP in the UK. There was also a lack of data on long-term outcomes and on the impact of EECP on cardiac-related mortality.
Results
The mean change scores for EECP and control for the clinical outcomes are summarised in Table 2. Details of how the outcomes were measured and pre- and post-treatment scores are available in Appendix 4. There was a statistically significant difference between EECP and control on one efficacy outcome, time to greater than 1-mm ST segment depression (exercise-induced ischaemia), which showed a benefit with EECP. There was a mean 37-second improvement in time to ST segment depression in the EECP group compared with a 4-second deterioration in the control group, mean difference 41.0 [95% confidence interval (CI) 9.10–73.90]. However, this result is not derived from an ITT analysis, is likely to be subject to attrition bias and may well over-estimate the treatment effect. Similarly, the change in exercise duration from baseline to the end of treatment was not based on an ITT analysis but, even so, the improvement in the EECP group failed to reach statistical significance (Table 2). Also the mean difference, –16.0 seconds (95% CI –47.79 to 15.79), did not reach the level of clinical significance stipulated in the sample size calculation (45 seconds). Small mean reductions between EECP and control in the change in self-reported angina episodes/day or daily nitroglycerin (NTG) use were reported (based on ITT analysis), but they did not reach statistical significance. There was a further analysis in which patients were categorised based on the proportion achieving a 25% or 50% improvement or worsening of angina frequency (see Appendix 4). There was a statistically significant benefit with EECP compared with control on this outcome; however, given the large number of cells with low values, the method of analysis used was not appropriate.
For QoL, the authors identified four primary outcomes for the analysis: the physical functioning, bodily pain and social functioning subscales of the SF-36, and the QLI score. 22 At 12 months, the EECP group reported a greater (statistically significant) improvement than the control group on all of these outcomes except physical functioning (see Appendix 4). However, follow-up data were available from only 71 of the 139 patients enrolled onto the study; therefore, there is a high risk that this sample is not representative of the total study population.
Adverse events
Adverse events were reported up to the end of treatment. There were more withdrawals due to AEs in the EECP group than in the control group, as well as a greater proportion of patients with AEs, device and non-device related (see Table 2). Adverse events classified as device related in the EECP group were paraesthesia (n = 2); oedema or swelling (n = 2); skin abrasion, bruise or blister (n = 13); and leg or back pain (n = 20). A small number of patients receiving sham EECP reported paraesthesia (n = 1); skin abrasion, bruise or blister (n = 2); and pain in the legs or back (n = 7). Leg discomfort was reported in 11.6% of EECP sessions and 4.9% of sham EECP sessions.
In terms of AEs defined as non-device related, nine patients receiving EECP experienced atrioventricular arrhythmia compared with three in the control group, and seven experienced other chest pain compared with three in the control group. Other non-device-related AEs were viral syndrome (EECP n = 1, control n = 0); anxiety (2, 0); dizziness (3, 1); tinnitus (1, 0); gastrointestinal disturbances (1, 1); headache (1, 0); blood pressure change (1, 1); epistaxis (2, 0); angina (1, 1); heart rate change (0, 3); and respiratory (4, 2).
Non-randomised controlled studies
Study characteristics and quality
The three non-randomised studies compared EECP, one with elective PCI19 and two with usual care (see Table 1). 18,20 There was a high risk of selection bias in all three studies. Without random allocation, there was a high risk of known or unknown systematic differences between patients in the EECP and control groups that may have influenced each group’s prognosis or responsiveness to treatment. In addition, given the nature of the comparators, blinding was not possible, which is particularly problematic given the subjective nature of most of the outcomes.
Results
One study was a comparison of two registries (n = 771), one for EECP and one for PCI. In this study, there were considerable differences between the two groups at baseline, with the EECP group having a higher prevalence of several risk factors. 19 One-year all-cause mortality was similar in both groups (Table 3). Fewer patients reported no angina symptoms in the EECP group than in the control group, and the proportion with a CCS classification of III or IV was higher at follow-up (see Table 3). Also, at 1 year a greater proportion of EECP than PCI recipients reported use of calcium channel blockers, long-acting nitrates, angiotensin-receptor blockers and NTG (see Appendix 4). Given the differences in baseline characteristics between the two groups, the results for all outcomes need to be treated with considerable caution.
Outcome | Treatment | Control | p-value (between groups) | Between group relative risk (95% CI)a |
---|---|---|---|---|
Holubkov, 200219 | EECP (n = 251) | PCI (n = 422) | ||
1-year all-cause mortality | 1.3% (95% CI 0.5–3.5) | 3.2% (95% CI 1.9–5.4) | NS | |
No angina symptoms | 43.7% | 73.4% | p < 0.001 |
0.59 (0.51–0.69) |
CCS classification III or IV/unstable angina | 15.5% | 9.5% | p = 0.02 |
1.64 (1.09–2.48) |
Barsheshet, 200818 | EECP (n = 15) | Usual care (n = 10) | ||
CCS classification: median (interquartile range) |
Baseline 3.0 (3.0–4.0) Follow-up 2.0 (2.0–3.0) p < 0.001 |
Baseline 3.0 (2.5–4.0) Follow-up 3.0 (2.0–3.5) p = 0.50 |
Not reported | |
Shechter, 200320 | EECP (n = 20) | Usual care (n = 20) | ||
CCS classification: mean (SE) |
Baseline 3.5 (0.5) Follow-up 1.9 (0.3) p < 0.0001 |
Baseline 3.3 (0.6) Follow-up 3.5 (0.5) p = 0.89 |
Not reported | |
NTG/day: mean (SE) |
Baseline 4.2 (2.7) Follow-up 0.4 (0.5) p < 0.001 |
Baseline 4.5 (2.3) Follow-up 4.4 (2.6) p = 0.87 |
Not reported |
The two studies with a usual care comparator had very small samples, n = 40 and n = 35, and used patients who refused EECP as the control group. 18,20 In both studies, CCS classification improved with EECP but not with usual care; however, neither study reported a statistical analysis of between group differences. In addition, for CCS classification the data were treated as continuous data, which is inappropriate for this four-category classification.
Summary
Only one RCT of EECP for chronic stable angina was found. This trial focused on improvement in symptoms and exercise duration. Cardiac-related mortality was not reported. In addition, three non-randomised studies with a control group investigated EECP in stable angina populations; because of limitations in the quality of these studies, the results need to be treated with considerable caution.
The RCT included patients with predominantly CCS class I or II stable angina and therefore may not be generalisable to a population of patients refractory to standard therapy who are likely to be offered EECP. The findings in favour of EECP either failed to reach statistical or clinical significance or were subject to attrition bias. There was evidence of a benefit with EECP on QoL 12 months after treatment; however, this was based on just under half of the original sample and should be treated with caution.
In summary, the available clinical study data provide only limited evidence of a clinically significant benefit of EECP in chronic stable angina, and even that may not be generalisable to a treatment refractory population.
Results of studies of EECP for heart failure
Randomised controlled trial
Study characteristics and quality
The objective of the PEECH trial, conducted by Feldman et al. ,21 was to assess the benefits of EECP in the treatment of mild to moderate heart failure. Patients were randomised to EECP of 35 1-hour sessions as an adjunct to pharmacotherapy or usual care (pharmacotherapy only). Prior to randomisation, medical therapy was optimised for all patients in compliance with the practice guidelines of the Heart Failure Society of America. EECP was at a pressure of 300 mmHg (reached within 5 minutes of treatment initiation). Only patients with stable heart failure (secondary to ischaemic heart disease or idiopathic-dilated cardiomyopathy), with LVEF less than 35 and NYHA class I or II were eligible for inclusion. Several exclusion criteria were applied (see data extraction tables, Appendix 4). The trial population was predominantly male (76%) and Caucasian (81%), with a mean age of 63 years. Patients were NYHA classification class II (65%) or class III (35%). Most patients (76%) were being treated with ACE inhibitors. Further details are given in Appendix 4.
Assessments were at baseline, end of treatment and 6-month follow-up, which was the primary time point for the analysis. The primary outcomes were the proportion of participants with at least a 60-second increase in exercise duration and the proportion with at least 1.25-ml/kg/minute increase in peak VO2. The study was powered (90%) to detect at least a 60-second increase in exercise duration from baseline in 50% of EECP recipients compared with 20% of control subjects, and a 1.25-ml/kg/minute increase in peak VO2 in 50% of EECP patients and 30% of control subjects at 0.05 level for both end points, or 0.025 for one.
Summary details of this study are reported in Table 1, and the full quality assessment is available in Appendix 3. The PEECH trial was a multicentre randomised trial with allocation concealment and blinded outcome assessment. Because the comparator was usual care, it was not possible to blind patients or those delivering the intervention. An appropriate ITT analysis was reported for the primary outcomes. The proportion of patients not completing the study was higher for the EECP group (23.7%) than for the control group (13.8%), mainly because of a higher frequency of AEs.
There are some limitations in the generalisability of results of the trial: although follow-up did extend beyond end of treatment, the 6-month follow-up can only provide limited information on the long-term outcomes of EECP in patients with heart failure. The inclusion/exclusion criteria were extensive, and the trial population may not reflect patients that would typically be seen in clinical practice for this therapy. In addition, there was a lack of data on cardiac-related mortality.
Results
Table 4 summarises the outcomes measured at the end points of 1-week, 3-month and 6-month follow-up. The primary end point for analysis was assessment at 6 months. There was a statistically significant difference between EECP and control on one primary outcome but not the other (Table 4). A significantly greater proportion of EECP than usual care recipients had at least a 60-second increase in exercise duration from baseline to 6 months (35% versus 25%, p = 0.016), but the proportion with an improvement in peak VO2 was similar (23% versus 24%, p = 0.698). These results at 6 months reflected those at 3 months.
Outcome | EECP | Control | p-value (between groups) | Mean difference (MD)/relative risk (RR) and 95% CIa |
---|---|---|---|---|
Exercise duration (percentage with at least a 60-second increase in exercise duration from baseline to 6 months) | 35.4% | 25.3% | p = 0.016b | RR 1.39 ( 0.89–2.16) |
Exercise duration [mean change in exercise duration from baseline(s) (SE)] | ||||
1-week follow-up |
n = 77 26.4 (12.2) |
n = 78 –5.5 (11.7) |
p = 0.010b | MD 31.9 ( –1.23 to 65.03) |
3-month follow up |
n = 78 34.5 (13.9) |
n = 82 –7.0 (12.7) |
p = 0.014b | MD 41.5 ( 4.72–78.28) |
6-month follow up |
n = 79 24.7 (15.2) |
n = 83 –9.9 (13.2) |
p = 0.013b | MD 34.6 ( –4.86 to 74.06) |
NYHA classification (percentage with improvement in classification)c | n = 93 | n = 94 | ||
1-week follow-up | 33.3% | 11.4% | p < 0.001b | RR 2.85 (1.52–5.32) |
3-month follow-up | 31.6% | 12.2% | p < 0.02b | RR 2.66 (1.42–5.01) |
6-month follow-up | 31.3% | 14.3% | p < 0.01b | RR 2.25 (1.25–4.06) |
Peak VO2(percentage with at least a peak VO2 increase of at least 1.25 ml/kg/minute from baseline to 6 months) | 22.8% | 24.1% | p = 0.698b | RR 0.96 ( 0.57–1.63) |
VO2 related [mean change in peak VO2 (ml/kg/minute)(SE)] | ||||
1-week follow-up | n = 77 0.1 (0.3) | n = 78 –0.4 (0.3) | p = 0.071b | MD 0.5 (–0.32 to 1.32) |
3-month follow-up | n = 78 0.2 (0.3) | n = 82 –0.4 (0.3) | p = 0.119b | MD 0.60 (–0.22 to1.42) |
6-month follow-up | n = 79 –0.3 (0.3) | n = 83 –0.6 (0.3) | p = 0.315b | MD 0.30 (–0.53 to 1.13) |
QoL [mean change in QoL score (CIs) using Minnesota Living with Heart Failure Questionnaire]d | ||||
1-week follow-up | –8.8 (–7 to –10.9) | –3.5 (–1.5 to –5) | p = 0.01e | |
3-month follow-up | –7.2 (–4.7 to –9.5) | –2.8 (–1 to –4.6) | p = 0.01e | |
6-month follow-up | –3.5 (–1.3 to –6.0) | –2.8 (–0.5 to –4.5) | p = 0.32e | |
Adverse events | ||||
Patients with serious AE, n (%) | 27 (30.3) | 26 (29.5) | NS | RR 1.05 (0.67–1.66) |
Withdrawal due to AE, n (%) | 11 (11.8) | 3 (3.2) | NS | |
Number of predefined clinical events | 89 | 88 | NS |
The results from the secondary outcomes were also mixed. There was a higher, statistically significant proportion of patients in the EECP group with an improvement in NYHA classification post treatment, 3 months’ and 6 months’ follow-up (RR 2.25, 95% CI 1.25–4.06). However, although there was a statistically significant improvement in QoL with EECP compared with control post treatment and at 3-month follow-up, there was no greater benefit with EECP at 6 months (see Table 4).
Adverse events
There were more withdrawals due to AEs in the EECP group than in the control group (12% versus 3%). In the EECP group withdrawal was due to sciatica, leg pain, arrhythmia, non-Q wave MI not attributed to therapy, worsening heart failure, biventricular pacemaker implantation and worsening lung cancer; in the control group withdrawal was due to death (n = 2) and atrioventricular block (see Appendix 4). The proportion of serious AEs and the number of predefined clinical events of interest were similar in both groups (see Table 4). Serious AEs defined as related to EECP treatment were worsening heart failure (n = 1), pulmonary embolism (n = 1) and deep vein thrombosis (n = 1). A single serious AE of worsening heart failure was defined as related to treatment in the control group. Minor AEs were not reported.
Summary
A single RCT of EECP for heart failure was identified. As with the chronic stable angina trial, the focus was on improvement in symptoms and exercise duration: cardiac-related mortality was not reported. In this trial of patients with mild to moderate heart failure, there was an improvement with EECP compared with usual care control on all outcome measures at the end of treatment. At 6 months’ follow-up, the benefit of EECP in terms of improved exercise duration and NYHA class had been maintained, but not in terms of peak VO2 or QoL. The clinical benefit to heart failure patients of a 35-second increase in mean exercise duration and a difference of 10% achieving a minimum 60-second increase in exercise duration is unclear.
Chapter 3 Assessment of cost-effectiveness evidence
Systematic review of existing cost-effectiveness evidence
Methods
A broad range of studies was considered for inclusion in the assessment of cost-effectiveness, including economic evaluations conducted alongside trials, modelling studies and analyses of administrative databases. Only full economic evaluations that compared two or more options and considered both costs and consequences (including cost-effectiveness, cost–utility and cost–benefit analyses) were included.
The following databases were searched for relevant published literature: Cochrane Controlled Trials Register (CCTR), EMBASE, Health Economic Evaluations Databases (HEED), MEDLINE, National Research Register (NRR), NHS Economic Evaluation Database (NHS EED), PsycINFO and Science Citation Index. Full details of the main search strategy for this review are presented in Appendix 1.
All obtained titles and abstracts were assessed for inclusion. The quality of the cost-effectiveness studies was assessed according to a checklist updated from that developed by Drummond and Jefferson. 23 This information is summarised within the text of the report, alongside a detailed critique of the study and the relevance to the UK NHS.
Results
The systematic literature search identified no studies which met the inclusion criteria for the cost-effectiveness review. No economic evaluations were identified that evaluated EECP treatment in patients with angina or heart failure. However, in some studies identified as part of the clinical effectiveness review, results of a cost–utility analysis of EECP for the treatment of chronic stable angina were reported, but no citation or reference to the study was given. The manufacturer of EECP, Vasomedical, was contacted, and a draft report of the unpublished cost–utility analysis obtained. This report was included as part of the cost-effectiveness review. The following sections provide a detailed critique of the cost-effectiveness evidence from the included study and an assessment of the quality and relevance of the data from the perspective of the UK NHS. A quality assessment checklist is provided in Appendix 5.
Review of manufacturer’s study
The manufacturer’s study was ‘Enhanced external counterpulsation for the treatment of patients with chronic stable angina pectoris: a cost–utility analysis’. 24
Overview
The study was designed to investigate the potential economic impact of EECP. A cost–utility analysis was performed to determine whether improvement in angina functional grades with EECP, as classified by the CCS score, results in favourable economic outcomes. Two alternative treatment strategies were considered for the management of chronic stable angina pectoris in patients who were refractory to medical therapy. The two strategies were (1) EECP plus standard American College of Cardiology (ACC)/American Heart Association (AHA) guideline compliant medical therapy, as recommended by the ACC and the AHA, and (2) standard ACC/AHA guideline compliant therapy alone. The main outcome measure was improvement in angina functional class, which was used as a proxy for establishing the improvement on HRQoL from EECP. Other outcomes were measured in terms of the direct costs of treatment and the costs of MACEs. Outcomes were assessed within a 2-year time horizon.
The study was based on a deterministic, Markov decision analytic model of chronic stable angina, with patients modelled over a period of 2 years and evaluated over a cycle length of 1 year. Using cohort simulation, patients cycled into one of six possible health states: (1) no angina symptoms, (2) CCS class I angina, (3) CCS class II angina, (4) CCS class III angina, (5) CCS class IV angina and (6) death. All patients entered the model after receiving one of the two alternative treatment strategies, and were assigned to one of the health states. Based on the effect of treatment on CCS angina class, the patients advanced into one of four transitional states: (1) better, (2) same, (3) worse and (4) death. These four transitional states determined whether there was an improvement or a deterioration in angina class. This improvement or deterioration resulted in movement into a health state, with an increment or decrement of one or more grades of the CCS classification. Each health state was assigned an estimate of cost and quality-adjusted survival. The study was conducted from a US payer’s perspective.
Summary of effectiveness data
The effectiveness of treatment was based on the assumption that therapies for chronic stable angina should aim to eliminate anginal chest pain and restore functional capacity through improvement in CCS classification angina level. Therefore, the effectiveness of treatment was determined by the available data required to populate the transition probabilities between the various states of the model. Initial Markov state probabilities were based on prevalence data from Michaels et al. 25 and Kandzari et al. 26 for the EECP plus medical therapy treatment and the medical therapy alone groups respectively. Neither of these studies was based on RCT data. Michaels et al. report outcomes in patients receiving EECP plus medical therapy from the International EECP Patient Registry (IEPR). The majority of the patients were reported to have CCS class III (61%) and CCS class IV (26%). The outcome of the cohort receiving medical therapy alone was based on observational data reported in the study by Kandzari et al. The majority of these patients were reported to have CCS class IV (64%) and CCS class III (14%). Both studies were assumed to be representative of the population typically presenting for EECP treatment in the clinical setting.
One- and 2-year transition probabilities were derived from the IEPR for the EECP treatment group, while for the non-EECP group assumptions for the transition probabilities for asymptomatic, CCS class I and class II states were derived from data from the Second Randomised Intervention Treatment of Angina (RITA-2) trial. 27 Assumptions for the class III and IV transition probabilities for the non-EECP group were based on a weighted means analysis of pooled data from trials on transmyocardial laser revascularisation and percutaneous myocardial laser revascularisation.
Summary of resource utilisation and cost data
Costs associated with antianginal treatment and treatment for MACEs were considered. These costs were based on Medicare reimbursement rates, the Medicare Physician Fee Schedule, previously published studies and the Red Book for wholesale drug costs. Codes applicable to procedures and diagnoses were identified through the International Classification of Diseases (ICD-9), Current Procedural Terminology (CPT), Ambulatory Payment Classification (APC), Diagnosis Related Group (DRG) and the Healthcare Common Procedural Coding System (HCPCS). Costs were reported in US dollars for the year 2004 and discounted at an annual rate of 3%. Productivity and personal care costs were not included in the analysis.
The cost of EECP was based on a standard EECP regimen consisting of 35 1-hour treatment sessions. Using an estimated Medicare payment rate of 80%, the cost of EECP was estimated to be $3654 based on utilisation rates of 75% and 25% in the clinic and hospital outpatient settings respectively. Baseline medical therapy was based on pre-treatment medication usage patterns reported in Michaels et al. 25 and was assumed to be identical for the two treatment strategies. Medical therapy included beta-blockers ($601 per annum), calcium antagonists ($470 per annum), rescue nitrates ($31 per annum) and long-acting nitrates ($505 per annum). The cost of MACEs was based on the annual probability of having CABG (unit cost $27,316), MI (unit cost $7008), PCI (unit cost $12,055), cardiac-related hospitalisation (unit cost $2786) and visit to an accident and emergency department (unit cost $2231) given treatment received.
Summary of utility data
Quality of life for the individual health states was obtained from published studies. Utilities were selected to reflect a general trend of decreasing QoL with increasing angina severity. For asymptomatic chronic stable angina, a utility value of 0.99 was assigned. For the progressive CCS functional classes of angina, utilities of 0.98, 0.90, 0.83 and 0.79 were applied to class I, II, III and IV respectively. A disutility was applied to MI for the duration of the event by subtracting a utility of 0.72 associated with MI from the baseline health state utility. Quality-adjusted life-years (QALYs) were calculated by multiplying the utility weights of each health state by the time in the health state.
Summary of cost-effectiveness data
For 66-year-old patients with chronic stable angina, EECP plus standard medical therapy was estimated to be more effective, with an additional benefit of 0.27 QALYs, but more costly, at an incremental cost of $845, than standard medical therapy alone over 2 years. The corresponding incremental cost-effectiveness ratio (ICER) was $3126 per additional QALY gained. The gain in QALYs can be attributed to the differences in QoL (in terms of utilities) between the CCS angina level states. The transition probabilities to states of higher CCS level are lower for the EECP plus medical therapy strategy than for standard medical therapy, leading to more favourable outcomes in the former treatment group. The costs between the two groups were similar. The additional upfront cost of EECP was offset by the lower probability of MACEs (with their associated costs) in the EECP plus medical therapy group.
A series of univariate sensitivity analyses were performed over a range of estimates for patients with chronic stable angina. The one-way analyses indicated that the ICER was most sensitive to variations in the transition probabilities associated with CCS class III and IV angina states. Decreasing the probability of improvement in class III angina with EECP plus medical therapy resulted in a substantial change in the relative position of medical therapy alone to EECP plus medical therapy treatment. When the probability of improvement in class III with EECP was less than 0.145, medical therapy alone was marginally more cost-effective.
Discussion
The results of the manufacturer’s analysis suggest that the addition of EECP to standard medical therapy is cost-effective for patients with chronic stable angina based on a cost-effectiveness threshold of at least $5000 per QALY gained. However, the study suffers from a number of major limitations. The use of non-randomised control data to inform the effectiveness estimates has led to reliance on assumptions that have been formulated from multiple sources. The model focuses primarily on the improvement in CCS classification angina level, but the transition probabilities used to represent these improvements are not comparative for the EECP treatment strategy relative to the medical therapy alone strategy. In addition, the link between CCS class level and HRQoL utilities is not well established. A number of assumptions for the utility values have been adopted based on a variety of different sources for each angina grade. The extent to which joint uncertainty in the model parameters has an impact on the overall estimate of cost-effectiveness has not been explored in a sensitivity analysis.
From a UK NHS perspective, the study has a number of additional limitations. The data are mostly sourced from a variety of US studies, and the costs are specific to the US. Consequently, it is difficult to assess the generalisability and transferability of the data to a UK setting, where the pattern of care is likely to be different. In the US, EECP is more developed in terms of its use than in the UK. The following section presents a new decision analytic model that has been developed to provide a more appropriate analysis in the context of the UK NHS.
Decision model
Overview
The review of cost-effectiveness studies in the previous section identified no formerly published studies on the cost-effectiveness of EECP for angina or heart failure. This lack of economic evaluations is largely due to the paucity of published evidence for EECP and the limited number of RCTs comparing EECP with alternative treatment strategies in angina or heart failure. Subject to the data that are available, a new decision analytic model was developed to assess the cost-effectiveness of EECP for angina in the UK NHS. The model provides a framework for the synthesis of available data identified from the clinical effectiveness review and the elicitation of unknown parameters from experts in order to evaluate the potential long-term cost-effectiveness of EECP.
The model was populated subject to the data available from the systematic review of clinical effectiveness. The Results of the review of clinical effectiveness section in Chapter 2 identified only two RCTs comparing EECP with an alternative treatment strategy. One of these RCTs assessed the safety and efficacy of EECP in patients with chronic stable angina, while the other assessed the benefits in patients with mild to moderate heart failure. The primary outcome of the clinical review was improvement in HRQoL from EECP. Consideration was given to all the effectiveness outcomes reported in the RCTs (see Chapter 2, Randomised controlled trial) for inclusion in the cost-effectiveness model. A series of additional searches were undertaken to find evidence to relate intermediate end points reported in the trials, such as improvement in exercise duration, to final health outcomes in terms of QALYs. The lack of substantiated evidence to link these intermediate outcomes with final end points meant that the primary outcome for the model was QoL improvement as assessed directly in the trials.
The model considers the potential long-term costs and benefits associated with the primary outcome of the review: improvement in QoL from EECP. The model evaluates costs from the perspective of the NHS and Personal Social Services (PSS), expressed in £ sterling at a 2008 price base. Outcomes in the model are expressed in terms of QALYs. Both costs and outcomes are discounted using a 3.5% annual discount rate, in line with current guidelines. 28 All stages of the work were informed by discussion with our clinical advisors to provide feedback on specific aspects of the analysis such as the model structure, data inputs and assumptions.
The model is probabilistic in that input parameters are entered into the model as probability distributions to reflect parameter uncertainty, i.e. uncertainty in the mean estimates. 29,30 Monte Carlo simulation is used to propagate uncertainty in input parameters through the model in such a way that the results of the analysis can also be presented with their associated uncertainty. The probabilistic analysis also provides a formal approach to quantifying the consequences associated with the uncertainty surrounding the model results, and it can be used to identify priorities for future research. The model was developed in the statistical programming package r. 31
Given the paucity of published evidence for EECP and the lack of RCTs, the potential value of future research in EECP is assessed. The model is used to undertake analyses of the EVI. Bayesian value of information analyses are used to estimate the expected costs of decision uncertainty predicted by the model, and the maximum value that can be placed on additional research aimed at reducing this uncertainty. 32 This provides an upper bound on the value of a future trial in this area, which provides a necessary but not sufficient condition for establishing whether a trial is likely to provide value for money. In addition to providing a global estimate of the total cost of uncertainty related to all inputs in the model, the EVI is estimated for individual parameters (and groups of parameters) contained in the model. To provide a sufficient condition for further research, the expected net benefit of sampling (ENBS) is calculated. 33 The ENBS for a particular study design is the difference between the expected value of sample information (EVSI) and the costs of sampling. It provides a sufficient condition for deciding if further research is worthwhile. For EECP, the ENBS is calculated to establish whether an additional clinical trial is required, the optimal sample size that should be used in the trial design, the appropriate length of follow-up of the trial and the end points that should be included.
The following sections outline the decision problem, the structure of the model, an overview of the key assumptions and data used to populate the model, and the methodology used to assess the potential value of future research in EECP.
Treatment strategies and population
The decision problem addressed by the model relates to the cost-effectiveness of EECP in adults with chronic stable angina. During the review process, consideration was given to extending the model to cover adults with heart failure. However, while the general structure of the model was considered to be generalisable across the different patient groups, the evidence requirements to populate the model in patients with heart failure were difficult to fulfil. Our clinical advice is that EECP is more developed in the UK in patients with angina; therefore, a decision was made to constrain the analysis to stable angina only. However, the model provides a framework to assess the cost-effectiveness and EVI associated with EECP in other patient groups.
The decision model evaluates a strategy of EECP treatment compared with no treatment on the assumption that angina patients would receive EECP treatment over and above standard current clinical practice care. This is consistent with the RCT in angina, MUST-EECP, which compared EECP with inactive EECP (see Chapter 2, Randomised controlled trial for full details). The base-case population in the model relates to the baseline characteristics of the population who entered the MUST-EECP trial (see Appendix 4), under the assumption that this trial population is representative of angina patients typically presenting for EECP in the current clinical setting.
Model structure
The model is structured to allow the projection of HRQoL benefits beyond the 1-year trial follow-up period of MUST-EECP, and to simulate the experience of angina patients over their lifetime in terms of risk of cardiovascular events and death. The model is projected over a lifetime time horizon, by which time all patients will have been predicted to die. In projecting to the lifetime of patients, assumptions need to be made concerning the duration of treatment in terms of repeat (top-up) procedures and the duration of the effect of treatment in terms of sustaining QoL benefits, reducing major CVD events and death. On the basis that there is no evidence to infer that EECP treatment compared with placebo has a differential impact on the risk of developing CVD events and death, it is assumed that the benefits of EECP are purely palliative. The model incorporates the risk of CVD events and death in order to keep track of the number of patients still alive in the model who could potentially benefit from QoL improvements, but because there is no differential impact on costs and QALYs between the treatment strategies resulting from CVD events, the estimate of cost-effectiveness is not affected by these events. The maximum follow-up time in MUST-EECP was 12 months after treatment. A worst-case scenario is one when the benefits achieved after 12 months of treatment are lost in the second year, at which time all patients are assumed to fall back to baseline QoL, i.e. pre-EECP QoL.
A Markov state transition model, as shown in Figure 2, was developed based on the likelihood of sustaining QoL benefits over time. Three health states were defined as ‘responders’, ‘non-responders’, and ‘dead’. The ‘responders’ state represents patients who sustain QoL benefits from EECP. The ‘non-responders’ state represents patients who lose initial QoL benefits from EECP. The ‘dead’ state incorporates death from both cardiovascular and other causes. In the first year after EECP treatment, patients are assumed to achieve, on average, the QoL benefits reported in the 12-month follow-up of the MUST-EECP trial. Given that patients, on average, achieve these QoL benefits at the end of the first year, patients in the second year either continue to sustain the 1-year QoL benefits and will move to the ‘responders’ state, or will lose the benefits by falling back to baseline QoL and entering the ‘non-responders’ state. Consideration was given to adding an additional state representing partial responders, i.e. those patients who partially sustain QoL benefits, whose QoL is better than at baseline but worse than at 12 months after EECP. However, due to a lack of any evidence to populate this transition or determine the QoL of these patients, it was excluded from the model. In the third and subsequent years, responders to EECP in the previous year will either continue to sustain their QoL benefits or enter the ‘non-responders’ state. The response in each year is dependent on patients receiving repeat top-up procedures as considered appropriate. All patients in the model face a risk of cardiovascular events, which eventually lead to death, and are deemed to be at a competing risk of a non-cardiovascular death.
Key assumptions
The cost-effectiveness of EECP in the NHS will be determined by a number of potential factors. These factors relate to the available clinical evidence base and the generalisability of this evidence to the NHS. A standard 35-hour treatment session of EECP will incur upfront costs, with additional costs of EECP incurred with the need for repeat or top-up procedures. For EECP to be considered cost-effective, it will be important to demonstrate that these additional costs result in potential long-term gains in QoL.
The model makes a number of key assumptions in considering the cost-effectiveness of EECP to the UK NHS, including:
-
Quality of life Potential QoL gains associated with EECP are examined in relation to a number of factors:
-
improved QoL benefits after treatment
-
the duration for which QoL benefits are likely to be maintained.
-
-
Risk of cardiovascular events Patients with angina face an elevated risk of CVD events and death. Treatment with EECP is assumed not to confer any differential effect on the risk of developing CVD events and death relative to no treatment.
-
Costs In addition to the initial upfront cost of a 35-hour treatment session with EECP, patients can receive repeat top-up procedures that incur additional costs.
-
Generalisability of evidence to the UK In addition to ensuring that the costs associated with EECP are relevant to the UK, consideration is given to whether the existing RCT evidence can be transferred to a UK setting.
There is significant uncertainty in relation to each of these separate aspects. This uncertainty is largely due to the limited evidence base for EECP in the short- and longer-term. The use of decision analysis provides a number of advantages in exploring these uncertainties in more detail:
-
It provides a framework to model both the short- and the long-term benefits associated with treatment.
-
It makes each of these assumptions explicit and can highlight where the current uncertainties exist.
-
It provides a quantitative approach to combining evidence from separate sources, and the use of probabilistic analysis means that the degree of uncertainty surrounding particular inputs can be reflected.
-
The potential impact of the assumptions on the cost-effectiveness of EECP can be considered.
-
The value of additional research to inform the decision problem can be established.
The following sections provide an overview of the model inputs and the methods used to inform the cost-effectiveness of EECP and the value of further research.
Model inputs
The main parameters in terms of clinical effectiveness, costs and QoL are discussed in detail in the following sections.
Clinical effectiveness: improvement in quality of life
The clinical effectiveness review identified only one RCT where EECP was compared with inactive EECP for patients with angina. 17 All aspects of clinical effectiveness reported in this trial were considered for inclusion in the cost-effectiveness model, including (1) exercise treadmill duration; (2) time to greater than 1-mm ST segment depression; (3) angina counts; (4) NTG use; and (5) QoL. Despite the use of additional searches (full details of the search strategy are reported in Appendix 1), no substantiated evidence was available to link the four intermediate outcomes to final health outcomes in terms of QALYs. As a result, the primary outcome used in the model was improvement in QoL, as reported in the trial itself. At the end of treatment and at 12 months after the end of treatment, the trial reports improvement in HRQoL from baseline, as assessed by the SF-36 and the cardiac version of the QLI. The SF-36 data were used to obtain a utility improvement from baseline to 1 year after treatment for the model (see Quality of life). This utility improvement was taken as the primary effectiveness outcome measure.
The generalisability of the RCT evidence to the NHS is an important issue. In some respects, the 35-hour EECP treatment sessions can be regarded as standard therapy and so, assuming that the characteristics of UK patients are similar to those of the subjects who entered the MUST-EECP trial, the improvements in QoL can be considered generalisable to the UK. However, the pattern of patient care may differ across centres; for example, patients receiving EECP may inadvertently also be receiving some form of psychological support, which may have a direct impact on their QoL. Given that this pattern of care can also vary across centres in the UK, it seems reasonable to assume that the patient characteristics of the MUST-EECP trial entrants are on average similar to UK patients.
Quality of life
In order to estimate QALYs, it is necessary to quality-adjust the period of time over which the average patient is alive within the model using an appropriate QoL weight (utility). The MUST-EECP trial reported improvements in QoL from baseline to 12 months following end of treatment across the eight dimensions of the SF-36 scale with both the EECP and the inactive EECP treatment arms. 22 The improvements are reported in terms of observed change in scale scores divided by the standard deviation for the scale in the general US population. The standard deviation for each scale was taken from Ware et al.,34 then the standardised scores were converted back to obtain the actual observed changes on each of the eight dimensions. A recently developed algorithm was applied to predict a preference-based European Quality of Life – 5 dimensions (EQ-5D) score using the summary scores of the eight SF-36 dimensions. 35 This algorithm provides an approach to estimating utility values associated with changes in the domains of SF-36 reported following EECP and inactive EECP. These were used to estimate the incremental change in utility for EECP relative to no treatment over a 12-month period. To incorporate uncertainty in the estimate of the incremental change in utility in the absence of details of sampling uncertainty in the trial, a beta distribution was applied with a standard error equivalent to half the mean change in utility. 30 Table 5 reports the utility improvement for EECP relative to no treatment at 1 year. Baseline utility values were taken from age- and sex-dependent population norms for the general UK population and adjusted downwards to reflect the presence of angina in this population. 36
Parameter | Mean change from baseline to 1 year following end of treatment | Incremental mean change (SE)a | Distribution | Source | |
---|---|---|---|---|---|
Active EECP | Inactive EECP | ||||
Utility | 0.1068 | 0.0351 | 0.0717 (0.036) | Beta (α = 3.64, β = 47.13) | Arora et al., 200222 |
Beyond the 12-month period of MUST-EECP, there is no trial evidence available to examine the degree to which the improvement in QoL benefits is sustained over time. In the absence of suitable trial estimates for the duration of treatment benefits, alternative approaches were considered to inform the duration of QoL benefits over time in the model. A wider set of studies incorporating the experience of patients in the IEPR were examined to provide generic measures of QoL beyond 12 months. However, despite examining all published studies in EECP, the review did not identify a single source that could provide a generic measure of QoL beyond 12 months. Typically, most studies forming part of the IEPR have examined QoL in terms of a five-point rating scale, where QoL is reported as (1) poor, (2) fair, (3) good, (4) very good and (5) excellent, before and after EECP and at 2- or 3-year follow-up. These studies suggest that most patients maintain their benefits from EECP at 2 or 3 years after treatment (Figure 3). However, without a generic measure of QoL, it is not possible to map these scores reliably at follow-up to changes in utility over time. In order to encapsulate the treatment duration in terms of sustained QoL benefits, expert elicitation techniques were employed (see below).
Probability of sustaining treatment benefits over time: elicitation of expert opinion
In the first year after treatment, patients in the model were assumed to receive, on average, the 1-year QoL improvement seen in the MUST-EECP trial. The sustained duration of these treatment benefits in subsequent years is unknown. Therefore, elicitation techniques were employed with clinical experts to quantify these unknown parameters. 39 These techniques involve asking clinical experts to elicit their beliefs about model parameters with or without some estimate of uncertainty. A consensus or individual expert approach can be adopted. For the transition probabilities of sustaining QoL benefits over time in the Markov model, expert elicitation was used. An Excel-based exercise was designed to elicit the probability of sustaining the first year QoL benefits in the second year, followed by the third year and so on. The exercise was conducted using the individual expert method, with each expert completing the exercise independently and giving their own belief about the unknown quantities with estimates of uncertainty. One repetitive question was asked throughout the elicitation exercise:
In year X, what proportion of sustained year X-1 patients would you expect to sustain the year 1 quality of life benefits?
Experts were given background information to the exercise explaining the QoL benefits achieved at year 1. The first question of the exercise asked experts to provide the proportion of patients in year 2 who are likely to sustain the average year 1 QoL benefits. Given their response, they were then asked whether they would expect the proportion to be different in subsequent years. If they responded ‘No’, the exercise was complete. If they responded ‘Yes’, they were asked to complete the next question which asked them to determine the proportion of year 2 patients who are likely to sustain the average year 1 QoL benefits in year 3. Given their response to year 3, they were then asked whether they would expect the proportion to be different in subsequent years, and so on with the process repeated. In answering the questions, experts were told to assume that patients undergo any additional repeat procedures (or top-up sessions) as required. Therefore, the responses to all questions were conditional on patients receiving as many top-up sessions as might be considered appropriate. The exercise is presented in Appendix 7.
Elicitation format
The format chosen for each of the questions was a frequency chart. 40 Experts were asked to place 20 crosses on the chart to represent their current belief and uncertainty about that particular question (see Appendix 7). For example, if the expert was completely certain about the answer, he or she would place all 20 crosses in one column of the grid. A distribution of uncertainty for the parameters was derived.
A pilot exercise was initially conducted with one expert to ensure that the questions were clear and interpreted correctly. For the final exercise, seven experts were identified on the basis of their experience and knowledge of EECP treatment in the UK. Five of them completed the exercise.
Elicitation results
Means and standard deviations for the probability of sustaining QoL benefits in each subsequent year are shown in Table 6. The results from each expert were linearly pooled to generate a ‘super’ distribution of values. 41 Each expert was given equal weight, and the pooled result was assumed to be representative of the beliefs of UK clinicians. A beta distribution was fitted to the linearly pooled data (Figure 4) and Monte Carlo simulations drawn from this distribution. In a sensitivity analysis, samples were drawn directly from the empirical data.
Mean probability of sustaining year 1 QoL benefits in subsequent yearsa (SD) | |||
---|---|---|---|
Year 2 | Year 3 | Year 4+ | |
Expert 1 | 0.670 (0.091) | 0.600 (0.082) | 0.526 (0.088) |
Expert 2 | 0.807 (0.047) | 0.886 (0.052) | 0.886 (0.052) |
Expert 3 | 0.785 (0.039) | 0.700 (0.057) | 0.675 (0.075) |
Expert 4 | 0.605 (0.104) | 0.605 (0.104) | 0.605 (0.104) |
Expert 5 | 0.908 (0.036) | 0.905 (0.035) | 0.898 (0.043) |
Pooled result | 0.757 (0.126) | 0.742 (0.150) | 0.719 (0.168) |
Mortality
The model separates deaths into those caused by CVD events and other causes of mortality, although no treatment effect from EECP in terms of mortality is modelled. The mortality associated with CVD events was informed by the EUropean trial on Reduction Of cardiac events with Perendopril in stable coronary Artery disease (EUROPA) trial. 42 This trial examined the reduction of cardiac events with perindopril compared with placebo on top of standard background treatment in stable coronary artery disease. In a cost-effectiveness analysis, perindopril was evaluated against usual care using data from the EUROPA trial. 42 As part of this analysis, risk equations were estimated for the risk of a cardiovascular event and death, similar to those presented for the Framingham study. 43 These risk equations facilitate the simulation of fatal and non-fatal events that a cohort of coronary artery disease patients would be expected to experience with and without perindopril. The risk equations based on the EUROPA data were used in the current model to estimate the mortality associated with CVD events, assuming patients are taking perindopril. Baseline variables corresponding to the patient characteristics of the MUST-EECP trial were used in the risk equations. The output was the number of deaths from CVD causes in each yearly cycle based on the likelihood of a first primary event of CVD death, non-fatal MI or cardiac arrest, and the likelihood of subsequent CVD deaths from non-fatal primary events.
The age-dependent risk of other cause mortality was based on standard UK age- and sex-specific mortality rates. 44 These were adjusted to exclude those deaths recorded with an International Classification of Diseases (ICD) code pertaining to cardiovascular disease (ICD-10 I20–I99). The treatments were assumed not to infer a differential mortality effect.
Resource use and unit costs
Resource utilisation and cost data were based on treatment received. Because no additional costs are incurred under a no treatment strategy, the only costs included in the model were those associated with EECP, which relate to the standard 35-hour treatment sessions and the need for repeat top-up procedures over time. The costs were derived from UK sources and expressed in £ sterling at a 2008 price base.
The cost of EECP per patient is based on the average number of patients per annum that a centre can currently handle and the cost of consumables. UK centres currently run at about 12 patients per annum [Ken Miles, Vasogenics (UK) Ltd and Wayne Sheedy, Castle Hill Hospital, Cottingham, personal communication, 2008], but this can be increased to 15 patients in the first few years and up to 20–25 patients per year in subsequent years with increased staffing. An average of 12 patients per year was used in the base-case analysis. The capital cost of a new EECP machine (‘AngioNew’) was estimated to be £90,000 + VAT (including installation and training for three therapists for 3 days). This estimate was based on information provided by Ken Miles (personal communication). The machine is expected to have a useful life of about 10 years, which gives an equivalent annual cost of £10,822 (with an annuity factor for 10 years included at an interest rate of 3.5% per annum). Typical equipment replacement costs include one or two sets of cuffs per year, one set of hoses per year and replacement of the pleth every 2 years. The unit costs associated with each of these were informed by Vasogenics’ current price list (effective from April 2007). The consumables per patient for all 35 sessions are typically one pair of trousers, an ultrasound scan, gel, and ECG electrodes. Table 7 provides a breakdown of the total cost per patient for 35 hours of EECP treatment. Allowing for overheads and staffing costs, the total cost per patient was estimated to be £4347 per treatment over a 35-hour course. Some patients may receive a repeat or top-up procedure involving fewer treatment sessions (for the probability of repeat procedures see Repeat procedures). The cost per session was obtained by dividing the total cost of treatment by 35, giving a cost of £124 per session. The additional cost of repeat procedures was based on an average of 10 additional sessions. In a sensitivity analysis, the total cost of EECP was varied from –£1000 to £1000 to reflect the possibility of increased/decreased utilisation (patient throughput) in some centres.
Resource | Per annum cost | Per patient cost (n = 12) | Source |
---|---|---|---|
Capital cost of machine (lifetime = 10 years) | £10,822 | £902 | Ken Miles, personal communication |
Equipment replacement costs | |||
One set of cuffs per year | £139 | £12 | Vasogenics price list (effective from April 2007) |
One set of hoses per year | £76 | £6 | Vasogenics price list (effective from April 2007) |
Pleth every 2 years | £53 | £4 | Vasogenics price list (effective from April 2007) |
Consumables (for all 35 sessions) | |||
Ultrasound scan | – | £75 | Vasogenics price list (effective from April 2007) |
Trousers | – | £16 | Vasogenics price list (effective from April 2007) |
Gel | – | £8 | Vasogenics price list (effective from April 2007) |
ECG electrodes | – | £110 | Vasogenics price list (effective from April 2007) |
Staffing costs | |||
Nurse (0.5 FTE) | £19,308 | £1609 | Wayne Sheedy, personal communication |
M006 Medic (0.2 FTE) | £9808 | £817 | Wayne Sheedy, personal communication |
Receptionist (0.25 FTE) | £4738 | £395 | Wayne Sheedy, personal communication |
Overhead costs | – | £393 | Wayne Sheedy, personal communication |
Total costs | £4347 |
Repeat procedures
A typical course of EECP involves a total of 35 hours of therapy. Some patients require (or request) a repeat or top-up procedure involving several additional sessions. These sessions are generally given to help sustain the long-term benefits of EECP. A search of the literature was undertaken to identify studies that could potentially inform the rate of repeat or top-up procedures. The search identified one study, based on the experience of patients in the IEPR, which examined the frequency and efficacy of repeat EECP for stable angina. 45 Within 2 years of the initial course of EECP, the rate of repeat EECP was 18% (194/1078 patients), which occurred at a mean interval of 378 days after initial EECP. Assuming a fixed rate with respect to time, the 2-year probability was converted to a 2-year rate and used to generate an annual probability. 46 This annual probability of repeats decreased exponentially over time. To incorporate uncertainty in the estimates of repeat procedures, a beta distribution was used.
Base-case analysis
The model results are presented according to a particular set of assumptions employed as part of the base-case analysis. The impact of employing alternative assumptions to those proposed in the base-case analysis is then explored using sensitivity analysis. The base-case assumes an average starting age, in the model, of 64 years and that 92% of subjects are male, based on the patient characteristics of the MUST-EECP trial. 22
Within the base-case approach, separate analyses have been undertaken assuming that QoL benefits from EECP are sustained for different durations. A worst-case scenario is considered in which the QoL gains from EECP are only maintained in the first year after treatment, and then lost in subsequent years. At the other extreme, a best-case scenario is considered in which the QoL benefits are assumed to last over a patient’s lifetime. Both the lifetime and the 1-year analyses model cost-effectiveness at the extremes. A more realistic approach is to consider the cost-effectiveness in terms of the proportion of patients likely to sustain benefits over time. Due to a lack of long-term evidence for QoL benefits following EECP, expert elicitation was used to arrive at a consensus on the likelihood of sustaining benefits long-term. The cost-effectiveness of EECP based on this consensus forms the base-case analysis.
Sensitivity analysis
A number of alternative scenarios are considered as part of the sensitivity analysis. For each element, the position in the base-case analysis is outlined, alongside the alternative assumptions applied. The sensitivity analyses are undertaken to assess the robustness of the base-case model results to variations in alternative assumptions related to key parameters in the model. Table 8 reports the alternative scenarios considered as part of the sensitivity analysis.
Scenario | Element | Position in base-case analysis | Variation in sensitivity analysis |
---|---|---|---|
1 | Elicited expert values for the probability of sustaining QoL benefits from EECP over time | Linearly pooled values across experts with beta distribution fitted |
Empirical values from each expert used in separate analyses Linearly pooled empirical values across experts used with no distribution specified |
2 | Costs of EECP | Total cost is £4347 per patient | Lower and higher costs assumed (from £1000 lower to £1000 higher) |
3 | Probability of repeat EECP sessions | Within 2 years of EECP, the rate of repeat procedures is 18% | Within 2 years of EECP, the rate of repeat procedures varied from 10% to 30% |
4 | Population |
92% male, 8% female Average age is 64 years |
Separate analysis for men and women Alternative starting ages assumed from 55 to 70 years |
5 | Discount rate | 3.5% applied to both costs and outcomes | 6% costs, 1.5% outcomes |
Cost-effectiveness results
The results of the model are presented in two ways. First, the mean lifetime costs and QALYs of the two strategies are presented and their cost-effectiveness compared, estimating ICERs where appropriate. 47 The ICER compares the additional costs that one strategy incurs over another with the additional benefits, and represents the additional cost required to achieve one additional unit of outcome, QALY. To provide a reference point, the National Institute for Health and Clinical Excellence (NICE) uses a threshold cost per QALY of around £20,000–£30,000 to determine whether an intervention represents good value for money in the NHS. 28 Consequently, if the ICER for EECP is less than £20,000 then EECP should be considered to be potentially cost-effective. ICERs within the range itself (i.e. between £20,000 and £30,000) are considered borderline, and an ICER above £30,000 is not typically considered to be cost-effective.
Second, the results of the probabilistic analysis using Monte Carlo simulation are used to calculate the combined impact of the model’s various uncertainties on the overall uncertainty surrounding the cost-effectiveness results themselves. To present the uncertainty in the cost-effectiveness of the alternative strategies, cost-effectiveness acceptability curves (CEACs) are used. 48 The CEAC shows the probability that EECP is cost-effective, using alternative values for the threshold cost per QALY.
Results of the base-case analysis
The results of the base-case analysis, together with the best- and worst-case scenario for the duration of QoL benefits is reported in Table 9. The base-case results show that the ICER of EECP for angina (£18,643) is just below the lower bound of conventional thresholds used to identify whether a particular treatment is considered to be cost-effective in the NHS. At a threshold of £20,000 per QALY, the probability that EECP is more cost-effective than no treatment is 0.444. As the threshold cost per QALY increases, the probability that EECP is cost-effective increases. The relationship between the threshold ICER and the probability that EECP is cost-effective is shown clearly in the CEAC in Figure 5. The figure demonstrates how the probability increases as the threshold ICER increases (reaching close to 1 at a threshold of around £80,000).
Base-case analysis using pooled expert elicitation values | Probability of being cost-effective for the cost-effectiveness threshold | ||||
---|---|---|---|---|---|
Treatment | Cost | QALY | ICER | £20,000 | £30,000 |
EECP | £4750 | 7.492 | £18,643 | 0.444 | 0.698 |
No treatment | £0 | 7.237 | 0.556 | 0.302 | |
Worst-case scenario | |||||
EECP | £4464 | 7.289 | £63,072 | 0.001 | 0.032 |
No treatment | £0 | 7.237 | 0.999 | 0.968 | |
Best-case scenario | |||||
EECP | £5117 | 8.117 | £5831 | 0.966 | 0.991 |
No treatment | £0 | 7.237 | 0.034 | 0.009 |
The results of the worst-case scenario, in which QoL benefits from EECP are only sustained in the first year after treatment, show that the ICER of EECP (£63,072) is well above the conventional thresholds of cost-effectiveness. Therefore, it is highly unlikely that EECP could be considered cost-effective if the duration of benefits from treatment is assumed to last only 1 year. The results of the best-case scenario, in which QoL benefits from EECP are fully sustained over a lifetime, show that the ICER of EECP (£5831) is well below conventional cost-effectiveness thresholds. The probability that EECP is cost-effective with sustained lifetime QoL gains approaches 1 at a much lower value of the ICER than the base-case analysis.
The cost-effectiveness results for EECP appear highly sensitive to the duration assigned to the QoL benefits that are assumed to be achieved with EECP. While the best-case scenario suggests that EECP is likely to be considered highly cost-effective based on conventional thresholds used to establish value for money by the NHS, the results from the base-case analysis are less clear cut. While the ICER presented for the base-case analysis still falls below the range of acceptable thresholds, it should be recognised that other factors (aside from the ICER itself) may be considered important. These factors may include the strength of evidence, the size of the affected population and whether a suitable comparator exists. 49
Results of the sensitivity analysis
Table 10 details the results of each of the alternative scenarios considered within the sensitivity analysis. The table reports the ICER and the probability that EECP is cost-effective at thresholds of £20,000 and £30,000 per additional QALY. The base-case ICER of £18,643 provides the benchmark for assessing whether the cost-effectiveness results appear robust to particular assumptions made in the base-case analysis.
Scenario | Element | Variation in sensitivity analysis | ICER | Probability EECP is cost-effective for the cost-effectiveness threshold | |
---|---|---|---|---|---|
£20,000 | £30,000 | ||||
Base-case | Not applicable | Not applicable | £18,643 | 0.444 | 0.698 |
1 | Elicited expert values for the probability of sustaining QoL benefits from EECP over time | Expert 1 empirical values | £28,158 | 0.194 | 0.483 |
Expert 2 empirical values | £12,235 | 0.734 | 0.894 | ||
Expert 3 empirical values | £21,473 | 0.386 | 0.666 | ||
Expert 4 empirical values | £27,245 | 0.213 | 0.481 | ||
Expert 5 empirical values | £10,664 | 0.805 | 0.931 | ||
Pooled expert empirical values | £18,237 | 0.463 | 0.701 | ||
2 | Costs of EECP sessions | Lower and higher costs assumed (from £1000 lower to £1000 higher) | |||
–£1000 | £14,354 | 0.618 | 0.821 | ||
–£500 | £16,499 | 0.529 | 0.764 | ||
+£500 | £20,788 | 0.372 | 0.639 | ||
+£1000 | £22,932 | 0.310 | 0.579 | ||
3 | Probability of repeat EECP sessions | Within 2 years of EECP, probability varied from 10% to 30% | |||
10% | £18,021 | 0.469 | 0.718 | ||
15% | £18,424 | 0.452 | 0.704 | ||
25% | £19,117 | 0.428 | 0.685 | ||
30% | £19,413 | 0.417 | 0.676 | ||
4 | Population | Separate analysis for men and women | |||
Men (100%) | £18,666 | 0.444 | 0.697 | ||
Women (100%) | £17,996 | 0.464 | 0.711 | ||
Alternative starting ages assumed from 55 to 70 years | |||||
55 years | £17,567 | 0.476 | 0.721 | ||
60 years | £17,951 | 0.466 | 0.714 | ||
70 years | £19,658 | 0.416 | 0.680 | ||
5 | Discount rate | 6% costs, 1.5% outcomes | £17,381 | 0.484 | 0.726 |
In the base-case analysis, the elicited expert values for the probability of sustaining QoL benefits from EECP over time were linearly pooled and a beta distribution fitted to the data. In a sensitivity analysis, the empirical values from each expert were considered separately to assess the cost-effectiveness. The ICERs from the five experts ranged from £10,664 to £28,158, indicating that the results are sensitive to the beliefs of the experts. The ICERs for experts 2 and 5 are well under threshold values conventionally considered to be cost-effective. The ICERs for experts 1 and 4 are similar but close to the upper threshold of £30,000 for cost-effectiveness. The ICER for expert 3 is closer to the pooled base-case ICER result. Because the results appear sensitive to the beliefs of the experts, the cost-effectiveness of EECP is highly sensitive to the probability of sustaining QoL benefits over time. A sensitivity analysis was also undertaken to assess the sensitivity of the beta distributional fit to the linearly pooled data by sampling from the empirical distribution of values. The results appear robust to the distributional form imposed on the data.
In the base-case analysis, the cost of EECP was £4347 per treatment. In a sensitivity analysis, a series of scenarios were considered by increasing/decreasing the costs of EECP to reflect the possibility of increased/decreased utilisation (patient throughput) in some centres. Clearly, if the costs are lower than those applied in the base-case analysis, the results will appear conservative to EECP. Reducing the costs by £1000 improved the cost-effectiveness, such that the ICER decreased to £14,354. Increasing the costs by £500 increased the ICER by £2145 per QALY. Increasing the costs by a further £500 increased the ICER by a similar amount again. If the costs are expected to be £3000 more than the base-case estimate of £4347 then it is unlikely that EECP can be considered to be cost-effective (with an ICER above the upper limit of £30,000 per QALY).
The base-case analysis assumed that the probability of repeat or top-up EECP sessions was 18% within 2 years of initial treatment. In a sensitivity analysis, this probability was varied from 10% to 30%. The corresponding results for the ICER varied from £18,021 to £19,413 respectively, indicating that the cost-effectiveness of EECP is quite robust to the likelihood of requiring additional treatment sessions.
The results of the base-case analysis were based on the average patient characteristics of entrants in the MUST-EECP trial (average age 64 years, 92% of sample subjects male). The cost-effectiveness results may also vary according to different patient characteristics (for example, men versus women, alternative ages). Heterogeneity in patient characteristics was explored using a series of separate scenarios. These scenarios were explored by varying the general population mortality rate according to the particular age and sex characteristics considered. Using this approach, the cost-effectiveness estimates in these scenarios are affected by the number of patients who can potentially stand to gain from sustained QoL improvements associated with EECP over time. The results demonstrate that cost-effectiveness is marginally improved in subgroups with the highest life expectancy (for example, women, age 55 years). However, differences between the subgroups are relatively minor, and the ICER for EECP remains around £18,000 per QALY across the subgroups.
Applying an alternative discount rate of 6% for costs and 1.5% for health outcomes (compared with 3.5% for both in the base-case analysis) improved the cost-effectiveness by a minor amount. The ICER remains below the lower bound of the £20,000 threshold.
Summary of cost-effectiveness results
The results of the base-case analysis demonstrate that the long-term maintenance of the QoL benefits of EECP appear central to the estimate of cost-effectiveness. If the QoL gains are maintained over the remaining lifetime of the patient then the cost-effectiveness of EECP appears clear, with the resulting ICER falling well below conventional thresholds of cost-effectiveness. Similarly, if the QoL gains are only maintained in the first year after treatment then the cost-effectiveness of EECP is also clear, but with a resulting ICER being well above the upper £30,000 threshold. A more realistic question of how long the benefits are likely to be maintained in patients becomes a key consideration. The results from the base-case analysis, which are based on pooled expert beliefs about the durability of benefits, suggest that the overall cost-effectiveness is finely balanced, and difficult to determine without long-term RCT evidence on QoL gains from EECP. The sensitivity analysis examining separately the beliefs of each expert supports this conclusion.
Value of information analysis: the decision to acquire more evidence
In the previous sections, the expected cost-effectiveness of EECP in angina was assessed given the existing evidence available. The information on long-term effectiveness of EECP is scarce, and there is a prudent need to establish if EECP has a role for treating angina and other forms of coronary artery disease. As such, an analysis of the EVI will help to prioritise the areas in which further research is needed in EECP. In the following sections, the potential value of future research is assessed, and a sufficient condition is presented for establishing if an additional clinical trial is required.
Methods for the expected value of information
The implications of the uncertainty associated with the cost-effectiveness of EECP are explored in this section by undertaking an analysis of the EVI. Analysis of the expected value of perfect information (EVPI) provides a formal quantitative approach to establishing if further primary research is indicated in light of the current decision uncertainty. 32 It also provides an indication of where additional research is most valuable. 50 The analysis produces an upper limit to the value of future research that could be undertaken, to reduce the uncertainty associated with a decision regarding the adoption of EECP routinely in the NHS.
Assuming that the objectives of the NHS are consistent with maximising health gains from available NHS resources, adoption decisions should be based on expected costs and benefits (i.e. on the ICER relative to some maximum willingness to pay for an additional unit of health gain) associated with the intervention. 51 However, decisions based on expected values will be uncertain, and there will always be a chance that the wrong decision will be made, in which case there will be opportunity losses across the population of angina and other patients in terms of health benefit and resources forgone. Therefore, the expected cost of uncertainty can be determined jointly by the probability that a decision based on existing information will be wrong and the consequences of an incorrect decision. Uncertainty in the cost-effectiveness of EECP was represented using the cost-effectiveness acceptability curve (see Figure 5). This demonstrated that, at particular threshold values of the ICER, there exists significant uncertainty surrounding the cost-effectiveness of EECP, which has important implications for the value of conducting further research to support the adoption decision.
The expected cost of uncertainty associated with a decision based on current information is equivalent to the EVPI since perfect information would eliminate the possibility of making an incorrect decision. Furthermore, the EVPI also represents the maximum amount that a decision-maker should be willing to pay for additional evidence to inform this decision in the future. EVPI is used to provide an upper bound on the value of additional research to that provided by the model. If the EVPI value is greater than the costs of additional research, consideration should be given to conducting further research to inform the adoption decision. In addition to providing a global estimate of the total cost of uncertainty related to all inputs in the model, EVPI can also be estimated for individual parameters (and groups of parameters) within the model. This partial EVPI analysis (termed EVPPI) can be used to identify the model parameters where more precise estimates would be most valuable.
The use of Monte Carlo simulation allows the expected costs of uncertainty associated with the initial adoption decision to be expressed as the proportion of iterations (or simulations) in which the uncertainty within the model results in an adoption decision other than that arising from maximising expected cost-effectiveness (i.e. expected net benefits). The benefits forgone are the difference in costs and outcomes (net benefit) between the optimal strategy for a given iteration and those of the strategy identified as optimal in the adoption decision (i.e. based on the expected cost-effectiveness estimates). The expectation of benefits forgone over all iterations represents the EVPI for an individual patient. More formally, this implies that, for a decision involving j treatments where net benefit (NB) is dependent upon a set of unknown parameters θ, the EVPI is the difference between the expected value of the decision made on the basis of existing information (maxj[Eθ{NB(j, θ)}]), and the value of the decision made with perfect information (maxj{NB(j, θ)}), averaged over all possible realisations of uncertainty (Eθ[maxj{NB(j, θ)}]):
The overall value of information for a population of patients who could benefit from EECP is determined by applying the EVPI per individual to the number of patients who would be affected by the information (i.e. the incidence) over the anticipated lifetime of the EECP technology:
where P0 is the prevalent population, It is the incidence in period t, T is the total number of periods for which information from research would be useful, and r is the discount rate.
The effective population who could potentially benefit from EECP is estimated to be around 7–10% of the number of patients who are affected by angina in the UK (Michael Chester, Liverpool Hope University, personal communication, 2008). The British Heart Foundation estimates that the prevalence of angina in the UK is 706,000 men aged between 55 and 75 years, and 392,000 women. 52 This gives a total of just under 1.1 million. The incidence of angina is estimated to be around 52,000 new cases per year in all men in the UK and around 43,000 in women. 52 Based on the base-case analysis where 92% of subjects are male, this implies a prevalence of about 680,880 and an annual incidence of around 51,280 for angina. Assuming that 10% of these patients could potentially benefit from EECP, this gives a prevalence of 68,088 and an annual incidence of 5128. The population EVPI is estimated using these values, and assumes that the information would be valuable for the 10-year lifetime of the EECP technology. A 3.5% annual discount rate is applied.
Individual patient and population EVPIs are calculated for the base-case model.
Results
Total expected value of perfect information
Figure 6 shows the population EVPI for the base-case model. The EVPI estimates are closely related to the threshold cost-effectiveness ratio and the associated probability that EECP is cost-effective. When the threshold for cost-effectiveness is low (for example, less than £5000 per QALY), EECP is not considered to be cost-effective under any scenario, and the associated probability that EECP is cost-effective is also low. In this case, there is minimal decision uncertainty that EECP is not optimal, therefore, additional information is unlikely to change this decision and so the estimates of EVPI are low. Similarly, when the threshold is considerably higher (for example, more than £50,000 per QALY), EECP is expected to be cost-effective under the base-case assumptions; therefore, the decision is less likely to be changed by further research. Hence, the EVPI falls to zero after £50,000 per QALY. The EVPI reaches a maximum at the point where the threshold for cost-effectiveness is equal to the expected ICER of EECP. This maximum occurs when the decision is most uncertain on whether to adopt or reject EECP based on current evidence (i.e. at £18,643 per QALY). Given that the EVPI places an upper bound on the value of conducting further research, the EVPI can be interpreted as follows. If the population EVPI exceeds the expected costs of additional research then it is potentially cost-effective to conduct further research. For example, if additional research in EECP is expected to cost £20 million then additional research is potentially cost-effective if the threshold is between £11,000 and £43,000 per QALY.
The population EVPI can be scaled back to provide results for the individual per patient EVPI. This allows decision-makers to apply the results to the potential size of their own population of interest. Table 11 provides a summary of the population and individual EVPI estimates for selected threshold values.
Scenario | Individual patient EVPI for the cost-effectiveness threshold | Population EVPI for the cost-effectiveness threshold | ||
---|---|---|---|---|
£20,000 | £30,000 | £20,000 | £30,000 | |
Base-case | £971.29 | £440.16 | £107,556,668 | £48,741,220 |
Partial expected value of perfect information
The total EVPI provides a useful estimate of the uncertainty surrounding the adoption decision as a whole, but it does not provide an indication of where further research would be considered most valuable. The value of reducing the uncertainty surrounding particular input parameters in the model can be established by estimating the expected value of partial perfect information (EVPPI). This considers particular elements of the decision problem in order to direct and focus research towards the specific areas in which the elimination of uncertainty has the most value. This can be particularly relevant to the design of any future research (see Expected value of sample information). The analysis of EVPPI can be conducted in a similar way to the EVPI for the decision as a whole but it requires substantial additional computations. Formally, the EVPPI for a parameter (or subset of parameters) φ, is the difference between the expected value of the decision made on the basis of existing information (maxj[Eθ{NB(j, θ)}]), (as with the calculation of decision EVPI) and the value of the decision made with perfect information about φ (maxj[Eθ|φ{NB(j, θ)}]). Where perfect information about the parameter φ has no impact on the decision, the information has no value. The value of the decision made with perfect information about φ is averaged over all possible realisations of uncertainty (Eφ[maxj(Eθ|φ{NB(j, θ)})]) to reflect the fact that the parameter can resolve at any point within the distributions:
There are three groups of uncertain parameters in the base-case model. These relate to:
-
the 1-year QoL improvement from EECP in the MUST-EECP trial
-
the probability of sustaining QoL benefits in each subsequent year
-
the probability of repeat top-up procedures.
The EVPI for each of these parameters [or groups of parameters in the case of (2) above] is calculated over a range of threshold values.
Table 12 provides the EVPPI estimates for the three groups of uncertain parameters in the base-case model for selected values of the threshold. The EVPI associated with the 1-year QoL gains from EECP is extremely high and appears to account for the majority of uncertainty in the model. The probability of sustaining these QoL gains in each subsequent year appears to have a more moderate influence on the overall decision uncertainty (based on the base-case assumptions). The estimates of EVPPI for these parameters are shown in Figure 7, based on a wider range of threshold values. The probability of repeat top-up procedures demonstrates little value to additional research.
Scenario | Parameters | Individual patient EVPPI for the cost-effectiveness threshold | Population EVPPI for the cost-effectiveness threshold | ||
---|---|---|---|---|---|
£20,000 | £30,000 | £20,000 | £30,000 | ||
Base-case | All parameters | £971.29 | £440.16 | £107,556,668 | £48,741,220 |
1 | 1-year QoL improvement | £784.68 | £340.35 | £86,892,420 | £37,689,025 |
2 | Probability of sustaining QoL benefits in subsequent years | £379.80 | £10.14 | £42,056,850 | £1,122,826 |
3 | Repeat top-up procedures | £0.00 | £0.00 | £0.00 | £0.00 |
Expected value of sample information
In the previous sections, the EVPI and EVPPI set an upper limit on the returns to further research, i.e. if the population EVPI is greater than the expected costs of further research, then further studies should be considered. However, to fully inform the research decision, the most efficient research design needs to be established;33 for example, the type of study to be conducted, the optimal sample size, the optimal allocation of patients within a clinical trial, the appropriate follow-up time and which end points should be included. 46,53,54 To establish the most appropriate design, the marginal benefits and marginal costs of gathering sample information need to be considered. The same framework of EVI analysis can be extended to establish the EVSI for a particular research design. The difference between the EVSI and the costs of sampling is the ENBS. The ENBS provides a measure of the payoff to the health system from research, and can be calculated for a range of sample sizes and alternative designs of research. Therefore, it provides a sufficient condition for deciding to conduct more research, i.e. if the ENBS is greater than zero then the marginal benefits of gathering the sample information exceed the marginal costs. The optimal design (e.g. sample size, follow-up duration, etc.) is characterised by that which maximises the ENBS. 33
The issue of which information to obtain first requires calculation of the EVSI. This places an upper limit on the cost of conducting a new trial for a given sample size n. In other words, it is the maximum value of conducting a new trial and it depends on the number of patients projected to enrol in the new study. If the cost of the new study is less than the EVSI, the new trial is considered to be worthwhile. The EVSI approach considers the payoff (expected net benefit) that could be obtained if decisions were based on having additional sample information. This is done by predicting possible sample results that might be expected from a particular study with sample size n. The sample information allows an update of imperfect prior information about model parameters, by combining the prior knowledge with each of the possible sample results to form a number of possible predicted posterior results. 53 The expected net benefit for the decision problem is calculated for each of these possible posteriors. The difference between the expected net benefit of the decision based on the predicted posteriors and the expected net benefit based on prior current information gives the EVSI for a sample of size n. More formally, a sample n on a set of unknown parameters θ will provide a sample result D. If D was known in advance, the expected value of the decision would be found by averaging over the posterior distribution of the NB of each treatment j given the new data D (maxj[Eθ|D{NB(j, θ)}]). However, as D is not known in advance, the expected value of the decision is taken by averaging over the predictive distribution of possible values of D conditional on θ (ED[maxj[Eθ|D{NB(j, θ)}]]). The EVSI is then expressed as:
which measures the additional value of a decision based on sample n rather than on current information.
Analogous to population EVPI, the overall value of sample information for a population of patients who could potentially benefit from EECP is determined by applying the EVSI per individual to the number of patients who would be affected by the information when it becomes available over the lifetime of the technology:
where P0 is the prevalence at time T = 0, FU is the follow-up length of the trial, Ii is the incidence in period i, It is the incidence in period t, T is the total number of periods for which information from research would be useful, and r is the discount rate.
To obtain the societal payoff to the proposed research, the population EVSI needs to be compared with the costs of sampling. Assuming that the proposed clinical trial has two treatment arms with equal allocation of patients across the two treatments, the cost of sampling (C) for a 1-year follow-up is given by:
where FC is the fixed cost of the proposed research, RC is the reporting costs, P0 is the prevalence at time T = 0, I1 is the incidence in year 1, NB* is the expected net benefit for the optimal treatment based on prior current information, NBST is the expected net benefit for standard therapy based on prior current information, and NBo is the expected net benefit of the treatment which is not optimal, based on prior information. Accounting for the length of follow-up of the trial, the third term represents the expected opportunity cost of a trial, when a decision on whether to adopt a particular treatment or not is delayed while the trial is undertaken, i.e. standard therapy is retained during the trial follow-up period. Therefore, in the third term, the prevalence at time T = 0 (minus the number of patients who entered the trial, n) and the incidence during the trial follow-up period will be allocated to standard therapy while the trial is undertaken. Consequently, if standard therapy is not cost-effective, there will be an expected opportunity cost equivalent to (NB*(T = 1) – NBST(T = 1)), whereas if standard therapy is cost-effective, there will be no loss. The fourth term accounts for the opportunity cost of allocating half the trial sample to the non-optimal treatment during the trial period.
The societal payoff to the proposed research, known as the ENBS, is the difference between the expected benefits of sampling (pEVSI) and the expected cost of sampling (C):
This provides a sufficient condition for deciding to conduct more research. If the ENBS(n) > 0 for any sample size, then further research is justified. The ENBS also provides a framework for the efficient design of the clinical trial. The optimal sample size n* for the proposed trial is where the ENBS reaches a maximum. A number of alternative research designs across a range of dimensions can be investigated within the framework. However, it is worth noting that the computations for EVSI can be very challenging when dimensions are added to the design space. 54
For EECP, a simple research design might consist of an RCT allocating equal numbers of entrants to EECP versus standard care. In this case, enumeration of a sufficient range of sample sizes will yield the optimal sample size n* that maximises the ENBS. This optimal sample size indicates how many patients should be enrolled in the trial for it to provide the highest payoff. Given the lack of evidence regarding the long-term maintenance of QoL benefits from EECP, the length of follow-up of the trial may be a further design feature to be optimised along with n.
Population EVSI and the ENBS are calculated for the base-case model. The optimal sample size and proposed length of follow-up are determined.
Results
Population expected value of sample information for the decision problem
Figure 8 shows the population EVSI for the base-case model for selected thresholds, assuming a linear relationship between inputs and expected costs and outcomes. The assumption of linearity has only a limited impact on the results (see Appendix 6). The EVSI corresponds to a 4-year clinical trial design that includes all the model parameters as end points, and in which the entrants are allocated equally between treatment arms. The EVSI is closely related to the threshold cost-effectiveness ratio in the same way as demonstrated with EVPI. For example, the EVSI is highest at the threshold of £20,000 at which the decision is more uncertain, reflecting the relationship between the population EVPI and the threshold seen in Figure 6. The EVSI increases as the sample size is increased, but at a declining rate. For this trial design, the EVSI will eventually approach the population EVPI for the particular threshold value as the sample size becomes very large.
The EVSI in Figure 8 provides the upper limit on the cost of conducting a new trial for a given sample size and cost-effectiveness threshold. It provides an estimate of the benefits of sample information, but these need to be compared with the costs of sampling.
Expected net benefit of sampling for the decision problem
By comparing the EVSI in Figure 8 with the costs of sampling, the optimal sample size for a clinical trial can be identified when the ENBS reaches a maximum. Figure 9 shows the ENBS for the decision problem at cost-effectiveness thresholds of £10,000 and £20,000 per QALY. At a threshold of £30,000, the ENBS is negative, indicating that the increased opportunity costs of sampling for a 4-year trial follow-up design outweigh the marginal gains generated from additional sample information. At the threshold of £30,000, the probability that EECP is cost-effective is higher. Consequently, there are higher opportunity costs of benefits forgone by allocating patients who could potentially benefit from EECP to standard therapy during the 4-year trial follow-up period when the decision-maker is willing to pay £30,000 per additional QALY.
In Figure 9, the fixed costs of sampling are excluded as they do not influence optimal sample size or allocation. 54 The reporting costs for patients enrolled in the treatment arms were assumed to be £300 per patient per follow-up year. The marginal costs of sampling with equal allocation are constant. Therefore, because the marginal value of sample information increases at a diminishing rate as the sample size increases but the costs of sampling increases in proportion to the number of patients enrolled in the trial, the ENBS will reach a maximum before declining. In Figure 9, at a threshold of £20,000 per QALY, the ENBS reaches a maximum of £87.9 million at an optimal sample size of 900 patients. If the ENBS of £87.9 million is greater than the fixed costs of the research, then the proposed 4-year clinical trial with equal allocation can be considered cost-effective.
Because the EVSI depends on the cost-effectiveness threshold, the ENBS also depends on the threshold, and so in Figure 9 there are different optimal sample sizes for different thresholds. For the threshold of £20,000, the ENBS curve is relatively flat at its maximum. Therefore, sample sizes slightly more or less than the optimal size of approximately 900 have little impact on the ENBS. The relationship between ENBS and sample size is dependent on the costs of sampling. If the costs of sampling are expected to be substantially more than those estimated in this example, the ENBS can be expected to fall from its maximum more quickly. At a threshold of £10,000 per QALY, the optimal sample size is much less (n* = 340) than at the threshold of £20,000. This is because further research is less valuable at this threshold. There is minimal decision uncertainty that EECP is not considered to be cost-effective at the threshold of £10,000 and, therefore, additional information is unlikely to change the adoption decision.
The ENBS and optimal sample size in Figure 9 is positive, indicating that this particular research design would be cost-effective and that further research is needed if the decision-maker is willing to pay less than £30,000 per additional QALY. The design employed in this example corresponds to a single trial with equal allocation between treatment arms. It also corresponds to a trial with a 4-year follow-up. The EVSI for the decision problem is based on a design that could potentially provide information on all the uncertain parameters in the model. As the elicitation exercise provided prior information on the sustained duration of QoL benefits up to year 4, the posterior predictions based on sample information were calculated up to year 4. Beyond that, the model assumes that the proportion of patients sustaining benefits in each subsequent year (conditional on sustaining benefits in the previous year) is equivalent to that in year 4. In the following section, the appropriate length of follow-up of the trial is considered as a further design feature.
Appropriate length of follow-up of clinical trial
The appropriate length of follow-up of the clinical trial is an important design feature in the case of EECP since the evidence for the long-term maintenance of QoL benefits is limited. Figure 10 shows the ENBS for different lengths of follow-up at a threshold of £20,000 per QALY. In the 1-year follow-up, it is assumed that information is revealed on the QoL gains from EECP relative to standard care (i.e. no EECP treatment) and on the number of patients requiring additional repeat sessions. The ENBS reaches a maximum of £84.2 million at an optimal sample size of 1450. In the 2-year follow-up, it is assumed that the same information from the 1-year follow-up is revealed but, in addition, information is revealed on the sustained duration of QoL benefits in the second year after treatment. The ENBS in this case is very similar to that in the 1-year follow-up and reaches a maximum of £84.1 million at a lower optimal sample size of 1200. In the 3-year follow-up, the same information as the 2-year follow-up is revealed, but the sustained duration of QoL benefits from year 2 to year 3 is also revealed. In this case, the ENBS falls below the ENBS for a 2-year follow-up because the increased opportunity costs incurred by withholding sample information for an additional year outweigh the marginal gains generated from the additional year’s information. The ENBS for a 3-year follow-up reaches a maximum at £81.7 million at an optimal sample size of 950. The ENBS for a 4-year follow-up is higher than the other periods of follow-up because the model assumes that the proportion of patients sustaining benefits in the fourth year is unlikely to differ substantially in subsequent years. In this case, information regarding the sustained benefits up to 4 years after treatment is more valuable than any shorter period of follow-up. Clearly, a trial involving a fifth year of follow-up would provide even further information (assuming that the additional costs incurred by following patients for another year do not outweigh the additional information gains), but at some point of follow-up assumptions need to be made regarding the sustained duration of benefits beyond the follow-up period. Based on the results of Figure 10, a 4-year follow-up with an optimal sample size of 900 patients allocated equally across treatment arms would provide the greatest returns to research.
Summary of value of information results
The cost-effectiveness results for EECP appear highly sensitive to the duration of sustained QoL benefits that are assumed to be achieved with treatment. The uncertainty surrounding the duration and also the actual estimate of the QoL gains from treatment results in a significant cost of uncertainty reflected in high EVPI estimates at particular cost-effectiveness thresholds. The population EVPI estimates suggest that further research in this area is likely to be of significant value. The EVPI for individual parameters highlighted that potential future research would be of most value directed towards obtaining more precise estimates of the QoL following EECP treatment and the duration that these QoL benefits are expected to be maintained.
Given that there is potential value to future research, a clinical trial design was proposed. This trial design considered an equal allocation of patients between the arms of the proposed trial. Although it depends on the cost-effectiveness threshold, the ENBS is positive for most sample sizes, indicating that further experimental research will be efficient. Given that the threshold for cost-effectiveness is £20,000 per QALY, the highest expected returns to additional research will come from a trial with a 4-year follow-up and an optimal sample size of 900 (i.e. 450 entrants to each arm of the proposed trial). Clearly, these conclusions are based on the set of assumptions employed in the base-case model. In particular, these recommendations are based on a population of patients with angina severity similar to MUST-EECP patients.
Chapter 4 Discussion
Statement of principal findings
Clinical evaluation
A systematic review was conducted to assess the clinical effectiveness and safety of EECP for treatment of stable angina and heart failure. There is a paucity of RCTs investigating the effectiveness of EECP in these groups of patients. Of the four controlled studies of EECP for the treatment of stable angina,17–20 only one was an RCT17 (the MUST-EECP trial), and a single RCT (the PEECH trial)21 represented the total body of controlled clinical studies in heart failure.
The evidence for the clinical effectiveness of EECP in chronic stable angina was extremely limited. The MUST-EECP trial provided the most reliable investigation of EECP in angina but, even so, the results have to be interpreted with caution owing to limitations in the quality of the study analysis and the short duration of follow-up. On the other hand, this study did use a sham EECP as placebo and may therefore have understated the effects of EECP in practice: the placebo effect of sham EECP may well be clinically significant and so any benefit of active EECP over that of sham EECP is likely to be smaller than the benefit seen with EECP compared with usual care. The MUST-EECP trial reported a mean 37-second improvement in time to exercise-induced ischaemia with EECP compared with a 4-second deterioration with sham EECP at the end of treatment; improvement in this outcome is a key objective of angina management according to European and US professional organisations. There were also limited improvements in mean exercise duration, number of angina episodes and NTG use, but these did not reach statistical significance (possibly because there were too few patients), and again the clinical significance is uncertain. Although there was evidence of a benefit with EECP on QoL 12 months after treatment, this was based on just under half of the original sample, so this finding should be treated with caution as this may not have been representative of the whole sample. With the exception of QoL, the outcomes were assessed only at the end of treatment, i.e. following 35 sessions, so the long-term effects of EECP in angina patients could not be determined. Mortality or MACEs were not assessed in this trial; therefore there is no evidence available from RCTs on these important clinical outcomes. There is evidence, based on a comparison of two registries, that 1-year all-cause mortality is similar in patients that have received EECP and PCI (1.3% and 3.2% respectively). In addition to some weaknesses in the internal validity of the trial, there are also limitations on the generalisability of the results of the trial. In common with the two large angioplasty studies (RITA-227 and COURAGE55), the substantial exclusion criteria and the large proportion of participants with Class I or II symptoms limit the extent to which the findings can be generalised to all patients with refractory stable angina. Furthermore, although many (if not all) of the patients in the MUST-EECP trial were experiencing angina while receiving medical therapy, refractory stable angina has a variety of definitions, some of which require the patient to have angina more severe than that seen in the MUST-EECP trial, i.e. refractory to both medication and surgery. 56,57
The PEECH trial evaluated the effects of EECP in patients with mild to moderate heart failure. As with the stable angina trial, the focus was on improvement in symptoms and exercise duration: cardiac-related mortality was not reported. In this trial, there was an improvement with EECP compared with usual care control on all outcome measures at the end of treatment. At 6 months’ follow-up, the benefit of EECP in terms of improved exercise duration and improved NYHA class had been maintained, but not in terms of peak VO2 or QoL. The clinical benefit to heart failure patients of a 35-second increase in mean exercise duration and a difference of 10% achieving a minimum 60-second increase in exercise duration is unclear. The inclusion/exclusion criteria were extensive; therefore, the trial population may not accurately reflect patients who would typically be seen in clinical practice for this therapy. The limited follow-up means that the effects of EECP on the long-term outcomes of these patients cannot be ascertained.
Adverse events associated with EECP were common in the RCTs, with around 12% of patients withdrawing due to AEs. The most commonly reported device-related AEs were leg or back pain, or skin abrasion, bruise or blister. Non-device-related AEs were also common, and in these studies it was not established whether the adverse effects classified as ‘non-device related’ could be due to the wider impact of EECP on the cardiovascular system. Thus, the adverse effects of EECP may be a clinically relevant limitation to the effectiveness of EECP.
Economic evaluation
The decision problem addressed by the decision analytic model relates to the cost-effectiveness of EECP in adults with chronic stable angina. The model evaluates a strategy of EECP treatment compared with no treatment, and is structured to project HRQoL benefits beyond the 1-year trial follow-up period of MUST-EECP. 17
The base-case analysis for a population of patients with angina severity similar to MUST-EECP demonstrates that the long-term maintenance of QoL benefits of EECP is central to the estimate of cost-effectiveness. If QoL benefits of EECP are assumed to be maintained for no more than 1 year after treatment, EECP does not appear to be cost-effective in the NHS, as defined by NICE’s cost-effectiveness threshold range. 28 In contrast, if QoL benefits are maintained over a lifetime, the cost-effectiveness of EECP appears clear, with a resulting ICER well below conventional thresholds of cost-effectiveness. The base-case analysis, based on pooled expert beliefs about the durability of QoL benefits, suggests that the overall cost-effectiveness of EECP is finely balanced and difficult to determine without evidence from an RCT with long-term follow-up about QoL from EECP. The sensitivity analysis examining the beliefs of each clinical expert separately on durability of benefits leads to conflicting conclusions about the cost-effectiveness of EECP.
The cost-effectiveness model reveals uncertainties surrounding the duration of treatment benefits and also the actual estimate of the 1-year QoL improvement from EECP. The value of information analysis suggests that future research in this area is likely to be of significant value. This research should be directed towards obtaining more precise estimates of the QoL following EECP treatment and of the duration over which these benefits are expected to be maintained. The ENBS is positive for a range of cost-effectiveness thresholds and sample sizes, indicating that further experimental research in EECP would be efficient. For this particular patient population (MUST-EECP type patients), a clinical trial design with a 4-year follow-up and a sample size of 900 is suggested by the value of information analysis. This proposed trial is expected to give the highest expected returns to research, based on the set of assumptions employed in the base-case model.
Strengths and limitations of the assessment
A rigorous review of the research literature on the effects of EECP for the treatment of refractory or chronic stable angina and heart failure has been conducted, capturing the most recent evidence relating to EECP. However, despite this, the assessment of the clinical evidence is clearly limited by the paucity of evidence. Only five studies identified in our searches were eligible for inclusion, and, of these, only two were RCTs (n = 326). The remaining three studies had significant methodological flaws, which seriously limit the value of their findings. One was a comparison of two registries in which the baseline characteristics of the two groups were substantially different. The other two studies had a very small number of participants, and assignment to treatment was self-selection. In addition, the evidence available from the RCTs was derived from mainly short-term outcomes. No RCT evidence or reliable data were available regarding mortality or MACEs.
Given that there is no existing cost-effectiveness evidence that provides a basis for informing policy decisions regarding the use of EECP in the NHS, a new decision-analytic model has been developed. While the cost-effectiveness model addresses this limitation by evaluating EECP treatment in stable angina, the model has several potential limitations that need to be considered in conjunction with the results. Clearly, the model output is dependent on the parameter inputs that are used. The QoL estimates applied in the model remain highly uncertain. Although there are several studies reporting on the QoL of patients following EECP treatment, most of these use a simple five-point rating scale that poses several problems if directly applied within a cost-effectiveness analysis. To date, there are no studies that directly quantify the long-term impact of EECP using a generic utility measure such as the EQ-5D. 58
This represents a major limitation when trying to establish the cost-effectiveness of an intervention, as the use of these measures provides a clearer basis for establishing value for money in the NHS when decisions need to be made across a range of health-care interventions and programmes. Therefore, it is important to establish that the additional value provided by EECP to the NHS will offset any benefits lost through resource displacements (potentially in different patient populations). The absence of direct data using a generic utility instrument represents a major omission from the existing evidence base for EECP. In the absence of these data, alternative approaches were used. For the 1-year QoL estimate, a mapping algorithm was used to convert the aggregate SF-36 data from the MUST-EECP trial into a utility-based measure (EQ-5D). The process of mapping between the instruments, and the lack of individual patient level data introduce an additional source of uncertainty. However, in the absence of alternative data, the current estimates represent the best available QoL values. In the absence of any long-term estimates for QoL, expert elicitation techniques were employed to quantify the durability of benefits. A number of separate scenarios demonstrated that the results were sensitive to the beliefs of the clinical experts. Therefore, the model results clearly demonstrate that the cost-effectiveness of EECP is extremely sensitive to the duration over which the benefits are likely to be maintained.
The decision model does not consider the impact of EECP treatment on ‘hard’ outcomes such as death or major adverse clinical events. No comparative studies of EECP address outcomes of death or clinical events such as MI. Consequently, no reliable estimates could be used to populate a long-term prognostic model of EECP for angina. The cost-effectiveness estimates for EECP can be considered conservative if EECP does, in fact, lead to a reduction in the risk of major clinical events over and above the reduction from standard care.
There is uncertainty regarding the need for repeat EECP treatment sessions. These repeat or top-up sessions have implications for costs and QoL, but there is little focus on this issue in the published research literature. Although the value of information analysis reported here indicates that there is little uncertainty in the probability of repeat top-up procedures, it should be recognised that owing to structural uncertainties in the model this uncertainty may be underestimated. It should also be recognised that the treatment costs of EECP itself remain uncertain. The costs used in the model are based on a reasonable approximation of the resource costs associated with the treatment sessions. However, it should be noted that different centres in the UK are currently charging different prices to purchasers for EECP therapy. This may reflect the increased/decreased utilisation (patient throughput) in some centres. The cost of EECP may change if departments are run more effectively. The analysis does not take into account escalating medical costs that may occur over time. Costs of the non-EECP option in the cost-effectiveness analysis may be underestimated, given that there could be baseline medical costs associated with hospitalisations.
The decision model only considers the cost-effectiveness of EECP in patients with chronic stable angina, similar in severity to MUST-EECP patients. Our clinical advice is that, currently, EECP is more widely used in angina than in heart failure. Owing to the limitations of existing evidence in relation to patients with heart failure, separate cost-effectiveness analyses were not undertaken for the two forms of heart disease. Consequently, the generalisability of these findings to a broader range of patients who could potentially benefit from EECP should be viewed with due caution. The modelling framework developed here for angina can be readily employed in other populations, including patients with heart failure, as and when further evidence emerges.
The available trials and case series are predominantly US based. There are very few UK-based data represented in the research literature. Therefore, it is uncertain how generalisable to the UK context the findings of the clinical evaluation are.
Chapter 5 Conclusions
The results from a single RCT do not provide firm evidence of the clinical effectiveness of EECP in chronic or refractory stable angina. Furthermore, better quality RCTs are required to investigate the benefit of EECP in terms of time to ST segment depression, exercise duration, angina frequency and patients’ requirement for NTG, and if these outweigh the common adverse effects associated with this intervention.
Similarly, the results from a single RCT in heart failure do not provide firm evidence of the clinical effectiveness of EECP. Statistically significant modest benefits were seen in terms of exercise duration and NYHA classification; however, their clinical significance is unclear. These effects need to be investigated in further RCTs.
To date, the impact of EECP on mortality or major adverse cardiovascular events has not been investigated in angina or heart failure.
The long-term maintenance of QoL benefits of EECP is central to the estimate of cost-effectiveness. If QoL benefits of EECP are assumed to be maintained for no more than 1 year after treatment, EECP does not appear to be cost-effective in patients with angina severity similar to those in the MUST-EECP trial. Assuming that QoL benefits are maintained over the remaining lifetime of the patient, the cost-effectiveness of EECP appears clear, with a resulting ICER well below conventional thresholds of cost-effectiveness. Based on current evidence, EECP appears cost-effective for this patient population, but there is significant value to future research informing the long-term maintenance of QoL benefits from EECP.
Recommendations for research
The limited evidence suggesting that EECP may be an effective treatment for chronic or refractory stable angina and mild to moderate heart failure would indicate that further RCTs are warranted. The available data from case series14 and the RCTs indicate that troublesome adverse effects may limit the benefits achievable with EECP. The investigation of adverse effects should be an important outcome in any future RCT. The value of information analysis undertaken in this report suggests that further research in this area is likely to be of significant value. Long-term follow-up trials assessing QoL from EECP in both chronic stable angina and heart failure are required. There is also an important need to establish the efficacy of EECP in patients with truly refractory severe angina, which is much more severe than that found in MUST-EECP patients.
Additional research is also required to address the following uncertainties detailed in our report:
-
generalisability of findings to UK practice
-
impact of EECP on mortality
-
impact of EECP on major adverse cardiovascular events
-
difference between QoL associated with EECP and other comparative treatments
-
duration of beneficial effects
-
efficacy in different subgroup populations; in particular, symptomatic relief in patients with truly refractory severe angina
-
effectiveness of different EECP treatment regimens.
Acknowledgements
We would like to thank those authors who responded to our requests for further information. In particular, we would like to thank the clinical experts who participated in the elicitation exercise. Claire McKenna would also like to thank Laura Bojke and Stefano Conti for their advice on specific aspects of the economic modelling.
Contribution of authors
Michael Chester and John Cleland provided technical and clinical advice and commented on drafts of the report. Karl Claxton, Neil Hawkins and Claire McKenna were involved in the cost-effectiveness section, study selection, development of the economic model and report writing, as was Mark Sculpher, who also took overall responsibility for the economic component. Kate Light devised the search strategy, carried out the literature searches and wrote the search methodology sections of the report. Catriona McDaid and Sara Suekarran were involved in the clinical effectiveness section, including writing the protocol, study selection, data extraction, quality assessment, data analysis and report writing. Nerys Woolacott provided input at all stages of the review, commented on drafts of the report and took overall responsibility for the review.
Disclaimer
The views expressed in this publication are those of the authors and not necessarily those of the HTA programme or the Department of Health.
References
- Blue Cross Blue Shield Association . External counterpulsation for treatment of chronic stable angina pectoris and chronic heart failure. TEC Assessment Program 2005;20:1-29.
- O’Toole L. Angina (chronic stable). Clin Evid 2007.
- Abrams J. Chronic stable angina. N Engl J Med 2005;352:2424-533.
- Allender S, Peto V, Scarborough P, Boxer A, Rayner M. Coronary heart disease statistics. London: British Heart Foundation; 2007.
- Stewart S, Murphy NF, Walker A, McGuire A, McMurray JJ. The current cost of angina pectoris to the National Health Service in the UK. Heart 2003;89:848-53.
- Scottish Intercollegiate Guidelines Network . Management of Stable Angina: A National Clinical Guideline. 2007.
- Henderson RA, Pocock SJ, Clayton T, Knight R, Fox KA, Julian DG, et al. Seven-year outcome in the RITA-2 trial: coronary angioplasty versus medical therapy. J Am Coll Cardiol 2003;42:1161-70.
- Mannheimer C, Camici P, Chester MR, Collins A, DeJongste M, Eliasson T, et al. The problem of chronic refractory angina: report from the ESC Joint Study Group on the treatment of refractory angina. Eur Heart J 2002;23:355-70.
- Scottish Intercollegiate Guidelines Network . Management of Chronic Heart Failure: A National Clinical Guideline 2007.
- McKelvie R. Heart failure. Clin Evid 2007.
- Cowie MR, Wood DA, Coats AJS, Thompson SG, Poole-Wilson PA, Suresh V, et al. Incidence and aetiology of heart failure. Eur Heart J 1999;20:421-8.
- Hobbs FDR, Kenkre JE, Roalfe AK, Davis RC, Hare R, Davies MK. Impact of heart failure and left ventricular systolic dysfunction on quality of life: a cross-sectional study comparing common chronic cardiac and medical disorders and a representative adult population. Eur Heart J 2002;23:1867-76.
- Sinvhal RM, Gowda RM, Khan IA. Enhanced external counterpulsation for refractory angina pectoris. Heart 2003;89:830-3.
- Ontario Ministry of Health and Long-Term Care . Enhanced External Counterpulsation (EECP): Health Technology Policy Assessment Update March 2006 2006.
- Centre for Reviews and Dissemination . Undertaking Systematic Reviews of Research on Effectiveness: CRD’s Guidance for Those Carrying Out or Commissioning Reviews [CRD Report 4] 2001.
- Deeks J, Dinnes J, D’Amico R, Sowden A, Sakarovitch C, Song F. Evaluating non-randomised intervention studies. Health Technol Assess 2003;7.
- Arora R, Chou T, Jain D, Fleishman B, Crawford L, McKiernan T, et al. The multicenter study of enhanced external counterpulsation (MUST-EECP): effect of EECP on exercise-induced myocardial ischemia and anginal episodes. J Am Coll Cardiol 1999;33:1833-40.
- Barsheshet A, Hod H, Shechter M, Sharabani-Yosef O, Rosenthal E, Barbash IM, et al. The effects of external counter pulsation therapy on circulating endothelial progenitor cells in patients with angina pectoris. Cardiology 2008;110:160-6.
- Holubkov R, Kennard E, Foris J, Kelsey S, Soran O, Williams D, et al. Comparison of patients undergoing enhanced external counterpulsation and percutaneous coronary intervention for stable angina pectoris. Am J Cardiol 2002;89:1182-6.
- Shechter M, Matetzky S, Feinberg M, Chouraqui P, Rotstein Z, Hod H. External counterpulsation therapy improves endothelial function in patients with refractory angina pectoris. J Am Coll Cardiol 2003;42:2090-5.
- Feldman AM, Silver MA, Francis GS, Abbottsmith CW, Fleishman BL, Soran O, et al. Enhanced external counterpulsation improves exercise tolerance in patients with chronic heart failure. J Am Coll Cardiol 2006;48:1198-205.
- Arora R, Chou T, Jain D, Fleishman B, Crawford L, McKiernan T, et al. Effects of enhanced external counterpulsation on health-related quality of life continue 12 months after treatment: a substudy of the Multicenter Study of Enhanced External Counterpulsation. J Investig Med 2002;50:25-32.
- Drummond M, Jefferson T. Guidelines for authors and peer reviewers of economic submissions to the BMJ. BMJ 1996;313:275-83.
- Aequitas Consulting Group . Enhanced External Counterpulsation for the Treatment of Patients With Chronic Sable Angina Pectoris: A Cost-Utility Analysis [industry Submission] 2004.
- Michaels A, Linnemeier G, Soran O, Kelsey S, Kennard E. Two-year outcomes after enhanced external counterpulsation for stable angina pectoris (from the International EECP Patient Registry). Am J Cardiol 2004;93:461-4.
- Kandzari DE, Lam LC, Eisenstein EL, Clapp-Channing N, Fine JT, Califf RM, et al. Advanced coronary artery disease: appropriate endpoints for trials of novel therapies. Am Heart J 2001;142:843-51.
- RITA-2 trial participants . Coronary angioplasty versus medical therapy for angina: the second Randomised Intervention Treatment of Angina (RITA-2) trial. Lancet 1997;350:461-8.
- National Institute for Clinical Excellence . Guidance to the Methods of Technology Appraisal 2004.
- Doubilet P, Begg C, Weinstein M. Probabilistic sensitivity analysis using Monte Carlo simulation: a practical approach. Med Decis Making 1985;5:155-77.
- Briggs AH, Goeree R, Blackhouse G, O’Brien BJ. Probabilistic analysis of cost-effectiveness models: choosing between treatment strategies for gastroesophageal reflux disease. Med Decis Making 2002;22:290-308.
- The R. Foundation for Statistical Computing. The R Project for Statistical Computing 2008. www.r-project.org/.
- Claxton K, Ginnelly L, Sculpher MJ, Philips Z, Palmer S. A pilot study on the use of decision theory and value of information analysis as part of the NHS Health Technology Assessment programme. Health Technol Assess 2004;8.
- Claxton K, Posnett J. An economic approach to clinical trial design and research priority-setting. Health Econ 1996;5:513-24.
- Ware JE, Kosinski M, Keller SD. The SF-36 physical and mental summary scales: a user’s manual. Boston, MA: The Health Institute; 1994.
- Ara R, Brazier J. Deriving an algorithm to convert the 8 mean SF-36 dimension scores into a mean EQ-5D preference-based score from published studies (where patient level data are not available). Value Health 2008;11:1131-43.
- Kind P, Hardman G, Macran S. UK Population Norms for EQ-5D. York; 1999.
- Soran O, Kennard E, Kfoury A, Kelsey S. Two-year clinical outcomes after enhanced external counterpulsation (EECP) therapy in patients with refractory angina pectoris and left ventricular dysfunction (from The International EECP Patient Registry). Am J Cardiol 2006;97:17-20.
- Loh PH, Cleland JGF, Louis AA, Kennard ED, Cook JF, Caplin JL, et al. Enhanced external counterpulsation in the treatment of chronic refractory angina: a long-term follow-up outcome from the international enhanced external counterpulsation patient registry. Clin Cardiol 2008;31:159-64.
- O’Hagan A, Buck CE, Daneshkhah A, Eiser JR, Garthwaite PH, Jenkinson DJ, et al. Uncertain judgements. Eliciting experts’ probabilities. Chichester: Wiley; 2006.
- van Noortwijk JM, Dekker A, Cooke RM, Mazzuchi TA. Expert judgment in maintenance optimization. IEEE Transactions on Reliability 1992;41:427-32.
- Cooke RM. Experts in uncertainty: opinion and subjective probability in science. New York: Oxford University Press; 1991.
- Briggs A, Mihaylova B, Sculpher M, Hall A, Wolstenholme J, Simoons M, et al. Cost effectiveness of perindopril in reducing cardiovascular events in patients with stable coronary artery disease using data from the EUROPA study. Heart 2007;93:1081-6.
- Anderson KM, Odell PM, Wilson PW. Cardiovascular disease risk profiles. Am Heart J 1991;121:293-8.
- Government Actuary’s Department . Interim Life Tables 2007. www.gad.gov.uk/Demography%5FData/Life_Tables/Interim_life_tables.asp.
- Michaels A, Barsness G, Soran O, Kelsey S, Kennard E, Hui J, et al. Frequency and efficacy of repeat enhanced external counterpulsation for stable angina pectoris (from the International EECP Patient Registry). Am J Cardiol 2005;95:394-7.
- Briggs A, Sculpher M, Claxton K. Decision modelling for health economic evaluation. Oxford: Oxford University Press; 2006.
- Johannesson M, Weinstein S. On the decision rules of cost-effectiveness analysis. J Health Econ 1993;12:459-67.
- Fenwick E, Claxton K, Sculpher M. Representing uncertainty: the role of cost-effectiveness acceptability curves. Health Econ 2001;10:779-89.
- Devlin N, Parkin D. Does NICE have a cost effectiveness threshold and what other factors influence its decisions? A binary choice analysis. Health Econ 2004;13:437-52.
- Claxton KP, Sculpher MJ. Using value of information analysis to prioritise health research – some lessons from recent UK experience. Pharmacoeconomics 2006;24:1055-68.
- Claxton K. The irrelevance of inference: a decision-making approach to the stochastic evaluation of health care technologies. J Health Econ 1999;18:341-64.
- Allender S, Peto V, Scarborough P, Boxer A, Rayner M. Coronary heart disease statistics. British Heart Foundation Statistics Database; 2007.
- Ades AE, Lu G, Claxton K. Expected value of sample information calculations in medical decision modelling. Med Decis Making 2004;24:207-26.
- Conti S, Claxton K. Dimensions of design space: a decision-theoretic approach to optimal research design. York: Centre for Health Economics, University of York; 2008.
- Boden WE, O’Rourke R, Teo KK, Hartigan PM, Maron DJ, Kostuk W, et al. The evolving pattern of symptomatic coronary artery disease in the United States and Canada: baseline characteristics of the Clinical Outcomes Utilizing Revascularization and Aggressive DruG Evaluation (COURAGE) trial. Am J Cardiol 2007;99:208-12.
- Lapenna E, Rapati D, Cardano P, De Bonis M, Lullo F, Zangrillo A, et al. Spinal cord stimulation for patients with refractory angina and previous coronary surgery. Ann Thorac Surg 2006;82:1704-8.
- Yang EH, Barsness GW, Gersh BJ, Chandrasekaran K, Lerman A. Current and future treatment strategies for refractory angina. Mayo Clin Proc 2004;79:1284-92.
- Kind P, Spilker B. Quality of life and pharmacoeconomics in clinical trials. Philadelphia: Lippincott-Raven; 1996.
- Akhtar M, Wu G-F, Du Z-M, Zheng Z-S, Michaels AD. Effect of external counterpulsation on plasma nitric oxide and endothelin-1 levels. Am J Cardiol 2006;98:28-30.
- Arora RR, Carlucci ML, Malone AM, Baron NV. Acute and chronic hemodynamic effects of enhanced external counterpulsation in patients with angina pectoris. J Investig Med 2001;49:500-4.
- Arora RR, Lopez S, Saric M. Enhanced external counterpulsation improves systolic function by echocardiography in patients with coronary artery disease. Heart Lung 2005;34:122-5.
- Bagger P. Enhanced external counterpulsation treatment of patients with chronic heart failure. National Research Register 2007.
- Bagger J, Hall RC, Koutroulis G, Nihoyannopoulos P. Effect of enhanced external counterpulsation on dobutamine-induced left ventricular wall motion abnormalities in severe chronic angina pectoris. Am J Cardiol 2004;93:465-7.
- Barsness G, Feldman A, Holmes D, Holubkov R, Kelsey S, Kennard E, et al. The International EECP Patient Registry (IEPR): design, methods, baseline characteristics, and acute results. Clin Cardiol 2001;24:435-42.
- Bonetti P, Barsness G, Keelan P, Schnell T, Pumper G, Kuvin J, et al. Enhanced external counterpulsation improves endothelial function in patients with symptomatic coronary artery disease. J Am Coll Cardiol 2003;41:1761-8.
- Cleland JGF. Enhanced external counter-pulsation for angina. National Research Register 2007.
- Cohn PF, Lawson WE. Role of enhanced external counterpulsation in angina treatment. J Myocard Ischemia 1994;6:25-7.
- Cohn PF, Lawson WE, Burger L, Hui JCK. Enhanced external counterpulsation: a new therapeutic option for patients who have failed coronary angioplasty and/or bypass surgery. Cardiovasc Rev Rep 1997;18:10-21.
- Dockery F, Rajkumar C, Bulpitt CJ, Hall RJ, Bagger JP. Enhanced external counterpulsation does not alter arterial stiffness in patients with angina. Clin Cardiol 2004;27:689-92.
- El-Sakka AI, Morsy AM, Fagih BI. Enhanced external counterpulsation in patients with coronary artery disease-associated erectile dysfunction. Part II: impact of disease duration and treatment courses. J Sex Med 2007;4:1448-53.
- El-Sakka A, Morsy A, Fagih B. Enhanced external counterpulsation in patients with coronary artery disease-associated erectile dysfunction. Part I: effects of risk factors. J Sex Med 2007;4:771-9.
- Fitzgerald C, Lawson W, Hui J, Kennard E. Enhanced external counterpulsation as initial revascularization treatment for angina refractory to medical therapy. Cardiology 2003;100:129-35.
- Fricchione GL, Jaghab K, Lawson W, Hui JCK, Jandorf L, Zheng ZS, et al. Psychosocial effects of enhanced external counterpulsation in the angina patient. Psychosomatics 1995;36:494-7.
- Gloth S, Oken HA. Enhanced external counter pulsation: the Howard County experience in the first 18 patients. Md Med J 1999;48:155-6.
- Guo XB, Guo HS, Wang XP, Chen SW, Wei JR, Huang LP. Enhanced external counterpulsation and exercise tolerance and plasm endothelial function in patients with coronary heart disease. Chin J Clin Rehabil 2005;9:38-9.
- Hall RJC. Enhanced external counterpulsation treatment of patients with refractory angina pectoris. National Research Register 2007.
- Henrikson CA, Chandra-Strobos N. Enhanced external counterpulsation therapy: significant clinical improvement without electrophysiologic remodeling. Ann Noninvasive Electrocardiol 2004;9:265-9.
- Kaluski E, Gabara Z, Uriel N, Milo O, Leitman M, Weisfogel J, et al. The benefits and safety of external counterpulsation in symptomatic heart failure. IMAJ 2006;8:687-90.
- Kasliwal RR, Mittal S, Kanojia A, Bhatia ML, Kronzon I, Trehan N. Sequential external counterpulsation: an adjunctive therapy for patients with chronic coronary artery disease and left ventricular dysfunction. Indian Heart J 1996;48:150-4.
- Lakshmi MV, Kennard ED, Kelsey SF, Holubkov R, Michaels AD. Relation of the pattern of diastolic augmentation during a course of enhanced external counterpulsation (EECP) to clinical benefit (from the International EECP Patient Registry). Am J Cardiol 2002;89:1303-5.
- Lawson WE, Hui JCK, Kennard ED, Soran O, McCullough PA, Kelsey SF. Effect of enhanced external counterpulsation on medically refractory angina patients with erectile dysfunction. Int J Clin Pract 2007;61:757-62.
- Lawson W, Hui J, Barsness G, Kennard E, Kelsey S. Effectiveness of enhanced external counterpulsation in patients with left main disease and angina. Clin Cardiol 2004;27:459-63.
- Lawson W, Hui J, Lang G. Treatment benefit in the Enhanced External Counterpulsation Consortium. Cardiology 2000;94:31-5.
- Lawson WE, Hui JC, Guo T, Burger L, Cohn PF. Prior revascularization increases the effectiveness of enhanced external counterpulsation. Clin Cardiol 1998;21:841-4.
- Lawson W, Silver M, Hui J, Kennard E, Kelsey S. Angina patients with diastolic versus systolic heart failure demonstrate comparable immediate and one-year benefit from enhanced external counterpulsation. J Card Fail 2005;11:61-6.
- Lawson WE, Hui JCK, Kennard ED, Kelsey SF, Michaels AD, Soran O. Two-year outcomes in patients with mild refractory angina treated with enhanced external counterpulsation. Clin Cardiol 2006;29:69-73.
- Lawson WE, Barsness G, Michaels AD, Soran O, Kennard ED, Kelsey SF, et al. Effectiveness of repeat enhanced external counterpulsation for refractory angina in patients failing to complete an initial course of therapy. Cardiology 2007;108:170-5.
- Lawson W, Hui J, Cohn P. Long-term prognosis of patients with angina treated with enhanced external counterpulsation: five-year follow-up study. Clin Cardiol 2000;23:254-8.
- Lawson WE, Hui JCK, Soroff HS, Zheng ZS, Kayden DS, Sasvary D, et al. Efficacy of enhanced external counterpulsation in the treatment of angina pectoris. Am J Cardiol 1992;70:859-62.
- Lawson WE, Hui JCK, Zheng ZS, Burgen L, Jiang L, Lillis O, et al. Improved exercise tolerance following enhanced external counterpulsation: cardiac or peripheral effect?. Cardiology 1996;87:271-5.
- Lawson WE, Hui JCK, Zheng ZS, Burger L, Jiang L, Lillis O, et al. Can angiographic findings predict which coronary patients will benefit from enhanced external counterpulsation?. Am J Cardiol 1996;77:1107-9.
- Lawson WE, Hui JCK, Zheng ZS, Oster Z, Katz JP, Diggs P, et al. Three-year sustained benefit from enhanced external counterpulsation in chronic angina pectoris. Am J Cardiol 1995;75:840-1.
- Lawson WE, Kennard ED, Holubkov R, Kelsey SF, Strobeck JE, Soran O, et al. Benefit and safety of enhanced external counterpulsation in treating coronary artery disease patients with a history of congestive heart failure. Cardiology 2001;96:78-84.
- Lawson W, Kennard E, Hui J, Holubkov R, Kelsey S. Analysis of baseline factors associated with reduction in chest pain in patients with angina pectoris treated by enhanced external counterpulsation. Am J Cardiol 2003;92:493-3.
- Lawson W, Hui J, Kennard E, Barsness G, Kelsey S. Predictors of benefit in angina patients one year after completing enhanced external counterpulsation: initial responders to treatment versus nonresponders. Cardiology 2005;103:201-6.
- Lee C-M, Wu Y-W, Jui H-Y, Chen M-F, Lee Y-T, Soran O. Enhanced external counterpulsation reduces lung/heart ratio at stress in patients with coronary artery disease. Cardiology 2006;106:237-40.
- Levenson J, Simon A, Megnien JL, Chironi G, Gariepy J, Pernollet MG, et al. Effects of enhanced external counterpulsation on carotid circulation in patients with coronary artery disease. Cardiology 2007;108:104-10.
- Linnemeier G, Rutter M, Barsness G, Kennard E, Nesto R. Enhanced external counterpulsation for the relief of angina in patients with diabetes: safety, efficacy and 1-year clinical outcomes. Am Heart J 2003;146:453-8.
- Linnemeier G, Michaels AD, Soran O, Kennard ED. Enhanced external counterpulsation in the management of angina in the elderly. Am J Geriatr Cardiol 2003;12:90-6.
- Loh PH. Enhanced external counterpulsation (EECP) in patients with ischaemic heart disease and chronic left ventricular systolic dysfunction evaluation. National Research Register 2007.
- Loh PH, Louis AA, Windram J, Rigby AS, Cook J, Hurren S, et al. The immediate and long-term outcome of enhanced external counterpulsation in treatment of chronic stable refractory angina. J Intern Med 2006;259:276-84.
- Masuda D, Fujita M, Nohara R, Matsumori A, Sasayama S. Improvement of oxygen metabolism in ischemic myocardium as a result of enhanced external counterpulsation with heparin pretreatment for patients with stable angina. Heart Vessels 2004;19:59-62.
- Masuda D, Nohara R, Hirai T, Kataoka K, Chen LG, Hosokawa R, et al. Enhanced external counterpulsation improved myocardial perfusion and coronary flow reserve in patients with chronic stable angina: evaluation by (13)N-ammonia positron emission tomography. Eur Heart J 2001;22:1451-8.
- McCullough PA, Henry TD, Kennard ED, Kelsey SF, Michaels AD. Residual high-grade angina after enhanced external counterpulsation therapy. Cardiovasc Revasc Med 2007;8:161-5.
- McCullough PA, Silver MA, Kennard ED, Kelsey SF, Michaels AD. Impact of body mass index on outcomes of enhanced external counterpulsation therapy. Am Heart J 2006;151:139-39.e13.
- Michaels AD, Accad M, Ports TA, Grossman W. Left ventricular systolic unloading and augmentation of intracoronary pressure and Doppler flow during enhanced external counterpulsation. Circulation 2002;106:1237-42.
- Michaels AD, Kennard ED, Kelsey SE, Holubkov R, Soran O, Spence S, et al. Does higher diastolic augmentation predict clinical benefit from enhanced external counterpulsation? Data from the International EECP Patient Registry (IEPR). Clin Cardiol 2001;24:453-8.
- Michaels AD, McCullough PA, Soran OZ, Lawson WE, Barsness GW, Henry TD, et al. Primer: practical approach to the selection of patients for and application of EECP. Nat Clin Pract Cardiovasc Med 2006;3:623-32.
- Michaels AD, Raisinghani A, Soran O, de Lame P-A, Lemaire ML, Kligfield P, et al. The effects of enhanced external counterpulsation on myocardial perfusion in patients with stable angina: a multicenter radionuclide study. Am Heart J 2005;150:1066-73.
- Michaels AD, Raisinghani A, Soran O, de Lame P-A, Lemaire ML, Watson DD, et al. The effects of enhanced counterpulsation on myocardial perfusion in patients with stable angina: a single blind multicentre pilot study. J Am Coll Cardiol 2004;3:891-4.
- Moore R. A randomised control trial in the treatment of refractory angina with enhanced computerisation (EECP). National Research Register 2007.
- Nichols WW, Estrada JC, Braith RW, Owens K, Conti CR. Enhanced external counterpulsation treatment improves arterial wall properties and wave reflection characteristics in patients with refractory angina. J Am Coll Cardiol 2006;48:1208-14.
- Novo G, Bagger JP, Carta R, Koutroulis G, Hall R, Nihoyannopoulos P. Enhanced external counterpulsation for treatment of refractory angina pectoris. J Cardiovasc Med 2006;7:335-9.
- Ochoa AB, deJong A, Grayson D, Franklin B, McCullough P. Effect of enhanced external counterpulsation on resting oxygen uptake in patients having previous coronary revascularization and in healthy. Am J Cardiol 2006;98:613-15.
- Olsson H. Quality of competence in the role of nursing – as result of education, professional practice and research. Vard Nord Utveckl Forsk 1999;19:5-10.
- Pettersson T, Bondesson S, Cojocaru D, Ohlsson O, Wackenfors A, Edvinsson L. One year follow-up of patients with refractory angina pectoris treated with enhanced external counterpulsation. BMC Cardiovasc Disord 2006;6.
- Rana JS, Mannam A, Donnell-Fink L, Gervino EV, Sellke FW, Laham RJ. Longevity of the placebo effect in the therapeutic angiogenesis and laser myocardial revascularization trials in patients with coronary heart disease. Am J Cardiol 2005;95:1456-9.
- Sajja V, Dod H, Beto R, Jain AC, Hobbs GR, Finkel MS. An analysis of the efficacy and safety of enhanced external counterpulsation at West Virginia University Hospitals. W V Med J 2007;103:10-2.
- Soran O, Fleishman B, Demarco T, Grossman W, Schneider VM, Manzo K, et al. Enhanced external counterpulsation in patients with heart failure: a multicenter feasibility study. Congest Heart Fail 2002;8:204-8.
- Soran O, Kennard ED, Bart BA, Kelsey SF. Impact of external counterpulsation treatment on emergency department visits and hospitalizations in refractory angina patients with left ventricular dysfunction. Congest Heart Fail 2007;13:36-40.
- Soran O, Kennard E, Kelsey S, Holubkov R, Strobeck J, Feldman A. Enhanced external counterpulsation as treatment for chronic angina in patients with left ventricular dysfunction: a report from the International EECP Patient Registry (IEPR). Congest Heart Fail 2002;8:297-302.
- Springer S, Fife A, Lawson W, Hui JCK, Jandorf L, Cohn PF, et al. Psychosocial effects of enhanced external counterpulsation in the angina patient: a second study. Psychosomatics 2001;42:124-32.
- Stys TP, Lawson WE, Hui JCK, Fleishman B, Manzo K, Strobeck JE, et al. Effects of enhanced external counterpulsation on stress radionuclide coronary perfusion and exercise capacity in chronic stable angina pectoris. Am J Cardiol 2002;89:822-4.
- Stys T, Lawson WE, Hui JCK, Lang G, Liuzzo J, Cohn PF. Acute hemodynamic effects and angina improvement with enhanced external counterpulsation. Angiology 2001;52:653-8.
- Sun J. Hemodynamic study of external counterpulsation with left and right cardiac catheters in 15 cases. Chung Hua Hsin Hsueh Kuan Ping Tsa Chih 1991;19:375-8.
- Tartaglia J, Stenerson J, Charney R, Ramasamy S, Fleishman B, Gerardi P, et al. Exercise capability and myocardial perfusion in chronic angina patients treated with enhanced external counterpulsation. Clin Cardiol 2003;26:287-90.
- Urano H, Ikeda H, Ueno T, Matsumoto T, Murohara T, Imaizumi T. Enhanced external counterpulsation improves exercise tolerance, reduces exercise-induced myocardial ischemia and improves left ventricular diastolic filling in patients with coronary artery disease. J Am Coll Cardiol 2001;37:93-9.
- Vijayaraghavan K, Santora L, Kahn J, Abbott N, Torelli J, Vardi G. New graduated pressure regimen for external counterpulsation reduces mortality and improves outcomes in congestive heart failure: a report from the Cardiomedics External Counterpulsation Patient Registry. Congest Heart Fail 2005;11:147-52.
- Walker S. Is a high diastolic augmentation ratio achieved during EECT therapy, a good indicator for patient benefit. National Research Register 2007.
- Weisfogel G, Schaffer M, Gann D, Dadourian B, Marshall T, Allymadian V. External counterpulsation produces a significant reduction in stable angina class, episodes, medication use, and hospitalization. Cardiovasc Rev Rep 2001;22:154-8.
- Werner D, Kropp J, Schellong S, Friedel C, Voigt J-U, Ludwig J, et al. Practicability and limitations of enhanced external counterpulsation as an additional treatment for angina. Clin Cardiol 2003;26:525-9.
- Yavari M, Montazeri HR. Effects of enhanced external counterpulsation on anginal symptoms and improvements in objective measures of myocardial ischaemia. Cardiovasc J Afr 2007;18:154-6.
- Yi Y, Yang Y, Jian C. Cerebral hemodynamic impairment and therapeutic effect of external counterpulsation on elderly patients with brain infarction. Bull Hunan Med Univ 1999;24:435-7.
- Youcheng S. External counterpulsation in treating angina pectoris evaluated by TI-201 myocardial perfusion imaging. Chung Hua Hsin Hsueh Kuan Ping Tsa Chih 1991;19:235-7.
- Zheng ZS. Clinical observations on 142 cases of angina pectoris treated by four-limb sequenced external counterpulsation. Chung Hua I Hsueh Tsa Chih 1981;61:415-17.
- Zheng Z-S, Li T-M, Kambic H, Chen G-H, Yu L-Q, Cai S-R, et al. Sequential external counterpulsation (SECP) in China. Trans Am Soc Artif Intern Organs 1983;29:599-603.
- Abbottsmith CW, Chung ES, Varricchione T, de Lame P-A, Silver MA, Francis GS, et al. Enhanced external counterpulsation improves exercise duration and peak oxygen consumption in older patients with heart failure: a subgroup analysis of the PEECH trial. Congest Heart Fail 2006;12:307-11.
- Feldman A, Silver M, Francis G, De Lame P, Parmley W. Treating heart failure with enhanced external counterpulsation (EECP): design of the Prospective Evaluation of EECP in Heart Failure (PEECH) trial. J Card Fail 2005;11:240-5.
Appendix 1 Searches
Main searches
MEDLINE (Ovid Online – www.ovid.com/)
1950–October 2007 (week 4)
Searched on 1 November 2007
Retrieved 206 hits
MEDLINE In-process (Ovid Online – www.ovid.com/)
October 31 2007
Searched on 1 November 2007
Retrieved 13 hits
EMBASE (Ovid Online – www.ovid.com/)
1980–2007 (week 43)
Searched on 1 November 2007
Retrieved 190 hits
CINAHL – Cumulative Index to Nursing & Allied Health Literature (Ovid Online – www.ovid.com/)
1982–October 2007 (week 4)
Searched on 1 November 2007
Retrieved 36 hits
Search strategy
-
external counterpulsation.ti,ab.
-
external counter pulsation.ti,ab.
-
eecp.ti,ab.
-
peech.ti,ab.
-
must eecp.ti,ab.
-
or/1–5
-
6
-
limit 7 to yr=“1980 – 2007”
Cochrane Database of Systematic Reviews (The Cochrane Library – www.thecochranelibrary.com/)
Issue 4 2007
Searched on 1 November 2007
Retrieved 1 hit
CENTRAL (The Cochrane Library – www.thecochranelibrary.com/)
Issue 4 2007
Searched on 1 November 2007
Retrieved 15 hits
Search strategy
#1 “external counterpulsation”
#2 “external counter pulsation”
#3 (eecp)
#4 “must eecp”
#5 (peech)
#6 (#1 OR #2 OR #3 OR #4 OR #5)
#7 (#6), from 1980 to 2007
DARE – Database of Abstracts of Reviews of Effects, HTA [Health Technology Assessment Database and NHS EED (NHS Economic Evaluation Database) (CRD administration database)]
Searched on 5 November 2007
Retrieved 1 hit from DARE, 8 hits from HTA and 0 hits from NHS EED
Search strategy
-
s external(w)counterpulsation
-
s external(w)counter(w)pulsation
-
s eecp
-
s peech
-
s must(w)eecp
-
s s1 or s2 or s3 or s4 or s5
-
s @1980:2007
-
s s6 and s7
Inside Conferences (Dialog File 65 on DialogClassic Web – www.dialogclassic.com/)
Searched on 6 November 2007
Retrieved 0 hits
Search strategy
-
External (w) counterpulsation/ti,ab,de
-
External (w) counter (w) pulsation/ti,ab,de
-
Eecp/ti,ab,de
-
Must (w) eecp/ti,ab,de
-
peech/ti,ab,de
-
s1:s5
-
py=2005:2007
-
s6 AND s7
NRR – National Research Register (www.nrr.nhs.uk/)
2007; Issue 4
Searched on 9 November 2007
Retrieved 8 hits
Search strategy
-
external counterpulsation
-
external counter pulsation
-
eecp
-
peech
-
must eecp
-
or/1–5
Clinical Trials.gov (http://clinicaltrials.gov/)
Searched on 09 November 2007
Retrieved 2 hits
Search strategy
The search interface to this resource is a very simple one and the search had to be modified accordingly.
“external counterpulsation” OR “external counter pulsation” OR eecp OR peech
Current Controlled Trials Meta Register (http://controlled-trials.com/mrct/)
Searched on 9 November 2007
Retrieved 6 hits
Search strategy
The search interface to this resource is a very simple one and the search had to be modified accordingly.
“external counterpulsation” OR “external counter pulsation” OR eecp OR peech
Vasomedical website (www.vasomedical.com/)
This site has a browsable section entitled “latest Health Information”, which yielded one result.
US Food and Drug Administration (FDA) website (http://www.fda.gov/)
Searched on 13 December 2007
Retrieved 97 hits
Search strategy
The search interface to the FDA website is very simple and the search strategy had to be adapted accordingly.
Two searches were carried out. All of the FDA website was searched.
Search 1
(“all of the words”) EECP
Search 2
(“with the exact phrase”) External counterpulsation
(“without the words”) EECP
Update searches
The strategies for the main searches were re-run and the results reduplicated against the original results.
-
MEDLINE (Ovid Online – www.ovid.com/) – March week 2 2008 – 4 new records
-
MEDLINE In-process (Ovid Online – www.ovid.com/) – March 25th 2008 – 1 new record
-
EMBASE (Ovid Online – www.ovid.com/) – Week 12 2008 – 3 new records
-
CINAHL – Cumulative Index to Nursing & Allied Health Literature (Ovid Online – www.ovid.com/) – March week 3 2008 – 3 new records
-
Cochrane Database of Systematic Reviews (The Cochrane Library – www.thecochranelibrary.com/) – 2008 Issue 1- no new records
-
CENTRAL (The Cochrane Library – www.thecochranelibrary.com/) – 2008 Issue 1 – no new records
-
DARE (Database of Abstracts of Reviews of Effects) (CRD administration database) – 28 March 2008 – no new records
-
HTA (Health Technology Assessment) Database (CRD administration database) – 28 March 2008 – no new records
-
NHS EED (NHS Economic Evaluation Database) (CRD administration database) –28 March 2008 – no new records
Additional economics searching
MEDLINE (Ovid Online – www.ovid.com/)
1950–January 2008 (week 3)
Searched on 29 January 2008
Retrieved 162 hits
MEDLINE In-process (Ovid Online – www.ovid.com/)
January 28 2008
Searched on 29 January 2008
Retrieved 4 hits
-
(eq5d or eq 5d or euroqol or euro qol or euroqual or euro qual).ti,ab.
-
(hye or hyes or health$year$equivalent$or health utilit$).ti,ab.
-
rosser.ti,ab.
-
(standard gamble$or time trade off or time tradeoff or tto or willingness to pay).ti,ab.
-
(disutilities or disutility or daly or disability adjusted life).ti,ab.
-
quality-adjusted life years/
-
qwb$.ti,ab.
-
(quality of wellbeing or quality of well being).ti,ab.
-
preference based.ti,ab.
-
(state adj2 (value or values or valuing or valued)).ti,ab.
-
(multiattribute$health or multi attribute$health).ti,ab.
-
(health utilit$index or health utilit$indices).ti,ab.
-
(multiattribute$theor$or multi attribute$theor$or multiattribute$analys$or multi attribute$analys$).ti,ab.
-
classification of illness state$.ti,ab.
-
health state$utilit$.ti,ab.
-
(multiattribute$utilit$or multi attribute$utilit$).ti,ab.
-
(sf 6d or sf6d or short form 6d or shortform 6d or sf six$or shortform six$or short form six$).ti,ab.
-
or/1–17
-
exp Angina Pectoris/
-
angina.ti,ab.
-
exp Heart Failure/
-
heart failure.ti,ab.
-
cardiac failure.ti,ab.
-
myocardial failure.ti,ab.
-
or/19–24
-
18 and 25
EMBASE (Ovid Online – www.ovid.com/)
1980–2008 (week 4)
Searched on 29 January 2008
Retrieved 264 hits
-
(eq5d or eq 5d or euroqol or euro qol or euroqual or euro qual).ti,ab.
-
(hye or hyes or health$year$equivalent$or health utilit$).ti,ab.
-
rosser.ti,ab.
-
(standard gamble$or time trade off or time tradeoff or tto or willingness to pay).ti,ab.
-
(disutilities or disutility or daly or disability adjusted life).ti,ab.
-
quality-adjusted life year/
-
qwb$.ti,ab.
-
(quality of wellbeing or quality of well being).ti,ab.
-
preference based.ti,ab.
-
(state adj2 (value or values or valuing or valued)).ti,ab.
-
(multiattribute$health or multi attribute$health).ti,ab.
-
(health utilit$index or health utilit$indices).ti,ab.
-
(multiattribute$theor$or multi attribute$theor$or multiattribute$analys$or multi attribute$analys$).ti,ab.
-
classification of illness state$.ti,ab.
-
health state$utilit$.ti,ab.
-
(multiattribute$utilit$or multi attribute$utilit$).ti,ab.
-
(sf 6d or sf6d or short form 6d or shortform 6d or sf six$or shortform six$or short form six$).ti,ab.
-
or/1–17
-
exp Angina Pectoris/
-
angina.ti,ab.
-
exp Heart Failure/
-
heart failure.ti,ab.
-
cardiac failure.ti,ab.
-
myocardial failure.ti,ab.
-
or/19–24
-
18 and 25
CINAHL – Cumulative Index to Nursing & Allied Health Literature (Ovid Online – www.ovid.com/)
1982–December 2007 (week 1)
Searched on 29 January 2008
Retrieved 10 hits
-
(eq5d or eq 5d or euroqol or euro qol or euroqual or euro qual).ti,ab.
-
(hye or hyes or health$year$equivalent$or health utilit$).ti,ab.
-
rosser.ti,ab.
-
(standard gamble$or time trade off or time tradeoff or tto or willingness to pay).ti,ab.
-
(disutilities or disutility or daly).ti,ab.
-
disability adjusted life.ti,ab.
-
qwb$.ti,ab.
-
(quality of wellbeing or quality of well being).ti,ab.
-
preference based.ti,ab.
-
(state adj2 (value or values or valuing or valued)).ti,ab.
-
(multiattribute$health or multi attribute$health).ti,ab.
-
(health utilit$index or health utilit$indices).ti,ab.
-
(multiattribute$theor$or multi attribute$theor$or multiattribute$analys$or multi attribute$analys$).ti,ab.
-
classification of illness state$.ti,ab.
-
health state$utilit$.ti,ab.
-
(multiattribute$utilit$or multi attribute$utilit$).ti,ab.
-
(sf 6d or sf6d or short form 6d or shortform 6d or sf six$or shortform six$or short form six$).ti,ab.
-
or/1–17
-
exp Angina Pectoris/
-
angina.ti,ab.
-
Heart Failure, Congestive/
-
heart failure.ti,ab.
-
cardiac failure.ti,ab.
-
myocardial failure.ti,ab.
-
or/19–24
-
18 and 25
Appendix 2 Excluded studies
Study | Reason for exclusion | ||||||
---|---|---|---|---|---|---|---|
Inappropriate interventiona | Inappropriate participantsb | Study designc | Study in progress (authors contacted) | ||||
EECP clinical consortium | International EECP Patient Registry | Cardiomedics Registry | Other case series | ||||
Akhtar et al., 200659 | × | × | |||||
Arora et al., 200160 | × | ||||||
Arora et al., 200561 | × | ||||||
Bagger, 200762 | × | ||||||
Bagger et al., 200463 | × | ||||||
Barsness et al., 200164 | × | ||||||
Bonetti et al., 200365 | × | ||||||
Cleland, 200766 | × | ||||||
Cohn and Lawson, 199467 | × | ||||||
Cohn et al., 199768 | × | ||||||
Cowie et al., 199911 | × | ||||||
Dockery et al., 200469 | × | ||||||
El-Sakka et al., 200770 | × | ||||||
El-Sakka et al., 200771 | × | ||||||
Fitzgerald et al., 200372 | × | ||||||
Fricchione et al., 199573 | × | ||||||
Gloth and Oken, 199974 | × | ||||||
Guo et al., 200575 | × | ||||||
Hall, 200776 | × | ||||||
Henrikson and Chandra-Strobos, 200477 | × | ||||||
Kaluski et al., 200678 | × | ||||||
Kasliwal et al., 199679 | × | ||||||
Lakshmi et al., 200280 | × | ||||||
Lawson et al., 200781 | × | ||||||
Lawson et al., 200482 | × | ||||||
Lawson et al., 200083 | × | ||||||
Lawson et al., 199884 | × | ||||||
Lawson et al., 200585 | × | ||||||
Lawson et al., 200686 | × | ||||||
Lawson et al., 200787 | × | ||||||
Lawson et al., 200088 | × | ||||||
Lawson et al., 199289 | × | ||||||
Lawson et al., 199690 | × | ||||||
Lawson et al., 199691 | × | ||||||
Lawson et al., 199592 | × | ||||||
Lawson et al., 200193 | × | ||||||
Lawson et al., 200394 | × | ||||||
Lawson et al., 200595 | × | ||||||
Lee et al., 200696 | × | ||||||
Levenson et al., 200797 | × | ||||||
Linnemeier et al., 200398 | × | ||||||
Linnemeier et al., 200399 | × | ||||||
Loh, 2007100 | × | ||||||
Loh et al., 2006101 | × | ||||||
Masuda et al., 2004102 | × | ||||||
Masuda et al., 2001103 | × | ||||||
McCullough et al., 2007104 | × | ||||||
McCullough et al., 2006105 | × | ||||||
Michaels et al., 2002106 | × | ||||||
Michaels et al., 200545 | × | ||||||
Michaels et al., 2001107 | × | ||||||
Michaels et al., 200425 | × | ||||||
Michaels et al., 2006108 | × | ||||||
Michaels et al., 2005109 | × | ||||||
Michaels et al., 2004110 | × | ||||||
Moore, 2007111 | × | ||||||
Nichols et al., 2006112 | × | ||||||
Novo et al., 2006113 | × | ||||||
Ochoa et al., 2006114 | × | ||||||
Olsson, 1999115 | × | ||||||
Pettersson et al., 2006116 | × | ||||||
Rana et al., 2005117 | × | ||||||
Sajja et al., 2007118 | × | ||||||
Soran et al., 2002119 | × | ||||||
Soran et al., 2007120 | × | ||||||
Soran et al., 2002121 | × | ||||||
Soran et al., 200637 | × | ||||||
Springer et al., 2001122 | × | ||||||
Stys et al., 2002123 | × | ||||||
Stys et al., 2001124 | × | ||||||
Sun, 1991125 | × | ||||||
Tartaglia et al., 2003126 | × | ||||||
Urano et al., 2001127 | × | ||||||
Vijayaraghavan et al., 2005128 | × | ||||||
Walker, 2007129 | × | ||||||
Weisfogel et al., 2001130 | × | ||||||
Werner et al., 2003131 | × | ||||||
Yavari and Montazeri, 2007132 | × | ||||||
Yi et al., 1999133 | × | ||||||
Youcheng, 1991134 | × | ||||||
Zheng, 1981135 | × | ||||||
Zheng et al., 1983136 | × |
Appendix 3 Quality assessment
Assessment criteria | Study | ||||
---|---|---|---|---|---|
Arora et al., 199917 | Barsheshet et al., 200818 | Holubkov et al., 200219 | Shechter et al., 200320 | Feldman et al., 200621 | |
Was the method used to assign participants to treatment groups truly random? | Yes | No | No | No | Yes |
If non-randomised, describe how participants were allocated to treatment groups | NA | Patients were referred to the EECP programme. The control group consisted of age- and gender-matched patients who refused EECP | Comparison of two registries | The EECP group was recruited from an EECP program. Age- and gender- matched patients who refused EECP were the control group | NA |
Was the treatment allocation concealed? | Yes | No | No | No | Yes |
Were the treatment groups similar at baseline? |
No The EECP group had longer duration of angina and a higher proportion with previous MI |
Yes |
No The EECP group had higher prevalence of several risk factors |
Yes | Yes |
If the above answer was no, was this taken into consideration in the analysis or study design? | No | NA |
No The authors state it was not appropriate due to the small number of events and other limitations of the data |
NA | NA |
Did the analysis include an ITT analysis (i.e. were all participants included in the analysis, in the group to which they were allocated)? |
Yes (for some outcomes) A partial ITT analysis – two participants who withdrew prior to first treatment were not included in the analysis |
No | No | No | Yes |
Were appropriate methods used to account for missing data in the ITT analysis? | Unclear | NA | NA | NA |
Yes (Last observation carried forward) |
Was any of the outcome assessment blinded? |
Yes Investigators collecting and processing data were blinded; participants were blinded; appointments were scheduled to minimise the chance of participants in the two groups meeting |
No | No | No |
Yes Staff responsible for baseline and follow-up assessment were blinded |
Proportion of participants who did not complete the study. |
EECP: 13/72 (18%) Control: 2/67 (3%) |
0% (none reported) | Unclear | 0% (none reported) |
EECP 22/93 (23.7%) Control 13/94 (13.8%) |
Appendix 4 Data extraction tables for clinical effectiveness review
Methods | Participants | Withdrawals | Outcomes assessed |
---|---|---|---|
RCT Intervention EECP 35 1-hour sessions of EECP could be given once or twice a day. Protocol-specified applied was 300 mmHg Details of any other therapy All medications (except on-demand NTG) remained unchanged throughout the study Comparator 35 hours of inactive (sham) counterpulsation. Treatment sessions lasting 1 hour could be given once or twice a day. Cuff pressure was 75 mmHg in this group Details of any other therapy All medications (except on-demand NTG) remained unchanged throughout the study Inclusion criteria Between 21 and 81 years old CCS Classification I, II or III Documented evidence of coronary artery disease (criteria specified) Have an exercise treadmill test positive for ischaemia Exclusion criteria MI or CABG in the preceding 3 months Cardiac catherisation in the preceding 2 weeks Unstable angina Overt congestive heart failure or a left ventricular ejection fraction less than or equal to 30% Significant valvular heart disease Blood pressure > 180/100mmHg Permanent pacemaker or implantable defibrillator Non-bypassed left main stenosis > 50% Severe symptomatic peripheral vascular disease History of varicosities, deep vein thrombosis, phlebitis or stasis ulcer, bleeding diathesis Warfarin use with International Normalised Ratio > 2.0 Atrial fibrillation or frequent ventricular premature beats that would interfere with EECP triggering, or baseline electroencephalogram abnormalities that would interfere with interpretation of exercise ECG Pregnant women and women of childbearing potential |
Number allocated to each group EECP n = 72; control n = 67 Age [mean (SD)] EECP 64 (9); control 62 (9) Sex (% male) EECP n = 61 (85.9); control n = 58 (87.9) Race, n (%) White: EECP 55 (77.5); control 49 (74.2%) Black: EECP 3 (4.2); control 2 (3.0) Hispanic: EECP 5 (7.0); control 10 (15.2) Asian: EECP 5 (7.0); control 3 (4.5) Other: EECP 3 (4.2); control 2 (3.0) Condition being treated Stable angina Baseline clinical characteristics CCS classification, n (%) Class I: EECP 17 (25.8); control 19 (26.8) Class II: EECP 34 (51.5); control 35 (49.3) Class III: EECP 15 (22.7); control 17 (23.9) Exercise duration(s), mean (SE) EECP (n = 57) 426 (20); control (n = 58) 432 (22) Time to ≥ 1-mm ST segment depression, mean seconds (SE) EECP (n = 56) 337 (18); control (n = 56) 326 (21) Angina episodes – angina count (all participants), mean (SE) EECP 0.76 (0.15); control 0.76 (0.13) Medication use, n (%) Nitrates: EECP 56 (78.9); control 54 (81.8) Aspirin taken as an antithrombotic: EECP 32 (87.3); control 60 (90.9) Calcium channel blocker: EECP 44 (62.0); control 36 (54.5) Beta-blocker: EECP 50 (70.4); control 51 (77.3) Lipid-lowering agents: EECP 44 (62.0); control 33 (50.0) NTG usage, mean (SE?) EECP 0.47 (0.13); control 0.51 (0.15) QoL Not reported Other Angina years, mean (SD) EECP 8.56 (7.88); control 4.5 (4.06), p < 0.01 Previous MI EECP n = 40 (56.3%); control n = 27 (40.9%), p < 0.05 Previous CABG EECP n = 33 (46.5%); control n = 25 (37.9%) Previous percutaneous transluminal coronary angioplasty EECP n = 27 (38.0%); control n = 22 (33.3%), p > 0.05 All baseline characteristics based on 71 and 66 participants for EECP and inactive EECP respectively |
Number of withdrawals and losses to follow-up: EECP ( n = 13) Prior to first treatment n = 1 Owing to adverse event n = 9 Owing to other medical event n = 2 Owing to personal reasons n = 1 ETT data were available for 57 of 59 who completed the trial (four protocol violations, seven adverse event withdrawals and three for personal reasons). Some of these withdrawals may already be reported above, as data in the study flow chart and text did not tally Control (n = 2) Prior to first treatment n = 1 Due to adverse event n = 1 ETT duration data were available for 58 of 65 who completed the trial (seven protocol violations and one adverse event withdrawal, which may be the withdrawal already reported) Did study report differences between participants that dropped out and those that did not? Yes (specify) Yes, for HRQoL study participants who supplied QoL data were compared to those who had not. The cohort without QoL data were younger, more had experienced an MI and had higher CCS classification |
List of outcomes reported and how they were measured ETT Exercise duration (seconds) – time from the start of exercise to the beginning of the recovery period Time to ≥ 1-mm ST segment depression(s) – the time from initiation of exercise to the occurrence of horizontal or down-sloping ST segment depression ≥ 1 mm, 80 ms after the J point, persisting for at least three consecutive beats Angina counts (average frequency of self-reported angina episodes over three 24-hour periods) The total number of angina episodes reported at three successive treatment sessions divided by the number of days on which the sessions took place. The first three sessions were the baseline period. The difference in angina counts between baseline and end of treatment were calculated as percentage change for each patient, and were classified into categories NTG count Average usage of on-demand NTG tablets per day QoL Medical Outcomes Study (SF-36) and the cardiac version of the QLI Adverse events Daily questioning by research nurses about any adverse reaction experienced since the previous session |
Results | |||
Exercise duration, mean seconds (SE) EECP (n = 57): baseline 426 (20), post treatment 470 (20), p < 0.001; control (n = 58): baseline 432 (22), post treatment 464 (22), p < 0.03 Adjusted mean (SE) EECP 42 (11); control 26 (12), between group p-value (using adjusted means): p < 0.31 Exercise duration, time to ST segment depression(s), mean (SE) EECP (n = 56): baseline 337 (18), post treatment 379 (18), p < 0.002; control (n = 56): baseline 326 (21), post treatment 330 (20), p < 0.74 Adjusted mean (SE) EECP 37 (11); control –4 (12). Between group p-value (using adjusted means): p = 0.01 NYHA classification: not applicable CCS classification: not reported Angina episodes Angina counts – ITT analysis, mean (SE?) EECP (n = 71): baseline 0.76 (0.15), post treatment 0.55 (0.27); control (n = 66): baseline 0.76 (0.13), post treatment 0.77 (0.2) Adjusted mean (SE?): EECP –0.11 (0.21); control 0.1 3 (0.22). Between group p-value (using adjusted means), p < 0.09 Angina counts – patients who received at least 34 sessions EECP: baseline 0.72 (0.14), post treatment 0.57 (0.38); control: baseline 0.77 (0.14), post treatment 0.76 (0.22). Between group p-value (using adjusted means), p < 0.035 It was unclear for some of the analysis whether SE or SD was being reported. We have made an assumption that the variance used is SE % improvement (from baseline) – ITT analysis EECP (n = 71): > 50% n = 32, 25–49% n = 1, 0–25% n = 33; control: (n = 66): > 50% n = 21, 25–49% n = 3, 0–25% n = 28 % worsening (from baseline) EECP: 1–25% n = 0, 26–50% n = 0; 51–100% n = 2, 100% n = 3; control: 1–25% n = 2, 26–50% n = 2, 51–100% n = 4, 100% n = 6 p-value for between group differences < 0.05 % improvement (from baseline) – analysis of greater than or equal to 34 sessions EECP (n = 57): > 50% n = 29, 25–49% n = 1, 0–25% n = 23; control: (n = 59) > 50% n = 19, 25–49% n = 2, 0–25% n = 24 % worsening (from baseline) EECP: 1–25% n = 0, 26–50% n = 0, 51–100% n = 0, 100% n = 4; control: 1–25% n = 0, 26–50% n = 2, 51–100% n = 5, 100% n = 7 p-value for between group differences < 0.02 VO2 related: not reported QoL (Magnitude of improvement or decline expressed in standard deviation units, baseline to end of treatment) Number of evaluable patients n = 71: EECP n = 36; control n = 35. Relationship between evaluable status and treatment group assignment p = 0.99 Physical functioning: EECP (n = 36) 0.75, p < 0.05; control (n = 35) 0.4, p < 0.05 Role disability due to physical health: EECP (n = 33) 0.55, p < 0.01; control (n = 34) 0.2 Bodily pain: EECP (n = 36) 0.65, p < 0.01; control (n = 35) 0.35, p < 0.05 General health: EECP (n = 34) 0.25; control (n = 34) –0.01 Vitality: EECP (n = 35) 0.2; control (n = 34) 0.15 Social functioning: EECP (n = 36) 0.35, p < 0.05; control (n = 35) –0.1. Between group difference in change p < 0.05 Role disability due to emotional health: EECP (n = 35) 0.6, p < 0.01; control (n = 34), 0.01. Between group difference in change p < 0.05 Mental health: EECP (n = 35) 0.35, p < 0.05; control (n = 34) 0.3 QLI-HF (cardiac specific health and functioning): EECP (n = 36) 0.65, p < 0.01; control (n = 35) 0.4, p < 0.05 QoL (Magnitude of improvement or decline expressed in standard deviation units, baseline to 1 year follow-up) Physical functioning: EECP (n = 36) 0.6, p < 0.01; control (n = 35) 0.3, p < 0.05 RP (work) Role disability due to physical health: EECP (n = 35) 0.6, p < 0.01; control (n = 35) 0.3 Bodily pain: EECP (n = 36) 0.5, p < 0.01; control (n = 35) 0.15. Between group difference in change p < 0.01 General health: EECP (n = 34) 0.25; control (n = 33) –0.05 Vitality: EECP (n = 36) 0.2; control (n = 33) 0.05 Social functioning: EECP (n = 36) 0.35 p < 0.05; control (n = 35) -0.1. Between group difference in change p < 0.05 Role disability due to emotional health: EECP (n = 36) 0.55, p < 0.01; control (n = 35) 0.15 Mental health: EECP (n = 36) 0.35, p < 0.05; control (n = 33) 0.2 QLI-HF (cardiac specific health and functioning): EECP (n = 36) 0.6, p < 0.01; control (n = 35) 0.2. Between group difference in change p < 0.01 Medication use NTG usage, mean (SE?) (ITT analysis) EECP: baseline 0.47 (0.13), post treatment 0.19 (0.07); control: baseline 0.51 (0.15), post treatment 0.45 (0.19) Adjusted mean (SE?): EECP –0.32 (0.12); control -0.10 (0.12). Between group p-value (using adjusted means) p > 0.1 NTG usage, mean (SE?) (patients who completed at least 34 sessions) EECP: baseline 0.39 (0.11), post treatment 0.12 (0.04); control: baseline 0.56 (0.17), post treatment 0.43 (0.21). Between group p-value (using adjusted means) p > 0.1 It was unclear for some of the analyses whether SE or SD was being reported. We have made an assumption that the variance used is SE Adverse events (EECP n = 71; control n = 66) Patients with adverse experiences: EECP n = 39 (54.9%); control n = 17 (25.8%) p < 0.001 Adverse experiences: non-device related (EECP, control) Viral syndrome 1, 0; anxiety 2, 0; dizziness 3, 1; tinnitus 1, 0; gastrointestinal disturbances 1, 1; headache 1, 0; blood pressure change 1, 1; epistaxis 2, 0; angina 1, 1; other chest pain 7, 3; atrioventricular arrhythmia 9, 3; heart rate change (sinusal) 0, 3; respiratory 4, 2 Total 33, 15, p < 0.005 Adverse experiences: device related (EECP, control) Paraesthesia 2, 1; oedema, swelling 2, 0; skin abrasion, bruise, blister 13, 2; pain (legs, back) 20, 7 Total 37, 10, p < 0.001 Leg discomfort reported in 11.6% (SE? 22.7) of EECP sessions and 4.9% (SE? 18.7) of control sessions. Owing to a typo, it is unclear which group had the greater percentage of leg discomfort – we have made the assumption it was the EECP group Summary of other outcomes: not applicable Details of subgroup analysis: not applicable Subgroup analysis results: not applicable |
Methods | Participants | Withdrawals | Outcomes assessed |
---|---|---|---|
Non-randomised controlled study Intervention EECP 35 hours of EECP over 7 weeks, i.e. 1 hour per day, 5 days per week Details of any other therapy All medications, diet and interventions were constant over the 10-week period after the participants were recruited to the study Comparator Standard care (not specified) Details of any other therapy All medications, diet and interventions were constant over the 10-week period after the participants were recruited to the study Inclusion criteria Men and women 40–90 years old Symptomatic coronary artery disease (CAD) documented by previous angiography (> 70% stenosis in any coronary artery) CCS classification II–IV Exclusion criteria Unstable angina Acute myocardial infarction in previous 3 months Aortic regurgitation Systemic hypertension > 180/110 mmHg Atrial fibrillation or ventricular premature beats that would interfere with EECP triggering Clinically evident peripheral vascular disease Deep vein thrombosis Phlebitis and haemorrhagic diathesis Use of anticoagulants Pregnancy Abdominal aortic aneurysm |
Number allocated to each group EECP n = 15; control n = 10 Age [mean (SD)] EECP 69.8 (11.2); control 69.3 (9.6) Sex (% male) EECP 12 (80); control 10 (100) Race Not reported Condition being treated Stable angina Baseline clinical characteristics VO2 related: not reported NYHA classification: not applicable CCS classification, n (%) EECP: Class II 2 (13.3); Class III 7 (46.6); Class IV: 6 (40) Control: Class II 2 (20); Class III 5 (50); Class IV 3 (30) Exercise duration: not reported Angina episodes: not reported Medication use, n (%) Aspirin: EECP 14 (93.3); control: 9 (90) Beta-blockers: EECP 12 (80); control 7 (70) Statins: EECP 13 (86.6); control 10 (100) Long acting nitrates: EECP 9 (60); control 5 (50) Diuretics: EECP 6 (40); control 4 (40) ACEI/ARB EECP 9 (60); control 7 (70) QoL: not reported Other History of MI, n (%) EECP 12 (80); control 9 (90) Previous revascularisation (PTCA and/or CABG), n (%) EECP 14 (93.3); control 10 (100) Left ventricular ejection fraction, mean % (SD) EECP 51.3 (10.8); control 49.3 (10.9) |
Number of withdrawals and losses to follow-up None reported Did study report differences between participants that dropped out and those that did not? Not applicable |
List of outcomes reported and how they were measured CCS angina class Reported but not extracted Number and colony-forming capacity of EPCs – changes in circulating EPCs were measured using flow activated cell sorter analysis and by counting EPC-CFUs (colony forming units) Endothelial function – percentage change in flow-mediated dilation after cuff deflation Endothelial dysfunction – asymmetric dimethylarginine, vascular endothelial growth factor and c-reactive protein levels were measured) |
Results | |||
Exercise duration: not reported NYHA classification: not applicable CCS classification: CCS changed from a categorical to a continuous scale, median (interquartile range) EECP: baseline 3.0 (3.0–4.0), post treatment: 2.0 (2.0–3.0), p < 0.001; control: baseline 3.0 (2.5–4.0); post treatment: 3.0 (2.0–3.5), p = 0.50 Angina episodes: not reported VO2 related: not reported QoL: not reported Medication use: not reported Adverse events: not reported Summary of other outcomes: not applicable Details of subgroup analysis: not applicable |
Methods | Participants | Withdrawals | Outcomes assessed |
---|---|---|---|
RCT Intervention EECP 35 1-hour sessions of EECP over 7–8 weeks. Protocol-specified applied pressure was 300 mmHg, and was reached within 5 minutes of treatment initiation Details of any other therapy Continued pharmacotherapy (PT) Comparator Continued pharmacotherapy For both groups, patients were receiving heart failure therapy in compliance with the Practice Guidelines of the Heart Failure Society of America For both groups, digoxin, diuretics and other medication used to treat heart failure could be given at the investigators discretion Inclusion criteria Symptomatic mild to moderate heart failure (NYHA class II – III) secondary to either ischaemic or non-ischaemic cardiomyopathy and a LVEF ≤ 35% Clinically stable Minimal or no oedema Be receiving heart failure therapy in compliance with the Practice Guidelines of the Heart Failure Society of America before enrolling Before enrolling be taking an ACE inhibitor or an angiotensin-receptor blocker and beta-blocker for at least 1 and 3 months respectively, unless these drugs are not tolerated Exclusion criteria Acute coronary syndrome in the 6 weeks prior to enrolment Non-bypassed left main coronary with a luminal stenosis ≥ 50% CABG in previous 3 months, PCI in previous 6 months or cardiac catheterisation in previous 2 weeks Arrhythmias that could interfere with EECP Chronic obstructive pulmonary disease (COPD) with forced expiratory volume of 1 second (FEV1) ≤ 1.5l Clinically significant valvular heart disease, acute myocarditis History of deep vein thrombosis, phlebitis, stasis ulcer, pulmonary embolism or aortic aneurysm Uncontrolled hypertension |
Number allocated to each group EECP n = 93; control n = 94 Age [mean (SD)] EECP 62.4 (11.7); control 63.0 (10.4) Sex (% male) EECP 77.4%; control 75.5% Race Caucasian: EECP n = 76 (81.7%); control n = 75 (79.8%) Condition being treated Heart failure Baseline clinical characteristics VO 2 related Peak VO2 ml/kg/minute, mean (SE) EECP 14.7 (0.4); control 14.1 (0.4) (Based on 80 and 84 patients respectively) NYHA classification, n (%) Class II: EECP 60 (64.5%); control 62 (66%) Class III: EECP 33 (35.5%); control 32 (34.0%) Exercise duration, seconds, mean (SE) EECP 610.6 (27.8); control 570.9 (26.1) (Based on 80 and 84 patients respectively) Medication use ACE inhibitors, n (%): EECP 70 (75.3); control 73 (77.7) Enalapril daily dose equivalent (mg), mean (SD): EECP 11.8 (10.1); control 13.5 (9.9) Median: EECP 10; control 10 Angiotensin-receptor blockers, n (%): EECP 18 (19.4); control 18 (19.1) Losartan daily dose equivalent (mg), mean (SD): EECP 63.2 (42.0); control 60.5 (38.5) Median: EECP 50; control 50 Beta-blockers, n (%): EECP 79 (84.9); control 81 (86.2) Carvedilol daily dose equivalent (mg), mean (SD): EECP 39.4 (29.7); control 39.7 (30.1) Median: EECP 25; control 25 QoL: baseline not reported Other Aetiology, ischaemic, n (%): EECP 64 (68.8%); control 66 (70.2%) Heart rate, beats per min (SD): EECP 70.7 (11.2); control 70.6 (12.0) Blood pressure mmHg (SD): systolic: EECP 116.7 (17.7); control 114.8 (18.4); diastolic: EECP 70.9 (10.2); control 70.8 (10.8) LVEF, mean % (SD): EECP 25.9% (6.1); control 26.7% (6.5) |
Number of withdrawals and losses to follow-up EECP n = 22 (23.7%) Adverse event: 11 Protocol violation: 2 Refused assignment: 2 Non-compliance: 1 Participant's decision: 5 Loss to follow-up: 2 Other: 4 Control n = 13 (13.8%) Adverse event: 3 Protocol violation: 2 Refused assignment: 1 Non-compliance: 0 Participant's decision: 6 Loss to follow-up: 1 Other: 1 Additional losses to follow-up EECP: 2 Pharmacotherapy: 1 Did study report differences between participants that dropped out and those that did not? No |
List of outcomes reported and how they were measured Exercise duration – percentage of patients that showed an increase in duration of 60 seconds or more Peak VO2 – percentage of patients with an increase in peak VO2 ≥ 1.25 ml/kg/minute from baseline at 6 months’ follow-up Change in peak VO2 Change in exercise duration Change in ventilatory equivalent for carbon dioxide Change in respiratory exchange ratio Change in Borg Score Change in ventilatory response (l/minute) Change in NYHA functional class Change in QoL (Minnesota Living with Heart Failure Questionnaire) Adverse events (an independent clinical end-points committee classified adverse events) |
Results | |||
Exercise duration [mean change in exercise duration from baseline(s) (SE)] 1-week follow-up: EECP (n = 77) 26.4 (12.2); control (n = 78) –5.5 (11.7), p = 0.010 3-month follow-up: EECP (n = 78) 34.5 (13.9); control (n = 82) –7.0 (12.7), p = 0.014 6-month follow-up: EECP (n = 79) 24.7 (15.2); control (n = 83) –9.9 (13.2), p = 0.013 Exercise duration (percentage of patients with at least a 60-second increase in exercise duration from baseline to 6 months’ follow-up) EECP 35.4%; control 25.3%, p = 0.016 NYHA classification (% patients with an improvement in NYHA class) 1-week follow-up: EECP 33.3%; control 11.4%, p < 0.001 3-month follow-up: EECP 31.6%; control 12.2%, p < 0.02 6-month follow-up: EECP 31.3%; control 14.3, p < 0.01 CCS classification: not applicable Angina episodes: not applicable VO 2 related [mean change in peak VO 2 (ml/kg/minute) (SE)] 1-week follow-up: EECP (n = 77) 0.1 (0.3); control (n = 78) –0.4 (0.3), p = 0.071 3-month follow-up: EECP (n = 78) 0.2 (0.3); control (n = 82) –0.4 (0.3), p = 0.119 6-month follow-up: EECP (n = 79) –0.3 (0.3); control (n = 83) –0.6 (0.3), p = 0.315 VO 2 related (% patients with a peak VO 2 increase ≥ 1.25 ml/kg/minute from baseline to 6 months’ follow-up) EECP 22.8%; control 24.1%, p = 0.698 QoL (mean change in QoL score (CIs) using Minnesota Living with Heart Failure Questionnaire) estimated from Figure 1 1-week follow-up: EECP –8.8 (–7 to –10.9); control –3.5 (–1.5 to –5), p = 0.01 3-month follow-up: EECP –7.2 (–4.7 to –9.5); control –2.8 (–1 to –4.6), p = 0.01 6-month follow-up: EECP –3.5 (–1.3 to –6); control –2.8 (–0.5 to –4.5), p = 0.32 Medication use: not reported Adverse events Percentage of patients discontinuing due to an adverse experience EECP 11.8; control 3.2 Discontinuation due to adverse event during treatment period EECP: sciatica n = 1, leg pain n = 1, arrhythmia n = 2, non-Q wave MI not attributable to therapy n = 1; control: death n = 2 Discontinuation due to adverse events in the follow-up period EECP: worsening heart failure (WHF) n = 4, biventricular pacemaker implantation n = 1, worsening lung cancer n = 1, control: atrioventricular block n = 1 Serious adverse events (SAE) Percentage of patients with SAEs: EECP n = 27 (30.3%); control n = 26 (29.5%) During treatment period EECP: SAEs n = 7 (7.9%); related to treatment: WHF n = 1, pulmonary embolism n = 1; control: SAEs n = 8 (9.1%); related to treatment: WHF n = 0, pulmonary embolism n = 0 During follow-up EECP: SAEs n = 21 (23.6%); related to treatment: WHF n = 0, deep vein thrombosis n = 1; control: SAEs n = 23 (26.1%); related to treatment: WHF n = 1; deep vein thrombosis n = 0 (There was a discrepancy in the paper between the total number of participants with SAE and the number of SAEs during treatment plus during follow-up) Pre-defined clinical events EECP: n = 89 WHF requiring IV therapy n = 8 (9%); WHF with no IV n = 8 (1.1%) (as stated in paper but looks like a typo); acute coronary syndrome (ACS) n = 1 (1.1%); MI n = 1 (4.5%); cardiovascular death n = 0 Control n = 88; WHF with IV n = 12 (13.6%); WHF with no IV n = 4 (2.3%); ACS n = 0 (0%); MI n = 0 (0%); cardiovascular death n = 2 (2.3%) Summary of other outcomes Ventilatory equivalent for carbon dioxide (VE/VCO2) – no change at any time point (data not presented) There was no significant difference at baseline or any follow-up time points between groups in respiratory exchange ratio (RER) or Borg score (overall median = 17) There was a statistically significant difference in ventilatory response (change in VE l/min) between groups at 1-week and 3-month follow-up, but not at 6 months Subgroup analysis results Subgroup 1: Patients with ischaemic versus non-ischaemic dilated cardiomyopathy Mean change in exercise duration, (seconds) (SE): 1-week follow-up EECP: ischaemic (n = 53) 24.6 (15.7), non-ischaemic (n = 24) 30.2 (18.3); control: ischaemic (n = 54) –16.7 (14.2), non-ischaemic (n = 24) 19.9 (20.3) Ischaemic p = 0.007; non-ischaemic p = 0.836 Mean change in exercise duration, (seconds) (SE): 3-month follow-up EECP: ischaemic (n = 54) 34.2 (17.2), non-ischaemic (n = 24) 35.4 (23.8); control: ischaemic (n = 57) –17.3 (13.1), non-ischaemic (n = 25) 16.7 (28.9) Ischaemic p = 0.017; non-ischaemic p = 0.741 Mean change in exercise duration, (seconds) (SE): 6-month follow-up EECP: ischaemic (n = 54) 20.6 (18.5), non-ischaemic (n = 25) 33.5 (26.8); control: ischaemic (n = 57) –25.8 (13.9), non-ischaemic (n = 26) 24.7 (28.3) Ischaemic p = 0.010; non-ischaemic p = 0.724 Increase in NYHA classification 1-week follow-up: EECP 37%; control 12.7%, p = 0.004 3-month follow-up: EECP 34.5%; control 12.3%, p = 0.025 6-month follow-up: EECP 36.4%; control 15.5%, p = 0.026 Change in peak VO 2 (ml/kg/minute) (SE): 1-week follow-up EECP: ischaemic (n = 53) 0.2 (0.4), non-ischaemic (n = 24) –0.2 (0.5); control: ischaemic (n = 54) –0.7 (0.4) non-ischaemic (n = 24) –0.4 (0.5) Ischaemic p = 0.008; non-ischaemic p = 0.987 Change in peak VO 2 (ml/kg/minute) (SE): 3-month follow-up EECP: ischaemic (n = 54) 0.0 (0.4) non-ischaemic (n = 24) 0.6 (0.5); control: ischaemic (n = 57) –0.4 (0.3); non-ischaemic (n = 25) –0.2 (0.8) ischaemic p = 0.122; non-ischaemic p = 0.437 Change in peak VO 2 (ml/kg/minute) (SE): 6-month follow-up EECP: ischaemic (n = 54) –0.4 (0.3) non-ischaemic (n = 25) –0.3 (0.5); control: ischaemic (n = 57) –0.9 (0.3) non-ischaemic (n = 26) 0.2 (0.6) ischaemic p = 0.115; non-ischaemic p = 0.935 QoL The only significant improvement was in the ischaemic group at 3 months' follow-up: EECP –6.5 (3.2); PT –1.5 (2.1), p = 0.046 Subgroup analysis results Subgroup 2: Older patients (EECP n = 41; PT n = 44) There were no significant differences at baseline between the subgroup and overall population Exercise duration – mean change in exercise duration, seconds (variance not reported) 1 week: EECP 23.0, control 3.4, p = 0.07; 3 months: EECP 52.2, control –19.1, p = 0.004; 6 months: EECP 30.0, control –22.3, p = 0.001 Exercise duration – increase in exercise duration ≥ 60 seconds from baseline to 6 months’ follow-up EECP 35.1; control 25%, p = 0.008 Improvement in NYHA classification 1 week: EECP 35.1%, control 9.8%, p = 0.042; 3 months: EECP 40.5%, control 9.1%, p = 0.046; 6 months: EECP 37.8%, control 15.9%, p-value not significant Peak VO 2 – increase in peak VO 2 ≥ 1.25ml/kg/minute from baseline to 6-month follow-up EECP 29.7; control 11.4, p = 0.017 Mean change in peak VO 2 (from baseline, ml/kg/minute) (variance not reported) 1 week: EECP –0.1, control –0.8, p = 0.09; 3 months: EECP 0.3, control –1.1, p = 0.02; 6 months: EECP –0.2, control –1.1, p < 0.001 QoL There was no statistically significant difference in Minnesota Living with Heart Failure Questionnaire score between EECP and PT within the 65 or older subgroup at any time point (data not reported) Adverse events Adverse events were consistent with those in the overall study population, i.e. non-serious adverse events related to skin and musculoskeletal experience were more frequent in the EECP group Serious adverse events EECP 12 (29.3%); control 16 (36.4%) 1 serious adverse event was defined as definitely related to EECP (WHF in a 72-year-old man with ischaemic heart failure) Events adjudicated by the PEECH committee occurred at a similar frequency in both study groups. |
Methods | Participants | Withdrawals | Outcomes assessed |
---|---|---|---|
Non-randomised controlled study Intervention EECP 1–2 hours of treatment per day, 5 or 6 days per week with a minimum total of 35 hours Details of any other therapy None reported Comparator Elective PCI Details of any other therapy None reported Inclusion criteria IEPR: all consecutive patients undergoing at least 1 hour of EECP treatment with no clinical or other exclusions. Patients were included in this analysis if they had stable exertional angina and were classified as PCI candidates at the time of first EECP treatment (14.8% of entire cohort) National Heart, Lung and Blood Institute Dynamic Registry of Coronary Interventions (Dynamic Registry): consecutive patients (with no exclusion criteria) undergoing insertion of a guide catheter as the first intended step of PCI. Patients were included in this analysis if they had undergone elective PCI for stable symptoms without myocardial infarction in the previous 30 days (23.2% of entire cohort) |
Number allocated to each group EECP n = 323; control n = 448 Age [mean (SD)] EECP 65.7 (10.5); control 64.5 (11.6) Sex (% male) EECP 79.9; control 72.3, p < 0.05 Race: not reported Condition being treated Stable angina Baseline clinical characteristics VO2 related: not reported NYHA classification: not applicable CCS classification EECP: Class I 9.6%; Class II 26.0%; Class III 47.1%; Class IV 17.3% Control: Class I 5.3%; Class II 41.4%; Class III 48.3%; Class IV 5.1%. p < 0.001 Exercise duration: not reported Angina episodes: not reported Medication use: not reported QoL: not reported Other Prior PCI EECP 53%; control 33.3%, p < 0.001 Prior CABG EECP 42.1%; control 18.6%, p < 0.001 Prior MI EECP 56.4%; control 27.8%, p < 0.001 Congestive heart failure EECP 16.8%; control 9.2%, p < 0.01 LVEF EECP 50.3 (SD 10.8); control 59.2 (SD 12.6), p < 0.001 |
Number of withdrawals and losses to follow-up Loss to follow-up unclear Patients alive and contacted at follow-up: EECP n = 251; control n = 422 Did study report differences between participants that dropped out and those that did not? No |
List of outcomes reported and how they were measured All-cause mortality Self-reported exertional angina CCS classification Medication use PCI during follow-up Repeat EECP (EECP group only) With the exception of mortality, outcomes were based on phone interview or by mail |
Results | |||
Exercise duration: not reported NYHA classification: not applicable CCS classification EECP (n = 251): Class I, 22.0%; Class II, 18.8%; Class III, 11.8%; Class IV/unstable, 3.7% Control (n = 422): Class I, 5.1%; Class II, 12.1%; Class III, 5.1%; Class IV/unstable, 4.4%, p = 0.02 for prevalence of Class III or IV/unstable angina (Note: due to differences in how the two registries classified unstable angina, stable Class IV and unstable angina were treated as a single category) Angina episodes (no angina) EECP (n = 251): 43.7%; control (n = 422): 73.4%, p < 0.001 VO2 related: not reported QoL: not reported Medication use Beta-blockers: EECP 53.8%; control 54.7% Calcium channel blockers: EECP 50.6%; control 33.7%, p < 0.001 Long-acting nitrates: EECP 53.0%; control 30.3%, p < 0.001 ACE inhibitors: EECP 26.7%; control 28.0% Angiotensin-receptor blockers: EECP 5.6%; control 1.9%, p < 0.01 Short-acting nitroglycerin: EECP: 43.3%; control 82.2%, p < 0.001 Adverse events: not reported Summary of other outcomes 1-year all-cause mortality: EECP 98.7% survival, mortality 1.3% (95% CI 0.5–3.5%); control 96.8% survival, mortality 3.2% (95% CI 1.9–5.4%) (not significant based on log-rank test) PCI during follow-up: control 17.2% (95% CI 14.0–21.1%); EECP 6.3% (95% CI 4.0–9.9%) Repeat EECP: EECP 9.1% (95% CI 6.2–13.0%) Details of subgroup analysis 1-year angina CCS classification reported by baseline classification; subgroup analysis results: not extracted Additional comments 85.8% of 323 patients treated with EECP completed a full course of treatment 92.1% of patients treated with PCI had a successful initial procedure (i.e. reduction of stenosis in all attempted lesions of at least 20% to a final stenosis of 50%, without occurrence of death, MI or emergency CABG during post-PCI hospitalisation |
Methods | Participants | Withdrawals | Outcomes assessed |
---|---|---|---|
Non-randomised controlled study Intervention EECP 35 hours over 7 weeks. Treatment sessions lasted for 1 hour, 5 days each week Details of any other therapy Regular medications were continued and usual diet was maintained throughout Comparator Details not provided Details of any other therapy Regular medications were continued and usual diet maintained throughout Inclusion criteria Men and women > 20 years old with coronary artery disease documented by previous myocardial infarction, coronary artery bypass surgery or coronary angiography or angioplasty CCS classification III or IV determined by specific criteria Exclusion criteria Unstable angina Congestive heart failure New York Heart Association > Class II Aortic regurgitation Valvular heart disease Acute MI < 3 months Left main stenosis > 50% Systemic hypertension > 180/110 mmHg Permanent pacemaker Atrial fibrillation or ventricular premature beats that would interfere with triggering EECP Clinically evident peripheral vascular disease Deep vein thrombosis Phlebitis and haemorrhagic diathesis Use of anticoagulants Pregnancy Abdominal aortic aneurysm History of drug or alcohol abuse Chronic liver disease |
Number allocated to each group EECP n = 20; control n = 20 Age [mean (SD)] EECP 68 (11); control 67 (12) Sex (% male) EECP 15 (75); control 17 (85) Race: not reported Condition being treated Stable angina Baseline clinical characteristics VO2 related: not reported NYHA classification: not applicable CCS classification, n (%) EECP: Class III 5 (25%); Class IV 15 (75%) Control: Class III 6 (30%); Class IV 14 (70%) Exercise duration: not reported Medication use, n (%) Beta-receptor antagonist: EECP 14 (70%); control 13 (65%) Calcium antagonists: EECP 9 (45%); control 7 (35%) Diuretics (lasix): EECP 4 (20%); control 5 (25%) Aspirin: EECP 19 (95%); control 19 (95%) Long-acting nitrates: EECP 16 (80%); control 17 (85%) ACE inhibitors: EECP 13 (65%); control 12 (60) Lipid-lowering agents: EECP 15 (75%); control 16 (80%) QoL: not reported Other Body mass index (kg/m2), mean (SD): EECP 26 (4); control 25 (7) Systemic hypertension, n (%): EECP 10 (50); control 7 (35) Previous MI, n (%): EECP 14 (70); control 13 (65) Previous coronary angioplasty, n (%): EECP 12 (60); control 13 (60) Previous coronary bypass, n (%): EECP 10 (50); control 11 (55) |
Number of withdrawals and losses to follow-up None Did study report differences between participants that dropped out and those that did not? Not applicable |
List of outcomes reported and how they were measured Use of nitroglycerin tablets during the preceding 7 days (mean sublingual nitrate consumption per day) CCS classification Adverse experiences – reported at each EECP session Flow-mediated dilation (%) and NTG-induced non-endothelium dependent vasodilatation (%) – measured using high resolution ultrasound |
Results | |||
Exercise duration: not applicable NYHA classification: not applicable CCS classification Mean CCS angina class (SD) from baseline to post treatment (CCS changed from a categorical to a continuous scale) EECP: baseline 3.5 (0.5), post-treatment 1.9 (0.3), p < 0.0001; control: baseline 3.3 (0.6), post treatment 3.5 (0.5), p = 0.89 Angina class at the end of the study, n (%) EECP: Class I 1 (5%), Class II 17 (85%), Class III 2 (10%), CCS Class IV 0; control data not reported Angina episodes: not applicable VO2 related: not applicable QoL: not reported Medication use [mean nitrate tablet consumption per day (SD) from baseline to post treatment] EECP: baseline 4.2 (2.7), post treatment 0.4 (0.5), p < 0.001; control: baseline 4.5 (2.3), post treatment 4.4 (2.6), p = 0.87 Adverse events The authors stated there were no serious adverse effects throughout the study Summary of other outcomes: not applicable Details of subgroup analysis: not applicable Subgroup analysis results: not applicable |
Appendix 5 Details of quality assessment for economic studies
Manufacturer’s study24 | ||
---|---|---|
Grade | Comments | |
Study question | ||
1. Costs and effects examined | Yes | |
2. Alternatives compared | Yes | |
3. The viewpoint/perspective of the analysis is clearly stated (e.g. NHS, society) | Yes | US payer’s perspective |
Selection of alternatives | ||
4. All relevant alternatives are compared (including do nothing, if applicable) | Yes | |
5. The alternatives being compared are clearly described (who did what, to whom, where and how often?) | Yes | |
6. The rationale for choosing the alternative programmes or interventions compared is stated | Yes | |
Form of evaluation | ||
7. The choice of form of economic evaluation is justified in relation to the questions addressed | Yes | |
8. If a cost-minimisation design is chosen, have equivalent outcomes been adequately demonstrated? | NA | |
Effectiveness data | ||
9. The source(s) of effectiveness estimates used are stated (e.g. single study, selection of studies, systematic review, expert opinion) | Yes | |
10. Effectiveness data from RCT or review of RCTs | No | Effectiveness data derived from registry data and observational studies. No RCT data were available for the alternatives being compared |
11. Potential biases identified (especially if data are not from RCTs) | No | |
12. Details of the method of synthesis or meta-analysis of estimates are given (if based on an overview of a number of effectiveness studies) | NA | No formal synthesis was undertaken |
Costs | ||
13. All the important and relevant resource use is included | Yes | |
14. All the important and relevant resource use is measured accurately (with methodology) | Yes | |
15. Appropriate unit costs estimated (with methodology) | Yes | |
16. Unit costs reported separately from resource use data | No | |
17. Productivity costs treated separately from other costs | NA | |
18. The year and country to which unit costs apply are stated with appropriate adjustments for inflation and/or currency conversion | Yes | 2004 US dollars |
Benefit measurement and valuation | ||
19. The primary outcome measure(s) for the economic evaluation are clearly stated | Yes | |
20. Methods to value health states and other benefits are stated | No | No health states were valued |
21. Details of the individuals from whom valuations were obtained are given | NA | |
Decision modelling | ||
22. Details of any decision model used are given (e.g. decision tree, Markov model) | Yes | |
23. The choice of model used and the key input parameters on which it is based are adequately detailed and justified | Yes | |
24. All model outputs described adequately | Yes | |
Discounting | ||
25. Discount rate used for both costs and benefits | Unclear | Costs were discounted at 3% per year. Not clear whether benefits were discounted |
26. Do discount rates accord with NHS guidance? | No | NHS guidance recommends 3.5% per year for costs and benefits |
Allowance for uncertainty | ||
Stochastic analysis of patient-level data | ||
27. Details of statistical tests and confidence intervals are given for stochastic data | NA | |
28. Uncertainty around cost-effectiveness expressed (e.g. confidence interval around ICER, cost-effectiveness acceptability curves) | NA | |
29. Sensitivity analysis used to assess uncertainty in non-stochastic variables (e.g. unit costs, discount rates) and analytic decisions (e.g. methods to handle missing data) | NA | |
Stochastic analysis of decision models | ||
30. Are all appropriate input parameters included with uncertainty? | No | |
31. Is second-order uncertainty (uncertainty in means) included rather than first order (uncertainty between patients)? | No | |
32. Are the probability distributions adequately detailed and appropriate? | No | |
33. Sensitivity analysis used to assess uncertainty in non-stochastic variables (e.g. unit costs, discount rates) and analytic decisions (e.g. methods to handle missing data) | No | |
Deterministic analysis | ||
34. The approach to sensitivity analysis is given (e.g. univariate, threshold analysis, etc.) | Yes | One-way sensitivity analysis |
35. The choice of variables for sensitivity analysis is justified | Yes | |
36. The ranges over which the variables are varied are stated | Yes | |
Presentation of results | ||
37. Incremental analysis is reported using appropriate decision rules | Yes | |
38. Major outcomes are presented in a disaggregated as well as an aggregated form | Yes | |
39. Applicable to the NHS setting | No | US based and unclear how generalisable these results are to a UK setting |
Appendix 6 Assumption of linearity in the economic model
The computational requirements for partial EVPI and EVSI can be simplified if the model has either a linear or a multilinear relationship between the parameters and the expected costs and outcomes. Although the economic model presented in Chapter 3, Decision model, is non-linear, a linear relationship was assumed between the inputs and the net benefit for the EVSI calculation. The impact of this assumption is shown in the partial EVPI estimates in Figure 11. The difference between the partial EVPI estimates for the non-linear versus linear assumption for the probability of sustaining benefits in subsequent years is negligible across the range of cost-effectiveness thresholds. The difference between the estimates for the 1-year QoL improvement is more pronounced. The estimate under the linear assumption is shifted to the right of the non-linear EVPPI, peaking at a threshold of £21,000 per QALY as opposed to £18,643 (maximum uncertainty), as in the non-linear case. Under the linear assumption, the partial estimate for the 1-year QoL improvement is approximately 5% more than the non-linear estimate at a threshold of £20,000. The small difference across the range of cost-effectiveness thresholds suggests that the non-linearity of the model has only a limited impact on the results. Therefore, the assumption of linearity in the EVSI calculations seems reasonable (and reduces the computational time substantially).
Appendix 7 Exercise used to elicit the beliefs of clinical experts
Elicitation exercise details
(Please read before beginning the exercise)
Introduction to the exercise
In the absence of trial data, we would like you to give us your expert opinion on the duration of QoL benefits over time for patients with angina pectoris receiving treatment with EECP.
Please make sure you read the information at the top of each question before attempting to answer it.
Please do not discuss your responses with other individuals. We are interested in your personal beliefs concerning each question.
Background information
The multicentre randomised control trial, MUST-EECP, evaluated QoL in patients receiving active EECP (treatment group) versus inactive EECP (control group). At the end of treatment and at 1-year follow-up, patients who had received active EECP showed greater improvements in QoL than those who had received inactive EECP. The incremental difference in benefits between the active and inactive EECP treatment arms at 1-year follow-up was of a similar magnitude to the incremental difference at the end of treatment. This suggests that QoL benefits from EECP are fully sustained at 1-year follow-up.
In this exercise, we would like you to determine the proportion of patients who will continue to sustain their QoL benefits in subsequent years.
In answering the questions, we would like you to assume that patients have any additional repeat procedures (or top-up sessions) when they require them. Therefore, your answers to all questions are conditional on patients receiving as many top-up sessions as might be appropriate.
Format of answers
In the following questions, information is requested using a grid. Each column represents a range of potential values for a piece of data. We request that you place 20 crosses in each grid. We would like you to place all 20 crosses in one or more columns to represent your current belief and uncertainty about that particular question. For example, if you are completely certain about the answer, then place all 20 crosses in one column of the grid.
Please begin by placing two of the crosses at the upper and lower limits of your belief about the piece of data. You should then place the remaining 18 crosses so as to express your remaining uncertainty about the particular piece of data (see example shown below in Figure 12). Use the letter X on your keyboard to represent the crosses. It is important that you place all 20 crosses in the grid.
QUESTION 1 – Sustained duration of QoL benefits at year 2 following treatment with EECP
We would like you to determine the proportion of patients in year 2 who are likely to sustain the average QoL benefits seen at year 1 following end of treatment.
Question 1: In year 2, what proportion of patients would you expect to sustain the year 1 QoL benefits?
Please place 20 crosses in the grid
Question 1b: Given your response above, do you expect the proportions to be different in subsequent years?
YES ❑ Please continue to Question 2 on the next page.
NO ❑ You have now completed the questionnaire. Many thanks for your responses. Please feel free to give us any additional feedback.
QUESTION 2 – Sustained duration of QoL benefits at year 3 following treatment with EECP
Given that patients have sustained benefits at year 2, we would like you to determine the proportion of patients in year 3 who are likely to sustain the average QoL benefits seen at year 1 following end of treatment.
Question 2: In year 3, what proportion of sustained year 2 patients would you expect to sustain the year 1 QoL benefits?
Please place 20 crosses in the grid
Question 2b: Given your response above, do you expect the proportions to be different in subsequent years?
YES ❑ Please continue to Question 3 on the next page.
NO ❑ You have now completed the questionnaire. Many thanks for your responses. Please feel free to give us any additional feedback.
Glossary
- Cardiac ischaemia
- Inadequate blood supply to the heart.
- Cardiac rehabilitation
- A structured programme, involving the patient and a multidisciplinary health-care team, consisting of exercise training, behavioural change, education and psychological support to facilitate lifestyle changes and prevent further cardiac events.
- Case series
- A group of case reports of patients who were given similar treatment. There is no control group involved.
- Controlled clinical trial
- A clinical study involving a control group.
- Coronary artery bypass graft
- A coronary revascularisation technique to treat coronary artery disease, which uses a blood vessel (called a graft) from the chest, leg or arm to bypass a narrowed or blocked coronary artery.
- Enhanced external counterpulsation
- A non-invasive technique used to improve cardiac perfusion.
- Glyceryl trinitrate
- A drug that can be used to treat an angina attack or be taken before exercise or exertion in order to help prevent an attack.
- Heart failure
- The symptoms that result from the inability of the heart to respond precisely to the physiological demands for increased cardiac output.
- Intention-to-treat analysis
- Analysis that compares participants in the groups to which they were originally assigned. This includes all patients, regardless of whether they satisfied the entry criteria, the treatment actually received and subsequent withdrawal or deviation from the protocol.
- Long-acting nitrates
- Drugs that prevent angina pain from developing. These have to be taken regularly and are not used for immediate pain relief, as they take time to start working.
- Myocardial infarction
- Known as a ‘heart attack’, whereby blood flow to the heart is impaired by a blood clot in a coronary artery. This can lead to damage to the heart tissue unless treated quickly.
- Oedema
- Retention of fluid in the body.
- Paraesthesia
- A sensation of tingling, burning, prickling, ‘pins and needles’ or numbness in a part of the body or in the skin.
- Peak VO2
- The maximum capacity of the body to utilise oxygen during incremental exercise.
- Percutaneous coronary intervention
- A coronary revascularisation technique used in the treatment of ischaemic heart disease involving widening of the coronary artery using a stent.
- Randomised controlled trial
- A trial in which the participants are randomly allocated to the control or treatment groups.
- Refractory stable angina
- Angina that persists, despite optimal drug treatment, when all surgical options have been exhausted.
List of abbreviations
- ACE
- angiotensin converting enzyme
- AE
- adverse event
- CABG
- coronary artery bypass graft
- CCS
- Canadian Cardiovascular Society
- CEAC
- cost-effectiveness acceptability curve
- CHD
- coronary heart disease
- CI
- confidence interval
- CRD
- Centre for Reviews and Dissemination
- CVD
- cardiovascular disease
- ECG
- electrocardiogram
- EECP
- enhanced external counterpulsation
- ENBS
- expected net benefit of sampling
- EVI
- expected value of information
- EVPI
- expected value of perfect information
- EVPPI
- expected value of partial perfect information
- EVSI
- expected value of sample information
- HRQoL
- health-related quality of life
- ICER
- incremental cost-effectiveness ratio
- IEPR
- International EECP Patient Registry
- ITT
- intention-to-treat
- LVEF
- left ventricular ejection fraction
- MACE
- major adverse clinical event
- MI
- myocardial infarction
- MUST-EECP
- Multicenter Study of Enhanced External Counterpulsation
- NICE
- National Institute for Health and Clinical Excellence
- NTG
- nitroglycerin
- NYHA
- New York Heart Association
- PCI
- percutaneous coronary intervention
- PEECH
- Prospective Evaluation of EECP in Congestive Heart Failure
- QALY
- quality-adjusted life-year
- QLI
- Quality of Life Index
- QoL
- quality of life
- RCT
- randomised controlled trial
- SCS
- spinal cord stimulation
- SE
- standard error
- SF-36
- 36-item Short Form health survey
- SIGN
- Scottish Intercollegiate Guidelines Network
- TENS
- transcutaneous electrical nerve stimulation
- VO2
- volume of oxygen uptake
All abbreviations that have been used in this report are listed here unless the abbreviation is well known (e.g. NHS), or it has been used only once, or it is a non-standard abbreviation used only in figures/tables/appendices, in which case the abbreviation is defined in the figure legend or in the notes at the end of the table.
Notes
Health Technology Assessment reports published to date
-
Home parenteral nutrition: a systematic review.
By Richards DM, Deeks JJ, Sheldon TA, Shaffer JL.
-
Diagnosis, management and screening of early localised prostate cancer.
A review by Selley S, Donovan J, Faulkner A, Coast J, Gillatt D.
-
The diagnosis, management, treatment and costs of prostate cancer in England and Wales.
A review by Chamberlain J, Melia J, Moss S, Brown J.
-
Screening for fragile X syndrome.
A review by Murray J, Cuckle H, Taylor G, Hewison J.
-
A review of near patient testing in primary care.
By Hobbs FDR, Delaney BC, Fitzmaurice DA, Wilson S, Hyde CJ, Thorpe GH, et al.
-
Systematic review of outpatient services for chronic pain control.
By McQuay HJ, Moore RA, Eccleston C, Morley S, de C Williams AC.
-
Neonatal screening for inborn errors of metabolism: cost, yield and outcome.
A review by Pollitt RJ, Green A, McCabe CJ, Booth A, Cooper NJ, Leonard JV, et al.
-
Preschool vision screening.
A review by Snowdon SK, Stewart-Brown SL.
-
Implications of socio-cultural contexts for the ethics of clinical trials.
A review by Ashcroft RE, Chadwick DW, Clark SRL, Edwards RHT, Frith L, Hutton JL.
-
A critical review of the role of neonatal hearing screening in the detection of congenital hearing impairment.
By Davis A, Bamford J, Wilson I, Ramkalawan T, Forshaw M, Wright S.
-
Newborn screening for inborn errors of metabolism: a systematic review.
By Seymour CA, Thomason MJ, Chalmers RA, Addison GM, Bain MD, Cockburn F, et al.
-
Routine preoperative testing: a systematic review of the evidence.
By Munro J, Booth A, Nicholl J.
-
Systematic review of the effectiveness of laxatives in the elderly.
By Petticrew M, Watt I, Sheldon T.
-
When and how to assess fast-changing technologies: a comparative study of medical applications of four generic technologies.
A review by Mowatt G, Bower DJ, Brebner JA, Cairns JA, Grant AM, McKee L.
-
Antenatal screening for Down’s syndrome.
A review by Wald NJ, Kennard A, Hackshaw A, McGuire A.
-
Screening for ovarian cancer: a systematic review.
By Bell R, Petticrew M, Luengo S, Sheldon TA.
-
Consensus development methods, and their use in clinical guideline development.
A review by Murphy MK, Black NA, Lamping DL, McKee CM, Sanderson CFB, Askham J, et al.
-
A cost–utility analysis of interferon beta for multiple sclerosis.
By Parkin D, McNamee P, Jacoby A, Miller P, Thomas S, Bates D.
-
Effectiveness and efficiency of methods of dialysis therapy for end-stage renal disease: systematic reviews.
By MacLeod A, Grant A, Donaldson C, Khan I, Campbell M, Daly C, et al.
-
Effectiveness of hip prostheses in primary total hip replacement: a critical review of evidence and an economic model.
By Faulkner A, Kennedy LG, Baxter K, Donovan J, Wilkinson M, Bevan G.
-
Antimicrobial prophylaxis in colorectal surgery: a systematic review of randomised controlled trials.
By Song F, Glenny AM.
-
Bone marrow and peripheral blood stem cell transplantation for malignancy.
A review by Johnson PWM, Simnett SJ, Sweetenham JW, Morgan GJ, Stewart LA.
-
Screening for speech and language delay: a systematic review of the literature.
By Law J, Boyle J, Harris F, Harkness A, Nye C.
-
Resource allocation for chronic stable angina: a systematic review of effectiveness, costs and cost-effectiveness of alternative interventions.
By Sculpher MJ, Petticrew M, Kelland JL, Elliott RA, Holdright DR, Buxton MJ.
-
Detection, adherence and control of hypertension for the prevention of stroke: a systematic review.
By Ebrahim S.
-
Postoperative analgesia and vomiting, with special reference to day-case surgery: a systematic review.
By McQuay HJ, Moore RA.
-
Choosing between randomised and nonrandomised studies: a systematic review.
By Britton A, McKee M, Black N, McPherson K, Sanderson C, Bain C.
-
Evaluating patient-based outcome measures for use in clinical trials.
A review by Fitzpatrick R, Davey C, Buxton MJ, Jones DR.
-
Ethical issues in the design and conduct of randomised controlled trials.
A review by Edwards SJL, Lilford RJ, Braunholtz DA, Jackson JC, Hewison J, Thornton J.
-
Qualitative research methods in health technology assessment: a review of the literature.
By Murphy E, Dingwall R, Greatbatch D, Parker S, Watson P.
-
The costs and benefits of paramedic skills in pre-hospital trauma care.
By Nicholl J, Hughes S, Dixon S, Turner J, Yates D.
-
Systematic review of endoscopic ultrasound in gastro-oesophageal cancer.
By Harris KM, Kelly S, Berry E, Hutton J, Roderick P, Cullingworth J, et al.
-
Systematic reviews of trials and other studies.
By Sutton AJ, Abrams KR, Jones DR, Sheldon TA, Song F.
-
Primary total hip replacement surgery: a systematic review of outcomes and modelling of cost-effectiveness associated with different prostheses.
A review by Fitzpatrick R, Shortall E, Sculpher M, Murray D, Morris R, Lodge M, et al.
-
Informed decision making: an annotated bibliography and systematic review.
By Bekker H, Thornton JG, Airey CM, Connelly JB, Hewison J, Robinson MB, et al.
-
Handling uncertainty when performing economic evaluation of healthcare interventions.
A review by Briggs AH, Gray AM.
-
The role of expectancies in the placebo effect and their use in the delivery of health care: a systematic review.
By Crow R, Gage H, Hampson S, Hart J, Kimber A, Thomas H.
-
A randomised controlled trial of different approaches to universal antenatal HIV testing: uptake and acceptability. Annex: Antenatal HIV testing – assessment of a routine voluntary approach.
By Simpson WM, Johnstone FD, Boyd FM, Goldberg DJ, Hart GJ, Gormley SM, et al.
-
Methods for evaluating area-wide and organisation-based interventions in health and health care: a systematic review.
By Ukoumunne OC, Gulliford MC, Chinn S, Sterne JAC, Burney PGJ.
-
Assessing the costs of healthcare technologies in clinical trials.
A review by Johnston K, Buxton MJ, Jones DR, Fitzpatrick R.
-
Cooperatives and their primary care emergency centres: organisation and impact.
By Hallam L, Henthorne K.
-
Screening for cystic fibrosis.
A review by Murray J, Cuckle H, Taylor G, Littlewood J, Hewison J.
-
A review of the use of health status measures in economic evaluation.
By Brazier J, Deverill M, Green C, Harper R, Booth A.
-
Methods for the analysis of quality-of-life and survival data in health technology assessment.
A review by Billingham LJ, Abrams KR, Jones DR.
-
Antenatal and neonatal haemoglobinopathy screening in the UK: review and economic analysis.
By Zeuner D, Ades AE, Karnon J, Brown J, Dezateux C, Anionwu EN.
-
Assessing the quality of reports of randomised trials: implications for the conduct of meta-analyses.
A review by Moher D, Cook DJ, Jadad AR, Tugwell P, Moher M, Jones A, et al.
-
‘Early warning systems’ for identifying new healthcare technologies.
By Robert G, Stevens A, Gabbay J.
-
A systematic review of the role of human papillomavirus testing within a cervical screening programme.
By Cuzick J, Sasieni P, Davies P, Adams J, Normand C, Frater A, et al.
-
Near patient testing in diabetes clinics: appraising the costs and outcomes.
By Grieve R, Beech R, Vincent J, Mazurkiewicz J.
-
Positron emission tomography: establishing priorities for health technology assessment.
A review by Robert G, Milne R.
-
The debridement of chronic wounds: a systematic review.
By Bradley M, Cullum N, Sheldon T.
-
Systematic reviews of wound care management: (2) Dressings and topical agents used in the healing of chronic wounds.
By Bradley M, Cullum N, Nelson EA, Petticrew M, Sheldon T, Torgerson D.
-
A systematic literature review of spiral and electron beam computed tomography: with particular reference to clinical applications in hepatic lesions, pulmonary embolus and coronary artery disease.
By Berry E, Kelly S, Hutton J, Harris KM, Roderick P, Boyce JC, et al.
-
What role for statins? A review and economic model.
By Ebrahim S, Davey Smith G, McCabe C, Payne N, Pickin M, Sheldon TA, et al.
-
Factors that limit the quality, number and progress of randomised controlled trials.
A review by Prescott RJ, Counsell CE, Gillespie WJ, Grant AM, Russell IT, Kiauka S, et al.
-
Antimicrobial prophylaxis in total hip replacement: a systematic review.
By Glenny AM, Song F.
-
Health promoting schools and health promotion in schools: two systematic reviews.
By Lister-Sharp D, Chapman S, Stewart-Brown S, Sowden A.
-
Economic evaluation of a primary care-based education programme for patients with osteoarthritis of the knee.
A review by Lord J, Victor C, Littlejohns P, Ross FM, Axford JS.
-
The estimation of marginal time preference in a UK-wide sample (TEMPUS) project.
A review by Cairns JA, van der Pol MM.
-
Geriatric rehabilitation following fractures in older people: a systematic review.
By Cameron I, Crotty M, Currie C, Finnegan T, Gillespie L, Gillespie W, et al.
-
Screening for sickle cell disease and thalassaemia: a systematic review with supplementary research.
By Davies SC, Cronin E, Gill M, Greengross P, Hickman M, Normand C.
-
Community provision of hearing aids and related audiology services.
A review by Reeves DJ, Alborz A, Hickson FS, Bamford JM.
-
False-negative results in screening programmes: systematic review of impact and implications.
By Petticrew MP, Sowden AJ, Lister-Sharp D, Wright K.
-
Costs and benefits of community postnatal support workers: a randomised controlled trial.
By Morrell CJ, Spiby H, Stewart P, Walters S, Morgan A.
-
Implantable contraceptives (subdermal implants and hormonally impregnated intrauterine systems) versus other forms of reversible contraceptives: two systematic reviews to assess relative effectiveness, acceptability, tolerability and cost-effectiveness.
By French RS, Cowan FM, Mansour DJA, Morris S, Procter T, Hughes D, et al.
-
An introduction to statistical methods for health technology assessment.
A review by White SJ, Ashby D, Brown PJ.
-
Disease-modifying drugs for multiple sclerosis: a rapid and systematic review.
By Clegg A, Bryant J, Milne R.
-
Publication and related biases.
A review by Song F, Eastwood AJ, Gilbody S, Duley L, Sutton AJ.
-
Cost and outcome implications of the organisation of vascular services.
By Michaels J, Brazier J, Palfreyman S, Shackley P, Slack R.
-
Monitoring blood glucose control in diabetes mellitus: a systematic review.
By Coster S, Gulliford MC, Seed PT, Powrie JK, Swaminathan R.
-
The effectiveness of domiciliary health visiting: a systematic review of international studies and a selective review of the British literature.
By Elkan R, Kendrick D, Hewitt M, Robinson JJA, Tolley K, Blair M, et al.
-
The determinants of screening uptake and interventions for increasing uptake: a systematic review.
By Jepson R, Clegg A, Forbes C, Lewis R, Sowden A, Kleijnen J.
-
The effectiveness and cost-effectiveness of prophylactic removal of wisdom teeth.
A rapid review by Song F, O’Meara S, Wilson P, Golder S, Kleijnen J.
-
Ultrasound screening in pregnancy: a systematic review of the clinical effectiveness, cost-effectiveness and women’s views.
By Bricker L, Garcia J, Henderson J, Mugford M, Neilson J, Roberts T, et al.
-
A rapid and systematic review of the effectiveness and cost-effectiveness of the taxanes used in the treatment of advanced breast and ovarian cancer.
By Lister-Sharp D, McDonagh MS, Khan KS, Kleijnen J.
-
Liquid-based cytology in cervical screening: a rapid and systematic review.
By Payne N, Chilcott J, McGoogan E.
-
Randomised controlled trial of non-directive counselling, cognitive–behaviour therapy and usual general practitioner care in the management of depression as well as mixed anxiety and depression in primary care.
By King M, Sibbald B, Ward E, Bower P, Lloyd M, Gabbay M, et al.
-
Routine referral for radiography of patients presenting with low back pain: is patients’ outcome influenced by GPs’ referral for plain radiography?
By Kerry S, Hilton S, Patel S, Dundas D, Rink E, Lord J.
-
Systematic reviews of wound care management: (3) antimicrobial agents for chronic wounds; (4) diabetic foot ulceration.
By O’Meara S, Cullum N, Majid M, Sheldon T.
-
Using routine data to complement and enhance the results of randomised controlled trials.
By Lewsey JD, Leyland AH, Murray GD, Boddy FA.
-
Coronary artery stents in the treatment of ischaemic heart disease: a rapid and systematic review.
By Meads C, Cummins C, Jolly K, Stevens A, Burls A, Hyde C.
-
Outcome measures for adult critical care: a systematic review.
By Hayes JA, Black NA, Jenkinson C, Young JD, Rowan KM, Daly K, et al.
-
A systematic review to evaluate the effectiveness of interventions to promote the initiation of breastfeeding.
By Fairbank L, O’Meara S, Renfrew MJ, Woolridge M, Sowden AJ, Lister-Sharp D.
-
Implantable cardioverter defibrillators: arrhythmias. A rapid and systematic review.
By Parkes J, Bryant J, Milne R.
-
Treatments for fatigue in multiple sclerosis: a rapid and systematic review.
By Brañas P, Jordan R, Fry-Smith A, Burls A, Hyde C.
-
Early asthma prophylaxis, natural history, skeletal development and economy (EASE): a pilot randomised controlled trial.
By Baxter-Jones ADG, Helms PJ, Russell G, Grant A, Ross S, Cairns JA, et al.
-
Screening for hypercholesterolaemia versus case finding for familial hypercholesterolaemia: a systematic review and cost-effectiveness analysis.
By Marks D, Wonderling D, Thorogood M, Lambert H, Humphries SE, Neil HAW.
-
A rapid and systematic review of the clinical effectiveness and cost-effectiveness of glycoprotein IIb/IIIa antagonists in the medical management of unstable angina.
By McDonagh MS, Bachmann LM, Golder S, Kleijnen J, ter Riet G.
-
A randomised controlled trial of prehospital intravenous fluid replacement therapy in serious trauma.
By Turner J, Nicholl J, Webber L, Cox H, Dixon S, Yates D.
-
Intrathecal pumps for giving opioids in chronic pain: a systematic review.
By Williams JE, Louw G, Towlerton G.
-
Combination therapy (interferon alfa and ribavirin) in the treatment of chronic hepatitis C: a rapid and systematic review.
By Shepherd J, Waugh N, Hewitson P.
-
A systematic review of comparisons of effect sizes derived from randomised and non-randomised studies.
By MacLehose RR, Reeves BC, Harvey IM, Sheldon TA, Russell IT, Black AMS.
-
Intravascular ultrasound-guided interventions in coronary artery disease: a systematic literature review, with decision-analytic modelling, of outcomes and cost-effectiveness.
By Berry E, Kelly S, Hutton J, Lindsay HSJ, Blaxill JM, Evans JA, et al.
-
A randomised controlled trial to evaluate the effectiveness and cost-effectiveness of counselling patients with chronic depression.
By Simpson S, Corney R, Fitzgerald P, Beecham J.
-
Systematic review of treatments for atopic eczema.
By Hoare C, Li Wan Po A, Williams H.
-
Bayesian methods in health technology assessment: a review.
By Spiegelhalter DJ, Myles JP, Jones DR, Abrams KR.
-
The management of dyspepsia: a systematic review.
By Delaney B, Moayyedi P, Deeks J, Innes M, Soo S, Barton P, et al.
-
A systematic review of treatments for severe psoriasis.
By Griffiths CEM, Clark CM, Chalmers RJG, Li Wan Po A, Williams HC.
-
Clinical and cost-effectiveness of donepezil, rivastigmine and galantamine for Alzheimer’s disease: a rapid and systematic review.
By Clegg A, Bryant J, Nicholson T, McIntyre L, De Broe S, Gerard K, et al.
-
The clinical effectiveness and cost-effectiveness of riluzole for motor neurone disease: a rapid and systematic review.
By Stewart A, Sandercock J, Bryan S, Hyde C, Barton PM, Fry-Smith A, et al.
-
Equity and the economic evaluation of healthcare.
By Sassi F, Archard L, Le Grand J.
-
Quality-of-life measures in chronic diseases of childhood.
By Eiser C, Morse R.
-
Eliciting public preferences for healthcare: a systematic review of techniques.
By Ryan M, Scott DA, Reeves C, Bate A, van Teijlingen ER, Russell EM, et al.
-
General health status measures for people with cognitive impairment: learning disability and acquired brain injury.
By Riemsma RP, Forbes CA, Glanville JM, Eastwood AJ, Kleijnen J.
-
An assessment of screening strategies for fragile X syndrome in the UK.
By Pembrey ME, Barnicoat AJ, Carmichael B, Bobrow M, Turner G.
-
Issues in methodological research: perspectives from researchers and commissioners.
By Lilford RJ, Richardson A, Stevens A, Fitzpatrick R, Edwards S, Rock F, et al.
-
Systematic reviews of wound care management: (5) beds; (6) compression; (7) laser therapy, therapeutic ultrasound, electrotherapy and electromagnetic therapy.
By Cullum N, Nelson EA, Flemming K, Sheldon T.
-
Effects of educational and psychosocial interventions for adolescents with diabetes mellitus: a systematic review.
By Hampson SE, Skinner TC, Hart J, Storey L, Gage H, Foxcroft D, et al.
-
Effectiveness of autologous chondrocyte transplantation for hyaline cartilage defects in knees: a rapid and systematic review.
By Jobanputra P, Parry D, Fry-Smith A, Burls A.
-
Statistical assessment of the learning curves of health technologies.
By Ramsay CR, Grant AM, Wallace SA, Garthwaite PH, Monk AF, Russell IT.
-
The effectiveness and cost-effectiveness of temozolomide for the treatment of recurrent malignant glioma: a rapid and systematic review.
By Dinnes J, Cave C, Huang S, Major K, Milne R.
-
A rapid and systematic review of the clinical effectiveness and cost-effectiveness of debriding agents in treating surgical wounds healing by secondary intention.
By Lewis R, Whiting P, ter Riet G, O’Meara S, Glanville J.
-
Home treatment for mental health problems: a systematic review.
By Burns T, Knapp M, Catty J, Healey A, Henderson J, Watt H, et al.
-
How to develop cost-conscious guidelines.
By Eccles M, Mason J.
-
The role of specialist nurses in multiple sclerosis: a rapid and systematic review.
By De Broe S, Christopher F, Waugh N.
-
A rapid and systematic review of the clinical effectiveness and cost-effectiveness of orlistat in the management of obesity.
By O’Meara S, Riemsma R, Shirran L, Mather L, ter Riet G.
-
The clinical effectiveness and cost-effectiveness of pioglitazone for type 2 diabetes mellitus: a rapid and systematic review.
By Chilcott J, Wight J, Lloyd Jones M, Tappenden P.
-
Extended scope of nursing practice: a multicentre randomised controlled trial of appropriately trained nurses and preregistration house officers in preoperative assessment in elective general surgery.
By Kinley H, Czoski-Murray C, George S, McCabe C, Primrose J, Reilly C, et al.
-
Systematic reviews of the effectiveness of day care for people with severe mental disorders: (1) Acute day hospital versus admission; (2) Vocational rehabilitation; (3) Day hospital versus outpatient care.
By Marshall M, Crowther R, Almaraz- Serrano A, Creed F, Sledge W, Kluiter H, et al.
-
The measurement and monitoring of surgical adverse events.
By Bruce J, Russell EM, Mollison J, Krukowski ZH.
-
Action research: a systematic review and guidance for assessment.
By Waterman H, Tillen D, Dickson R, de Koning K.
-
A rapid and systematic review of the clinical effectiveness and cost-effectiveness of gemcitabine for the treatment of pancreatic cancer.
By Ward S, Morris E, Bansback N, Calvert N, Crellin A, Forman D, et al.
-
A rapid and systematic review of the evidence for the clinical effectiveness and cost-effectiveness of irinotecan, oxaliplatin and raltitrexed for the treatment of advanced colorectal cancer.
By Lloyd Jones M, Hummel S, Bansback N, Orr B, Seymour M.
-
Comparison of the effectiveness of inhaler devices in asthma and chronic obstructive airways disease: a systematic review of the literature.
By Brocklebank D, Ram F, Wright J, Barry P, Cates C, Davies L, et al.
-
The cost-effectiveness of magnetic resonance imaging for investigation of the knee joint.
By Bryan S, Weatherburn G, Bungay H, Hatrick C, Salas C, Parry D, et al.
-
A rapid and systematic review of the clinical effectiveness and cost-effectiveness of topotecan for ovarian cancer.
By Forbes C, Shirran L, Bagnall A-M, Duffy S, ter Riet G.
-
Superseded by a report published in a later volume.
-
The role of radiography in primary care patients with low back pain of at least 6 weeks duration: a randomised (unblinded) controlled trial.
By Kendrick D, Fielding K, Bentley E, Miller P, Kerslake R, Pringle M.
-
Design and use of questionnaires: a review of best practice applicable to surveys of health service staff and patients.
By McColl E, Jacoby A, Thomas L, Soutter J, Bamford C, Steen N, et al.
-
A rapid and systematic review of the clinical effectiveness and cost-effectiveness of paclitaxel, docetaxel, gemcitabine and vinorelbine in non-small-cell lung cancer.
By Clegg A, Scott DA, Sidhu M, Hewitson P, Waugh N.
-
Subgroup analyses in randomised controlled trials: quantifying the risks of false-positives and false-negatives.
By Brookes ST, Whitley E, Peters TJ, Mulheran PA, Egger M, Davey Smith G.
-
Depot antipsychotic medication in the treatment of patients with schizophrenia: (1) Meta-review; (2) Patient and nurse attitudes.
By David AS, Adams C.
-
A systematic review of controlled trials of the effectiveness and cost-effectiveness of brief psychological treatments for depression.
By Churchill R, Hunot V, Corney R, Knapp M, McGuire H, Tylee A, et al.
-
Cost analysis of child health surveillance.
By Sanderson D, Wright D, Acton C, Duree D.
-
A study of the methods used to select review criteria for clinical audit.
By Hearnshaw H, Harker R, Cheater F, Baker R, Grimshaw G.
-
Fludarabine as second-line therapy for B cell chronic lymphocytic leukaemia: a technology assessment.
By Hyde C, Wake B, Bryan S, Barton P, Fry-Smith A, Davenport C, et al.
-
Rituximab as third-line treatment for refractory or recurrent Stage III or IV follicular non-Hodgkin’s lymphoma: a systematic review and economic evaluation.
By Wake B, Hyde C, Bryan S, Barton P, Song F, Fry-Smith A, et al.
-
A systematic review of discharge arrangements for older people.
By Parker SG, Peet SM, McPherson A, Cannaby AM, Baker R, Wilson A, et al.
-
The clinical effectiveness and cost-effectiveness of inhaler devices used in the routine management of chronic asthma in older children: a systematic review and economic evaluation.
By Peters J, Stevenson M, Beverley C, Lim J, Smith S.
-
The clinical effectiveness and cost-effectiveness of sibutramine in the management of obesity: a technology assessment.
By O’Meara S, Riemsma R, Shirran L, Mather L, ter Riet G.
-
The cost-effectiveness of magnetic resonance angiography for carotid artery stenosis and peripheral vascular disease: a systematic review.
By Berry E, Kelly S, Westwood ME, Davies LM, Gough MJ, Bamford JM, et al.
-
Promoting physical activity in South Asian Muslim women through ‘exercise on prescription’.
By Carroll B, Ali N, Azam N.
-
Zanamivir for the treatment of influenza in adults: a systematic review and economic evaluation.
By Burls A, Clark W, Stewart T, Preston C, Bryan S, Jefferson T, et al.
-
A review of the natural history and epidemiology of multiple sclerosis: implications for resource allocation and health economic models.
By Richards RG, Sampson FC, Beard SM, Tappenden P.
-
Screening for gestational diabetes: a systematic review and economic evaluation.
By Scott DA, Loveman E, McIntyre L, Waugh N.
-
The clinical effectiveness and cost-effectiveness of surgery for people with morbid obesity: a systematic review and economic evaluation.
By Clegg AJ, Colquitt J, Sidhu MK, Royle P, Loveman E, Walker A.
-
The clinical effectiveness of trastuzumab for breast cancer: a systematic review.
By Lewis R, Bagnall A-M, Forbes C, Shirran E, Duffy S, Kleijnen J, et al.
-
The clinical effectiveness and cost-effectiveness of vinorelbine for breast cancer: a systematic review and economic evaluation.
By Lewis R, Bagnall A-M, King S, Woolacott N, Forbes C, Shirran L, et al.
-
A systematic review of the effectiveness and cost-effectiveness of metal-on-metal hip resurfacing arthroplasty for treatment of hip disease.
By Vale L, Wyness L, McCormack K, McKenzie L, Brazzelli M, Stearns SC.
-
The clinical effectiveness and cost-effectiveness of bupropion and nicotine replacement therapy for smoking cessation: a systematic review and economic evaluation.
By Woolacott NF, Jones L, Forbes CA, Mather LC, Sowden AJ, Song FJ, et al.
-
A systematic review of effectiveness and economic evaluation of new drug treatments for juvenile idiopathic arthritis: etanercept.
By Cummins C, Connock M, Fry-Smith A, Burls A.
-
Clinical effectiveness and cost-effectiveness of growth hormone in children: a systematic review and economic evaluation.
By Bryant J, Cave C, Mihaylova B, Chase D, McIntyre L, Gerard K, et al.
-
Clinical effectiveness and cost-effectiveness of growth hormone in adults in relation to impact on quality of life: a systematic review and economic evaluation.
By Bryant J, Loveman E, Chase D, Mihaylova B, Cave C, Gerard K, et al.
-
Clinical medication review by a pharmacist of patients on repeat prescriptions in general practice: a randomised controlled trial.
By Zermansky AG, Petty DR, Raynor DK, Lowe CJ, Freementle N, Vail A.
-
The effectiveness of infliximab and etanercept for the treatment of rheumatoid arthritis: a systematic review and economic evaluation.
By Jobanputra P, Barton P, Bryan S, Burls A.
-
A systematic review and economic evaluation of computerised cognitive behaviour therapy for depression and anxiety.
By Kaltenthaler E, Shackley P, Stevens K, Beverley C, Parry G, Chilcott J.
-
A systematic review and economic evaluation of pegylated liposomal doxorubicin hydrochloride for ovarian cancer.
By Forbes C, Wilby J, Richardson G, Sculpher M, Mather L, Reimsma R.
-
A systematic review of the effectiveness of interventions based on a stages-of-change approach to promote individual behaviour change.
By Riemsma RP, Pattenden J, Bridle C, Sowden AJ, Mather L, Watt IS, et al.
-
A systematic review update of the clinical effectiveness and cost-effectiveness of glycoprotein IIb/IIIa antagonists.
By Robinson M, Ginnelly L, Sculpher M, Jones L, Riemsma R, Palmer S, et al.
-
A systematic review of the effectiveness, cost-effectiveness and barriers to implementation of thrombolytic and neuroprotective therapy for acute ischaemic stroke in the NHS.
By Sandercock P, Berge E, Dennis M, Forbes J, Hand P, Kwan J, et al.
-
A randomised controlled crossover trial of nurse practitioner versus doctor-led outpatient care in a bronchiectasis clinic.
By Caine N, Sharples LD, Hollingworth W, French J, Keogan M, Exley A, et al.
-
Clinical effectiveness and cost – consequences of selective serotonin reuptake inhibitors in the treatment of sex offenders.
By Adi Y, Ashcroft D, Browne K, Beech A, Fry-Smith A, Hyde C.
-
Treatment of established osteoporosis: a systematic review and cost–utility analysis.
By Kanis JA, Brazier JE, Stevenson M, Calvert NW, Lloyd Jones M.
-
Which anaesthetic agents are cost-effective in day surgery? Literature review, national survey of practice and randomised controlled trial.
By Elliott RA Payne K, Moore JK, Davies LM, Harper NJN, St Leger AS, et al.
-
Screening for hepatitis C among injecting drug users and in genitourinary medicine clinics: systematic reviews of effectiveness, modelling study and national survey of current practice.
By Stein K, Dalziel K, Walker A, McIntyre L, Jenkins B, Horne J, et al.
-
The measurement of satisfaction with healthcare: implications for practice from a systematic review of the literature.
By Crow R, Gage H, Hampson S, Hart J, Kimber A, Storey L, et al.
-
The effectiveness and cost-effectiveness of imatinib in chronic myeloid leukaemia: a systematic review.
By Garside R, Round A, Dalziel K, Stein K, Royle R.
-
A comparative study of hypertonic saline, daily and alternate-day rhDNase in children with cystic fibrosis.
By Suri R, Wallis C, Bush A, Thompson S, Normand C, Flather M, et al.
-
A systematic review of the costs and effectiveness of different models of paediatric home care.
By Parker G, Bhakta P, Lovett CA, Paisley S, Olsen R, Turner D, et al.
-
How important are comprehensive literature searches and the assessment of trial quality in systematic reviews? Empirical study.
By Egger M, Jüni P, Bartlett C, Holenstein F, Sterne J.
-
Systematic review of the effectiveness and cost-effectiveness, and economic evaluation, of home versus hospital or satellite unit haemodialysis for people with end-stage renal failure.
By Mowatt G, Vale L, Perez J, Wyness L, Fraser C, MacLeod A, et al.
-
Systematic review and economic evaluation of the effectiveness of infliximab for the treatment of Crohn’s disease.
By Clark W, Raftery J, Barton P, Song F, Fry-Smith A, Burls A.
-
A review of the clinical effectiveness and cost-effectiveness of routine anti-D prophylaxis for pregnant women who are rhesus negative.
By Chilcott J, Lloyd Jones M, Wight J, Forman K, Wray J, Beverley C, et al.
-
Systematic review and evaluation of the use of tumour markers in paediatric oncology: Ewing’s sarcoma and neuroblastoma.
By Riley RD, Burchill SA, Abrams KR, Heney D, Lambert PC, Jones DR, et al.
-
The cost-effectiveness of screening for Helicobacter pylori to reduce mortality and morbidity from gastric cancer and peptic ulcer disease: a discrete-event simulation model.
By Roderick P, Davies R, Raftery J, Crabbe D, Pearce R, Bhandari P, et al.
-
The clinical effectiveness and cost-effectiveness of routine dental checks: a systematic review and economic evaluation.
By Davenport C, Elley K, Salas C, Taylor-Weetman CL, Fry-Smith A, Bryan S, et al.
-
A multicentre randomised controlled trial assessing the costs and benefits of using structured information and analysis of women’s preferences in the management of menorrhagia.
By Kennedy ADM, Sculpher MJ, Coulter A, Dwyer N, Rees M, Horsley S, et al.
-
Clinical effectiveness and cost–utility of photodynamic therapy for wet age-related macular degeneration: a systematic review and economic evaluation.
By Meads C, Salas C, Roberts T, Moore D, Fry-Smith A, Hyde C.
-
Evaluation of molecular tests for prenatal diagnosis of chromosome abnormalities.
By Grimshaw GM, Szczepura A, Hultén M, MacDonald F, Nevin NC, Sutton F, et al.
-
First and second trimester antenatal screening for Down’s syndrome: the results of the Serum, Urine and Ultrasound Screening Study (SURUSS).
By Wald NJ, Rodeck C, Hackshaw AK, Walters J, Chitty L, Mackinson AM.
-
The effectiveness and cost-effectiveness of ultrasound locating devices for central venous access: a systematic review and economic evaluation.
By Calvert N, Hind D, McWilliams RG, Thomas SM, Beverley C, Davidson A.
-
A systematic review of atypical antipsychotics in schizophrenia.
By Bagnall A-M, Jones L, Lewis R, Ginnelly L, Glanville J, Torgerson D, et al.
-
Prostate Testing for Cancer and Treatment (ProtecT) feasibility study.
By Donovan J, Hamdy F, Neal D, Peters T, Oliver S, Brindle L, et al.
-
Early thrombolysis for the treatment of acute myocardial infarction: a systematic review and economic evaluation.
By Boland A, Dundar Y, Bagust A, Haycox A, Hill R, Mujica Mota R, et al.
-
Screening for fragile X syndrome: a literature review and modelling.
By Song FJ, Barton P, Sleightholme V, Yao GL, Fry-Smith A.
-
Systematic review of endoscopic sinus surgery for nasal polyps.
By Dalziel K, Stein K, Round A, Garside R, Royle P.
-
Towards efficient guidelines: how to monitor guideline use in primary care.
By Hutchinson A, McIntosh A, Cox S, Gilbert C.
-
Effectiveness and cost-effectiveness of acute hospital-based spinal cord injuries services: systematic review.
By Bagnall A-M, Jones L, Richardson G, Duffy S, Riemsma R.
-
Prioritisation of health technology assessment. The PATHS model: methods and case studies.
By Townsend J, Buxton M, Harper G.
-
Systematic review of the clinical effectiveness and cost-effectiveness of tension-free vaginal tape for treatment of urinary stress incontinence.
By Cody J, Wyness L, Wallace S, Glazener C, Kilonzo M, Stearns S, et al.
-
The clinical and cost-effectiveness of patient education models for diabetes: a systematic review and economic evaluation.
By Loveman E, Cave C, Green C, Royle P, Dunn N, Waugh N.
-
The role of modelling in prioritising and planning clinical trials.
By Chilcott J, Brennan A, Booth A, Karnon J, Tappenden P.
-
Cost–benefit evaluation of routine influenza immunisation in people 65–74 years of age.
By Allsup S, Gosney M, Haycox A, Regan M.
-
The clinical and cost-effectiveness of pulsatile machine perfusion versus cold storage of kidneys for transplantation retrieved from heart-beating and non-heart-beating donors.
By Wight J, Chilcott J, Holmes M, Brewer N.
-
Can randomised trials rely on existing electronic data? A feasibility study to explore the value of routine data in health technology assessment.
By Williams JG, Cheung WY, Cohen DR, Hutchings HA, Longo MF, Russell IT.
-
Evaluating non-randomised intervention studies.
By Deeks JJ, Dinnes J, D’Amico R, Sowden AJ, Sakarovitch C, Song F, et al.
-
A randomised controlled trial to assess the impact of a package comprising a patient-orientated, evidence-based self- help guidebook and patient-centred consultations on disease management and satisfaction in inflammatory bowel disease.
By Kennedy A, Nelson E, Reeves D, Richardson G, Roberts C, Robinson A, et al.
-
The effectiveness of diagnostic tests for the assessment of shoulder pain due to soft tissue disorders: a systematic review.
By Dinnes J, Loveman E, McIntyre L, Waugh N.
-
The value of digital imaging in diabetic retinopathy.
By Sharp PF, Olson J, Strachan F, Hipwell J, Ludbrook A, O’Donnell M, et al.
-
Lowering blood pressure to prevent myocardial infarction and stroke: a new preventive strategy.
By Law M, Wald N, Morris J.
-
Clinical and cost-effectiveness of capecitabine and tegafur with uracil for the treatment of metastatic colorectal cancer: systematic review and economic evaluation.
By Ward S, Kaltenthaler E, Cowan J, Brewer N.
-
Clinical and cost-effectiveness of new and emerging technologies for early localised prostate cancer: a systematic review.
By Hummel S, Paisley S, Morgan A, Currie E, Brewer N.
-
Literature searching for clinical and cost-effectiveness studies used in health technology assessment reports carried out for the National Institute for Clinical Excellence appraisal system.
By Royle P, Waugh N.
-
Systematic review and economic decision modelling for the prevention and treatment of influenza A and B.
By Turner D, Wailoo A, Nicholson K, Cooper N, Sutton A, Abrams K.
-
A randomised controlled trial to evaluate the clinical and cost-effectiveness of Hickman line insertions in adult cancer patients by nurses.
By Boland A, Haycox A, Bagust A, Fitzsimmons L.
-
Redesigning postnatal care: a randomised controlled trial of protocol-based midwifery-led care focused on individual women’s physical and psychological health needs.
By MacArthur C, Winter HR, Bick DE, Lilford RJ, Lancashire RJ, Knowles H, et al.
-
Estimating implied rates of discount in healthcare decision-making.
By West RR, McNabb R, Thompson AGH, Sheldon TA, Grimley Evans J.
-
Systematic review of isolation policies in the hospital management of methicillin-resistant Staphylococcus aureus: a review of the literature with epidemiological and economic modelling.
By Cooper BS, Stone SP, Kibbler CC, Cookson BD, Roberts JA, Medley GF, et al.
-
Treatments for spasticity and pain in multiple sclerosis: a systematic review.
By Beard S, Hunn A, Wight J.
-
The inclusion of reports of randomised trials published in languages other than English in systematic reviews.
By Moher D, Pham B, Lawson ML, Klassen TP.
-
The impact of screening on future health-promoting behaviours and health beliefs: a systematic review.
By Bankhead CR, Brett J, Bukach C, Webster P, Stewart-Brown S, Munafo M, et al.
-
What is the best imaging strategy for acute stroke?
By Wardlaw JM, Keir SL, Seymour J, Lewis S, Sandercock PAG, Dennis MS, et al.
-
Systematic review and modelling of the investigation of acute and chronic chest pain presenting in primary care.
By Mant J, McManus RJ, Oakes RAL, Delaney BC, Barton PM, Deeks JJ, et al.
-
The effectiveness and cost-effectiveness of microwave and thermal balloon endometrial ablation for heavy menstrual bleeding: a systematic review and economic modelling.
By Garside R, Stein K, Wyatt K, Round A, Price A.
-
A systematic review of the role of bisphosphonates in metastatic disease.
By Ross JR, Saunders Y, Edmonds PM, Patel S, Wonderling D, Normand C, et al.
-
Systematic review of the clinical effectiveness and cost-effectiveness of capecitabine (Xeloda®) for locally advanced and/or metastatic breast cancer.
By Jones L, Hawkins N, Westwood M, Wright K, Richardson G, Riemsma R.
-
Effectiveness and efficiency of guideline dissemination and implementation strategies.
By Grimshaw JM, Thomas RE, MacLennan G, Fraser C, Ramsay CR, Vale L, et al.
-
Clinical effectiveness and costs of the Sugarbaker procedure for the treatment of pseudomyxoma peritonei.
By Bryant J, Clegg AJ, Sidhu MK, Brodin H, Royle P, Davidson P.
-
Psychological treatment for insomnia in the regulation of long-term hypnotic drug use.
By Morgan K, Dixon S, Mathers N, Thompson J, Tomeny M.
-
Improving the evaluation of therapeutic interventions in multiple sclerosis: development of a patient-based measure of outcome.
By Hobart JC, Riazi A, Lamping DL, Fitzpatrick R, Thompson AJ.
-
A systematic review and economic evaluation of magnetic resonance cholangiopancreatography compared with diagnostic endoscopic retrograde cholangiopancreatography.
By Kaltenthaler E, Bravo Vergel Y, Chilcott J, Thomas S, Blakeborough T, Walters SJ, et al.
-
The use of modelling to evaluate new drugs for patients with a chronic condition: the case of antibodies against tumour necrosis factor in rheumatoid arthritis.
By Barton P, Jobanputra P, Wilson J, Bryan S, Burls A.
-
Clinical effectiveness and cost-effectiveness of neonatal screening for inborn errors of metabolism using tandem mass spectrometry: a systematic review.
By Pandor A, Eastham J, Beverley C, Chilcott J, Paisley S.
-
Clinical effectiveness and cost-effectiveness of pioglitazone and rosiglitazone in the treatment of type 2 diabetes: a systematic review and economic evaluation.
By Czoski-Murray C, Warren E, Chilcott J, Beverley C, Psyllaki MA, Cowan J.
-
Routine examination of the newborn: the EMREN study. Evaluation of an extension of the midwife role including a randomised controlled trial of appropriately trained midwives and paediatric senior house officers.
By Townsend J, Wolke D, Hayes J, Davé S, Rogers C, Bloomfield L, et al.
-
Involving consumers in research and development agenda setting for the NHS: developing an evidence-based approach.
By Oliver S, Clarke-Jones L, Rees R, Milne R, Buchanan P, Gabbay J, et al.
-
A multi-centre randomised controlled trial of minimally invasive direct coronary bypass grafting versus percutaneous transluminal coronary angioplasty with stenting for proximal stenosis of the left anterior descending coronary artery.
By Reeves BC, Angelini GD, Bryan AJ, Taylor FC, Cripps T, Spyt TJ, et al.
-
Does early magnetic resonance imaging influence management or improve outcome in patients referred to secondary care with low back pain? A pragmatic randomised controlled trial.
By Gilbert FJ, Grant AM, Gillan MGC, Vale L, Scott NW, Campbell MK, et al.
-
The clinical and cost-effectiveness of anakinra for the treatment of rheumatoid arthritis in adults: a systematic review and economic analysis.
By Clark W, Jobanputra P, Barton P, Burls A.
-
A rapid and systematic review and economic evaluation of the clinical and cost-effectiveness of newer drugs for treatment of mania associated with bipolar affective disorder.
By Bridle C, Palmer S, Bagnall A-M, Darba J, Duffy S, Sculpher M, et al.
-
Liquid-based cytology in cervical screening: an updated rapid and systematic review and economic analysis.
By Karnon J, Peters J, Platt J, Chilcott J, McGoogan E, Brewer N.
-
Systematic review of the long-term effects and economic consequences of treatments for obesity and implications for health improvement.
By Avenell A, Broom J, Brown TJ, Poobalan A, Aucott L, Stearns SC, et al.
-
Autoantibody testing in children with newly diagnosed type 1 diabetes mellitus.
By Dretzke J, Cummins C, Sandercock J, Fry-Smith A, Barrett T, Burls A.
-
Clinical effectiveness and cost-effectiveness of prehospital intravenous fluids in trauma patients.
By Dretzke J, Sandercock J, Bayliss S, Burls A.
-
Newer hypnotic drugs for the short-term management of insomnia: a systematic review and economic evaluation.
By Dündar Y, Boland A, Strobl J, Dodd S, Haycox A, Bagust A, et al.
-
Development and validation of methods for assessing the quality of diagnostic accuracy studies.
By Whiting P, Rutjes AWS, Dinnes J, Reitsma JB, Bossuyt PMM, Kleijnen J.
-
EVALUATE hysterectomy trial: a multicentre randomised trial comparing abdominal, vaginal and laparoscopic methods of hysterectomy.
By Garry R, Fountain J, Brown J, Manca A, Mason S, Sculpher M, et al.
-
Methods for expected value of information analysis in complex health economic models: developments on the health economics of interferon-β and glatiramer acetate for multiple sclerosis.
By Tappenden P, Chilcott JB, Eggington S, Oakley J, McCabe C.
-
Effectiveness and cost-effectiveness of imatinib for first-line treatment of chronic myeloid leukaemia in chronic phase: a systematic review and economic analysis.
By Dalziel K, Round A, Stein K, Garside R, Price A.
-
VenUS I: a randomised controlled trial of two types of bandage for treating venous leg ulcers.
By Iglesias C, Nelson EA, Cullum NA, Torgerson DJ, on behalf of the VenUS Team.
-
Systematic review of the effectiveness and cost-effectiveness, and economic evaluation, of myocardial perfusion scintigraphy for the diagnosis and management of angina and myocardial infarction.
By Mowatt G, Vale L, Brazzelli M, Hernandez R, Murray A, Scott N, et al.
-
A pilot study on the use of decision theory and value of information analysis as part of the NHS Health Technology Assessment programme.
By Claxton K, Ginnelly L, Sculpher M, Philips Z, Palmer S.
-
The Social Support and Family Health Study: a randomised controlled trial and economic evaluation of two alternative forms of postnatal support for mothers living in disadvantaged inner-city areas.
By Wiggins M, Oakley A, Roberts I, Turner H, Rajan L, Austerberry H, et al.
-
Psychosocial aspects of genetic screening of pregnant women and newborns: a systematic review.
By Green JM, Hewison J, Bekker HL, Bryant, Cuckle HS.
-
Evaluation of abnormal uterine bleeding: comparison of three outpatient procedures within cohorts defined by age and menopausal status.
By Critchley HOD, Warner P, Lee AJ, Brechin S, Guise J, Graham B.
-
Coronary artery stents: a rapid systematic review and economic evaluation.
By Hill R, Bagust A, Bakhai A, Dickson R, Dündar Y, Haycox A, et al.
-
Review of guidelines for good practice in decision-analytic modelling in health technology assessment.
By Philips Z, Ginnelly L, Sculpher M, Claxton K, Golder S, Riemsma R, et al.
-
Rituximab (MabThera®) for aggressive non-Hodgkin’s lymphoma: systematic review and economic evaluation.
By Knight C, Hind D, Brewer N, Abbott V.
-
Clinical effectiveness and cost-effectiveness of clopidogrel and modified-release dipyridamole in the secondary prevention of occlusive vascular events: a systematic review and economic evaluation.
By Jones L, Griffin S, Palmer S, Main C, Orton V, Sculpher M, et al.
-
Pegylated interferon α-2a and -2b in combination with ribavirin in the treatment of chronic hepatitis C: a systematic review and economic evaluation.
By Shepherd J, Brodin H, Cave C, Waugh N, Price A, Gabbay J.
-
Clopidogrel used in combination with aspirin compared with aspirin alone in the treatment of non-ST-segment- elevation acute coronary syndromes: a systematic review and economic evaluation.
By Main C, Palmer S, Griffin S, Jones L, Orton V, Sculpher M, et al.
-
Provision, uptake and cost of cardiac rehabilitation programmes: improving services to under-represented groups.
By Beswick AD, Rees K, Griebsch I, Taylor FC, Burke M, West RR, et al.
-
Involving South Asian patients in clinical trials.
By Hussain-Gambles M, Leese B, Atkin K, Brown J, Mason S, Tovey P.
-
Clinical and cost-effectiveness of continuous subcutaneous insulin infusion for diabetes.
By Colquitt JL, Green C, Sidhu MK, Hartwell D, Waugh N.
-
Identification and assessment of ongoing trials in health technology assessment reviews.
By Song FJ, Fry-Smith A, Davenport C, Bayliss S, Adi Y, Wilson JS, et al.
-
Systematic review and economic evaluation of a long-acting insulin analogue, insulin glargine
By Warren E, Weatherley-Jones E, Chilcott J, Beverley C.
-
Supplementation of a home-based exercise programme with a class-based programme for people with osteoarthritis of the knees: a randomised controlled trial and health economic analysis.
By McCarthy CJ, Mills PM, Pullen R, Richardson G, Hawkins N, Roberts CR, et al.
-
Clinical and cost-effectiveness of once-daily versus more frequent use of same potency topical corticosteroids for atopic eczema: a systematic review and economic evaluation.
By Green C, Colquitt JL, Kirby J, Davidson P, Payne E.
-
Acupuncture of chronic headache disorders in primary care: randomised controlled trial and economic analysis.
By Vickers AJ, Rees RW, Zollman CE, McCarney R, Smith CM, Ellis N, et al.
-
Generalisability in economic evaluation studies in healthcare: a review and case studies.
By Sculpher MJ, Pang FS, Manca A, Drummond MF, Golder S, Urdahl H, et al.
-
Virtual outreach: a randomised controlled trial and economic evaluation of joint teleconferenced medical consultations.
By Wallace P, Barber J, Clayton W, Currell R, Fleming K, Garner P, et al.
-
Randomised controlled multiple treatment comparison to provide a cost-effectiveness rationale for the selection of antimicrobial therapy in acne.
By Ozolins M, Eady EA, Avery A, Cunliffe WJ, O’Neill C, Simpson NB, et al.
-
Do the findings of case series studies vary significantly according to methodological characteristics?
By Dalziel K, Round A, Stein K, Garside R, Castelnuovo E, Payne L.
-
Improving the referral process for familial breast cancer genetic counselling: findings of three randomised controlled trials of two interventions.
By Wilson BJ, Torrance N, Mollison J, Wordsworth S, Gray JR, Haites NE, et al.
-
Randomised evaluation of alternative electrosurgical modalities to treat bladder outflow obstruction in men with benign prostatic hyperplasia.
By Fowler C, McAllister W, Plail R, Karim O, Yang Q.
-
A pragmatic randomised controlled trial of the cost-effectiveness of palliative therapies for patients with inoperable oesophageal cancer.
By Shenfine J, McNamee P, Steen N, Bond J, Griffin SM.
-
Impact of computer-aided detection prompts on the sensitivity and specificity of screening mammography.
By Taylor P, Champness J, Given- Wilson R, Johnston K, Potts H.
-
Issues in data monitoring and interim analysis of trials.
By Grant AM, Altman DG, Babiker AB, Campbell MK, Clemens FJ, Darbyshire JH, et al.
-
Lay public’s understanding of equipoise and randomisation in randomised controlled trials.
By Robinson EJ, Kerr CEP, Stevens AJ, Lilford RJ, Braunholtz DA, Edwards SJ, et al.
-
Clinical and cost-effectiveness of electroconvulsive therapy for depressive illness, schizophrenia, catatonia and mania: systematic reviews and economic modelling studies.
By Greenhalgh J, Knight C, Hind D, Beverley C, Walters S.
-
Measurement of health-related quality of life for people with dementia: development of a new instrument (DEMQOL) and an evaluation of current methodology.
By Smith SC, Lamping DL, Banerjee S, Harwood R, Foley B, Smith P, et al.
-
Clinical effectiveness and cost-effectiveness of drotrecogin alfa (activated) (Xigris®) for the treatment of severe sepsis in adults: a systematic review and economic evaluation.
By Green C, Dinnes J, Takeda A, Shepherd J, Hartwell D, Cave C, et al.
-
A methodological review of how heterogeneity has been examined in systematic reviews of diagnostic test accuracy.
By Dinnes J, Deeks J, Kirby J, Roderick P.
-
Cervical screening programmes: can automation help? Evidence from systematic reviews, an economic analysis and a simulation modelling exercise applied to the UK.
By Willis BH, Barton P, Pearmain P, Bryan S, Hyde C.
-
Laparoscopic surgery for inguinal hernia repair: systematic review of effectiveness and economic evaluation.
By McCormack K, Wake B, Perez J, Fraser C, Cook J, McIntosh E, et al.
-
Clinical effectiveness, tolerability and cost-effectiveness of newer drugs for epilepsy in adults: a systematic review and economic evaluation.
By Wilby J, Kainth A, Hawkins N, Epstein D, McIntosh H, McDaid C, et al.
-
A randomised controlled trial to compare the cost-effectiveness of tricyclic antidepressants, selective serotonin reuptake inhibitors and lofepramine.
By Peveler R, Kendrick T, Buxton M, Longworth L, Baldwin D, Moore M, et al.
-
Clinical effectiveness and cost-effectiveness of immediate angioplasty for acute myocardial infarction: systematic review and economic evaluation.
By Hartwell D, Colquitt J, Loveman E, Clegg AJ, Brodin H, Waugh N, et al.
-
A randomised controlled comparison of alternative strategies in stroke care.
By Kalra L, Evans A, Perez I, Knapp M, Swift C, Donaldson N.
-
The investigation and analysis of critical incidents and adverse events in healthcare.
By Woloshynowych M, Rogers S, Taylor-Adams S, Vincent C.
-
Potential use of routine databases in health technology assessment.
By Raftery J, Roderick P, Stevens A.
-
Clinical and cost-effectiveness of newer immunosuppressive regimens in renal transplantation: a systematic review and modelling study.
By Woodroffe R, Yao GL, Meads C, Bayliss S, Ready A, Raftery J, et al.
-
A systematic review and economic evaluation of alendronate, etidronate, risedronate, raloxifene and teriparatide for the prevention and treatment of postmenopausal osteoporosis.
By Stevenson M, Lloyd Jones M, De Nigris E, Brewer N, Davis S, Oakley J.
-
A systematic review to examine the impact of psycho-educational interventions on health outcomes and costs in adults and children with difficult asthma.
By Smith JR, Mugford M, Holland R, Candy B, Noble MJ, Harrison BDW, et al.
-
An evaluation of the costs, effectiveness and quality of renal replacement therapy provision in renal satellite units in England and Wales.
By Roderick P, Nicholson T, Armitage A, Mehta R, Mullee M, Gerard K, et al.
-
Imatinib for the treatment of patients with unresectable and/or metastatic gastrointestinal stromal tumours: systematic review and economic evaluation.
By Wilson J, Connock M, Song F, Yao G, Fry-Smith A, Raftery J, et al.
-
Indirect comparisons of competing interventions.
By Glenny AM, Altman DG, Song F, Sakarovitch C, Deeks JJ, D’Amico R, et al.
-
Cost-effectiveness of alternative strategies for the initial medical management of non-ST elevation acute coronary syndrome: systematic review and decision-analytical modelling.
By Robinson M, Palmer S, Sculpher M, Philips Z, Ginnelly L, Bowens A, et al.
-
Outcomes of electrically stimulated gracilis neosphincter surgery.
By Tillin T, Chambers M, Feldman R.
-
The effectiveness and cost-effectiveness of pimecrolimus and tacrolimus for atopic eczema: a systematic review and economic evaluation.
By Garside R, Stein K, Castelnuovo E, Pitt M, Ashcroft D, Dimmock P, et al.
-
Systematic review on urine albumin testing for early detection of diabetic complications.
By Newman DJ, Mattock MB, Dawnay ABS, Kerry S, McGuire A, Yaqoob M, et al.
-
Randomised controlled trial of the cost-effectiveness of water-based therapy for lower limb osteoarthritis.
By Cochrane T, Davey RC, Matthes Edwards SM.
-
Longer term clinical and economic benefits of offering acupuncture care to patients with chronic low back pain.
By Thomas KJ, MacPherson H, Ratcliffe J, Thorpe L, Brazier J, Campbell M, et al.
-
Cost-effectiveness and safety of epidural steroids in the management of sciatica.
By Price C, Arden N, Coglan L, Rogers P.
-
The British Rheumatoid Outcome Study Group (BROSG) randomised controlled trial to compare the effectiveness and cost-effectiveness of aggressive versus symptomatic therapy in established rheumatoid arthritis.
By Symmons D, Tricker K, Roberts C, Davies L, Dawes P, Scott DL.
-
Conceptual framework and systematic review of the effects of participants’ and professionals’ preferences in randomised controlled trials.
By King M, Nazareth I, Lampe F, Bower P, Chandler M, Morou M, et al.
-
The clinical and cost-effectiveness of implantable cardioverter defibrillators: a systematic review.
By Bryant J, Brodin H, Loveman E, Payne E, Clegg A.
-
A trial of problem-solving by community mental health nurses for anxiety, depression and life difficulties among general practice patients. The CPN-GP study.
By Kendrick T, Simons L, Mynors-Wallis L, Gray A, Lathlean J, Pickering R, et al.
-
The causes and effects of socio-demographic exclusions from clinical trials.
By Bartlett C, Doyal L, Ebrahim S, Davey P, Bachmann M, Egger M, et al.
-
Is hydrotherapy cost-effective? A randomised controlled trial of combined hydrotherapy programmes compared with physiotherapy land techniques in children with juvenile idiopathic arthritis.
By Epps H, Ginnelly L, Utley M, Southwood T, Gallivan S, Sculpher M, et al.
-
A randomised controlled trial and cost-effectiveness study of systematic screening (targeted and total population screening) versus routine practice for the detection of atrial fibrillation in people aged 65 and over. The SAFE study.
By Hobbs FDR, Fitzmaurice DA, Mant J, Murray E, Jowett S, Bryan S, et al.
-
Displaced intracapsular hip fractures in fit, older people: a randomised comparison of reduction and fixation, bipolar hemiarthroplasty and total hip arthroplasty.
By Keating JF, Grant A, Masson M, Scott NW, Forbes JF.
-
Long-term outcome of cognitive behaviour therapy clinical trials in central Scotland.
By Durham RC, Chambers JA, Power KG, Sharp DM, Macdonald RR, Major KA, et al.
-
The effectiveness and cost-effectiveness of dual-chamber pacemakers compared with single-chamber pacemakers for bradycardia due to atrioventricular block or sick sinus syndrome: systematic review and economic evaluation.
By Castelnuovo E, Stein K, Pitt M, Garside R, Payne E.
-
Newborn screening for congenital heart defects: a systematic review and cost-effectiveness analysis.
By Knowles R, Griebsch I, Dezateux C, Brown J, Bull C, Wren C.
-
The clinical and cost-effectiveness of left ventricular assist devices for end-stage heart failure: a systematic review and economic evaluation.
By Clegg AJ, Scott DA, Loveman E, Colquitt J, Hutchinson J, Royle P, et al.
-
The effectiveness of the Heidelberg Retina Tomograph and laser diagnostic glaucoma scanning system (GDx) in detecting and monitoring glaucoma.
By Kwartz AJ, Henson DB, Harper RA, Spencer AF, McLeod D.
-
Clinical and cost-effectiveness of autologous chondrocyte implantation for cartilage defects in knee joints: systematic review and economic evaluation.
By Clar C, Cummins E, McIntyre L, Thomas S, Lamb J, Bain L, et al.
-
Systematic review of effectiveness of different treatments for childhood retinoblastoma.
By McDaid C, Hartley S, Bagnall A-M, Ritchie G, Light K, Riemsma R.
-
Towards evidence-based guidelines for the prevention of venous thromboembolism: systematic reviews of mechanical methods, oral anticoagulation, dextran and regional anaesthesia as thromboprophylaxis.
By Roderick P, Ferris G, Wilson K, Halls H, Jackson D, Collins R, et al.
-
The effectiveness and cost-effectiveness of parent training/education programmes for the treatment of conduct disorder, including oppositional defiant disorder, in children.
By Dretzke J, Frew E, Davenport C, Barlow J, Stewart-Brown S, Sandercock J, et al.
-
The clinical and cost-effectiveness of donepezil, rivastigmine, galantamine and memantine for Alzheimer’s disease.
By Loveman E, Green C, Kirby J, Takeda A, Picot J, Payne E, et al.
-
FOOD: a multicentre randomised trial evaluating feeding policies in patients admitted to hospital with a recent stroke.
By Dennis M, Lewis S, Cranswick G, Forbes J.
-
The clinical effectiveness and cost-effectiveness of computed tomography screening for lung cancer: systematic reviews.
By Black C, Bagust A, Boland A, Walker S, McLeod C, De Verteuil R, et al.
-
A systematic review of the effectiveness and cost-effectiveness of neuroimaging assessments used to visualise the seizure focus in people with refractory epilepsy being considered for surgery.
By Whiting P, Gupta R, Burch J, Mujica Mota RE, Wright K, Marson A, et al.
-
Comparison of conference abstracts and presentations with full-text articles in the health technology assessments of rapidly evolving technologies.
By Dundar Y, Dodd S, Dickson R, Walley T, Haycox A, Williamson PR.
-
Systematic review and evaluation of methods of assessing urinary incontinence.
By Martin JL, Williams KS, Abrams KR, Turner DA, Sutton AJ, Chapple C, et al.
-
The clinical effectiveness and cost-effectiveness of newer drugs for children with epilepsy. A systematic review.
By Connock M, Frew E, Evans B-W, Bryan S, Cummins C, Fry-Smith A, et al.
-
Surveillance of Barrett’s oesophagus: exploring the uncertainty through systematic review, expert workshop and economic modelling.
By Garside R, Pitt M, Somerville M, Stein K, Price A, Gilbert N.
-
Topotecan, pegylated liposomal doxorubicin hydrochloride and paclitaxel for second-line or subsequent treatment of advanced ovarian cancer: a systematic review and economic evaluation.
By Main C, Bojke L, Griffin S, Norman G, Barbieri M, Mather L, et al.
-
Evaluation of molecular techniques in prediction and diagnosis of cytomegalovirus disease in immunocompromised patients.
By Szczepura A, Westmoreland D, Vinogradova Y, Fox J, Clark M.
-
Screening for thrombophilia in high-risk situations: systematic review and cost-effectiveness analysis. The Thrombosis: Risk and Economic Assessment of Thrombophilia Screening (TREATS) study.
By Wu O, Robertson L, Twaddle S, Lowe GDO, Clark P, Greaves M, et al.
-
A series of systematic reviews to inform a decision analysis for sampling and treating infected diabetic foot ulcers.
By Nelson EA, O’Meara S, Craig D, Iglesias C, Golder S, Dalton J, et al.
-
Randomised clinical trial, observational study and assessment of cost-effectiveness of the treatment of varicose veins (REACTIV trial).
By Michaels JA, Campbell WB, Brazier JE, MacIntyre JB, Palfreyman SJ, Ratcliffe J, et al.
-
The cost-effectiveness of screening for oral cancer in primary care.
By Speight PM, Palmer S, Moles DR, Downer MC, Smith DH, Henriksson M, et al.
-
Measurement of the clinical and cost-effectiveness of non-invasive diagnostic testing strategies for deep vein thrombosis.
By Goodacre S, Sampson F, Stevenson M, Wailoo A, Sutton A, Thomas S, et al.
-
Systematic review of the effectiveness and cost-effectiveness of HealOzone® for the treatment of occlusal pit/fissure caries and root caries.
By Brazzelli M, McKenzie L, Fielding S, Fraser C, Clarkson J, Kilonzo M, et al.
-
Randomised controlled trials of conventional antipsychotic versus new atypical drugs, and new atypical drugs versus clozapine, in people with schizophrenia responding poorly to, or intolerant of, current drug treatment.
By Lewis SW, Davies L, Jones PB, Barnes TRE, Murray RM, Kerwin R, et al.
-
Diagnostic tests and algorithms used in the investigation of haematuria: systematic reviews and economic evaluation.
By Rodgers M, Nixon J, Hempel S, Aho T, Kelly J, Neal D, et al.
-
Cognitive behavioural therapy in addition to antispasmodic therapy for irritable bowel syndrome in primary care: randomised controlled trial.
By Kennedy TM, Chalder T, McCrone P, Darnley S, Knapp M, Jones RH, et al.
-
A systematic review of the clinical effectiveness and cost-effectiveness of enzyme replacement therapies for Fabry’s disease and mucopolysaccharidosis type 1.
By Connock M, Juarez-Garcia A, Frew E, Mans A, Dretzke J, Fry-Smith A, et al.
-
Health benefits of antiviral therapy for mild chronic hepatitis C: randomised controlled trial and economic evaluation.
By Wright M, Grieve R, Roberts J, Main J, Thomas HC, on behalf of the UK Mild Hepatitis C Trial Investigators.
-
Pressure relieving support surfaces: a randomised evaluation.
By Nixon J, Nelson EA, Cranny G, Iglesias CP, Hawkins K, Cullum NA, et al.
-
A systematic review and economic model of the effectiveness and cost-effectiveness of methylphenidate, dexamfetamine and atomoxetine for the treatment of attention deficit hyperactivity disorder in children and adolescents.
By King S, Griffin S, Hodges Z, Weatherly H, Asseburg C, Richardson G, et al.
-
The clinical effectiveness and cost-effectiveness of enzyme replacement therapy for Gaucher’s disease: a systematic review.
By Connock M, Burls A, Frew E, Fry-Smith A, Juarez-Garcia A, McCabe C, et al.
-
Effectiveness and cost-effectiveness of salicylic acid and cryotherapy for cutaneous warts. An economic decision model.
By Thomas KS, Keogh-Brown MR, Chalmers JR, Fordham RJ, Holland RC, Armstrong SJ, et al.
-
A systematic literature review of the effectiveness of non-pharmacological interventions to prevent wandering in dementia and evaluation of the ethical implications and acceptability of their use.
By Robinson L, Hutchings D, Corner L, Beyer F, Dickinson H, Vanoli A, et al.
-
A review of the evidence on the effects and costs of implantable cardioverter defibrillator therapy in different patient groups, and modelling of cost-effectiveness and cost–utility for these groups in a UK context.
By Buxton M, Caine N, Chase D, Connelly D, Grace A, Jackson C, et al.
-
Adefovir dipivoxil and pegylated interferon alfa-2a for the treatment of chronic hepatitis B: a systematic review and economic evaluation.
By Shepherd J, Jones J, Takeda A, Davidson P, Price A.
-
An evaluation of the clinical and cost-effectiveness of pulmonary artery catheters in patient management in intensive care: a systematic review and a randomised controlled trial.
By Harvey S, Stevens K, Harrison D, Young D, Brampton W, McCabe C, et al.
-
Accurate, practical and cost-effective assessment of carotid stenosis in the UK.
By Wardlaw JM, Chappell FM, Stevenson M, De Nigris E, Thomas S, Gillard J, et al.
-
Etanercept and infliximab for the treatment of psoriatic arthritis: a systematic review and economic evaluation.
By Woolacott N, Bravo Vergel Y, Hawkins N, Kainth A, Khadjesari Z, Misso K, et al.
-
The cost-effectiveness of testing for hepatitis C in former injecting drug users.
By Castelnuovo E, Thompson-Coon J, Pitt M, Cramp M, Siebert U, Price A, et al.
-
Computerised cognitive behaviour therapy for depression and anxiety update: a systematic review and economic evaluation.
By Kaltenthaler E, Brazier J, De Nigris E, Tumur I, Ferriter M, Beverley C, et al.
-
Cost-effectiveness of using prognostic information to select women with breast cancer for adjuvant systemic therapy.
By Williams C, Brunskill S, Altman D, Briggs A, Campbell H, Clarke M, et al.
-
Psychological therapies including dialectical behaviour therapy for borderline personality disorder: a systematic review and preliminary economic evaluation.
By Brazier J, Tumur I, Holmes M, Ferriter M, Parry G, Dent-Brown K, et al.
-
Clinical effectiveness and cost-effectiveness of tests for the diagnosis and investigation of urinary tract infection in children: a systematic review and economic model.
By Whiting P, Westwood M, Bojke L, Palmer S, Richardson G, Cooper J, et al.
-
Cognitive behavioural therapy in chronic fatigue syndrome: a randomised controlled trial of an outpatient group programme.
By O’Dowd H, Gladwell P, Rogers CA, Hollinghurst S, Gregory A.
-
A comparison of the cost-effectiveness of five strategies for the prevention of nonsteroidal anti-inflammatory drug-induced gastrointestinal toxicity: a systematic review with economic modelling.
By Brown TJ, Hooper L, Elliott RA, Payne K, Webb R, Roberts C, et al.
-
The effectiveness and cost-effectiveness of computed tomography screening for coronary artery disease: systematic review.
By Waugh N, Black C, Walker S, McIntyre L, Cummins E, Hillis G.
-
What are the clinical outcome and cost-effectiveness of endoscopy undertaken by nurses when compared with doctors? A Multi-Institution Nurse Endoscopy Trial (MINuET).
By Williams J, Russell I, Durai D, Cheung W-Y, Farrin A, Bloor K, et al.
-
The clinical and cost-effectiveness of oxaliplatin and capecitabine for the adjuvant treatment of colon cancer: systematic review and economic evaluation.
By Pandor A, Eggington S, Paisley S, Tappenden P, Sutcliffe P.
-
A systematic review of the effectiveness of adalimumab, etanercept and infliximab for the treatment of rheumatoid arthritis in adults and an economic evaluation of their cost-effectiveness.
By Chen Y-F, Jobanputra P, Barton P, Jowett S, Bryan S, Clark W, et al.
-
Telemedicine in dermatology: a randomised controlled trial.
By Bowns IR, Collins K, Walters SJ, McDonagh AJG.
-
Cost-effectiveness of cell salvage and alternative methods of minimising perioperative allogeneic blood transfusion: a systematic review and economic model.
By Davies L, Brown TJ, Haynes S, Payne K, Elliott RA, McCollum C.
-
Clinical effectiveness and cost-effectiveness of laparoscopic surgery for colorectal cancer: systematic reviews and economic evaluation.
By Murray A, Lourenco T, de Verteuil R, Hernandez R, Fraser C, McKinley A, et al.
-
Etanercept and efalizumab for the treatment of psoriasis: a systematic review.
By Woolacott N, Hawkins N, Mason A, Kainth A, Khadjesari Z, Bravo Vergel Y, et al.
-
Systematic reviews of clinical decision tools for acute abdominal pain.
By Liu JLY, Wyatt JC, Deeks JJ, Clamp S, Keen J, Verde P, et al.
-
Evaluation of the ventricular assist device programme in the UK.
By Sharples L, Buxton M, Caine N, Cafferty F, Demiris N, Dyer M, et al.
-
A systematic review and economic model of the clinical and cost-effectiveness of immunosuppressive therapy for renal transplantation in children.
By Yao G, Albon E, Adi Y, Milford D, Bayliss S, Ready A, et al.
-
Amniocentesis results: investigation of anxiety. The ARIA trial.
By Hewison J, Nixon J, Fountain J, Cocks K, Jones C, Mason G, et al.
-
Pemetrexed disodium for the treatment of malignant pleural mesothelioma: a systematic review and economic evaluation.
By Dundar Y, Bagust A, Dickson R, Dodd S, Green J, Haycox A, et al.
-
A systematic review and economic model of the clinical effectiveness and cost-effectiveness of docetaxel in combination with prednisone or prednisolone for the treatment of hormone-refractory metastatic prostate cancer.
By Collins R, Fenwick E, Trowman R, Perard R, Norman G, Light K, et al.
-
A systematic review of rapid diagnostic tests for the detection of tuberculosis infection.
By Dinnes J, Deeks J, Kunst H, Gibson A, Cummins E, Waugh N, et al.
-
The clinical effectiveness and cost-effectiveness of strontium ranelate for the prevention of osteoporotic fragility fractures in postmenopausal women.
By Stevenson M, Davis S, Lloyd-Jones M, Beverley C.
-
A systematic review of quantitative and qualitative research on the role and effectiveness of written information available to patients about individual medicines.
By Raynor DK, Blenkinsopp A, Knapp P, Grime J, Nicolson DJ, Pollock K, et al.
-
Oral naltrexone as a treatment for relapse prevention in formerly opioid-dependent drug users: a systematic review and economic evaluation.
By Adi Y, Juarez-Garcia A, Wang D, Jowett S, Frew E, Day E, et al.
-
Glucocorticoid-induced osteoporosis: a systematic review and cost–utility analysis.
By Kanis JA, Stevenson M, McCloskey EV, Davis S, Lloyd-Jones M.
-
Epidemiological, social, diagnostic and economic evaluation of population screening for genital chlamydial infection.
By Low N, McCarthy A, Macleod J, Salisbury C, Campbell R, Roberts TE, et al.
-
Methadone and buprenorphine for the management of opioid dependence: a systematic review and economic evaluation.
By Connock M, Juarez-Garcia A, Jowett S, Frew E, Liu Z, Taylor RJ, et al.
-
Exercise Evaluation Randomised Trial (EXERT): a randomised trial comparing GP referral for leisure centre-based exercise, community-based walking and advice only.
By Isaacs AJ, Critchley JA, See Tai S, Buckingham K, Westley D, Harridge SDR, et al.
-
Interferon alfa (pegylated and non-pegylated) and ribavirin for the treatment of mild chronic hepatitis C: a systematic review and economic evaluation.
By Shepherd J, Jones J, Hartwell D, Davidson P, Price A, Waugh N.
-
Systematic review and economic evaluation of bevacizumab and cetuximab for the treatment of metastatic colorectal cancer.
By Tappenden P, Jones R, Paisley S, Carroll C.
-
A systematic review and economic evaluation of epoetin alfa, epoetin beta and darbepoetin alfa in anaemia associated with cancer, especially that attributable to cancer treatment.
By Wilson J, Yao GL, Raftery J, Bohlius J, Brunskill S, Sandercock J, et al.
-
A systematic review and economic evaluation of statins for the prevention of coronary events.
By Ward S, Lloyd Jones M, Pandor A, Holmes M, Ara R, Ryan A, et al.
-
A systematic review of the effectiveness and cost-effectiveness of different models of community-based respite care for frail older people and their carers.
By Mason A, Weatherly H, Spilsbury K, Arksey H, Golder S, Adamson J, et al.
-
Additional therapy for young children with spastic cerebral palsy: a randomised controlled trial.
By Weindling AM, Cunningham CC, Glenn SM, Edwards RT, Reeves DJ.
-
Screening for type 2 diabetes: literature review and economic modelling.
By Waugh N, Scotland G, McNamee P, Gillett M, Brennan A, Goyder E, et al.
-
The effectiveness and cost-effectiveness of cinacalcet for secondary hyperparathyroidism in end-stage renal disease patients on dialysis: a systematic review and economic evaluation.
By Garside R, Pitt M, Anderson R, Mealing S, Roome C, Snaith A, et al.
-
The clinical effectiveness and cost-effectiveness of gemcitabine for metastatic breast cancer: a systematic review and economic evaluation.
By Takeda AL, Jones J, Loveman E, Tan SC, Clegg AJ.
-
A systematic review of duplex ultrasound, magnetic resonance angiography and computed tomography angiography for the diagnosis and assessment of symptomatic, lower limb peripheral arterial disease.
By Collins R, Cranny G, Burch J, Aguiar-Ibáñez R, Craig D, Wright K, et al.
-
The clinical effectiveness and cost-effectiveness of treatments for children with idiopathic steroid-resistant nephrotic syndrome: a systematic review.
By Colquitt JL, Kirby J, Green C, Cooper K, Trompeter RS.
-
A systematic review of the routine monitoring of growth in children of primary school age to identify growth-related conditions.
By Fayter D, Nixon J, Hartley S, Rithalia A, Butler G, Rudolf M, et al.
-
Systematic review of the effectiveness of preventing and treating Staphylococcus aureus carriage in reducing peritoneal catheter-related infections.
By McCormack K, Rabindranath K, Kilonzo M, Vale L, Fraser C, McIntyre L, et al.
-
The clinical effectiveness and cost of repetitive transcranial magnetic stimulation versus electroconvulsive therapy in severe depression: a multicentre pragmatic randomised controlled trial and economic analysis.
By McLoughlin DM, Mogg A, Eranti S, Pluck G, Purvis R, Edwards D, et al.
-
A randomised controlled trial and economic evaluation of direct versus indirect and individual versus group modes of speech and language therapy for children with primary language impairment.
By Boyle J, McCartney E, Forbes J, O’Hare A.
-
Hormonal therapies for early breast cancer: systematic review and economic evaluation.
By Hind D, Ward S, De Nigris E, Simpson E, Carroll C, Wyld L.
-
Cardioprotection against the toxic effects of anthracyclines given to children with cancer: a systematic review.
By Bryant J, Picot J, Levitt G, Sullivan I, Baxter L, Clegg A.
-
Adalimumab, etanercept and infliximab for the treatment of ankylosing spondylitis: a systematic review and economic evaluation.
By McLeod C, Bagust A, Boland A, Dagenais P, Dickson R, Dundar Y, et al.
-
Prenatal screening and treatment strategies to prevent group B streptococcal and other bacterial infections in early infancy: cost-effectiveness and expected value of information analyses.
By Colbourn T, Asseburg C, Bojke L, Philips Z, Claxton K, Ades AE, et al.
-
Clinical effectiveness and cost-effectiveness of bone morphogenetic proteins in the non-healing of fractures and spinal fusion: a systematic review.
By Garrison KR, Donell S, Ryder J, Shemilt I, Mugford M, Harvey I, et al.
-
A randomised controlled trial of postoperative radiotherapy following breast-conserving surgery in a minimum-risk older population. The PRIME trial.
By Prescott RJ, Kunkler IH, Williams LJ, King CC, Jack W, van der Pol M, et al.
-
Current practice, accuracy, effectiveness and cost-effectiveness of the school entry hearing screen.
By Bamford J, Fortnum H, Bristow K, Smith J, Vamvakas G, Davies L, et al.
-
The clinical effectiveness and cost-effectiveness of inhaled insulin in diabetes mellitus: a systematic review and economic evaluation.
By Black C, Cummins E, Royle P, Philip S, Waugh N.
-
Surveillance of cirrhosis for hepatocellular carcinoma: systematic review and economic analysis.
By Thompson Coon J, Rogers G, Hewson P, Wright D, Anderson R, Cramp M, et al.
-
The Birmingham Rehabilitation Uptake Maximisation Study (BRUM). Homebased compared with hospital-based cardiac rehabilitation in a multi-ethnic population: cost-effectiveness and patient adherence.
By Jolly K, Taylor R, Lip GYH, Greenfield S, Raftery J, Mant J, et al.
-
A systematic review of the clinical, public health and cost-effectiveness of rapid diagnostic tests for the detection and identification of bacterial intestinal pathogens in faeces and food.
By Abubakar I, Irvine L, Aldus CF, Wyatt GM, Fordham R, Schelenz S, et al.
-
A randomised controlled trial examining the longer-term outcomes of standard versus new antiepileptic drugs. The SANAD trial.
By Marson AG, Appleton R, Baker GA, Chadwick DW, Doughty J, Eaton B, et al.
-
Clinical effectiveness and cost-effectiveness of different models of managing long-term oral anti-coagulation therapy: a systematic review and economic modelling.
By Connock M, Stevens C, Fry-Smith A, Jowett S, Fitzmaurice D, Moore D, et al.
-
A systematic review and economic model of the clinical effectiveness and cost-effectiveness of interventions for preventing relapse in people with bipolar disorder.
By Soares-Weiser K, Bravo Vergel Y, Beynon S, Dunn G, Barbieri M, Duffy S, et al.
-
Taxanes for the adjuvant treatment of early breast cancer: systematic review and economic evaluation.
By Ward S, Simpson E, Davis S, Hind D, Rees A, Wilkinson A.
-
The clinical effectiveness and cost-effectiveness of screening for open angle glaucoma: a systematic review and economic evaluation.
By Burr JM, Mowatt G, Hernández R, Siddiqui MAR, Cook J, Lourenco T, et al.
-
Acceptability, benefit and costs of early screening for hearing disability: a study of potential screening tests and models.
By Davis A, Smith P, Ferguson M, Stephens D, Gianopoulos I.
-
Contamination in trials of educational interventions.
By Keogh-Brown MR, Bachmann MO, Shepstone L, Hewitt C, Howe A, Ramsay CR, et al.
-
Overview of the clinical effectiveness of positron emission tomography imaging in selected cancers.
By Facey K, Bradbury I, Laking G, Payne E.
-
The effectiveness and cost-effectiveness of carmustine implants and temozolomide for the treatment of newly diagnosed high-grade glioma: a systematic review and economic evaluation.
By Garside R, Pitt M, Anderson R, Rogers G, Dyer M, Mealing S, et al.
-
Drug-eluting stents: a systematic review and economic evaluation.
By Hill RA, Boland A, Dickson R, Dündar Y, Haycox A, McLeod C, et al.
-
The clinical effectiveness and cost-effectiveness of cardiac resynchronisation (biventricular pacing) for heart failure: systematic review and economic model.
By Fox M, Mealing S, Anderson R, Dean J, Stein K, Price A, et al.
-
Recruitment to randomised trials: strategies for trial enrolment and participation study. The STEPS study.
By Campbell MK, Snowdon C, Francis D, Elbourne D, McDonald AM, Knight R, et al.
-
Cost-effectiveness of functional cardiac testing in the diagnosis and management of coronary artery disease: a randomised controlled trial. The CECaT trial.
By Sharples L, Hughes V, Crean A, Dyer M, Buxton M, Goldsmith K, et al.
-
Evaluation of diagnostic tests when there is no gold standard. A review of methods.
By Rutjes AWS, Reitsma JB, Coomarasamy A, Khan KS, Bossuyt PMM.
-
Systematic reviews of the clinical effectiveness and cost-effectiveness of proton pump inhibitors in acute upper gastrointestinal bleeding.
By Leontiadis GI, Sreedharan A, Dorward S, Barton P, Delaney B, Howden CW, et al.
-
A review and critique of modelling in prioritising and designing screening programmes.
By Karnon J, Goyder E, Tappenden P, McPhie S, Towers I, Brazier J, et al.
-
An assessment of the impact of the NHS Health Technology Assessment Programme.
By Hanney S, Buxton M, Green C, Coulson D, Raftery J.
-
A systematic review and economic model of switching from nonglycopeptide to glycopeptide antibiotic prophylaxis for surgery.
By Cranny G, Elliott R, Weatherly H, Chambers D, Hawkins N, Myers L, et al.
-
‘Cut down to quit’ with nicotine replacement therapies in smoking cessation: a systematic review of effectiveness and economic analysis.
By Wang D, Connock M, Barton P, Fry-Smith A, Aveyard P, Moore D.
-
A systematic review of the effectiveness of strategies for reducing fracture risk in children with juvenile idiopathic arthritis with additional data on long-term risk of fracture and cost of disease management.
By Thornton J, Ashcroft D, O’Neill T, Elliott R, Adams J, Roberts C, et al.
-
Does befriending by trained lay workers improve psychological well-being and quality of life for carers of people with dementia, and at what cost? A randomised controlled trial.
By Charlesworth G, Shepstone L, Wilson E, Thalanany M, Mugford M, Poland F.
-
A multi-centre retrospective cohort study comparing the efficacy, safety and cost-effectiveness of hysterectomy and uterine artery embolisation for the treatment of symptomatic uterine fibroids. The HOPEFUL study.
By Hirst A, Dutton S, Wu O, Briggs A, Edwards C, Waldenmaier L, et al.
-
Methods of prediction and prevention of pre-eclampsia: systematic reviews of accuracy and effectiveness literature with economic modelling.
By Meads CA, Cnossen JS, Meher S, Juarez-Garcia A, ter Riet G, Duley L, et al.
-
The use of economic evaluations in NHS decision-making: a review and empirical investigation.
By Williams I, McIver S, Moore D, Bryan S.
-
Stapled haemorrhoidectomy (haemorrhoidopexy) for the treatment of haemorrhoids: a systematic review and economic evaluation.
By Burch J, Epstein D, Baba-Akbari A, Weatherly H, Fox D, Golder S, et al.
-
The clinical effectiveness of diabetes education models for Type 2 diabetes: a systematic review.
By Loveman E, Frampton GK, Clegg AJ.
-
Payment to healthcare professionals for patient recruitment to trials: systematic review and qualitative study.
By Raftery J, Bryant J, Powell J, Kerr C, Hawker S.
-
Cyclooxygenase-2 selective non-steroidal anti-inflammatory drugs (etodolac, meloxicam, celecoxib, rofecoxib, etoricoxib, valdecoxib and lumiracoxib) for osteoarthritis and rheumatoid arthritis: a systematic review and economic evaluation.
By Chen Y-F, Jobanputra P, Barton P, Bryan S, Fry-Smith A, Harris G, et al.
-
The clinical effectiveness and cost-effectiveness of central venous catheters treated with anti-infective agents in preventing bloodstream infections: a systematic review and economic evaluation.
By Hockenhull JC, Dwan K, Boland A, Smith G, Bagust A, Dundar Y, et al.
-
Stepped treatment of older adults on laxatives. The STOOL trial.
By Mihaylov S, Stark C, McColl E, Steen N, Vanoli A, Rubin G, et al.
-
A randomised controlled trial of cognitive behaviour therapy in adolescents with major depression treated by selective serotonin reuptake inhibitors. The ADAPT trial.
By Goodyer IM, Dubicka B, Wilkinson P, Kelvin R, Roberts C, Byford S, et al.
-
The use of irinotecan, oxaliplatin and raltitrexed for the treatment of advanced colorectal cancer: systematic review and economic evaluation.
By Hind D, Tappenden P, Tumur I, Eggington E, Sutcliffe P, Ryan A.
-
Ranibizumab and pegaptanib for the treatment of age-related macular degeneration: a systematic review and economic evaluation.
By Colquitt JL, Jones J, Tan SC, Takeda A, Clegg AJ, Price A.
-
Systematic review of the clinical effectiveness and cost-effectiveness of 64-slice or higher computed tomography angiography as an alternative to invasive coronary angiography in the investigation of coronary artery disease.
By Mowatt G, Cummins E, Waugh N, Walker S, Cook J, Jia X, et al.
-
Structural neuroimaging in psychosis: a systematic review and economic evaluation.
By Albon E, Tsourapas A, Frew E, Davenport C, Oyebode F, Bayliss S, et al.
-
Systematic review and economic analysis of the comparative effectiveness of different inhaled corticosteroids and their usage with long-acting beta2 agonists for the treatment of chronic asthma in adults and children aged 12 years and over.
By Shepherd J, Rogers G, Anderson R, Main C, Thompson-Coon J, Hartwell D, et al.
-
Systematic review and economic analysis of the comparative effectiveness of different inhaled corticosteroids and their usage with long-acting beta2 agonists for the treatment of chronic asthma in children under the age of 12 years.
By Main C, Shepherd J, Anderson R, Rogers G, Thompson-Coon J, Liu Z, et al.
-
Ezetimibe for the treatment of hypercholesterolaemia: a systematic review and economic evaluation.
By Ara R, Tumur I, Pandor A, Duenas A, Williams R, Wilkinson A, et al.
-
Topical or oral ibuprofen for chronic knee pain in older people. The TOIB study.
By Underwood M, Ashby D, Carnes D, Castelnuovo E, Cross P, Harding G, et al.
-
A prospective randomised comparison of minor surgery in primary and secondary care. The MiSTIC trial.
By George S, Pockney P, Primrose J, Smith H, Little P, Kinley H, et al.
-
A review and critical appraisal of measures of therapist–patient interactions in mental health settings.
By Cahill J, Barkham M, Hardy G, Gilbody S, Richards D, Bower P, et al.
-
The clinical effectiveness and cost-effectiveness of screening programmes for amblyopia and strabismus in children up to the age of 4–5 years: a systematic review and economic evaluation.
By Carlton J, Karnon J, Czoski-Murray C, Smith KJ, Marr J.
-
A systematic review of the clinical effectiveness and cost-effectiveness and economic modelling of minimal incision total hip replacement approaches in the management of arthritic disease of the hip.
By de Verteuil R, Imamura M, Zhu S, Glazener C, Fraser C, Munro N, et al.
-
A preliminary model-based assessment of the cost–utility of a screening programme for early age-related macular degeneration.
By Karnon J, Czoski-Murray C, Smith K, Brand C, Chakravarthy U, Davis S, et al.
-
Intravenous magnesium sulphate and sotalol for prevention of atrial fibrillation after coronary artery bypass surgery: a systematic review and economic evaluation.
By Shepherd J, Jones J, Frampton GK, Tanajewski L, Turner D, Price A.
-
Absorbent products for urinary/faecal incontinence: a comparative evaluation of key product categories.
By Fader M, Cottenden A, Getliffe K, Gage H, Clarke-O’Neill S, Jamieson K, et al.
-
A systematic review of repetitive functional task practice with modelling of resource use, costs and effectiveness.
By French B, Leathley M, Sutton C, McAdam J, Thomas L, Forster A, et al.
-
The effectiveness and cost-effectivness of minimal access surgery amongst people with gastro-oesophageal reflux disease – a UK collaborative study. The reflux trial.
By Grant A, Wileman S, Ramsay C, Bojke L, Epstein D, Sculpher M, et al.
-
Time to full publication of studies of anti-cancer medicines for breast cancer and the potential for publication bias: a short systematic review.
By Takeda A, Loveman E, Harris P, Hartwell D, Welch K.
-
Performance of screening tests for child physical abuse in accident and emergency departments.
By Woodman J, Pitt M, Wentz R, Taylor B, Hodes D, Gilbert RE.
-
Curative catheter ablation in atrial fibrillation and typical atrial flutter: systematic review and economic evaluation.
By Rodgers M, McKenna C, Palmer S, Chambers D, Van Hout S, Golder S, et al.
-
Systematic review and economic modelling of effectiveness and cost utility of surgical treatments for men with benign prostatic enlargement.
By Lourenco T, Armstrong N, N’Dow J, Nabi G, Deverill M, Pickard R, et al.
-
Immunoprophylaxis against respiratory syncytial virus (RSV) with palivizumab in children: a systematic review and economic evaluation.
By Wang D, Cummins C, Bayliss S, Sandercock J, Burls A.
-
Deferasirox for the treatment of iron overload associated with regular blood transfusions (transfusional haemosiderosis) in patients suffering with chronic anaemia: a systematic review and economic evaluation.
By McLeod C, Fleeman N, Kirkham J, Bagust A, Boland A, Chu P, et al.
-
Thrombophilia testing in people with venous thromboembolism: systematic review and cost-effectiveness analysis.
By Simpson EL, Stevenson MD, Rawdin A, Papaioannou D.
-
Surgical procedures and non-surgical devices for the management of non-apnoeic snoring: a systematic review of clinical effects and associated treatment costs.
By Main C, Liu Z, Welch K, Weiner G, Quentin Jones S, Stein K.
-
Continuous positive airway pressure devices for the treatment of obstructive sleep apnoea–hypopnoea syndrome: a systematic review and economic analysis.
By McDaid C, Griffin S, Weatherly H, Durée K, van der Burgt M, van Hout S, Akers J, et al.
-
Use of classical and novel biomarkers as prognostic risk factors for localised prostate cancer: a systematic review.
By Sutcliffe P, Hummel S, Simpson E, Young T, Rees A, Wilkinson A, et al.
-
The harmful health effects of recreational ecstasy: a systematic review of observational evidence.
By Rogers G, Elston J, Garside R, Roome C, Taylor R, Younger P, et al.
-
Systematic review of the clinical effectiveness and cost-effectiveness of oesophageal Doppler monitoring in critically ill and high-risk surgical patients.
By Mowatt G, Houston G, Hernández R, de Verteuil R, Fraser C, Cuthbertson B, et al.
-
The use of surrogate outcomes in model-based cost-effectiveness analyses: a survey of UK Health Technology Assessment reports.
By Taylor RS, Elston J.
-
Controlling Hypertension and Hypotension Immediately Post Stroke (CHHIPS) – a randomised controlled trial.
By Potter J, Mistri A, Brodie F, Chernova J, Wilson E, Jagger C, et al.
-
Routine antenatal anti-D prophylaxis for RhD-negative women: a systematic review and economic evaluation.
By Pilgrim H, Lloyd-Jones M, Rees A.
-
Amantadine, oseltamivir and zanamivir for the prophylaxis of influenza (including a review of existing guidance no. 67): a systematic review and economic evaluation.
By Tappenden P, Jackson R, Cooper K, Rees A, Simpson E, Read R, et al.
-
Improving the evaluation of therapeutic interventions in multiple sclerosis: the role of new psychometric methods.
By Hobart J, Cano S.
-
Treatment of severe ankle sprain: a pragmatic randomised controlled trial comparing the clinical effectiveness and cost-effectiveness of three types of mechanical ankle support with tubular bandage. The CAST trial.
By Cooke MW, Marsh JL, Clark M, Nakash R, Jarvis RM, Hutton JL, et al. , on behalf of the CAST trial group.
-
Non-occupational postexposure prophylaxis for HIV: a systematic review.
By Bryant J, Baxter L, Hird S.
-
Blood glucose self-monitoring in type 2 diabetes: a randomised controlled trial.
By Farmer AJ, Wade AN, French DP, Simon J, Yudkin P, Gray A, et al.
-
How far does screening women for domestic (partner) violence in different health-care settings meet criteria for a screening programme? Systematic reviews of nine UK National Screening Committee criteria.
By Feder G, Ramsay J, Dunne D, Rose M, Arsene C, Norman R, et al.
-
Spinal cord stimulation for chronic pain of neuropathic or ischaemic origin: systematic review and economic evaluation.
By Simpson, EL, Duenas A, Holmes MW, Papaioannou D, Chilcott J.
-
The role of magnetic resonance imaging in the identification of suspected acoustic neuroma: a systematic review of clinical and costeffectiveness and natural history.
By Fortnum H, O’Neill C, Taylor R, Lenthall R, Nikolopoulos T, Lightfoot G, et al.
-
Dipsticks and diagnostic algorithms in urinary tract infection: development and validation, randomised trial, economic analysis, observational cohort and qualitative study.
By Little P, Turner S, Rumsby K, Warner G, Moore M, Lowes JA, et al.
-
Systematic review of respite care in the frail elderly.
By Shaw C, McNamara R, Abrams K, Cannings-John R, Hood K, Longo M, et al.
-
Neuroleptics in the treatment of aggressive challenging behaviour for people with intellectual disabilities: a randomised controlled trial (NACHBID).
By Tyrer P, Oliver-Africano P, Romeo R, Knapp M, Dickens S, Bouras N, et al.
-
Randomised controlled trial to determine the clinical effectiveness and cost-effectiveness of selective serotonin reuptake inhibitors plus supportive care, versus supportive care alone, for mild to moderate depression with somatic symptoms in primary care: the THREAD (THREshold for AntiDepressant response) study.
By Kendrick T, Chatwin J, Dowrick C, Tylee A, Morriss R, Peveler R, et al.
-
Diagnostic strategies using DNA testing for hereditary haemochromatosis in at-risk populations: a systematic review and economic evaluation.
By Bryant J, Cooper K, Picot J, Clegg A, Roderick P, Rosenberg W, et al.
Health Technology Assessment programme
-
Director, NIHR HTA programme, Professor of Clinical Pharmacology, University of Liverpool
-
Director, Medical Care Research Unit, University of Sheffield
Prioritisation Strategy Group
-
Director, NIHR HTA programme, Professor of Clinical Pharmacology, University of Liverpool
-
Director, Medical Care Research Unit, University of Sheffield
-
Dr Bob Coates, Consultant Advisor, NETSCC, HTA
-
Dr Andrew Cook, Consultant Advisor, NETSCC, HTA
-
Dr Peter Davidson, Director of Science Support, NETSCC, HTA
-
Professor Robin E Ferner, Consultant Physician and Director, West Midlands Centre for Adverse Drug Reactions, City Hospital NHS Trust, Birmingham
-
Professor Paul Glasziou, Professor of Evidence-Based Medicine, University of Oxford
-
Dr Nick Hicks, Director of NHS Support, NETSCC, HTA
-
Dr Edmund Jessop, Medical Adviser, National Specialist, National Commissioning Group (NCG), Department of Health, London
-
Ms Lynn Kerridge, Chief Executive Officer, NETSCC and NETSCC, HTA
-
Dr Ruairidh Milne, Director of Strategy and Development, NETSCC
-
Ms Kay Pattison, Section Head, NHS R&D Programme, Department of Health
-
Ms Pamela Young, Specialist Programme Manager, NETSCC, HTA
HTA Commissioning Board
-
Director, NIHR HTA programme, Professor of Clinical Pharmacology, University of Liverpool
-
Director, Medical Care Research Unit, University of Sheffield
-
Senior Lecturer in General Practice, Department of Primary Health Care, University of Oxford
-
Professor Ann Ashburn, Professor of Rehabilitation and Head of Research, Southampton General Hospital
-
Professor Deborah Ashby, Professor of Medical Statistics, Queen Mary, University of London
-
Professor John Cairns, Professor of Health Economics, London School of Hygiene and Tropical Medicine
-
Professor Peter Croft, Director of Primary Care Sciences Research Centre, Keele University
-
Professor Nicky Cullum, Director of Centre for Evidence-Based Nursing, University of York
-
Professor Jenny Donovan, Professor of Social Medicine, University of Bristol
-
Professor Steve Halligan, Professor of Gastrointestinal Radiology, University College Hospital, London
-
Professor Freddie Hamdy, Professor of Urology, University of Sheffield
-
Professor Allan House, Professor of Liaison Psychiatry, University of Leeds
-
Dr Martin J Landray, Reader in Epidemiology, Honorary Consultant Physician, Clinical Trial Service Unit, University of Oxford?
-
Professor Stuart Logan, Director of Health & Social Care Research, The Peninsula Medical School, Universities of Exeter and Plymouth
-
Dr Rafael Perera, Lecturer in Medical Statisitics, Department of Primary Health Care, Univeristy of Oxford
-
Professor Ian Roberts, Professor of Epidemiology & Public Health, London School of Hygiene and Tropical Medicine
-
Professor Mark Sculpher, Professor of Health Economics, University of York
-
Professor Helen Smith, Professor of Primary Care, University of Brighton
-
Professor Kate Thomas, Professor of Complementary & Alternative Medicine Research, University of Leeds
-
Professor David John Torgerson, Director of York Trials Unit, University of York
-
Professor Hywel Williams, Professor of Dermato-Epidemiology, University of Nottingham
-
Ms Kay Pattison, Section Head, NHS R&D Programmes, Research and Development Directorate, Department of Health
-
Dr Morven Roberts, Clinical Trials Manager, Medical Research Council
Diagnostic Technologies & Screening Panel
-
Professor of Evidence-Based Medicine, University of Oxford
-
Consultant Paediatrician and Honorary Senior Lecturer, Great Ormond Street Hospital, London
-
Professor Judith E Adams, Consultant Radiologist, Manchester Royal Infirmary, Central Manchester & Manchester Children’s University Hospitals NHS Trust, and Professor of Diagnostic Radiology, Imaging Science and Biomedical Engineering, Cancer & Imaging Sciences, University of Manchester
-
Ms Jane Bates, Consultant Ultrasound Practitioner, Ultrasound Department, Leeds Teaching Hospital NHS Trust
-
Dr Stephanie Dancer, Consultant Microbiologist, Hairmyres Hospital, East Kilbride
-
Professor Glyn Elwyn, Primary Medical Care Research Group, Swansea Clinical School, University of Wales
-
Dr Ron Gray, Consultant Clinical Epidemiologist, Department of Public Health, University of Oxford
-
Professor Paul D Griffiths, Professor of Radiology, University of Sheffield
-
Dr Jennifer J Kurinczuk, Consultant Clinical Epidemiologist, National Perinatal Epidemiology Unit, Oxford
-
Dr Susanne M Ludgate, Medical Director, Medicines & Healthcare Products Regulatory Agency, London
-
Dr Anne Mackie, Director of Programmes, UK National Screening Committee
-
Dr Michael Millar, Consultant Senior Lecturer in Microbiology, Barts and The London NHS Trust, Royal London Hospital
-
Mr Stephen Pilling, Director, Centre for Outcomes, Research & Effectiveness, Joint Director, National Collaborating Centre for Mental Health, University College London
-
Mrs Una Rennard, Service User Representative
-
Dr Phil Shackley, Senior Lecturer in Health Economics, School of Population and Health Sciences, University of Newcastle upon Tyne
-
Dr W Stuart A Smellie, Consultant in Chemical Pathology, Bishop Auckland General Hospital
-
Dr Nicholas Summerton, Consultant Clinical and Public Health Advisor, NICE
-
Ms Dawn Talbot, Service User Representative
-
Dr Graham Taylor, Scientific Advisor, Regional DNA Laboratory, St James’s University Hospital, Leeds
-
Professor Lindsay Wilson Turnbull, Scientific Director of the Centre for Magnetic Resonance Investigations and YCR Professor of Radiology, Hull Royal Infirmary
-
Dr Tim Elliott, Team Leader, Cancer Screening, Department of Health
-
Dr Catherine Moody, Programme Manager, Neuroscience and Mental Health Board
-
Dr Ursula Wells, Principal Research Officer, Department of Health
Pharmaceuticals Panel
-
Consultant Physician and Director, West Midlands Centre for Adverse Drug Reactions, City Hospital NHS Trust, Birmingham
-
Professor in Child Health, University of Nottingham
-
Mrs Nicola Carey, Senior Research Fellow, School of Health and Social Care, The University of Reading
-
Mr John Chapman, Service User Representative
-
Dr Peter Elton, Director of Public Health, Bury Primary Care Trust
-
Dr Ben Goldacre, Research Fellow, Division of Psychological Medicine and Psychiatry, King’s College London
-
Mrs Barbara Greggains, Service User Representative
-
Dr Bill Gutteridge, Medical Adviser, London Strategic Health Authority
-
Dr Dyfrig Hughes, Reader in Pharmacoeconomics and Deputy Director, Centre for Economics and Policy in Health, IMSCaR, Bangor University
-
Professor Jonathan Ledermann, Professor of Medical Oncology and Director of the Cancer Research UK and University College London Cancer Trials Centre
-
Dr Yoon K Loke, Senior Lecturer in Clinical Pharmacology, University of East Anglia
-
Professor Femi Oyebode, Consultant Psychiatrist and Head of Department, University of Birmingham
-
Dr Andrew Prentice, Senior Lecturer and Consultant Obstetrician and Gynaecologist, The Rosie Hospital, University of Cambridge
-
Dr Martin Shelly, General Practitioner, Leeds, and Associate Director, NHS Clinical Governance Support Team, Leicester
-
Dr Gillian Shepherd, Director, Health and Clinical Excellence, Merck Serono Ltd
-
Mrs Katrina Simister, Assistant Director New Medicines, National Prescribing Centre, Liverpool
-
Mr David Symes, Service User Representative
-
Dr Lesley Wise, Unit Manager, Pharmacoepidemiology Research Unit, VRMM, Medicines & Healthcare Products Regulatory Agency
-
Ms Kay Pattison, Section Head, NHS R&D Programme, Department of Health
-
Mr Simon Reeve, Head of Clinical and Cost-Effectiveness, Medicines, Pharmacy and Industry Group, Department of Health
-
Dr Heike Weber, Programme Manager, Medical Research Council
-
Dr Ursula Wells, Principal Research Officer, Department of Health
Therapeutic Procedures Panel
-
Consultant Physician, North Bristol NHS Trust
-
Professor of Psychiatry, Division of Health in the Community, University of Warwick, Coventry
-
Professor Jane Barlow, Professor of Public Health in the Early Years, Health Sciences Research Institute, Warwick Medical School, Coventry
-
Ms Maree Barnett, Acting Branch Head of Vascular Programme, Department of Health
-
Mrs Val Carlill, Service User Representative
-
Mrs Anthea De Barton-Watson, Service User Representative
-
Mr Mark Emberton, Senior Lecturer in Oncological Urology, Institute of Urology, University College Hospital, London
-
Professor Steve Goodacre, Professor of Emergency Medicine, University of Sheffield
-
Professor Christopher Griffiths, Professor of Primary Care, Barts and The London School of Medicine and Dentistry
-
Mr Paul Hilton, Consultant Gynaecologist and Urogynaecologist, Royal Victoria Infirmary, Newcastle upon Tyne
-
Professor Nicholas James, Professor of Clinical Oncology, University of Birmingham, and Consultant in Clinical Oncology, Queen Elizabeth Hospital
-
Dr Peter Martin, Consultant Neurologist, Addenbrooke’s Hospital, Cambridge
-
Dr Kate Radford, Senior Lecturer (Research), Clinical Practice Research Unit, University of Central Lancashire, Preston
-
Mr Jim Reece Service User Representative
-
Dr Karen Roberts, Nurse Consultant, Dunston Hill Hospital Cottages
-
Dr Phillip Leech, Principal Medical Officer for Primary Care, Department of Health
-
Ms Kay Pattison, Section Head, NHS R&D Programme, Department of Health
-
Dr Morven Roberts, Clinical Trials Manager, Medical Research Council
-
Professor Tom Walley, Director, NIHR HTA programme, Professor of Clinical Pharmacology, University of Liverpool
-
Dr Ursula Wells, Principal Research Officer, Department of Health
Disease Prevention Panel
-
Medical Adviser, National Specialist, National Commissioning Group (NCG), London
-
Director, NHS Sustainable Development Unit, Cambridge
-
Dr Elizabeth Fellow-Smith, Medical Director, West London Mental Health Trust, Middlesex
-
Dr John Jackson, General Practitioner, Parkway Medical Centre, Newcastle upon Tyne
-
Professor Mike Kelly, Director, Centre for Public Health Excellence, NICE, London
-
Dr Chris McCall, General Practitioner, The Hadleigh Practice, Corfe Mullen, Dorset
-
Ms Jeanett Martin, Director of Nursing, BarnDoc Limited, Lewisham Primary Care Trust
-
Dr Julie Mytton, Locum Consultant in Public Health Medicine, Bristol Primary Care Trust
-
Miss Nicky Mullany, Service User Representative
-
Professor Ian Roberts, Professor of Epidemiology and Public Health, London School of Hygiene & Tropical Medicine
-
Professor Ken Stein, Senior Clinical Lecturer in Public Health, University of Exeter
-
Dr Kieran Sweeney, Honorary Clinical Senior Lecturer, Peninsula College of Medicine and Dentistry, Universities of Exeter and Plymouth
-
Professor Carol Tannahill, Glasgow Centre for Population Health
-
Professor Margaret Thorogood, Professor of Epidemiology, University of Warwick Medical School, Coventry
-
Ms Christine McGuire, Research & Development, Department of Health
-
Dr Caroline Stone, Programme Manager, Medical Research Council
Expert Advisory Network
-
Professor Douglas Altman, Professor of Statistics in Medicine, Centre for Statistics in Medicine, University of Oxford
-
Professor John Bond, Professor of Social Gerontology & Health Services Research, University of Newcastle upon Tyne
-
Professor Andrew Bradbury, Professor of Vascular Surgery, Solihull Hospital, Birmingham
-
Mr Shaun Brogan, Chief Executive, Ridgeway Primary Care Group, Aylesbury
-
Mrs Stella Burnside OBE, Chief Executive, Regulation and Improvement Authority, Belfast
-
Ms Tracy Bury, Project Manager, World Confederation for Physical Therapy, London
-
Professor Iain T Cameron, Professor of Obstetrics and Gynaecology and Head of the School of Medicine, University of Southampton
-
Dr Christine Clark, Medical Writer and Consultant Pharmacist, Rossendale
-
Professor Collette Clifford, Professor of Nursing and Head of Research, The Medical School, University of Birmingham
-
Professor Barry Cookson, Director, Laboratory of Hospital Infection, Public Health Laboratory Service, London
-
Dr Carl Counsell, Clinical Senior Lecturer in Neurology, University of Aberdeen
-
Professor Howard Cuckle, Professor of Reproductive Epidemiology, Department of Paediatrics, Obstetrics & Gynaecology, University of Leeds
-
Dr Katherine Darton, Information Unit, MIND – The Mental Health Charity, London
-
Professor Carol Dezateux, Professor of Paediatric Epidemiology, Institute of Child Health, London
-
Mr John Dunning, Consultant Cardiothoracic Surgeon, Papworth Hospital NHS Trust, Cambridge
-
Mr Jonothan Earnshaw, Consultant Vascular Surgeon, Gloucestershire Royal Hospital, Gloucester
-
Professor Martin Eccles, Professor of Clinical Effectiveness, Centre for Health Services Research, University of Newcastle upon Tyne
-
Professor Pam Enderby, Dean of Faculty of Medicine, Institute of General Practice and Primary Care, University of Sheffield
-
Professor Gene Feder, Professor of Primary Care Research & Development, Centre for Health Sciences, Barts and The London School of Medicine and Dentistry
-
Mr Leonard R Fenwick, Chief Executive, Freeman Hospital, Newcastle upon Tyne
-
Mrs Gillian Fletcher, Antenatal Teacher and Tutor and President, National Childbirth Trust, Henfield
-
Professor Jayne Franklyn, Professor of Medicine, University of Birmingham
-
Mr Tam Fry, Honorary Chairman, Child Growth Foundation, London
-
Professor Fiona Gilbert, Consultant Radiologist and NCRN Member, University of Aberdeen
-
Professor Paul Gregg, Professor of Orthopaedic Surgical Science, South Tees Hospital NHS Trust
-
Bec Hanley, Co-director, TwoCan Associates, West Sussex
-
Dr Maryann L Hardy, Senior Lecturer, University of Bradford
-
Mrs Sharon Hart, Healthcare Management Consultant, Reading
-
Professor Robert E Hawkins, CRC Professor and Director of Medical Oncology, Christie CRC Research Centre, Christie Hospital NHS Trust, Manchester
-
Professor Richard Hobbs, Head of Department of Primary Care & General Practice, University of Birmingham
-
Professor Alan Horwich, Dean and Section Chairman, The Institute of Cancer Research, London
-
Professor Allen Hutchinson, Director of Public Health and Deputy Dean of ScHARR, University of Sheffield
-
Professor Peter Jones, Professor of Psychiatry, University of Cambridge, Cambridge
-
Professor Stan Kaye, Cancer Research UK Professor of Medical Oncology, Royal Marsden Hospital and Institute of Cancer Research, Surrey
-
Dr Duncan Keeley, General Practitioner (Dr Burch & Ptnrs), The Health Centre, Thame
-
Dr Donna Lamping, Research Degrees Programme Director and Reader in Psychology, Health Services Research Unit, London School of Hygiene and Tropical Medicine, London
-
Mr George Levvy, Chief Executive, Motor Neurone Disease Association, Northampton
-
Professor James Lindesay, Professor of Psychiatry for the Elderly, University of Leicester
-
Professor Julian Little, Professor of Human Genome Epidemiology, University of Ottawa
-
Professor Alistaire McGuire, Professor of Health Economics, London School of Economics
-
Professor Rajan Madhok, Medical Director and Director of Public Health, Directorate of Clinical Strategy & Public Health, North & East Yorkshire & Northern Lincolnshire Health Authority, York
-
Professor Alexander Markham, Director, Molecular Medicine Unit, St James’s University Hospital, Leeds
-
Dr Peter Moore, Freelance Science Writer, Ashtead
-
Dr Andrew Mortimore, Public Health Director, Southampton City Primary Care Trust
-
Dr Sue Moss, Associate Director, Cancer Screening Evaluation Unit, Institute of Cancer Research, Sutton
-
Professor Miranda Mugford, Professor of Health Economics and Group Co-ordinator, University of East Anglia
-
Professor Jim Neilson, Head of School of Reproductive & Developmental Medicine and Professor of Obstetrics and Gynaecology, University of Liverpool
-
Mrs Julietta Patnick, National Co-ordinator, NHS Cancer Screening Programmes, Sheffield
-
Professor Robert Peveler, Professor of Liaison Psychiatry, Royal South Hants Hospital, Southampton
-
Professor Chris Price, Director of Clinical Research, Bayer Diagnostics Europe, Stoke Poges
-
Professor William Rosenberg, Professor of Hepatology and Consultant Physician, University of Southampton
-
Professor Peter Sandercock, Professor of Medical Neurology, Department of Clinical Neurosciences, University of Edinburgh
-
Dr Susan Schonfield, Consultant in Public Health, Hillingdon Primary Care Trust, Middlesex
-
Dr Eamonn Sheridan, Consultant in Clinical Genetics, St James’s University Hospital, Leeds
-
Dr Margaret Somerville, Director of Public Health Learning, Peninsula Medical School, University of Plymouth
-
Professor Sarah Stewart-Brown, Professor of Public Health, Division of Health in the Community, University of Warwick, Coventry
-
Professor Ala Szczepura, Professor of Health Service Research, Centre for Health Services Studies, University of Warwick, Coventry
-
Mrs Joan Webster, Consumer Member, Southern Derbyshire Community Health Council
-
Professor Martin Whittle, Clinical Co-director, National Co-ordinating Centre for Women’s and Children’s Health, Lymington