Notes
Article history
The research reported in this issue of the journal was commissioned by the HTA programme as project number 99/20/03. The contractual start date was in September 2001. The draft report began editorial review in February 2009 and was accepted for publication in July 2009. As the funder, by devising a commissioning brief, the HTA programme specified the research question and study design. The authors have been wholly responsible for all data collection, analysis and interpretation, and for writing up their work. The HTA editors and publisher have tried to ensure the accuracy of the authors’ report and would like to thank the referees for their constructive comments on the draft document. However, they do not accept liability for damages or losses arising from material published in this report.
Declared competing interests of authors
None
Permissions
Copyright statement
© 2010 Queen’s Printer and Controller of HMSO. This journal may be freely reproduced for the purposes of private research and study and may be included in professional journals provided that suitable acknowledgement is made and the reproduction is not associated with any form of advertising. Applications for commercial reproduction should be addressed to: NETSCC, Health Technology Assessment, Alpha House, University of Southampton Science Park, Southampton SO16 7NS, UK.
2010 Queen’s Printer and Controller of HMSO
Chapter 1 Background and introduction
In 1999, the NHS Research and Development Health Technology Assessment (HTA) programme identified that original research was necessary to investigate the key research question: ‘What is the cost-effectiveness of tonsillectomy/adeno-tonsillectomy in children with recurrent throat infections?’ The research brief specified the requirement for a randomised controlled trial (RCT) with economic analysis.
Scientific background
In the UK, sore throats cost the NHS an estimated £60 million per annum in GP consultations, result in 90,000 tonsillectomy procedures, approximately half of which are in children, and result in a loss of more than 35 million school or work days annually. 1 The incidence of tonsillectomy has risen since the early 1990s, although levels are still much lower than in the 1930s, when 100,000 operations were performed on UK school children. 2 Adenoidectomy is performed with tonsillectomy in about one third of patients. Private medical insurance is associated with higher selective surgical rates for tonsillectomy or adeno-tonsillectomy in children under the age of 7 years3 and 16% of all UK ear, nose and throat (ENT) surgical activity is in the independent sector. Therefore, figures based purely on NHS returns inevitably underestimate the total activity. In addition to the health-care costs, tonsillectomy incurs parental costs as one parent usually resides in hospital overnight. Thereafter the average time to return to normal activity for children under 15 years of age is 12 days. 4
There is a broad similarity in the criteria for tonsillectomy in clinical guidelines in the UK5,6 and North America. 7 The minimum criteria are typically a 2-year history of three to four sore throats of moderate severity (5-day duration) per annum. This is despite evidence that even histories that seem impressive may not be confirmed on close scrutiny in the majority of cases. 8 The complex psychosocial influences on tonsillectomy rates include parental enthusiasm for intervention,9 lack of information10 and maternal use of psychotropic drugs which increases twofold the rate of consultation for childhood sore throat. 11,12 Guidelines may not be uniformly implemented, even when locally derived. Surgeons tend to break guidelines more often in favour of performing surgery than withholding surgery. 5
National and international variations in the rates of adeno-tonsillectomy have been recognised for decades. Even in the 1930s, 50% of children in the UK and the USA received a tonsillectomy, while the rate was 0.5% or lower in Germany. 2 A survey of such variation in Quebec, highlighted the importance of clinical uncertainty among physicians about the recommendation for surgical intervention,13 providing further support for conducting primary research. The Scottish National Tonsil Audit showed that rates of tonsillectomy in childhood varied from less than 4 per 10,000 children in the Forth Valley to almost 10 per 10,000 children in Dumfries and Galloway. 14
Differential costs and benefits of surgery at different age groups are not known. The tonsils are traditionally thought to undergo a period of physiological enlargement around the age of school entry. Older children and adolescents may have a somewhat different natural history, and illness at higher ages has rather different (educational) implications.
Mortality from tonsillectomy has been estimated at between 1 per 16,000 and 1 per 35,000 operations,15 but surgical risk at this level is hard to measure, conceptualise and convey. The major non-fatal complications are infection, haemorrhage (2.15%) and pain, which lasts on average 5–6 days16,17 and may be inadequately treated in children. 18 Haemorrhage is unpleasant, it requires intravenous fluid administration, with or without blood transfusion, and a return to theatre. The reported rate of second anaesthetic for haemostasis varies widely from 0.75% in one British review4 to as low as 0.06% in a study of almost 9409 children in Toronto. 19 In the UK, post tonsillectomy, it has been reported that the readmission rate is as high as 7%,4 but an internal audit found that in Newcastle it was only 2.3% for children receiving adeno-tonsillectomy (unpublished data; Department of Clinical Effectiveness, Freeman Hospital, Newcastle, 1999). The overall reported complication rate ranges from 8%14 to 14%,17 the majority of complications being relatively minor such as sore throat, nausea, fever and dysphagia. Most 2–10 year olds undergoing surgery show behavioural changes such as attention seeking, temper tantrums and night waking and there is also anecdotal evidence for depression after tonsillectomy. 20 Younger children, because of cognitive immaturity, seem less able to adapt to hospitalisation. 21,22 Late sequelae may include lower postoperative serum immunoglobulin levels, but these have been ascribed to reduction in antigen stimulation. 23 There is continuing debate about the suggestion that tonsillectomy increases the risk of Hodgkin’s lymphoma;24 a large Scandinavian population cohort study found an increased risk of Hodgkin’s disease, especially in younger children. 25 The risk of transmission of new variant Creutzfeldt–Jakob disease (nvCJD) from contaminated tonsillectomy instruments remains quite unquantified. Some UK centres continue to use disposable tonsillectomy sets.
Despite the frequency of tonsil dissection for recurrent sore throats in children, there is a remarkable lack of robust evidence for its efficacy. Uncontrolled patient reports suggest the procedure to be very effective, but recurrent sore throat, particularly in childhood, may be a self-limiting illness. Where non-intervention control groups have been studied, the benefits of adeno-tonsillectomy seem almost to disappear after 2 years. Available studies are either 20–30 years old or confined to small numbers of severely affected individuals with limited general applicability. The Cochrane Review concluded that there is no evidence from RCTs to guide the clinicians in formulating the indications for surgery in children or adults. 26 The authors surmised that there is a need for high quality evidence from RCTs to establish the effectiveness of (adeno-)tonsillectomy and that these should assess the effectiveness of the procedure in patients with throat infections of differing severity and frequency. A recent Dutch RCT of adeno-tonsillectomy versus watchful waiting reported no differences between treatment arms for children with mild symptoms, and only a small difference of less than one episode of fever a year between treatment arms for children with moderate symptoms. 27
The Scottish National Tonsillectomy Audit14 showed high levels of patient satisfaction and revealed that 80% of subjects did not consult a doctor in the subsequent 12 months. However, over the past 30 years a number of controlled studies with longer follow-up indicates marginal and diminishing levels of clinical benefit over a period of non-intervention. There are no substantial claims for the benefit of childhood tonsillectomy after 2 years. Roos and colleagues28 assessed the benefit to be 1.0–1.5 fewer sore throats (0.5–1.0 episodes per annum) over the first 2 years after surgery in those with three to four episodes per annum preoperatively. Other studies29–31 showed benefits of the order of 1.5 fewer sore throats versus controls in the first postoperative year and, on average, one fewer episode in the second year. All of these and other available studies provide inadequate evidence due to poor definition of entry and outcome criteria, failure to include intention-to-treat calculations and small or skewed samples. 32 Even the only generally acceptable scientific study by Paradise and colleagues17 suffered from having comparatively small numbers of participants drawn form a skewed population of more severely affected children. The benefits of surgery were more marked (approximately 1.75 fewer episodes in year 1, 1.50 in year 2) but equally short lived. The drop-out rate was 34% by the end of year 2, and one in three of the control group underwent surgery and were excluded from the analysis. Also, the very active therapy of the control arm may have mitigated any impact of surgery. The Paradise group went on to study a more typical, i.e. less severely affected, group of children, but the full results of this study, near completion in 1992, have never been reported.
Weight gain is a cited supplementary benefit of tonsillectomy. Two studies showed accelerated weight gain postoperatively, but as the children were shown to be of normal or above average height and weight preoperatively, this effect may be undesirable. 33
A straw poll of consultant otolaryngologists asked what level of reduction in sore throat would justify removal of the tonsils? Replies were remarkably consistent – at least two sore throats fewer per annum. No published trial to date shows a benefit of this magnitude, even in the first year after surgery.
We therefore designed a pragmatic RCT to answer the key research question: ‘What is the effectiveness and cost-effectiveness of (adeno-)tonsillectomy in comparison with standard non-surgical management in children aged under 16 with recurrent throat infections?’ Assessment of outcome emphasised those that were important to children themselves and their parents or carers. Our specific research questions were:
-
Does tonsillectomy or adeno-tonsillectomy reduce the number of episodes of recurrent sore throats among children to a clinically significant extent?
-
Are there differences in clinical outcome for the age groups: 4–7, 8–11 and 12–15 years?
-
What is the cost-effectiveness of tonsillectomy/adeno-tonsillectomy for children, and what are the costs and benefits to families?
-
What are the important outcomes of tonsillectomy/adeno-tonsillectomy for children and their parents/carers, and what is the importance of these to children and their parents’ quality of life?
-
What are parents’ (and older children’s) preferences for different treatment options for recurrent sore throat?
-
How representative of the target population are trial participants?
Structure of this report
This report contains eight chapters and eight associated appendices. The original study protocol is reproduced in Appendix 1. In Chapter 2 we describe the methods used in the study. This includes a comprehensive account of the rationale and methods used in the prospective pragmatic RCT and prospective non-randomised cohort study of non-trial participants comparing surgical intervention with conventional medical treatment and changes to the original protocol. Chapter 3 provides the main results of the trial and cohort study using the analysis strategy described in the original protocol. Chapter 4 describes a small qualitative study of parents and teenagers to identify the experience of recurrent sore throat and their preferences for different treatment options; the study was used to confirm person-centred outcomes and the development of a utility study. Chapter 5 describes a small utility study to assess the preferences of parents and children for the treatment of recurrent sore throat. Chapter 6 describes the economic analysis. Chapter 7 discusses the implications of the study results for the NHS, and Chapter 8 provides conclusions for practice, policy and further research.
Chapter 2 Methods of research
The design of this study was a pragmatic RCT with economic analysis comparing conventional surgical intervention with conventional medical treatment for children with recurrent sore throats (here after referred to as the trial). Eligible subjects who declined participation in the trial were offered their preferred treatment and invited to participate in a parallel non-randomised cohort study (hereafter referred to as the cohort). The analyses of the trial and cohort data are reported in Chapter 3. The economic analysis is reported in Chapter 6. A small qualitative study to investigate treatment and outcome preferences was undertaken prior to commencement of the trial and cohort (see Chapter 4). A small utility study was undertaken once recruitment to the cohort was halted (see Chapter 5).
Rationale for design
Randomised controlled trials are the gold standard study design for the evaluation of health-care interventions in an evidence-based health-care system. The assessment of clinical effectiveness and cost-effectiveness of health technologies that are well established and widely used in clinical practice is particularly challenging in HTA where patients (or clinicians) express preferences for particular treatment regimes and are not in treatment equipoise. Standard RCT designs used where there are strong patient preferences experience high non-participation (refusal) rates and, consequently, increased confounding and decreased generalisability. Patient preference trial designs that combine the RCT with a non-randomised experimental design are increasingly used where there are strong patient preferences. 34,35
Tonsillectomy and adeno-tonsillectomy for the treatment of children with recurrent sore throat has been routine clinical practice for over 50 years. When developing the study, we anticipated patient preferences to increase the non-participation rate in a standard RCT design, although there was little evidence that there was parental enthusiasm for surgical intervention. 9 We therefore designed a study that combined a pragmatic RCT36 with a parallel non-randomised cohort.
Patient preference trials of interventions for childhood conditions also raise the question of ‘whose preference?’, particularly where teenage children are participating. Although we did not attempt to differentiate between the preferences of parents and children, when recruiting participants to the study we did collect ‘patient-reported’ outcome data from both parents and teenage children.
Trial and cohort
Interventions
Surgical treatment consisted of tonsillectomy and adeno-tonsillectomy with adenoid curettage, and tonsillectomy by dissection or bipolar diathermy according to surgical preference. In the trial, surgical interventions were required to take place within 12 weeks of randomisation.
Medical treatment consisted of conventional treatment. There was no active intervention protocol as no single prescribing strategy would be able to cover all participants. 37 The referring GP was free to treat as in his or her current practice.
Participants
Study subjects were children aged between 4 and 15 years on their last birthday with recurrent sore throats, referred from primary care to the five secondary care otolaryngology departments located in the north of England or west central Scotland; Freeman Hospital, Newcastle upon Tyne (from 13 May 2002 to 31 July 2006); Alder Hey Children’s Hospital, Liverpool (from 11 November 2002 to 30 June 2005); Booth Hall Children’s Hospital, Manchester (from 8 November 2002 to 30 May 2006); Bradford Royal Infirmary (from 7 December 2004 to 31 July 2006); Royal Hospital for Sick Children, Glasgow (from 4 March 2005 to 31 July 2006). The study inclusion and exclusion criteria are shown in Box 1.
4+ episodes of sore throat within each of the preceding 2 years
6+ episodes of sore throat within the last year
Exclusion criteriaPrevious tonsillectomy
Hospitalisation due to tonsillitis
Quinsy
Marked obstructive airway during attack
Comorbidity affecting ability to undergo surgery within 6 months
Bleeding disorder
Otitis media with effusion
Sleep apnoea syndrome
Rare medical condition (e.g. glomerulonephritis or Henoch–Schönlein purpura)
Suspected velopharyngeal insufficiency
Congenital/valvular heart disease
Mid way through the study, the recruitment process was reviewed. This involved a discussion about the application of the eligibility criteria with the participating surgeons and, as a result, the inclusion criteria were simplified in an attempt to further harmonise the process of recruitment (see Summary of changes to study protocol). Thus two different sets of criteria were used. Recruitment to the study took place in secondary care between May 2002 and July 2006. All primary care referrals of children with recurrent sore throats to the five study centres were considered by participating surgeons. Trained research nurses [Grade F registered general nurses (RGNs) with at least 2 years postregistration experience in ENT and research] introduced the study to children and their parents who were shown a video (see Appendix 2 for the script of the video) describing the main aspects of the study. Printed information sheets were also provided (see Appendix 3). In light of this information the research nurses discussed the study with children and their parents, who then went on to have a further, informed, discussion with the participating surgeon. For children and parents willing to participate in either the trial or the cohort study the research nurses then obtained written consent and collected baseline data. The video transcript, information sheets and consent forms (see Appendix 4) were translated into Bengali, Punjabi, Gujarati and Urdu.
Randomisation
Independent World Wide Web-based computer randomisation allocated trial participants to interventions while cohort participants elected their treatment. Children recruited to either the trial or the cohort were stratified by hospital and by age at their last birthday into three groups (4–7 years, 8–11 years and 12–15 years). Blocked randomisation was used to ensure that within each centre and within each of the three age groups children were allocated in equal numbers to each arm of the trial. Where study centres were unable to access the World Wide Web they telephoned the co-ordinating centre in order for web-based randomisation to be completed on their behalf.
Data collection
The primary clinical outcome was the reported number of episodes of sore throat in the 2 years after entry into the study. Secondary clinical outcomes included the reported number of episodes of sore throat, otitis media and upper respiratory tract infection that invoked a GP consultation; reported number of symptom-free days; reported severity of sore throats; and surgical and anaesthetic morbidity. In addition to the measurement of these clinical outcomes, the impact of the treatment on costs and quality of life was assessed. Quality of life was assessed using the Pediatric Quality of Life Inventory™ (PedsQL™). 38–40
At baseline, an anonymised eligibility form was completed by the surgeon for each child approached about the study, recording demographic characteristics (gender, age) along with reported history of sore throats. A baseline questionnaire (see Appendix 5) was completed by participants upon recruitment to the study. All participants were followed up for 24 months from the date of initial randomisation. To minimise recall bias, data on sore throats were gathered by a simple structured daily health diary (see Appendix 6), which was completed and returned by participants on a monthly basis for 24 months. In addition, simple outcome questionnaires based on the baseline questionnaire (see Appendix 5) were administered to study participants at 3, 12 and 24 months into the study. Data on consultation rates and prescribed medication were gathered from GP medical records by manual abstraction by trained researchers at the end of follow-up for all trial participants and a sample of cohort participants.
Diaries
Data on sore throats were gathered by a simple structured daily health diary, which was completed and returned by participants on a monthly basis for 24 months. The diary for month 1 was given to participants by research nurses at the clinic and returned by post after 4 weeks in a prepaid envelope addressed to the study centre. Subsequent diaries were posted to participants directly from the study centre 5 days in advance of the new diary start date, with a letter reminding participants to return the previous diary. Research nurses and, later on, researchers reminded diary non-responders to return diaries by telephone on a monthly basis.
Questionnaires
Outcome questionnaires were administered to participants at 3, 12 and 24 months after randomisation. A baseline questionnaire was completed by participants upon recruitment to the trial. Baseline questionnaires were given to participants by research nurses at the clinic and were either returned immediately at the clinic or taken away and returned by post in prepaid addressed envelopes to the study centre. On their due date, 3-, 12- and 24-month questionnaires were posted to participants directly from the co-ordinating centre. First reminders were sent to non-responders 2 weeks after the initial questionnaire (letter and envelope only). Second reminders were sent 4 weeks after the initial questionnaire (letter, questionnaire and envelope). Third reminders were carried out 6 weeks after the initial questionnaire (telephone reminder which could include further letters, a questionnaire and envelopes).
For children under the age of 8 years, parents completed all outcome measures. For children over the age of 8, children completed the diary and the PedsQL™ section of the questionnaire, while their parents completed the remainder of the questionnaire. If a child turned 16 during the course of the trial he or she was then asked to complete all the outcome measures. All outcome measures were anonymous.
Study power
In this trial we anticipated a fairly large difference in the primary clinical outcome (the reported number of episodes of sore throat in the 2 years after randomisation) with an effect size of around 1.0, but a smaller difference in a number of psychosocial outcomes, including health-related quality of life, with an effect size of 0.33. No standard sample size formula is available for economic evaluations, and a number of methods were proposed. 41–43 The information that was available limited the use of such methods in practical applications. Published data17 suggested that tonsillectomy may lead to a reduction of approximately 1.5 days per year in missed schooling. Given a reported standard deviation of 4.5, to detect this difference with 80% power we needed approximately 142 children in each arm of the trial assuming a significance level of 5%. A sample size of 142 children in the cohort group opting for surgery would allow us to detect similar differences between the cohort group and propositi. The sample was stratified by age (4–7 years, 8–11 years, 12–15 years). With a total of 284 children, we had approximately 47 randomised to each treatment arm in each stratum. Given that the standard deviation of the number of sore throats per year was 2.018, we were able to estimate the difference between treatments in each strata with a standard error of 0.41. (Equivalently we had 90% power to detect a difference of 1.35 episodes of sore throat per year in each stratum assuming a type 1 error of 0.05.) It was anticipated that the clinically important difference in outcome between the two arms of the trial would be approximately two episodes in the second year of follow-up. A sample size of 142 children in each arm enabled us to measure this difference with sufficient precision to undertake a meaningful economic analysis.
Blinding
The trial was conducted in normal clinical practice and the blinding of health professionals and participants to the intervention was not possible. However, all researchers who conducted interviews or processed self-completed questionnaires and diaries were blind to the interventions of all trial and cohort participants. This was facilitated by separating the responsibility for recruitment and randomisation from outcome assessment. Furthermore, participants were encouraged to respond to questions without describing their treatment regime. In this way, we minimised subjective bias towards a given treatment.
Ethical approval
This study was approved by the Northern & Yorkshire Multicentre Research Ethics Committee and associated Local Research Ethics Committees. The study received a clinical trial authorisation from the Medicines and Healthcare products Regulatory Agency. The study was approved by the NHS Research and Development department and a Caldicott Guardian from each participating secondary care site. Primary care trust support was provided regarding collection of data from GP records.
Adverse events
Adverse events were recorded in self-completion daily diaries and GP records. Expected adverse events included infection, haemorrhage and pain following tonsillectomy, with possible hospital readmission as well as sore throat, nausea, fever and dysphagia. No reporting of serious adverse events was required. All adverse events were managed as per normal care as the intervention did not deviate from normal care.
Summary of changes to study protocol
In order to increase recruitment to the trial, inclusion criteria were amended in May 2004 from ‘children (or carers) reporting experience of mild symptoms, 6 or more episodes within 2 years or 8 or more episodes within 1 year, and children reporting experience of moderate symptoms (sore throat for 5 days or more), 6 or more episodes within 2 years or 6 or more within 1 year’ to ‘children (or carers) reporting experience of 4 or more episodes of sore throat within each of 2 years or 6 or more episodes of sore throat within 1 year’.
Exclusion criteria were also amended in May 2004 in order to increase safety from ‘children will be excluded if they require hospitalisation due to tonsillitis or quinsy; have obstructive symptoms suggestive of clinically significant sleep apnoea syndrome or rare medical conditions such as glomerulonephritis or Henoch–Schönlein purpura; or have previously had a tonsillectomy; or have suspected velopharyngeal insufficiency’ to ‘Children will be excluded if they require hospitalisation due to quinsy; have obstructive symptoms suggestive of clinically significant sleep apnoea syndrome, have rare medical conditions such as glomerulonephritis or Henoch–Schönlein purpura; have previously had a tonsillectomy; have suspected velopharyngeal insufficiency, have co-morbidity that means they are unable to undergo the operation within the next 6 months, have a bleeding disorder, or have congenital/valvular heart disease’.
In July 2004 the project was extended from 5 to 7 years to increase patient recruitment.
Two additional study centres: Royal Hospital for Sick Children, Glasgow and Bradford Royal Infirmary were added in September 2004.
The title of the study was amended in September 2004 from NESTAC: North of England Study of Tonsillectomy and Adeno-tonsillectomy in Children to NESSTAC: North of England and Scotland Study of Tonsillectomy and Adeno-tonsillectomy in Children, with the addition of Glasgow as a study centre.
Postal questionnaires became interview administered in October 2006 in an attempt to improve response rates.
Statistical methods
Main analysis
An intention-to-treat analysis was performed according to the original protocol. The primary clinical outcome measure was the number of episodes of sore throat. This variable was analysed using generalised linear modelling assuming a Poisson error structure with a log link function. 44 By fitting the difference between the two experimental groups as a fixed effect, interval estimates of the effect of tonsillectomy (in each of the first 2 years of follow-up) were generated. These estimates were then used in the economic analysis. The same approach was used to analyse the other outcomes. A Poisson error structure was assumed for data in the form of a count (such as the number of episodes of absence from school), and normal error structure adopted for continuous variables (such as the quality of life indices).
Secondary analysis
The aim of secondary analysis was to determine whether we could identify groups of children who had benefited from surgical treatment. It was hypothesised that disease severity may be an important factor. A severity index based on history of the condition during the year before entry to the study was derived using data recorded in GP records. The relationship between severity and the effect of tonsillectomy was then investigated using the modelling approach described above.
Cohort analysis
Data from participants who declined to be randomised were used to assess the external validity of the main study. Baseline characteristics of the cohort were compared with those of the study population using standard tests for the comparison of two independent samples (e.g. the t-test or Mann–Whitney test as appropriate). Outcome for the cohort was compared with outcome for the two groups of study participants using the modelling approach described above.
Summary of changes to the protocol for analysis
In the original protocol we specified that ‘secondary clinical outcomes included reported numbers of episodes of sore throat, otitis media and upper respiratory tract infection which invoked a GP consultation’. In practice it has not been possible to uniquely determine the cause of each individual GP consultation. The two variables that have been analysed are the number of GP consultations in which a sore throat was mentioned and the total number of GP consultations.
In the protocol we also specified that we would analyse our primary outcome measure – the number of episodes of sore throat – using Poisson regression models. After inspection of the data prior to breaking the blinding it was decided to extend this approach to include negative binomial regression models to allow us to take into account over-dispersion in the data.
In addition to the pre-specified secondary analysis we also examined whether the effect of tonsillectomy varied for the different age strata (as this was specified as one of the study objectives) and whether there was a difference between boys and girls. After observing how the response rate varied with time we decided to adjust all the secondary analyses to take into account when diaries were returned for each child.
When the analysis plan for the cohort study was written it was envisaged that all the children in the cohort would opt to have a tonsillectomy. Thus we specified that cohort and trial children would be compared using methods appropriate for comparing two independent samples (t-tests and Mann–Whitney tests). In practice, a sample of parents/children opted for medical management of their sore throats. We have therefore used methods appropriate for comparing three groups – one-way analysis of variance and chi-squared tests.
Chapter 3 Trial and cohort results
In this chapter we report the main results from the pragmatic RCT (trial) and the parallel prospective cohort study (cohort). The chapter is divided into five sections. First we describe the Consolidated Standards of Reporting Trials (CONSORT) flow chart and review the response and completion rates for each data collection method over the life of the study. Second we describe the baseline characteristics of trial and cohort participants. In the next two sections we report our primary analysis on the impact of the interventions on primary and secondary outcomes. Finally we report a secondary analysis to determine the characteristics of those groups of children who benefited from surgical treatment.
Participant flow
Figure 1 shows the CONSORT flow chart of children in the study.
Eligibility
Five centres assessed 1546 children for eligibility for the study. Five hundred and thirty-one were not eligible. Of these, 328 (62%) did not meet the inclusion criteria and 162 (31%) were excluded because of the exclusion criteria (see Box 1). Other reasons for exclusion included communication difficulties (n = 29), being involved in another RCT (n = 2), and emigrating (n = 1). No reasons were recorded for nine children.
Enrolment
Of 1015 eligible children, 286 (28%) refused to participate in the study. Of the remaining 729, 268 (37%) agreed to participate in the trial and 461 (63%) agreed to participate in the cohort.
Allocation
Trial participants were randomly allocated to surgical (n = 131) or medical (n = 137) management. Of those randomised to surgery, 120 (92%) had an (adeno-)tonsillectomy within 24 months of randomisation, and of those randomised to medical management, 36 (26%) had an (adeno-)tonsillectomy within 24 months of randomisation.
Cohort participants selected surgical (n = 387) or medical (n = 65) management. Of those selecting surgery, 374 (97%) had an (adeno-)tonsillectomy within 24 months of randomisation, and of those selecting medical management, nine (14%) had an (adeno-)tonsillectomy within 24 months of randomisation.
The number of children recruited by each centre broken down by study group is given in Table 1.
Centre | Study group | Total | ||
---|---|---|---|---|
Cohort medical | Trial | Cohort surgical | ||
Newcastle | 23 (8.5%) | 140 (51.7%) | 108 (39.9%) | 271 |
Liverpool | 36 (17.6%) | 23 (11.3%) | 145 (71.1%) | 204 |
Manchester | 8 (6.0%) | 39 (29.3%) | 86 (64.7%) | 133 |
Bradford | 0 (0) | 39 (69.6%) | 17 (30.4%) | 56 |
Glasgow | 7 (10.8%) | 27 (41.5%) | 31 (47.7%) | 65 |
Total | 74 (10.2%) | 268 (36.8%) | 387 (53.1%) | 729 |
Follow-up
Trial and cohort participants were followed up for up to 2 years from time of randomisation. Follow-up was undertaken in three ways:
-
Self-completion health diaries (see Appendix 6). These took the form of booklets, each corresponding to a time period of 28 days (4 weeks). A total of 24 booklets were sent out to study participants at 4-weekly intervals.
-
Telephone prompt interviews were introduced part-way through the study because of concern about the low response rates to the health diary. If a due diary was not returned within 28 days, a telephone call was made to the relevant study participant who was then asked to provide a limited amount of information about the child’s health.
-
Self-completed postal outcome questionnaires (see Appendix 5) were administered at 3, 12 and 24 months after entry into the study.
Health diaries
Each participant was sent 24 4-weekly diaries. There was a poor response rate for both trial and cohort participants. Of trial participants, 81.7% (219/268) returned at least one diary. The mean number of diaries returned per child in the trial was 9.91. The overall diary response rate for trial participants was 41.3%. Of cohort participants 65.5% (302/461) children returned at least one diary. The mean number of diaries returned per child in the cohort was 6.84. The overall diary response rate for cohort participants was 28.5%.
Trial participants were significant more likely to respond than cohort participants [relative risk (RR) 1.24; 95% confidence interval (CI) 1.16 to 1.81]. There was no evidence that response rates differed between types of management (surgical versus medical: RR 0.97; 95% CI 0.76 to 1.24).
In Figure 2, diaries are numbered sequentially by month from randomisation (1–24). The figure clearly shows that response rates declined over the 24-monthly follow-up period for both trial and cohort participants. For trial participants only, adding responses from telephone interviews that corresponded to a missing diary provided an average of 1.6 additional monthly measurements. This equates to an overall response rate for the selected primary outcome variable of 47.8% for trial participants.
Self-completion postal questionnaires
There was a poor response rate for both trial and cohort participants (Table 2). At 12 months, 47.8% of trial and 32.8% of cohort participants responded. There was a further decline by 24 months, with 44.0% of trial and 27.1% of cohort participants responding.
Trial | Cohort | |||||
---|---|---|---|---|---|---|
Surgical management n (%) | Medical management n (%) | Total n (%) | Surgical management n (%) | Medical management n (%) | Total n (%) | |
Number of participants | 131 | 137 | 268 | 387 | 74 | 461 |
Returned 12-month questionnaire | 73 (58%) | 55 (40%) | 128 (48%) | 124 (32%) | 27 (36%) | 151 (33%) |
Returned 24-month questionnaire | 64 (49%) | 54 (39%) | 118 (44%) | 100 (26%) | 25 (34%) | 125 (27%) |
Trial participants were much more likely to return their 12-month questionnaire than cohort participants [RR 1.46 (95% CI 1.22 to 1.75) in year 1 and RR 1.62 (95% CI 1.33 to 1.99) in year 2]. Among trial participants the difference in response rates between the two arms was statistically significant (p = 0.014) in year 1; children randomised to tonsillectomy were more likely to respond than other children (RR 1.39; 95% CI 1.08 to 1.79). The corresponding RR in year 2 was 1.24 (95% CI 0.94 to 1.63).
Abstraction of general practitioner records
We attempted to approach all GPs of trial participants and, because of resource constraints, sampled the GPs we approached for cohort participants. Table 3 shows the number of GP records sampled and examined for trial and cohort participants. Not all records were accessible because the research team failed to make contact within the time available (n = 85), the participant was no longer registered with the practice and the research team were unable to trace him or her via the tracing service (n = 40), and practices denied access, either requesting payment or a more recent participant consent record (n = 31).
Trial | Cohort | |||||
---|---|---|---|---|---|---|
Medical n (%) | Surgical n (%) | Total n (%) | Medical n (%) | Surgical n (%) | Total n (%) | |
Number of participants | 137 | 131 | 268 | 74 | 387 | 461 |
Number for whom an approach was made to their GP | 137 (100%) | 130 (99%) | 267 (99%) | 73 (99%) | 146 (38%) | 219 (48%) |
Number of those for whom an approach was made whose GP record was accessible | 93 (68%) | 92 (70%) | 185 (69%) | 49 (66%) | 96 (24%) | 145 (31%) |
Baseline characteristics of study participants
Trial and cohort participants (n = 729) were invited to complete and return by post a baseline self-completed questionnaire (see Appendix 5). The baseline questionnaire was completed by 87.9% (641) of participants. Table 4 compares the characteristics of responders and non-responders. Trial participants had a higher non-response rate than cohort surgical or cohort medical participants.
Responders (n = 641) | Non-responders (n = 88) | Test of difference between groups | |
---|---|---|---|
Gender, n (%) | |||
Male | 243 (89%) | 29 (11%) | χ2 = 0.812, df = 1, p = 0.367 |
Female | 398 (87%) | 59 (13%) | |
Study group, n (%) | |||
All trial participants | 225 (84%) | 43 (16%) | χ2 = 6.311, df = 2, p = 0.043 |
Cohort surgical management | 349 (90%) | 38 (10%) | |
Cohort medical management | 67 (91%) | 7 (9%) |
Table 5 shows the demographic characteristics of study participants who responded to the baseline survey. There was some evidence that the proportion of boys was higher in the group opting for medical managements than in the other two groups (χ22=8.3; p = 0.02). There was no evidence that age influenced choice of group.
Variable | Cohort medical (n = 67) | Trial (n = 225) | Cohort surgery (n = 349) | Test of differences between groups |
---|---|---|---|---|
Males, n (%) | 36 (54%) | 76 (35%) | 129 (37%) | χ22=8.3; p = 0.016 |
Age group, n(%) | ||||
Age: 4–7 years, n (%) | 28 (42%) | 80 (36%) | 126 (36%) | χ42=4.24; p = 0.375 |
Age: 8–11 years, n (%) | 24 (36%) | 81 (36%) | 108 (31%) | |
Age: 12–16 years, n (%) | 15 (22%) | 64 (28%) | 115 (33%) |
Health during 3 months prior to baseline survey
Responses to questions relating to the child’s health over the 3 months prior to the baseline survey are summarised in Table 6. Most of the children (97%) in the study reported at least one sore throat. Although the difference between groups was not significant at the 5% level (χ22=5.3; p = 0.07), the trend across the study groups was replicated in the other variables relating to sore throats (where the difference between groups was significant). In general, children who opted to retain their tonsils had fewer and shorter sore throats than other children. Children who opted to have their tonsils removed tended to report the most frequent and most severe sore throats. Children who consented to be randomised were somewhere in the middle. The same response pattern was observed in the questions relating to interruption of schooling and quality of life: children opting for surgery reported the greatest perceived disruption and poorest quality of life; children opting for medical management reported the least perceived disruption and best quality of life (Table 7).
Variable | Cohort medical (N = 67) | Trial (N = 225) | Cohort surgery (N = 349) | Test of differences between groups |
---|---|---|---|---|
Any sore throats? n (%) | 63 (94%) | 219 (97%) | 341 (99%) | χ22=5.26; p = 0.067 |
Mean number of sore throats lasting less than 2 weeks (SD) | 2.7 (1.6) | 3.2 (2.4) | 3.6 (2.5) | F2,630 = 4.92; p = 0.008 |
Mean length (days) last sore throat (SD) | 5.3 (3.2) | 7.2 (5.5) | 7.8 (4.6) | F2,630 = 8.14; p < 0.001 |
Any chronic (for longer than 2 weeks) sore throat? n (%) | 13 (19%) | 65 (30%) | 155 (46%) | χ22=22.23; p < 0.001 |
Sore throat resulted in ear infection? n (%) | 20 (30%) | 76 (35%) | 153 (45%) | χ22=7.79; p = 0.021 |
Variable | Cohort medical (N = 67) | Trial (N = 225) | Cohort surgery (N = 349) | Test of differences between groups |
---|---|---|---|---|
Any days off school? n (%) | 52 (79%) | 187 (87%) | 320 (93%) | χ22=13.15; p = 0.002 |
Mean number of days off school (SD) | 6.6 (6.4) | 8.3 (7.9) | 11.2 (9.0) | F2,632 = 13.17; p < 0.001 |
Progress at school affected n (%) | 19 (29%) | 84 (39%) | 215 (62%) | χ22=42.33; p < 0.001 |
PedsQL: Mean Physical Health Summary Score (SD) | 77.2 (18.5) | 77.5 (18.8) | 71.1 (22.3) | F2,621 = 7.21; p = 0.001 |
PedsQL: Mean Mental Health Summary Score (SD) | 76.6 (13.2) | 72.4 (14.5) | 68.9 (15.4) | F2,620 = 9.03; p < 0.001 |
Factors influencing the choice of group to which the child was entered were investigated using multinomial regression. The dependent variable was the choice of study group: 1 = cohort medical, 2 = trial, 3 = cohort surgical. All the variables listed in Table 8 were investigated as potential explanatory variables. Significance tests were based on changes in log likelihood. The greatest change in log likelihood was obtained by fitting the variables described in Tables 5–7.
Step | Explanatory variable | –2 Log likelihood | Model selection: likelihood ratio tests | ||
---|---|---|---|---|---|
χ2 | df | p | |||
0 | Intercept | 136.5 | |||
1 | Progress at school affected? | 92.5 | 44.1 | 2 | < 0.001 |
2 | Any chronic sore throats? | 80.3 | 12.2 | 2 | 0.002 |
3 | Gender | 71.9 | 8.4 | 2 | 0.015 |
The most important predictor of choice of group was whether it was perceived that the child’s progress at school was being affected by their condition in the 3 months prior to the baseline survey. The second most important predictor was whether the child had experienced any chronic sore throats in the 3 months prior to the baseline survey. The final explanatory variable that entered the model was gender. Once these variables were included in the model, none of the other explanatory variables (age, number of episodes and duration of sore throats, ear infection or time off school) produced a significant reduction in –2 log likelihood. Similarly, none of the two-way interactions between any of the explanatory variables produced a significant improvement in the fit of the model.
The parameter estimates of the multinomial regression of choice of group are shown in Table 9. These estimates revealed that children were more likely to be entered into the cohort surgical group than into the trial if it was perceived that their progress at school was being affected by their symptoms (odds ratio = 2.40; 95% CI 1.67 to 3.44). Children were more likely to be entered into the cohort surgical group than the trial if they had experienced a chronic sore throat prior to the baseline survey (odds ratio = 1.57; 95% CI 1.08 to 2.28). Boys were more likely than girls to be entered into the cohort medical group rather than the trial (odds ratio = 0.45; 95% CI 0.25 to 0.79).
Explanatory variable | Group | ||||||
---|---|---|---|---|---|---|---|
Cohort medical | Cohort surgical | ||||||
OR | 95% CI | p | OR | 95% CI | p | ||
Progress at school affected | 0.67 | 0.36 | 1.25 | 0.207 | 2.40 | 1.67 to 3.44 | < 0.001 |
Chronic sore throat experienced | 0.60 | 0.30 | 1.20 | 0.151 | 1.57 | 1.08 to 2.28 | 0.018 |
Child is a girl | 0.45 | 0.25 | 0.79 | 0.005 | 0.94 | 0.65 to 1.36 | 0.748 |
Health in 2 years prior to study
We did not ask parents or teenagers to recall the health of participants in the 2 years before the baseline survey because of the limitations of retrospective data over this time frame. Using data abstracted from GP records Table 10 shows the number of GP consultations in the 2 years prior to the study, the average number of these per participant was 9.8. The mean number of consultations at which a sore throat was mentioned was 5.8.
Cohort medical (n = 49) | Trial (n = 185) | Cohort surgery (n = 96) | |
---|---|---|---|
Total number of GP consultations | 10.3 (6.9) | 10.3 (6.3) | 8.6 (5.8) |
Mean (standard deviation) | |||
Number of GP consultations for sore throat | 6.2 (4.2) | 6.0 (3.7) | 5.4 (3.4) |
Mean (standard deviation) |
A comparison of the change in –2 log likelihood with the appropriate percentage points of a chi-squared distribution with two degrees of freedom using a negative binomial regression indicated that the difference between groups was not significant (χ22=5.36; p = 0.07 and χ22=2.13; p = 0.34 for total number of consultations and consultations with sore throats respectively).
Comparison of the two randomised groups
The baseline characteristics of children who agreed to be randomised are summarised in Table 11. Overall, the two groups were evenly balanced with respect to case-mix and history of sore throats.
Variable | Statistic | Group | ||
---|---|---|---|---|
Medical | Surgical | |||
Number randomised | n | 137 | 131 | |
Gender | Male | na (%) | 49 (35.8) | 44 (33.4) |
Female | na (%) | 88 (64.2) | 87 (66.4) | |
Age band (years) | 4–7 | na (%) | 50 (36.5) | 50 (38.2) |
8–11 | na (%) | 47 (34.3) | 48 (36.6) | |
12–15 | na (%) | 40 (29.2) | 33 (25.2) | |
Returned baseline survey | na (%) | 111 (81.0) | 114 (87.0) | |
Responded to question about sore throats | nb (%) | 109 (98.2) | 111 (97.4) | |
Experienced one or more sore throats in previous 3 months | nc (%) | 102 | 110 | |
Number of sore throats in previous 3 months | Mean (SD) | 3.34 (2.63) | 3.09 (2.08) | |
Duration of last sore throat | Mean (SD) | 7.31 (6.04) | 7.12 (4.85) | |
Responded to question about whether child experienced a sore throat lasting longer than 15 days | nb (%) | 107 (96.4) | 110 (96.5) | |
Experienced a sore throat lasting longer than 15 days in the previous 3 months | nc (%) | 34 (31.8) | 32 (29.1) | |
Responded to question about ear infection | nb (%) | 108 (97.3) | 109 (95.6) | |
Experienced an ear infection in previous 3 months | nc (%) | 37 (34.3) | 40 (36.7) | |
Responded to question about time off school | nb (%) | 109 (98.2) | 106 (93.0) | |
Experienced time off school | nc (%) | 90 (82.6) | 97 (91.5) | |
Number of days of school in previous 3 months | Mean (SD) | 7.66 (8.24) | 8.98 (7.51) | |
Responded to question about progress at school | nb (%) | 109 (98.2) | 107 (93.9) | |
Felt that progress at school was affected by sore throats | nc (%) | 36 (33.0) | 48 (44.9) |
Primary outcome
The primary outcome was the number of episodes of sore throat experienced during 2 years of follow-up by each participating child. In the diary, the parent or child was asked to indicate the days on which the child had experienced a sore throat. Box 2 describes the algorithm for defining an episode of sore throat used in the following analysis.
The minimum number of consecutive days on which a sore throat is recorded that can constitute an episode is 3
The maximum number of consecutive days is not defined – i.e. 30 consecutive days of recorded sore throat would still count as one episode
Any consecutive recording of sore throat interrupted by 4 days of non-recording constitutes a new episode
Periods of sore throat separated in time by less than 4 days with no recording of sore throat were pooled before application of the above criteria
For example:
Suppose X is a day of sore throat and + is a day where no sore throat symptoms are reported. Then:
+ + + + X X X + + + + would be classed as an episode of sore throat of 3 days
+ + + + X + X +X X X + + + + would be classed as an episode of sore throat of 5 days
+ + + + X + X + + + + would not be classed as an episode of sore throat
+ + + + X + + X + + X + X + + + + would be classed as an episode of sore throat of 4 days
+ + + + X X + + + X X X X X + X + + + + would be classed as a single episode of sore throat of 8 days
+ + + + X X + X X + X X + X X + + + + would be classed as a single episode of sore throat of 8 days
+ + + + X X X + + + + X X X + + + + would be classed as two episodes of sore throat each of 3 days
Using the algorithm described in Box 2, Table 12 shows in each year of follow-up the mean number of episodes of sore throat per month for the four trial and cohort groups.
Year 1 | Year 2 | |||||
---|---|---|---|---|---|---|
Mean | Standard deviation | Number of respondents | Mean | Standard deviation | Number of respondents | |
Cohort medical management | 0.59 | 0.44 | 55 | 0.38 | 0.34 | 27 |
Cohort surgical management | 0.71 | 0.50 | 248 | 0.19 | 0.36 | 111 |
Trial medical management | 0.64 | 0.49 | 112 | 0.33 | 0.43 | 74 |
Trial surgical management | 0.50 | 0.43 | 119 | 0.13 | 0.21 | 83 |
Estimated effect of tonsillectomy based on trial participants
The number of episodes of sore throat was analysed using a Poisson regression model. Our pre-specified primary analysis was to estimate the effect of tonsillectomy in each of the 2 years of follow-up based on responses corresponding to children enrolled in the trial. The model parameters corresponding to this analysis are given in the first column of Table 13.
Model | Year 1 | Year 2 | ||||||
---|---|---|---|---|---|---|---|---|
IRR | 95% CI | p | IRR | 95% CI | p | |||
Poisson regression model | 0.70 | 0.61 | 0.80 | < 0.001 | 0.54 | 0.42 | 0.70 | < 0.001 |
Poisson regression model adjusting for strata (centre and age) | 0.70 | 0.61 | 0.80 | < 0.001 | 0.51 | 0.39 | 0.66 | < 0.001 |
Negative binomial regression model (adjusting for over-dispersion) | 0.70 | 0.58 | 0.85 | < 0.001 | 0.49 | 0.33 | 0.73 | < 0.001 |
Negative binomial regression model adjusting for strata (centre and age) | 0.71 | 0.59 | 0.85 | < 0.001 | 0.48 | 0.32 | 0.70 | < 0.001 |
During both years of follow-up, children randomised to surgical management were less likely to record episodes of sore throat than those randomised to medical management; the incidence rate ratio (IRR) was 0.70 (95% CI 0.61 to 0.80) and 0.54 (95% CI 0.42 to 0.70) in years 1 and 2 respectively. Adjusting for the strata used in randomisation (by fitting centre and age effects) resulted in only small changes in the magnitude of the estimates of tonsillectomy. Similarly adjusting for over-dispersion (by fitting a negative binomial regression model) made some difference to the point estimate in the second year and resulted in wider CIs in both years.
Comparing children in the trial with children in the cohort
The outcome for children in the trial and children in the corresponding cohort group was compared using a negative binomial regression model (Table 14).
Model | Year 1 | Year 2 | ||||
---|---|---|---|---|---|---|
IRR | 95% CI | p | IRR | 95% CI | p | |
Children randomised to tonsillectomy compared with children who opted to have a tonsillectomy | 0.63 | 0.53 to 0.74 | < 0.001 | 0.85 | 0.57 to 1.25 | 0.406 |
Children randomised to medical management compared with children who opted for medical management | 1.12 | 0.88 to 1.42 | 0.353 | 0.74 | 0.46 to 1.19 | 0.208 |
Children randomised to tonsillectomy reported fewer episodes of sore throat than children who opted for tonsillectomy. The difference was greatest in the first year of follow-up (IRR = 0.63; 95% CI 0.53 to 0.74). The difference was smaller in the second year and not statistically significant (IRR = 0.85; 95% CI 0.57 to 1.25), although because of the reduced amount of data the CIs were wider. The difference in outcome between children randomised to medical management and those children who opted for medical management was not significant in either year of follow-up, although the width of the CIs means that we can not exclude the possibility that a clinically important difference may exist.
Estimating the effect of tonsillectomy based on self-completion questionnaires
Table 15 shows the mean number of sore throats that lasted less than 2 weeks reported by trial and cohort participants in the 12-month and 24-month follow-up questionnaires according to whether they were in the medical or surgical management group.
Year 1 | Year 2 | |||||
---|---|---|---|---|---|---|
Mean | Standard deviation | Number of respondents | Mean | Standard deviation | Number of respondents | |
Cohort medical management | 1.60 | 2.37 | 25 | 1.09 | 1.35 | 23 |
Cohort surgical management | 1.12 | 1.63 | 113 | 0.45 | 0.86 | 96 |
Trial medical management | 1.37 | 1.52 | 54 | 1.15 | 1.83 | 53 |
Trial surgical management | 0.93 | 1.33 | 69 | 0.81 | 1.72 | 59 |
Effect of tonsillectomy based on responses from trial participants
Although during the first year children randomised to surgical management were less likely to record a sore throat than children randomised to medical management, negative binomial regression suggests that the difference was not statistically significant (IRR = 0.68; 95% CI 0.42 to 1.08). The corresponding result for year 2 was very similar (IRR = 0.71; 95% CI 0.37 to 1.35).
Comparison of children in the trial with children in the cohort
Although during the first year participants randomised to surgical management in the trial were less likely to record a sore throat than cohort participants who opted for surgical management, negative binomial regression suggests that the difference was not statistically significant (IRR = 0.83 with 95% CI 0.53 to 1.31). The rate of recording of sore throats in year 1 was similar for children randomised to medical management and children who opted for medical management (IRR = 0.86; 95% CI 0.47 to 1.55). The corresponding figures for year 2 were: surgical management IRR = 1.82 (95% CI 0.93 to 3.53) and medical management IRR = 1.06 (95% CI 0.51 to 2.18).
Estimate of number of episodes of sore throat over the 2 years of follow-up for inclusion in economic evaluation
For the economic analysis (see Chapter 6) an estimate of the number of episodes of sore throats over the 2 years of follow-up was required for each trial participant. These estimates were based on the returned diaries. The estimates were obtained using the following procedures:
-
For each child we calculated the mean number of sore throats per diary returned and multiplied this by 26 to give an estimate of the total number of sore throats over the 2 years of the study. (This is referred to below as the unadjusted estimate.)
-
For each child, for each diary returned, we calculated a diary number – equal to the number of months from the start of the study for that particular child. For each child the first diary had a diary number of 1. For a child who returned all 24 diaries, the diary number of the final diary was 24.
-
For each child we then calculated the mean of these diary numbers. For a child who returned all 24 diaries the mean diary number was 12.5. While it was theoretically possible that this mean could take any value between 1 and 24, in practice more diaries were missing from the second year than the first and thus the mean diary number for most children was less than 12.5. Across all children in the two randomised groups the mean figure was 8.6.
-
We then looked at the relationship between the number of episodes of sore throat reported and mean diary number using a weighted linear regression procedure. The dependent variable was the estimated number of sore throats obtained in step 1 above. Two explanatory variables were included: the mean diary number calculated in steps 2 and 3; and a binary indicator of the group to which the child was randomised (tonsillectomy or medical management). The regression weights were the number of diaries returned by that child (we had more precise estimates of the number of days of sore throat for children who returned more diaries). The estimated regression coefficients were: intercept 23.5 (95% CI 20.3 to 26.7); mean diary number –1.16 (95% CI –1.44 to –0.88); and group –3.51 (95% CI –5.19 to –1.83). The associated R-squared value was 0.27.
-
For each child we then calculated an adjusted estimate of the number of sore throats for the 2 years of the study using:
The weighted mean of these adjusted and unadjusted estimates are given in Table 16.
Variable | Group | |||
---|---|---|---|---|
Medical management | Surgical management | |||
Mean | Standard deviation | Mean | Standard deviation | |
Unadjusted estimate | 11.4 | 8.7 | 7.4 | 6.1 |
Adjusted estimate assuming a linear trend | 9.0 | 7.7 | 5.5 | 5.2 |
Using a weighted least squares regression procedure, the estimated effect of tonsillectomy (intention to treat) over the 2 years of the study was a reduction of 3.5 episodes (95% CI 1.8 to 5.2).
Secondary outcomes
Days with sore throat
Table 17 shows the mean number of recorded days of sore throat and the mean number of sore throat days per returned diary for each year of follow-up.
Year 1 | Year 2 | |||||
---|---|---|---|---|---|---|
Mean days of sore throat (SD) | Mean days of sore throat per returned diary (SD) | Number of respondents | Mean days of sore throat (SD) | Mean days of sore throat per returned diary (SD) | Number of respondents | |
Cohort medical management | 30.56 (28.67) | 4.95 (4.95) | 55 | 20.44 (21.90) | 2.52 (2.32) | 27 |
Cohort surgical management | 42.77 (44.61) | 7.47 (6.04) | 247 | 10.45 (19.48) | 1.46 (2.81) | 111 |
Trial medical management | 49.11 (54.62) | 7.28 (6.74) | 107 | 20.16 (40.79) | 3.17 (5.78) | 55 |
Trial surgical management | 31.00 (29.25) | 4.97 (4.38) | 110 | 8.00 (12.61) | 0.86 (1.18) | 62 |
Effect of surgical management
Using diary data (see Table 17) a number of negative binomial regression models were developed to consider the effects of tonsillectomy (intention to treat). The results are summarised in Box 3. For each comparison, models were developed separately for the effect in the first and second years of follow-up. The models estimated the likelihood of a participant in one group recording a day of sore throat compared with the likelihood of a participant in the comparator group recording a day of sore throat.
Effect in year 1: IRR = 0.67 (95% CI 0.52 to 0.85)
Effect in year 2: IRR = 0.27 (95% CI 0.16 to 0.46
Comparison of trial and cohort surgical armsEffect in year 1: IRR = 0.65 (95% CI 0.54 to 0.78)
Effect in year 2: IRR = 0.60 (95% CI 0.37 to 0.97)
Comparison of trial and cohort medical armsEffect in year 1: IRR = 1.48 (95% CI 1.08 to 2.04)
Effect in year 2: IRR = 1.23 (95% CI 0.63 to 2.42)
The models suggest that trial participants in the surgery group were less likely than trial participants in the medical group to record a day of sore throat during both years of the study. Trial participants in the surgery group were less likely to record a day of sore throat than cohort participants in the surgery group during both years of the study. Trial participants in the medical group were more likely to record a day of sore throat than cohort participants in the medical group during both years of the study, although the difference in incidence rates in year 2 was not statistically significant (p = 0.53). The very wide CI for the IRR in year 2 reflects the comparatively small number of children who returned diaries in this period.
GP consultations
Table 18 shows the mean number of recorded GP consultations and the mean number of recorded consultations for sore throat for each year of follow-up.
Year 1 | Year 2 | ||||
---|---|---|---|---|---|
Mean number of consultations (SD) | Mean number of sore throat consultations (SD) | Mean number of consultations (SD) | Mean number of sore throat consultations (SD) | Number of records | |
Cohort medical management | 3.16 (3.14) | 1.63 (1.98) | 3.12 (3.10) | 1.45 (2.07) | 49 |
Cohort surgical management | 3.69 (3.33) | 1.86 (2.23) | 2.71 (3.51) | 0.78 (1.31) | 96 |
Trial medical management | 4.38 (3.48) | 2.35 (2.35) | 3.40 (3.20) | 1.33 (1.56) | 93 |
Trial surgical management | 3.99 (3.74) | 1.90 (2.84) | 2.84 (2.90) | 0.89 (1.44) | 92 |
All consultations
Using consultation data from the available GP records about all consultations for trial participants, the estimated effects of tonsillectomy in years 1 and 2 are given by IRRs of 0.91 (95% CI 0.71 to 1.17) and 0.83 (95% CI 0.63 to 1.10) respectively. The incidence rate of consultations for any reason was similar for trial participants randomised to surgical management and cohort participants who opted for surgical management with IRRs of 1.08 (95% CI 0.84 to 1.40) and 1.05 (95% CI 0.76 to 1.45) in years 1 and 2 respectively. The incidence rate of consultations for any reason may have been a little higher for trial participants randomised to medical management than for cohort participants who opted for medical management in year 1 (IRR = 1.38; 95% CI 1.01 to 1.88), but there was little difference in year 2 (IRR = 1.09; 95% CI 0.79 to 1.50).
Consultations for sore throat
Using consultation data from the available GP records about consultations for sore throat for trial participants, the estimated effects of tonsillectomy in years 1 and 2 are given by IRRs of 0.81 (95% CI 0.59 to 1.10) and 0.67 (95% CI 0.46 to 0.97) respectively. The incidence rate of consultations for sore throat was fairly similar for trial participants randomised to surgical management and cohort participants who opted for surgical management, with IRRs of 1.02 (95% CI 0.73 to 1.41) and 1.14 (95% CI 0.72 to 1.80) in years 1 and 2 respectively. The incidence rate of consultations for sore throat may have been a little higher for trial participants randomised to medical management than for cohort participants who opted for medical management in year 1 (IRR = 1.44; 95% CI 0.98 to 2.13), but there was little difference in year 2 (IRR = 0.92; 95% CI 0.61 to 1.39).
Quality of life
The PedsQL 4.038–40 was included in the self-completed questionnaires at baseline, 3 months, 12 months and 24 months. PedsQL has two generic core scales that assess physical health and psychosocial health. Higher scores indicate better self-rated health-related quality of life. Table 19 shows the mean scores for each scale at the four follow-up points.
Baseline (n = number of respondents) Mean (SD) | 3 months (n = number of respondents) Mean (SD) | 12 months (n = number of respondents) Mean (SD) | 24 months (n = number of respondents) Mean (SD) | |
---|---|---|---|---|
Physical health | ||||
Cohort medical management | (n = 65) 77.17 (18.7) | (n = 44) 85.66 (16.44) | (n = 27) 84.66 (16.00) | (n = 25) 91.88 (9.59) |
Cohort surgical management | (n = 338) 71.10 (22.33) | (n = 177) 74.37 (18.17) | (n = 117) 87.15 (15.00) | (n = 96) 91.35 (14.48) |
Trial medical management | (n = 108) 76.26 (19.50) | (n = 85) 74.66 (21.56) | (n = 52) 85.34 (17.86) | (n = 53) 88.05 (12.76) |
Trial surgical management | (n = 111) 78.75 (18.01) | (n = 86) 83.70 (16.75) | (n = 71) 89.95 (16.37) | (n = 63) 88.79 (17.66) |
Psychosocial health | ||||
Cohort medical management | (n = 66) 76.58 (13.22) | (n = 45) 80.08 (15.55) | (n = 27) 82.78 (16.12) | (n = 25) 87.46 (10.38) |
Cohort surgical management | (n = 334) 68.87 (15.44) | (n = 176) 70.51 (17.83) | (n = 118) 82.27 (15.83) | (n = 95) 85.85 (13.78) |
Trial medical management | (n = 110) 72.33 (14.86) | (n = 85) 73.34 (17.96) | (n = 52) 79.97 (17.49) | (n = 53) 83.87 (12.95) |
Trial surgical management | (n = 111) 70.95 (14.18) | (n = 85) 77.37 (15.07) | (n = 71) 83.81 (15.31) | (n = 63) 84.30 (15.02) |
Effect of surgical management
Based on the responses summarised in Table 19, the estimated effect of surgical management on trial participants was 4.62 (95% CI –1.53 to 10.76) and 0.74 (95% CI –5.02 to 6.50) in years 1 and 2 respectively on physical health, and 2.97 (95% CI –2.03 to 9.72) and 0.43 (95% CI –4.78 to 5.64) in years 1 and 2 respectively on psychosocial health. Adjusting for baseline assessment (analysis of covariance) the corresponding figures were 3.08 (95% CI –3.11 to 9.27) and 0.31 (95% CI –5.74 to 6.37) in years 1 and 2 respectively for physical health, and 2.43 (95% CI –3.08 to 7.03) and 0.39 (95% CI –4.52 to 5.29) in years 1 and 2 respectively for psychosocial health. In terms of effect size these would be classed as small effects, being around 0.25 or less.
Comparison of outcome for cohort with outcome for trial participants
Outcome was similar for trial participants randomised to surgical management and cohort participants who opted for surgical management. The mean differences in quality of life scores were 2.80 (95% CI –1.81 to 7.41) and –2.56 (95% CI –7.62 to 2.50) in years 1 and 2 respectively for physical health, and 1.55 (95% CI –3.09 to 6.18) and –1.55 (95% CI –6.13 to 3.03) in years 1 and 2 respectively for psychosocial health. Adjusting for baseline quality of life, the corresponding mean differences were 1.24 (95% CI –3.60 to 6.08) and –2.77 (95% CI –8.00 to 2.47) in years 1 and 2 respectively for physical health, and 0.62 (95% CI –5.09 to 3.84) and –1.82 (95% CI –6.20 to 2.57) in years 1 and 2 respectively for psychosocial health. Again, these estimates reflect relatively small effect sizes (less than 0.25).
Outcome was similar for trial participants randomised to medical management and cohort participants who opted for medical management. The mean differences in quality of life scores were 0.68 (95% CI –7.47 to 8.83) and –3.82 (95% CI –9.55 to 1.91) in years 1 and 2 respectively for physical health, and –2.81 (95% CI –10.86 to 5.24) and –3.59 (95% CI –9.48 to 2.30) in years 1 and 2 respectively for psychosocial health. Adjusting for baseline quality of life, the corresponding mean differences were 0.00 (95% CI –7.47 to 7.48) and –3.68 (95% CI –9.28 to 1.93) in years 1 and 2 respectively for physical health, and –1.04 (95% CI –8.29 to 6.21) and –1.81 (95% CI –7.08 to 3.46) in years 1 and 2 respectively for psychosocial health. Again, these estimates reflect relatively small effect sizes (less than 0.25).
Secondary analysis
All secondary analysis was ‘intention to treat’ and restricted to trial participants. The aim of secondary analysis was to determine whether we could identify groups of participants who benefited from surgical treatment. In the main analysis it was noted that the number of reported sore throats was fewer in year 2 than in year 1. It was also noted that there was a reduction in the proportion of diaries returned as time passed during the follow-up period (see Figure 2). It was decided that the secondary analysis should take these factors into account. This was done by setting the dependent variable to be the number of episodes of sore throat reported by the participant during the 2-year follow-up period, and including as a covariate the mean ‘diary number’ (diaries having been numbered sequentially from 1 to 24). This covariate proved to be highly significant and was retained, along with a general effect of surgical management, as the reference model with which the other models were compared. Fitting a negative binomial regression model, including the number of diaries returned as an exposure variable, yielded the following estimates:
-
Effect of surgical management: IRR = 0.68 (95% CI 0.58 to 0.81).
-
Effect of change of 1 in mean diary number: IRR = 0.90 (95% CI 0.88 to 0.92).
Severity of symptoms prior to entry into study
The only measure of symptom severity available from the GP records was the number of consultations for sore throat during the 2 years prior to entry. This was included as an explanatory variable; the number of episodes of sore throat reported during follow-up was not associated with the number of consultations for sore throat prior to entry to the study. The effect of one additional consultation is estimated as: IRR = 0.99 (95% CI 0.96 to 0.02).
Fitting an interaction between this severity index and surgical management did not significantly improve the fit of the model (change in –2 log likelihood = 0.24 for the loss of 1 degree of freedom; p = 0.625).
An alternative measure of symptom severity was available from the baseline questionnaire – the number of sore throats reported in the 3 months prior to entry into the study. This explanatory variable significantly improved the fit of the model; the greater the number of sore throats reported in the 3 months prior to entry to the study, the greater the likelihood of a sore throat being recorded during follow-up. The effect of one additional sore throat reported at baseline is estimated as: IRR = 1.07 (95% CI 1.03 to 1.11).
However, the interaction between the effect of surgical management and the number of sore throats reported at baseline was not significant (change in –2 log likelihood = 2.60 for the loss of 1 degree of freedom; p = 0.107). The effect of one additional sore throat reported at baseline on the effect of surgical management is estimated as: IRR = 0.94 (95% CI 0.87 to 1.01).
Age group
The sampling strategy for the trial stratified the sample by age group in anticipation of age differences. Table 20 shows the mean number of episodes of sore throat per diary returned by age group and treatment group.
Age (years) | n | Outcome: episodes of sore throat | ||||||
---|---|---|---|---|---|---|---|---|
Episodes per diary returned | Adjusteda number of episodes per diary returned | |||||||
Mean | SD | 95% CIb | Mean | SD | 95% CIb | |||
Medical management | 4–7 | 42 | 0.33 | 1.03 | 0.24 to 0.43 | 0.27 | 0.89 | 0.18 to 0.35 |
8–11 | 40 | 0.55 | 1.20 | 0.45 to 0.65 | 0.45 | 1.16 | 0.36 to 0.54 | |
12–15 | 35 | 0.43 | 1.13 | 0.32 to 0.55 | 0.32 | 0.97 | 0.21 to 0.42 | |
Total | 117 | 0.44 | 1.16 | 0.38 to 0.49 | 0.35 | 1.04 | 0.30 to 0.39 | |
Surgical management | 4–7 | 47 | 0.28 | 0.84 | 0.21 to 0.35 | 0.21 | 0.73 | 0.15 to 0.27 |
8–11 | 43 | 0.28 | 0.78 | 0.20 to 0.35 | 0.21 | 0.78 | 0.15 to 0.27 | |
12–15 | 31 | 0.32 | 1.03 | 0.22 to 0.41 | 0.20 | 0.74 | 0.12 to 0.28 | |
Total | 121 | 0.28 | 0.87 | 0.23 to 0.34 | 0.21 | 0.74 | 0.17 to 0.25 |
There were three age strata. The number of reported episodes of sore throat was analysed using negative binomial regression. There was no evidence that the number of sore throats reported during follow-up differed by age group (change in –2 log likelihood was 3.79 for the loss of two degrees of freedom; p = 0.150). However, fitting an interaction between the effect of age and the effect of surgical management does produce a significant improvement in the fit of the model (when compared with the main effects model, the change in –2 log likelihood was 9.57 for the loss of two degrees of freedom; p = 0.008; alternatively when compared with the more parsimonious model with just the main effect of surgical management, the change in –2 log likelihood was 9.77 for the loss of four degrees of freedom; p = 0.040). The parameter estimates corresponding to this model are given in Table 21.
Effect | IRR | 95% CI | p |
---|---|---|---|
Change of +1 in mean diary number | 0.90 | 0.88 to 0.92 | < 0.001 |
Effect of being in age group 8 to 11 years (compared with 4 to 7 years) | 1.51 | 1.16 to 1.98 | 0.002 |
Effect of being in age group 12 to 15 years (compared with 4 to 7 years) | 1.13 | 0.85 to 1.51 | 0.409 |
Effect of tonsillectomy for child aged 4 to 7 years | 0.85 | 0.64 to 1.11 | 0.243 |
Effect of tonsillectomy for child aged 8 to 11 years | 0.53 | 0.41 to 0.70 | < 0.001 |
Effect of tonsillectomy for child aged 12 to 15 years | 0.76 | 0.55 to 1.04 | 0.088 |
Overall, children aged between 8 and 11 years were more likely to report an episode of sore throat than other children during the period of follow-up and it is in these children that we saw the largest effect of surgical management. Trial participants aged 8–11 years randomised to medical management tended to report more sore throats than participants in other age groups randomised to medical management. Participants aged 8–11 years randomised to surgical management tended to report similar levels of sore throat during follow-up to participants in other age groups randomised to surgical management. These results are consistent with the summary statistics presented in Table 20. The mean number of episodes per diary returned for participants aged between 8 and 11 years randomised to medical management was 0.55, which was higher than for all other groups. It may be that the higher level of reporting of sore throats by children aged between 8 and 11 years randomised to medical management is a chance anomaly.
Gender
Table 22 shows the mean number of episodes of sore throat per diary returned by gender and treatment group.
Gender | n | Outcome: episodes of sore throat | ||||||
---|---|---|---|---|---|---|---|---|
Episodes per diary returned | Adjusteda number of episodes per diary returned | |||||||
Mean | SD | 95% CIb | Mean | SD | 95% CIb | |||
Medical management | Male | 41 | 0.36 | 1.11 | 0.26 to 0.45 | 0.27 | 0.95 | 0.18 to 0.36 |
Female | 76 | 0.48 | 1.16 | 0.41 to 0.56 | 0.39 | 1.06 | 0.32 to 0.46 | |
Total | 117 | 0.44 | 1.16 | 0.38 to 0.49 | 0.34 | 1.04 | 0.30 to 0.39 | |
Surgical management | Male | 37 | 0.25 | 0.78 | 0.18 to 0.32 | 0.18 | 0.66 | 0.12 to 0.24 |
Female | 84 | 0.30 | 0.90 | 0.25 to 0.36 | 0.23 | 0.77 | 0.18 to 0.27 | |
Total | 121 | 0.28 | 0.87 | 0.23 to 0.34 | 0.21 | 0.74 | 0.17 to 0.25 |
Fitting gender as a main effect suggested that female participants tended to report more sore throats over the follow-up period than male participants (IRR = 1.24; 95% CI 1.04 to 1.49). However, the interaction between gender and surgical management was not significant (change in –2 log likelihood = 0.25 for the loss of 1 degree of freedom; p = 0.614). The additional effect of surgical management for a female participant is estimated as IRR = 0.91 (95% CI 0.64 to 1.30).
Potential adverse events of tonsillectomy and of treatment of sore throats using antibiotics
Respondents were asked to indicate whether particular symptoms were observed on each day in each diary. For each child the proportion of days on which each symptom was observed was calculated. In addition this was done separately for days on which a sore throat was reported and other days. In general other symptoms were more likely to be reported on days when the child was also suffering from sore throat (Table 23).
Sore throat also recorded? (N = 521) | ||||||
---|---|---|---|---|---|---|
No | Yes | |||||
Mean | n a | SD | Mean | n b | SD | |
Sore ear | 2.7 | 516 | 8.5 | 15.9 | 508 | 21.1 |
Difficulty swallowing | 2.1 | 516 | 6.9 | 34.5 | 508 | 26.1 |
Nausea or vomiting | 2.6 | 516 | 7.5 | 12.4 | 508 | 16.8 |
Diarrhoea | 1.1 | 516 | 3.5 | 3.6 | 508 | 9.8 |
Aches and pains | 1.8 | 516 | 4.9 | 11.5 | 508 | 17.4 |
Fever or temperature | 1.5 | 516 | 4.7 | 16.1 | 508 | 18.9 |
No appetite | 2.6 | 516 | 7.0 | 19.8 | 508 | 22.2 |
Felt tired | 5.8 | 516 | 11.6 | 27.6 | 508 | 25.9 |
The overall proportion of days with each symptom is broken down by study group can be found in Table 24.
Symptom | Participant type | Comparisons between groups | |||||||||
---|---|---|---|---|---|---|---|---|---|---|---|
Trial | Cohort | Trial participants: surgical vs medical | Surgical: trial vs cohort | Medical: trial vs cohort | |||||||
Medical (n = 109) | Surgical (n = 110) | Medical (n = 55) | Surgical (n = 247) | RR | 95% CI | p | RR | 95% CI | RR | 95% CI | |
Sore ear | 5.7 | 4.2 | 3.8 | 7.2 | 0.70 | 0.44 to 1.11 | 0.13 | 0.56 | 0.38 to 0.80 | 1.48 | 0.80 to 2.75 |
Difficulty swallowing | 10.5 | 6.1 | 5.8 | 11.9 | 0.55 | 0.40 to 0.77 | < 0.001 | 0.47 | 0.39 to 0.65 | 1.84 | 1.18 to 2.86 |
Nausea or vomiting | 4.1 | 4.2 | 3.0 | 5.4 | 0.98 | 0.67 to 1.43 | 0.91 | 0.75 | 0.54 to 1.04 | 1.44 | 0.90 to 2.33 |
Diarrhoea | 1.5 | 1.4 | 1.3 | 2.1 | 0.86 | 0.44 to 1.69 | 0.66 | 0.64 | 0.34 to 1.08 | 1.25 | 0.59 to 2.62 |
Aches and pains | 4.3 | 2.6 | 2.2 | 4.6 | 0.56 | 0.35 to 0.91 | 0.02 | 0.51 | 0.35 to 0.76 | 1.86 | 1.08 to 3.23 |
Fever or temperature | 3.7 | 2.6 | 3.6 | 5.0 | 0.67 | 0.47 to 0.95 | 0.03 | 0.50 | 0.37 to 0.69 | 1.03 | 0.66 to 1.61 |
No appetite | 8.5 | 3.8 | 3.5 | 7.2 | 0.44 | 0.30 to 0.64 | < 0.001 | 0.51 | 0.38 to 0.69 | 2.43 | 1.57 to 2.47 |
Tired/no energy | 10.7 | 7.2 | 5.3 | 11.9 | 0.64 | 0.46 to 0.91 | 0.01 | 0.58 | 0.44 to 0.77 | 2.04 | 1.34 to 3.11 |
In general, children randomised to surgery reported fewer symptoms than children randomised to medical management. However, these children also reported considerably fewer symptoms than children who (or whose parents) expressed a preference for tonsillectomy.
Chapter 4 The qualitative study
This chapter describes a qualitative study of parents and teenagers undertaken to inform the development of the study and to identify the experience of recurrent sore throat and their preferences for different treatment options. The qualitative study has been used to support the choice of person-centred outcomes in the trial and cohort study and the development of the utility study (see Chapter 5).
Methods
The study design was qualitative. Data were generated through in-depth interviews with dyads of children aged 4–16 years and their parents. The interviews took place in the family home, all of which were based in the north-east of England. Data collection took place between July and August 2002. Interviews lasted between 30 minutes and 1.5 hours and their content was recorded using a digital audio recorder.
Recruitment
A convenience sample was recruited from children and their parent or guardian attending one of two regular ENT outpatient clinics held at one of the trial centres. Children had been referred to these clinics by their GP for recurrent sore throats. One of the study trial managers explained the study to all 16 children and parents/guardians attending the clinics, and asked if they would be willing to be approached to participate in the study and to provide their contact details. A letter, signed by the interviewer, was sent to children and their parent/guardian, inviting them formally to participate in the study. A study information sheet was included with the letter, providing details of the study team, why the children’s help was required, how the interviews would proceed and how the information would be handled and ultimately reported. Parents were subsequently telephoned to gain their consent to participate in the interviews. Out of the 16 families originally approached, 12 agreed to take part. Written consent was given by both the child and the parent/guardian involved in each interview.
Interviews
All interviews were carried out by a social scientist with expertise in qualitative interviewing. Semi-structured interviews were based on a flexible topic guide, which highlighted a number of issues considered to be relevant to the study (see Appendix 7). After 12 interviews no new issues were emerging so data saturation was judged to have occurred and no further participants were approached.
Data management and analysis
Digital audio data were transcribed verbatim, by professional transcribers, as soon as possible after each interview. Typed transcripts were then reviewed by the interviewer for transcription errors and to respond to any queries regarding unclear or inaudible words. Data collection and analysis proceeded in an iterative fashion in several closely linked stages as follows: familiarisation with the data by reading transcripts; identification of recurrent or important topics; development of a topic index; use of index to code data on transcripts; extension and elaboration of the topic index; coalescing of related topics into themes; abstraction of data from transcripts into themes; further collapsing and refinement of categories; and finally the interpretation of analysis into a narrative. nvivo qualitative data management software was used in indexing and coding of data and themes. For ethical reasons, children and their parents were interviewed together therefore the data were analysed together; however, where possible data were reported separately according to children’s and parents’ responses.
Ethical issues
Children and their parents/guardians were advised that participation was entirely voluntary and had no influence on their treatment, and they could withdraw at any time. All interview transcripts were anonymised and treated in the strictest confidence. All direct identifying information was removed from the transcripts by giving each child a unique code number which was used to attribute comments during analysis. The study received ethical approval from the Multicentre Research Ethics Committee as part of the trial and cohort study.
Findings
The findings from these interviews comprise a brief description of the participants along with a rough evaluation of the parent’s and child’s contribution to each interview. Data from the interviews are reported under the general themes of: physical and emotional effects of recurrent sore throat; impact of recurrent sore throat on education, social life and family; and management of this chronic condition. Anonymised quotations, from the interviews, are included in the text to illustrate points made.
Participants
The sample consisted of 12 parents and children (eight male and four female) aged between 4 and 16 years with recurrent sore throats who had recently been referred to ENT (Table 25).
Interview number | Gender | Child’s age (years) | Parent(s) present | Tonsillectomy |
---|---|---|---|---|
09 | Male | 4 | Mother and fathera | Yes (privately) |
04 | Male | 5 | Mother | Wait and see |
10 | Male | 5 | Mother | On waiting list |
01 | Male | 6 | Mother | On waiting list |
07 | Male | 7 | Mother and father | On waiting list |
03 | Male | 10 | Mother | Yes (NHS) |
12 | Male | 10 | Mother | Wait and see |
05 | Male | 14 | Mother | On waiting list |
11 | Female | 10 | Mother | On waiting list |
02 | Female | 12 | Mother | On waiting list |
08 | Female | 15 | Mother | Wait and see |
06 | Female | 16 | Mother | Wait and see |
At the time of interview, six of the participants were on the hospital waiting list to have their tonsils removed, four were waiting to see if the frequency of their sore throats improved with time while two had already had their tonsils removed (one as an NHS patient and one privately). In all interviews the child’s mother was present and on two occasions the father was also present. On one occasion the father was present in order to translate for both the mother and the child.
Parent/child contributions to the data
Word count was used as a proxy for contribution to the interview by participants. Overall, parents dominated the interviews, taking on average 84% of the interview (range 44–99%). Children’s contributions ranged from 1% to 56% of the interview. Children dominated only one interview (56%); this was the oldest child (16 years) in the sample. While there were two other teenagers in the sample, only one made a substantial contribution to the interview (31% versus 4%). For the younger children, age did not appear to be related to contribution during the interview.
Effects of recurrent sore throat
Physical
There was a rich description of the physical symptoms that participants associated with their own or their child’s sore throat. While children naturally tended to use less mature language to describe their symptoms, their descriptions were no less colourful than those given by their parents. Although some of the children found their symptoms difficult to articulate:
Well it does hurt a little bit … [it’s] sore.
(01, male, age 6)
This was not necessarily associated with the age of the child:
It’s like swollen and when I cough it’s like dead loud and horrible and like it croaks a little bit … it hurts when I kind of cough in my throat … it hurts a little bit when I swallow … I wanted to say, sometimes at night when I’m breathing it sometimes stops my breathing … and I feel sick through the night too
(04, male, age 5)
Most children mentioned the classic sore throat symptoms which are associated with pain and difficulties eating. Children spoke of not being able to eat, not feeling hungry and finding it hard or impossible to swallow food. Most children said that it hurt or was painful having sore throats, and one child talked of associated ear pain. About half of the children mentioned abnormalities of the tonsils such as being big and/or red, and half of the children described abnormalities of the throat such as sore throat, dry throat and tickly throat. The use of the voice (such as it being difficult to talk, having a croaky voice or cough and loss of speech) was also frequently mentioned. Other less frequently quoted symptoms included aches, temperatures, sickness, tiredness, general feelings of being unwell, and problems with breathing, snoring and bad breath (Box 4).
Big tonsils (02, female, age 12); (04, male, age 5); (06, female, age 16); (08, female, age 15)
Sore throat (01, male, age 6); (03, male, age 10); (08, female, age 15); (10, male, age 5)
Can’t swallow (04, male, age 5); (08, female, age 15); (09, male, age 4); (11, female, age 10)
Painful (06, female, age 16); (08, female, age 15); (09, male, age 4); (10, male, age 5)
Can’t eat (01, male, age 6); (03, male, age 10); (11, female, age 10)
Not hungry (01, male, age 6); (08, female, age 15); (10, male, age 5)
Being/feeling sick (02, female, age 12); (04, male, age 5); (10, male, age 5)
Difficult to talk (01, male, age 6); (03, male, age 10); (06, female, age 16)
It hurts (01, male, age 6); (03, male, age 10); (04, male, age 5)
Red tonsils (06, female, age 16); (08, female, age 15)
Headaches (08, female, age 15); (11, female, age 10)
Tired (01, male, age 6); (06, female, age 16)
Get hot (04, male, age 5); (11, female, age 10)
Temperature (08, female, age 15); (09, male, age 4)
Dry throat (02, female, age 12)
Tickling in throat (06, female, age 16)
Neck aches (01, male, age 6)
Sore neck (10, male, age 5)
Croaky voice (04, male, age 5)
Loss of voice (06, female, age 16)
Loud cough (04, male, age 5)
Snoring (01, male, age 6)
Stops me breathing (04, male, age 5)
Hard to breathe (06, female, age 16)
Ear pain (11, female, age 10)
Don’t feel well (04, male, age 5)
Feel run down (08, female, age 15)
Bad breath (11, female, age 10)
Similarly, all parents mentioned sore throat symptoms surrounding food (loss of appetite, poor eating and problems swallowing), but in contrast to the children’s’ responses all parents also discussed abnormalities of the tonsils, describing visible symptoms such as spots or pus on the tonsils. Pain was mentioned much less frequently by the parents than by their children perhaps because this was a less visible symptom, but many talked about their child feeling ‘sore’ in the throat. Again, in contrast to their children, the majority of parents listed changes in temperature as a symptom of sore throat. About half of the parents felt that energy levels and sleep patterns were affected and half said their children either felt sick or actually vomited. Just under half of the parents talked about a change in the voice. Parents mentioned all of the other less frequently disclosed symptoms that had been listed by the children; however, parents occasionally listed other less common symptoms such as prominent glands in the neck, cold sores, scarlet fever, pallor and anaemia (Box 5).
Loss of appetite/poor eating (01, male, age 6); (02, female, age 12); (03, male, age 10); (04, male, age 5); (05, male, age 14); (07, male, age 7); (09, male, age 4); (10, male, age 5); (11, female, age 10)
Sore throat (01, male, age 6); (02, female, age 12); (04, male, age 5); (05, male, age 14); (06, female, age 16); (07, male, age 7); (10, male, age 5); (11, female, age 10)
High temperature/sweating/fever/shivering (01, male, age 6); (02, female, age 12); (03, male, age 10); (04, male, age 5); (07, male, age 7); (08, female, age 15); (09, male, age 4); (10, male, age 5)
Feeling sick/vomiting (02, female, age 12); (04, male, age 5); (07, male, age 7); (08, female, age 15); (09, male, age 4); (10, male, age 5)
Very large (swollen) tonsils (01, male, age 6); (02, female, age 12); (04, male, age 5); (06, female, age 16); (08, female, age 15); (10, male, age 5)
Lack of energy/need to sleep/drained (01, male, age 6); (02, female, age 12); (04, male, age 5); (07, male, age 7); (11, female, age 10)
Problems swallowing (01, male, age 6); (02, female, age 12); (03, male, age 10); (07, male, age 7); (09, male, age 4)
Red tonsils (01, male, age 6); (02, female, age 12); (06, female, age 16); (11, female, age 10)
Bad breath (01, male, age 6); (09, male, age 4); (11, female, age 10); (07, male, age 7)
Problems with ears (02, female, age 12); (10, male, age 5)
Ear infections (06, female, age 16)
Prominent glands in the neck (01, male, age 6); (06, female, age 16)
Swollen (puffed up) face (02, female, age 12); (05, male, age 14)
Headache/aches (01, male, age 6); (04, male, age 5)
Cough (09, male, age 4); (11, female, age 10)
Snoring (01, male, age 6); (07, male, age 7)
Stomach pains (03, male, age 10); (10, male, age 5)
Red blotches (rash) on face/arms (02, female, age 12); (04, male, age 5)
Pallor (07, male, age 7); (10, male, age 5)
‘Thick’ voice (01, male, age 6)
Croaky voice (10, male, age 5)
Problems breathing (02, female, age 12); (specifically at night) (04, male, age 5)
Little white deposits (on tonsils) (01, male, age 6)
Yellow poisoney colour (in back of throat) (03, male, age 10)
Yellow spots (in back of throat) (04, male, age 5)
White spots (in the mouth) (09, male, age 4)
Feeling ‘something’ in throat (04, male, age 5)
Hoarse/barking cough (04, male, age 5)
Problems sleeping (07, male, age 7)
In pain (05, male, age 14)
General feeling of being unwell (10, male, age 5)
Sneezing/sniffling (01, male, age 6)
Scarlet fever (04, male, age 5)
Cold sores (07, male, age 7)
Anaemia (10, male, age 5);
Emotional
Although there was much less data relating to the emotional consequences of chronic sore throats, at least one of each parent–child dyad mentioned some emotional effect or change in personality which they associated with having chronic sore throats. The over-riding theme was one of moodiness, general lethargy, withdrawal and clinginess.
Well he’s normally a happy go lucky bairn but as I say, when he’s got the tonsillitis he’s really withdrawn in himself and he’s, very, very, quiet, you know he’s in pain
(Mother of 05, male, age 14)
It was kind of depressing at one point … I had worked so hard … for the Drama and then it was kind of all getting messed about with my tonsils.
(06, female, age 16)
More worrying emotional responses were bed wetting (which was only mentioned by parents and not children) and embarrassment and alienation because of smelly breath. It must be noted, however, that the children’s responses may have been inhibited by the presence of their parents or other family members.
Impact of recurrent sore throat
Education
All of the children in this sample had had time off school because they were sent home by their teachers or kept out of school by their parent(s) because they either were too ill or had related medical appointments to attend. All of the parents in this sample were concerned regarding the amount of schooling that had been missed by their child, with this concern increasing during important (exam) school years. There were mixed views among the children as to whether missing school was a positive or negative experience, although many children complained about having to catch up on missed work. On a number of occasions the school itself had cited concern regarding the child’s attendance, and on one occasion the education authority had become involved.
Well apart from, me form tutor she was doing that and she was like, well you’ve missed quite a bit of school through your tonsils, she was like are you not, are you not going to see the doctor and I was like, well not really we’re going, we’ll go to the hospital, ask them about getting them took out, but some of the teachers were having problems ‘cause I was missing some of the lessons
(06, female, age 16)
Social life
The social life of all of the children in this sample had been negatively affected by recurrent sore throats.
You feel you are missing out sometimes like when people go out like to somewhere … and you can’t because you’re bad [ill].
(02, female, age 12)
None of the children would go out and play or be with friends during an episode of sore throat, either because they were not allowed to or because they did not feel able to. Many children had hobbies that they were unable to perform such as singing, karate, swimming, drama, dancing and sport. Most of the children would rest or sleep and perform sedentary activities (such as watching television, reading or drawing) during an episode of sore throat. Many of the participants had missed or caused the cancellation of family days out or special events because of their sore throat. Two participants had experienced disruption to their holiday as a result of their recurrent sore throat.
Family
Naturally, any recurrent health complaint is likely to take its toll on the sufferer’s family. All of the parents were frustrated at the consequences of the recurrent nature of their child’s ill health. All of the working parents had, at some point, needed to take time off work to look after their child or to make visits to health professionals. On two occasions this was cited as the reason for leaving or losing jobs.
I’ve lost jobs because of him having been off school … I don’t think that sometimes people believe you, you know?
(Mother of 10, male, age 5)
Non-working parents were equally frustrated about being tied to the house or concerned about how they would cope if they went back to work.
Ah it’s terrible, you have to stay in the house all week and she does, does your head in … she does – she just does your head in … because you can’t go anywhere … she cannot go shopping and I’ve got to get my brother or her nana to come and you know sit with her but it does your head in doesn’t it.
(Mother of 02, female, age 12)
Many of the parents used their extended family (aunts, uncles, grandparents, siblings) as an alternative source of care when taking time off work became difficult or they became ill. A lot of the parents said they experienced periods of tiredness because they had been kept awake during the night or had tried to sleep with their ill child. The social lives of families, including family holidays, days out and evenings out, were also affected by their child’s recurrent sore throats, and some felt that their other children suffered from lack of attention as a consequence. Parents and siblings also had to deal with the associated emotional problems described above.
Management of recurrent sore throats
Throughout the interviews, a number of themes arose regarding how the families managed the chronic problem of recurrent sore throats.
Requesting tonsillectomy
The over-riding theme was the need to request or even demand the surgical removal of the child’s tonsils. There was a general feeling that parents might have to fight to get this treatment and that there was an increasing reluctance to remove tonsils in recent years which was understood to be largely because of costs. However, parents were unconvinced that their children would simply ‘grow out of’ recurrent sore throats or ‘grow into’ their tonsils, and surgery was often thought to be the only long-term solution.
Yeah his brother had his took out and he’s been brilliant since he got his done … it was the best thing I could have done for him … that’s why we are trying to push to get his done because it’s just recurring all the time, every couple of months or so and it’s not fair on the bairn and it’s not fair on his education either because he’s having to have the time off school because he’s just, well he wouldn’t be any good at school.
(Mother of 05, male, age 14)
However, it must be made clear here that there were substantial differences between children and their parent(s) regarding their views on surgery. On only three occasions were parent(s) and child in agreement regarding their desire, or lack of desire, to have surgery. On two other occasions the child exhibited a strong desire for surgery while their parent(s) was less sure; these were the two oldest children in the sample.
I was a bit disappointed actually because I just wanted to get rid of it [sore throat] straight away.
(08, female, age 15)
In all other cases it was the parent(s) who desired surgery while the child was either ‘worried’, ‘scared’, ‘panicked’ or adamant that they did not want surgery.
‘Playing’ the surgical waiting list
For parents who were more cautious about surgery, perhaps because their child’s symptoms had improved, there was a strategy of ‘playing’ the surgical waiting list. This involved joining the list for tonsillectomies, but using the time to wait and see whether the symptoms improved. Once the child reached the top of the waiting list the parents would then choose whether or not to go ahead with the surgery. However, if the decision was made not to have surgery at that time, the parents suggested that they would be able to ask for their child to be put back on the bottom of the waiting list just in case their symptoms got worse again. This was viewed as the best use of the waiting time.
Well, it’s like the consultant said, if for one reason you don’t want the operation, go on the waiting list again for the 10 months, and it starts reoccurring, obviously just get in touch with him and hopefully get it done eventually, you know, it’s just the waiting list again and another 10 months.
(Father of 07, male, age 7)
Self-referring to secondary health care
Once families had been referred to secondary care but had agreed to wait and see if their child’s symptoms would improve with time, there was a general agreement that they could then self-refer direct to secondary care if the child’s symptoms worsened. This gave parents the reassurance that they could seek direct help without having to ‘fight’ their way through the referral system.
I was really surprised … she said that … actually if he ever got that again ring us up direct and we will take him straight in and have them done, which I thought was good.
(Mother of 04, male, age 5)
Having a tonsillectomy ‘just in case’
Even though symptoms were improving for some of the children, some of the parents thought that their child’s tonsils should be removed as a precaution against the sore throat symptoms reoccurring.
If it come to the 10 month up and he didn’t need it done, my wife says, ‘Oh I might get it done anyway, just in case’.
(Father of 07, male, age 7)
Using the experience of others
As a result of the lack of evidence relating to the best treatment for recurrent sore throats, parents relied heavily on their own or others’ experience.
His brother had his [tonsils] took out and he’s been brilliant since he got his done – it was the best thing I could have done for him.
(Mother of 05, male, age 14)
The majority of parents interviewed either had had their own tonsils removed or knew of someone else who had had their tonsils removed with great success, and used this knowledge to decide on the best course of treatment for their child. However, two parents had also heard about tonsillectomy operations ‘going wrong’, which left them scared and worried. However, after raising these concerns with the consultant, the parents felt that the risks were small enough for them to still request the operation. None of the parents or children related experiences of others successfully ‘growing out’ of sore throats.
Requesting prescriptions for antibiotics
Another popular strategy in coping with recurrent sore throat was requesting repeat prescriptions for antibiotics from the GP. Often this was dependent on seeing the ‘right’ GP in the practice or visiting an out-of-hours service. However, many parents preferred not to see the GP but to request prescriptions over the telephone. This allowed parents to receive the desired outcome from a trip to the GP without having to actually attend an appointment. It appeared to be a solution for some GPs as well as parents.
It started a few year ago … he was just constantly sore throats obviously all the time … so we were obviously down the Doctors but the last few month I was just actually phoning the doctor up and asking for a prescription over the phone because they knew what is was and they were well Doctor always just used to say, right we know what’s the matter with him … and just give him a prescription over the phone for the last few month.
(Mother of 03, male, age 10)
Attending school with sore throat
In the meantime, while children were experiencing recurrent sore throats, most of the parents at one time or another had sent their child to school while they were ill. This was often in response to increasing levels of absence from school (for the child) and work (for the parents). This strategy sometimes resulted in the child being sent home from school by their teacher; however, this allowed the parent to transfer the responsibility for the child’s absence to the teacher or school.
I mean if I had my way she would be at school with a sore throat, but I mean you cannot … I have been guilty sending her to school because I know that she comes home and I wait here for the phone call and about half eleven or something you’ll get a phone call saying … will you be in, she’s on her way home, you know … is it alright for her to come home and I’ll say well I cannot very leave her there … so she’ll end up coming home and she’ll be off the rest of the week … and then she’ll go back to school for a fortnight and then she’ll get a sore throat again but I mean as I say she only started there but she missed a lot of school … I mean her attendance was only 55% not on really … I mean she would be there all the time if it wasn’t for this you know.
(Mother of 02, female, age 12)
Summary
This small qualitative study provides an understanding of the drivers behind parents seeking a surgical solution to their children’s condition. There are a number of caveats that should be made about these data. The study used a convenience sample; the selection of families was based on ease of availability and accessibility rather than using a purposive sample guided by theory. However, the sample broadly reflected the normal range of children seen in ENT outpatient clinics. However, it did not cover the whole range of ages for both boys and girls, with fewer younger girls than might have been expected from normal referral patterns. The interviews provided a rich description of the condition from the perspective of children and their parents and provided an insight into their treatment preferences. These insights were used in the development of the outcome questionnaires and in the construction of the scenarios in the utility study that is described in Chapter 5.
Interviewing dyads presents its own problems as they are jointly created accounts presenting neither the parent’s nor the child’s version of events. Certainly the percentage contribution of the children to the interviews was much lower than that of the parents. Both contributions may have been inhibited by the presence of others. The presence of parents is likely to affect the accounts given by children as they are tempered by the presence of adults. Similarly, parents are perhaps unlikely to express their deepest fears of the risks of surgery in front of young children. Although young people may have the cognitive skills to form opinions, the adult status of the researcher may cause problems in eliciting, collecting and interpreting their thoughts. In addition, it was parents who took the lead in volunteering and consenting to the study and it is difficult to establish how far this was in collaboration with the child.
Chapter 5 Utility willingness-to-pay study
By estimating the quality of life for different health states associated with tonsillitis and tonsillectomy, it is possible to calculate the number of quality-adjusted life-years (QALYs) that can be gained from treatment using changes in health-related quality of life over time. Participants’ ratings of their quality of life were given a score which is anchored at values of zero for death and one for full health. These scores, known as health-state utilities, were used to ‘quality adjust’ remaining life-years. QALYs are the product of the number of life-years and the quality of those life-years. Therefore, 2 years in a health state valued at 0.5 would be equivalent to 1 QALY, the same as 1 year spent in a health state valued at 1.0. This is useful because, if time in different health states can be empirically assessed and it is feasible to value those different health states on the 0–1 scale, then, using QALYs, the impact of different treatments can be compared on a common unit of assessment that encompasses both quality and length of life. 45
Objectives
The aim of the utility study was to measure quality of life for health states associated with tonsillitis. The specific objectives were:
-
To estimate the health-state utility associated with recurrent sore throat.
-
To estimate the health-state utility associated with surgical management.
-
To calculate the utility loss or gain associated with surgical management.
Eliciting utility values – the standard gamble method
The standard gamble method was used to elicit utility values for health states associated with recurrent sore throat and medical or surgical management. Standard gamble is a technique used to elicit individuals’ preferences.
To measure individuals’ preferences for a chronic health state, individuals are offered a choice between two options. Option 1 is some form of treatment that has two possible outcomes: a return to full health for the rest of their life or immediate death. The probability that the treatment will work and they will return to full health is p and the probability it won’t and they will die is (1 – p). Option 2 is a certain outcome of remaining in the chronic health state (state i) for the rest of their life. The individual is then asked to make a choice between options 1 and 2 as the probability p is varied. The probability p* at which the individual is indifferent between the two options is the utility value of health state i (if measured on a scale where perfect health is p = 1 and death is p = 0).
The scores that are obtained using the standard gamble method for each health state represent the directly derived utility values of those states. The utility value indicates the risk of death a person is willing to take in exchange for perfect health, i.e. a utility value of 0.6 indicates that an individual is willing to take up to a 60% risk of death in exchange for perfect health.
To facilitate the standard gamble exercise a visual aid known as a chance board was used. 46 This presents the probabilities associated with each of the uncertain and certain outcomes as a percentage risk of an event, which is generally more understandable to people.
The chance board
The board is divided into two sections. The top half of the board illustrated the uncertain Option 1 with probability, p, of the most preferred health state and 1 – p of the least preferred health state. The probabilities can be changed by turning a wheel underneath the board. On the bottom part of the board is the certain outcome Option 2. The health state placed in this section relates to symptoms that characterise tonsillectomy.
The probabilities were then altered using a ping-pong strategy back and forth between a low and high value until the participant was indifferent to Option 1 or 2. Using the ping-pong strategy reduced the possibility of anchoring bias. It also reduced the risk of a framing effect caused by participants believing that the increases or decreases in probability were gains and losses subject to a reference point.
Scenario development
Health-state scenarios were developed to be used in the standard gamble exercise. To meet the study objectives two scenarios were developed; one that represented the tonsillitis state and another that represented the outcomes following tonsillectomy. As the alternative treatment for tonsillitis is essentially reactionary, based on prescribing antibiotics when the patient is experiencing an episode of tonsillitis, it was decided not to create a third scenario based on medical management, but instead incorporate this into the tonsillitis health-state scenario. Two sets of scenarios were developed, one that was for parents and the other for teenagers. The scenarios presented an identical list of symptoms but were worded as either ‘your child’ will experience these symptoms in the scenarios to be presented to parents, or ‘you’ will experience these symptoms in the scenarios presented to teenagers.
An initial search of the literature indicated that there were no previous studies that had presented health states associated with tonsillitis for use in quality of life surveys. Therefore it was necessary to develop the health states based on the best available evidence at the time on the type of symptoms that a patient with tonsillitis would experience before and after surgery. The information for the scenarios was gathered from the literature on tonsillitis47–58 and in consultation with the clinicians on the project. As the utility study was being conducted alongside the main trial it was not possible to use the actual number of reductions in sore throats that was reported in the trial, as these data were not available at the time; therefore, we had to use the best available estimates from the literature at the time. Initially the symptoms were presented under five subheadings: physical health; emotional health; behaviour; family activities; and impact on parents’ time/emotions. For each scenario, an explanation of how parents’ own or their child’s health would be affected was presented under each heading. No specific time frame was added to each scenario; however, participants would be informed that the symptoms would last until the child reached 18 years. Although it is known that tonsillitis is essentially a self-limiting disease and is unlikely to last longer than a few years, the standard gamble exercise requires that each scenario lasts for a given time period or it is not a chronic illness. As all of the children who would take part in this study would be of different ages, a pragmatic decision to make the time frame up to the age of 18 years was taken. Two additional scenarios were added to the tonsillitis and tonsillectomy scenarios, these were full health and death. These scenarios were necessary to be able to value the other health states on the 0–1 quality of life scale.
Before piloting of the standard gamble exercise, the scenarios were written as a bulleted list of symptoms without the subheadings included in order to provide concise scenarios that were easy to read. The final scenarios were labelled Health State X, which corresponds to the tonsillitis state, and Health State Z, which is the tonsillectomy state. These labels were used so as not to influence the respondents with the names of the disease and the treatment. A final set of scenarios for parents is shown in Box 6.
You get 6–7 sore throats each year; these last 7–10 days each
During this time …
-
it hurts to swallow
-
you have a temperature
-
headache
-
feel sick and eat less
-
take antibiotics which can give you diarrhoea and a rash
-
you feel tired and irritable
-
cannot go to school
-
cannot do your usual activities
-
your parents are worried about you and may not be able to go to work
For up to 2 weeks after the treatment you …
-
have a sore throat
-
feel sick
-
have a temperature
-
feel tired and bad-tempered
-
small risk (1 in 20) that the tonsils will bleed and you have to have a blood transfusion
-
cannot go to school
-
cannot take part in family, group or sporting activities
-
may wake up in the night
-
your parents are more worried and have to stay off work to look after you
After the first 2 weeks you …
-
have 1–2 sore throats each year; these last 2–3 days each
-
have 2–3 days off school each year when you have a sore throat
-
feel ill and tired and bad-tempered when you have a sore throat
-
your parents may have to take time off work when you have a sore throat
-
when you do not have a sore throat you have no pain or discomfort, behave normally and can take part in your normal activities
No pain or discomfort and you are full of energy
Behave normally at home and school
Able to go to school and join in classes
Join in family, group or sporting activities
Your parents go to work and carry out their normal activities
Interview materials
The standard gamble exercise was carried out using face-to-face interviews. An interviewer manual was designed to guide the interviewers through the standard gamble exercise (see Appendix 8).
This included an introduction to the study for the interviewer to read out to the participant and then a step-by-step guide to using the chance board to complete the standard gamble exercise. A response booklet was designed to go alongside the interviewer manual so that the interviewer could record the participant’s answers to the standard gamble. The response booklet also included a set of demographic questions to be completed after the standard gamble exercise. This was included to be able to present information on the sample and potentially understand the answers given, especially if the parent’s employment or income had been affected by his or her child’s tonsillitis.
A participant information sheet was designed to give to participants before the exercise to explain the purpose of the study and any potential benefits and disadvantages in taking part. A consent form was also produced. All of these materials were approved by the Newcastle and North Tyneside Research Ethics Committee.
Pilot study
A small pilot study was conducted with members of staff at the Institute of Health and Society, Newcastle University. This pilot study was primarily to test out the materials and provide training to the interviewers. Before the pilot study, initial training on using the chance board was provided by a member of the research team with previous experience of using the chance board in a clinical setting (HM). During the piloting process the interviewer manual was updated to make it more naturalistic for the interviewer to read out.
It became clear during the pilot study that when performing the second gamble, which involves trading against death, the participants were reluctant to gamble even at very small risks of death. The nature of the standard gamble exercise means that to be able to place a health-state scenario on the 0–1 scale it must be gambled agai nst death or be chained through a health state that has been gambled against death. Although this could potentially prove problematic in the main study, it was decided to continue with the exercise on the basis that parents and children who had experience of the symptoms of tonsillitis may be more willing to gamble to be free of those symptoms, which the qualitative study had identified as debilitating to children and their parents (see Chapter 4).
Willingness to pay
Willingness to pay (WTP) is another method of preference elicitation which is used to measure a person’s ‘strength of preference’ for, or the value of, a good or service. 59 Maximum WTP represents the maximum amount of other goods an individual is willing to give up (or sacrifice) expressed in monetary terms to gain the benefits of the programme. 60 The contingent valuation method is generally used to elicit individuals’ WTP in health care. This involves designing a survey that sets up a hypothetical scenario involving a change in a commodity and eliciting an individual’s WTP for it. 61
One of the main advantages of using WTP is that it can capture more than just the health gain that an individual gains from a service, which is not captured by QALYs. In the case of tonsillitis it is likely that more than the health change that arises from treatment is important to the families, with the type of treatment, the impact on parents’ employment and the child’s education also likely to be of importance.
As the purpose of the WTP question was to determine how much parents value the provision of a tonsillectomy, it was decided that the WTP question should be answered only by parents who rate Health State Z (tonsillectomy) above Health State X (tonsillitis). The teenagers were not asked the WTP question as it was assumed that they did not have an income from which they could trade. The WTP question was based on the two health states, X and Z, which the participants had previously read as part of the standard gamble exercise and was therefore familiar to them. The WTP question asked the participant to imagine that he or she was in Health State X, but could pay for a treatment which would result in moving to Health State Z. The risks of the treatment were outlined before asking the participant if he or she would be willing to pay for the treatment. The full question is given in Box 7.
For participants who ranked Health State Z above Health State X.
We would like to understand more about how much you value treatment for your child’s tonsillectomy. One way of measuring the value to you of the treatment is to ask what you would be willing to pay to receive this treatment. This is simply a way of measuring how strongly you feel about having the treatment for tonsillectomy.
Imagine that your child experienced the symptoms that were presented on the card labelled Health State X. There is a surgical treatment available which would improve your child’s symptoms to those presented on the card labelled Health State Z, but it is not yet available on the NHS. So, imagine that, if you would like your child to have this treatment, you would have to pay for it privately. As with all surgical procedures there is a very small risk of death associated with this treatment. For this treatment the risk of death is 1 in 35,000. This means for every 35,000 people who have the operation one person will die as a result of this.
Would you consider paying for this treatment or continue with the scenario described on card X? Bear in mind that any payment you make for this treatment will reduce the amount of money that you have available to you to spend on everything else.
Would pay
Continue with X
If yes, what is the maximum amount you would be willing to pay for this treatment?
(Write in amount here)………………………………………………………………
To help determine each participant’s maximum WTP, a card sorting type exercise was used. This exercise involved 15 small payment cards, each of which was printed with an amount of money ranging from £1 to £20,000. The full set of values was £1, £2.50, £5, £10, £25, £50, £100, £250, £500, £1000, £2000, £3000, £5000, £10,000 and £20,000. Each participant was given a set of payment cards and a template on which to place them. They were asked to shuffle the cards and then take one card at random (to avoid ‘starting point bias’ whereby participants ‘anchor’ their subsequent WTP value on a card offered to them by the interviewer) and decide if they would be willing to pay that amount for the intervention described in the question. If yes, they were told to place it on the template in the box marked ‘definitely would pay’; if no, they were told to place it in the box marked ‘definitely would not pay’; or if they were not sure, to place it in the ‘unsure’ box.
The participant repeated this exercise for all of the different payment cards, and was then asked to record the highest value placed in the ‘definitely would pay’ box onto the questionnaire booklet along with the lowest value placed in the ‘definitely would not pay’ box. Finally, the participant was asked to decide what was the maximum amount he or she would be willing to pay and record this on the questionnaire booklet too. It was stressed to the participant that this may be one of the figures on the payment cards or it may be another value not listed. Each participant was asked to remember when making his or her decision how much they could afford to pay. As an individual’s response to a WTP question is constrained by his or her ability to pay, in the demographics section of the questionnaire a question on the participant’s current income was also included so that this could be taken into account in the analysis of the WTP questions.
Data collection
Participants were recruited from two of the NESSTAC trial sites: Newcastle and Glasgow. These participants were not in the NESSTAC trial and therefore were not assigned to either medical or surgical management. Interviews took place from March to July 2008.
In Newcastle, participants were recruited to the study through a tonsillectomy preoperative assessment clinic. Patients and their parents visit the paediatric ward for assessment prior to surgery. These clinics operate once a week. Each patient who attended the clinic between May and July 2008 was invited to take part in the study by the nurse conducting the preoperative assessment. If the parents agreed to take part in the study, the nurse introduced the parent to the researcher. If patients were over 12 years old, they were also asked if they would be willing to take part. The researcher outlined the patient information sheet to participants and, if they were still willing to take part, took their consent. The interview was then conducted.
As all patients attending the preoperative assessment clinic in Newcastle were by definition already committed to a tonsillectomy as their means of treatment, it was decided that to gain a wider range of patients whose sore throats were managed in other ways, another clinic should be used. In Glasgow, a children’s ENT outpatient clinic was used. Three special sore throat clinics were set up in March and April 2008. Each eligible patient attending these clinics was asked by his or her consultant to take part in the study. The eligibility criteria for the study were that the patient must have suffered with recurrent sore throat in the past year and must be able to complete an interview in English. If the patient agreed the consultant took consent from the parent or teenager and introduced them to the researcher for the interview to take place.
Three interviewers (CL, HM, Marie Poole) conducted the interviews over the 5-month period. Each interviewer was trained using the interviewer manual so as to remove any potential interview bias. Each parent or teenager who agreed to take part in the study was interviewed following his or her clinic appointment. The interviewer followed a set manual (see Appendix 8) so that the same wording was used for each participant. Participants were given further information on the study before moving onto the exercise where they first ranked the health states and then completed the standard gamble questions. If they had ranked Health State Z above X (the tonsillectomy state above the tonsillitis state) they were also asked to answer the WTP question as was outlined above. All participants were then asked to complete the demographic questions and the interview was concluded. Interview data were entered into an excel spreadsheet to aid analysis.
Results
Characteristics of participants
Over the 5-month recruitment period there was a total of 48 eligible parents attending a clinic in either Glasgow (13) or Newcastle (35). From this potential sample, 41 parents agreed to take part. The response rates were 100% for Glasgow and 80% for Newcastle. The most common reason given by parents refusing to take part was that the child had to return to school after the clinic.
There were 12 eligible teenagers, one from Glasgow and 11 from Newcastle. Few teenagers in Glasgow were expected because participants were recruited from a children’s hospital which predominately treats children aged 12 years and under. A total of 11 teenagers agreed to take part with one person from Newcastle deciding not to. For all 10 teenagers from Newcastle the exercise was completed by both the teenager and his or her parent.
The characteristics of the children whose parents completed the exercise are given in Table 26. Additional information on how the child’s sore throats have affected the parent is also presented in this table.
Number of participants by gender | |
---|---|
Male | 21 |
Female | 20 |
Mean age (SD) | 8 (3.98) years |
Age range (SD) | 3–17 years |
Mean number of sore throats per year (SD) | 8.1 (5.48) |
Number of parents completing exercise | |
Mother | 33 |
Father | 7 |
Mean age of parent (SD) | 34 (8.75) years |
Mean number of days taken off work (SD) | 6.1 (7.50) |
Table 27 shows the characteristics of teenagers who participated in the study.
Number of participants by gender | |
---|---|
Male | 4 |
Female | 7 |
Mean age (SD) | 14 (1.97) years |
Age range (SD) | 12–17 years |
Mean number of sore throats per year | 9 (5.04) |
Standard gamble results
The first stage of the standard gamble exercise was a ranking where the participant had to rank Health States X and Z. As there were two possible outcomes that participants could choose as their preferred health state, the results are presented in two ways.
It was expected a priori that Health State Z (representing tonsillectomy) would be ranked above Health State X (representing tonsillitis). From the 41 parents completing the ranking, 28 ranked Z above X (68%). For the teenagers, eight ranked health state Z higher (73%). Table 28 presents the results for the two health states when Z was ranked higher than X.
Utility Score Z (range) | Utility Score X (range) | |
---|---|---|
Parent | 0.965 (0.703–1.000) | 0.931 (0.65–1.00) |
Teenager | 0.840 (0.19–1.00) | 0.776 (0.1–1.0) |
The utility values were elicited using a chaining method where the health state ranked first was scored against full health and the worst ranked health state, this worse health state was then scored against full health and death. The highest ranked state was then rescored using the value that was elicited for the lower ranked state. A chaining exercise was used, as early piloting of the exercise highlighted that participants were not willing to take a risk of death for health states that they perceived were not serious. From the 28 parents who ranked Health State Z highest, 14 were unwilling to take any risk of death even for the health state they ranked worse (Health State X). Only one teenager was unwilling to take any risk of death, perhaps indicating a different attitude to risk to their parents.
The alternative for participants was to rank Health State X above Health State Z, with 13 parents and three teenagers doing this. Table 29 shows the utility when Health State X was ranked higher than Z.
Utility Score X (range) | Utility Score Z (range) | |
---|---|---|
Parent | 0.961 (0.73–1.00) | 0.938 (0.55–1.00) |
Teenager | 0.61 (0.45–0.80) | 0.450 (0.35–0.55) |
In this ranking, eight parents were not willing to take any risk of death, but all three teenagers were. Although only three teenagers ranked Health State X above Z, the utility scores elicited from them were substantially lower than those given by the parents.
Willingness to pay results
The WTP question was introduced to complement the standard gamble exercise as it does not ask participants to make any trade-offs between a health state and death, but instead gets them to consider their budget constraints when expressing their value for a health state.
The WTP was only given to parents as most of the teenagers were too young to be in employment and were unlikely to have control over the household budget.
In addition, the WTP was only given to parents who had ranked Health State Z above X, because the aim of the exercise was to find out how much these parents valued tonsillectomy as a treatment for their children.
All 28 parents were willing to complete the WTP question. The mean WTP was £8059 with a range of £100–30,000; therefore, the median of £5000 may be a more representative value. No one gave a zero response, highlighting the importance that parents place on providing a treatment that would move their child from Health State X to Z.
Estimation of quality-adjusted life-years
With these results, it is possible to estimate the QALY gain for the two ranking combinations. Using the mean age of 8 years of the children in this sample and the fact that parents were told to imagine that the symptoms of tonsillitis would last until the child reached 18 years, the time horizon of any potential gain would be 10 years. For those who ranked Health State Z higher than Health State X, the gain in moving X to Z was 0.034. Owing to the design of the standard gamble exercise, the QALY gains estimated were for a longer duration than the cost data and were also longer than would be expected given the nature of the disease. Therefore, these QALY gains should be discounted at 3.5%, which is the current recommended value for discounting by the UK Treasury. 62 This would give QALY gains of 0.3 when Health State Z was ranked above Health State X, and 0.2 when X was ranked above Z. To combine these two values into an overall gain, it is necessary to weight the gains by the proportion of the sample that ranked the health states in each of the two combinations. Approximately 68% of the sample ranked Health State Z above X; therefore, the QALY gain of 0.3 is weighted by this. For those who ranked Health State X above Z, the gain of 0.2 QALYs is weighted by 32%. The overall QALY gain is 0.136 QALYs. Thus, the best QALY gain from treatment for tonsillitis is, based on this study, 0.3 QALYs and at worst is 0.136 QALYs. These gains are relatively small.
For teenagers the gains are larger. For those ranking Health State Z above Health State X, the gain was 0.55 QALYs and was 1.38 QALYs when X was ranked above Z. However, when these values were weighted, the overall gain was 0.28 QALYs. This information was used to calculate an incremental cost per QALY gained (see Chapter 6).
Discussion
The sample size of 41 participants may be considered small. However, although a larger sample may have reduced the variance within the results, all of the 41 interviews followed a similar pattern, with parents unwilling to take even quite small risks for either health state, no matter which health state they had ranked first.
The utility values that were elicited are illustrative of the fact that the parents were unwilling to take risks against death, with all of the values being higher than 0.931, which can also be thought of as 93.1% of full health.
For the 28 parents who ranked Health State Z above Health State X, the utility values elicited from them were 0.965 and 0.931 respectively. These values can also be expressed as: Health State Z was valued as 96.5% of full health and Health State X valued at 93.1% of full health. Both of these values are high, indicating that this sample of parents did not believe that these health states have a large impact on quality of life. The gain in quality of life from Health State Z over Health State X is 0.034.
The remaining 13 parents ranked Health State X higher than Health State Z. This result was less expected as it had been assumed that parents would prefer for their child to have tonsillectomy. This was especially the case for those attending the Newcastle clinics, as these were preoperative assessment appointments on the paediatric ENT ward. There were eight parents from Newcastle who ranked the health states in this way. The main reasons given for preferring Health State X was that they did not like the side effects of Health State Z, especially the risk of bleeding and needing a blood transfusion. The health states were designed in conjunction with clinicians to accurately represent the potential side effects of a tonsillectomy and the potential outcomes that a child might experience following a tonsillectomy. It could also be the case that, as the health states were labelled only X and Z, the parents were unaware that Health State Z represented the tonsillectomy and Health State X presented the common symptoms of recurrent tonsillitis. The health states were purposely not labelled so as to avoid any bias from the participants actively seeking a particular type of treatment.
The utility values elicited from these 13 parents were 0.961 for Health State X and 0.938 for Health State Z, giving a difference of 0.023 between the two health states. Again these values show that these health states were rated highly and did not have a large impact on quality of life.
Just over half of the parents (53%) did not take any risk of death when asked to trade the worst health state against full health and death. This was expected following early piloting. Many of the parents commented that they would not take a risk of death to avoid the worse health state as it was not worth it if the child would grow out of the illness by the age of 18. In the interviews, it was emphasised that the scenarios were hypothetical and that death was not an expected outcome of their child’s treatment, but, as with all surgical treatments, there is a small risk of death (estimated at between 1 in 16,000 and 1 in 35,000 for tonsillectomy); however, none of the parents interviewed discussed this risk. This could indicate that they were unaware of the risk or that they considered it to be so small that it did not come into their decision-making when deciding on whether to go ahead with a procedure. This may highlight that the risks need to be more clearly explained to parents, especially when taking into account the non-fatal risks of treatment, which a number of parents seemed to be unaware of.
One of the features of the exercise was that the parent was told that the health states would last until the child reached 18 years. This may have influenced the way in which parents answered the questions, depending on the current age of their child. To see if this made a difference to the values, the data were split by the age categories 4–7, 8–11 and 12–15 years and reanalysed. The results are not presented here as on examination of the values there was no difference in the utility values between each of the age groups. However, there was some difference in the WTP values. Parents of the children aged between 4 and 7 years were willing to pay £10,000 (median) while parents of children in the 8- to 11-year age group were willing to pay £2000 and those in the 12- to 15-year group £3000.
The standard gamble method typically results in higher utility values than would be expected if they had been estimated using another method such as the visual analogue scale or the time trade-off. This is because, with the standard gamble method, to be able to place a health state on the 0–1 scale, at least one of the health states must be gambled against death. With a temporary, non-fatal health state, such as tonsillitis, many people would not take a risk of death to avoid the health state being valued.
If they were asked to rate the same health state using the visual analogue scale, they would likely give a lower valuation to a health state; however, this involves no sacrifice from the participant. In this situation the time trade-off is not appropriate as it involves sacrificing time in the future, which is not realistic in this situation given the young age of the patients and that they are expected to grow out of the illness by the time they reach adulthood. The use of a generic quality of life instrument such as the European Quality of Life-5 Dimensions was also rejected for this study as the five domains are not very applicable to tonsillitis and also the questionnaire would be completed by parents and it is difficult for them to accurately understand how tonsillitis affects their child’s quality of life.
There were a smaller number of teenagers who completed the study; however, the results indicate that there could be significant differences in the way in which patients view their quality of life with tonsillitis and the treatment options. The small sample size means that there is less confidence in the results but they do demonstrate that the patients view the quality of life with both tonsillitis and tonsillectomy to be worse than their parents do. The majority of the teenagers ranked Health State Z above X giving a utility score of 0.840 to Health State Z and a score of 0.776 to Health State X. Only one person was unwilling to take any risk of death, this could mean that as the person who suffers with recurrent tonsillitis they believe that this has a serious impact on their quality of life. It could also mean that the risk perceptions and hypothetical risk perceptions of younger people are different to older adults and they may be more risk seeking. Three teenagers ranked Health State X above Health State Z and attached very low utility scores to both health states (0.61 to X and 0.450 to Z). With only three participants it is not possible to draw firm conclusions on whether these results would remain this low if more participants had been recruited to the study.
The health-state utility values indicate that the two health states are not that different, and neither had a great impact on quality of life. However, the WTP results provide a different view suggesting that a treatment for tonsillitis is very important to the parents participating in this study. All parents who were asked the WTP question were willing to pay something. Some of the parents said that they would pay anything and more said that they would pay everything they could. The main reason given was that they could not put a price on their child’s health. These results are more in keeping with the qualitative study (see Chapter 4), where the main theme of the interviews was the parents’ requests or demands for tonsillectomy. This demand for tonsillectomy appears to be on the basis that the parents interviewed in the qualitative study used their own personal experience or the experience of others they knew that had undergone successful tonsillectomies. This is likely to explain the higher WTP values if the parents believed that the treatment would be successful.
One of the main weaknesses of this study was that it was conducted alongside the trial and therefore it was not possible to use the clinical effectiveness results from the trial in the health-state scenarios. The estimates of the numbers of sore throats that are presented in the health-state scenarios are based on the literature. Following the completion of the trial, the estimates included in the health-state scenarios do not correspond that closely with those found in the trial. Therefore, the QALY calculations reported here are for the health states presented and not the actual health gains experienced by those in the trial.
Chapter 6 Economic evaluation
Economic evaluation
This chapter describes the economic evaluation based on trial participants only, which was conducted as an intention-to-treat cost-effectiveness analysis as described in the original protocol. The perspective for the collection of costs was the UK NHS. The number of episodes of sore throat avoided using the number of reported sore throats by trial participants during the 2-year follow-up period was the primary outcome used in the estimation of cost-effectiveness. A cost-effectiveness analysis was performed following methods outlined by Drummond et al. 63 Costs and outcomes for each of the trial participants were calculated and the mean incremental cost-effectiveness ratio (ICER) was estimated as:
As the follow-up period of the study was only 2 years, the costs and outcomes were not discounted. Data from the utility study (see Chapter 5) were used to calculate the incremental QALY gain.
Confidence intervals for the cost and outcome data were estimated using a non-parametric bootstrapping method,64 which accounted for any skewness in the data. 65
Cost data
The medical resource data required for the cost analysis can be split into two categories: contact with medical professionals and drug prescribing.
Health service unit costs were valued using the most recent Department of Health resource cost data, at 2005–6 UK prices. 66 The items of NHS resources that were included and their unit costs are shown in Table 30, along with the source of cost information. The cost of drugs consumed by participants includes only drugs prescribed by participants’ GPs. The 56th edition of the British National Formulary67 was consulted for the unit cost of individual drugs prescribed to trial participants. Unit cost data were then combined with resource use data to estimate the total NHS resources used by trial participants during the 2-year follow-up.
Item | Cost (£) | Source |
---|---|---|
Primary care | ||
GP appointment (consultation time of 11.7 minutes) | 30.00 | PSSRU68 |
GP home visit (visit lasting 23 minutes) | 49.00 | PSSRU68 |
GP telephone consultation (lasting 7.1 minutes) | 18.00 | PSSRU68 |
Nurse appointment (per consultation) | 9.00 | PSSRU68 |
Nurse home visit (per home visit) | 17.00 | PSSRU68 |
Nurse telephone consultation (lasting 6 minutes) | 2.60 | PSSRU68 |
Visit to emergency out-of-hours clinic (based on walk-in centre attendance) | 27.00 | PSSRU68 |
Call to NHS direct (call taken by nurse) | 2.69 | Richards et al.69 |
Secondary care | ||
Accident and Emergency visit | 84.00 | Department of Health reference costs, 200666 |
Outpatient visita | 78.00 | Department of Health reference costs, 200666 |
Inpatient stayb | 1206.00 | Department of Health reference costs, 200666 |
Emergency ambulance | 337.00 | Department of Health reference costs, 200666 |
Tonsillectomy | 996.00 | Specific NHS Trust |
Resource use
Resources used by trial participants in relation to their recurrent sore throats were recorded in the outcome questionnaires (see Appendix 5) and GP records. Only resource use for the treatment of recurrent sore throat was included in the calculation of cost-effectiveness. The response rates for the return of self-completed questionnaires and abstraction of GP records have been reported in Chapter 3. The resource data have not been adjusted to account for the response rate. The nature of the resource use data, in multiple categories and with varying returns from participants in each section of the trial, does not allow for an accurate transformation of the data similar to that performed for the effectiveness data. In not performing a similar transformation of the resource use data there is likely to be a bias in the overall estimates of the resulting costs for resource use. As it is likely that there will be under-reporting of all resources used it is likely that this will result in a lower overall cost to the NHS than may in fact have occurred. The economic evaluation was performed using only patients who had at least one piece of cost and outcome data. Table 31 shows the total recorded resources used by trial participants randomised to medical management and surgical management.
Service | Medical management (n = 115) | Surgical management (n = 120) |
---|---|---|
Prescription drugsa | ||
Treatment for infection | 426, 5 (4.51) | 389, 4 (3.77) |
Total number of drugs prescribed, mean number of drugs prescribed per patient (SD) | ||
Analgesics | 189, 2 (2.62) | 211, 2 (3.13) |
Total number of drugs prescribed, mean number of drugs prescribed per patient (SD) | ||
NHS contactsb | ||
GP contact (number) | 571 | 492 |
Nurse contact (number) | 106 | 84 |
Outpatient visits (number) | 79 | 64 |
Inpatient visits (number) | 15 | 30 |
From Table 31 it can be seen that there are some differences in resource use between the patients in the surgical and medical management groups. Those in the medical management group had more contact with primary care health professionals with more visits to the GP and nurse. Patients in the surgical arm of the trial reported more inpatient visits. However, some caution must be taken in drawing conclusions as to whether surgery increases inpatient visits. The questionnaire asked parents to record any inpatient stays during the previous reporting period but it was not specifically noted that this should not include their inpatient stay for their tonsillectomy procedure. Therefore it is possible that for both arms of the trial patients reported an inpatient stay that was actually their tonsillectomy procedure. If this was the case then, for those in the surgical arm, there will be some double counting of secondary care services. This may mean that the incremental cost between the two groups is lower than reported here.
Costs
NHS costs
The estimated mean costs for trial participants randomised to medical management or surgical management are shown in Table 32. The difference in the mean cost between the surgical group and the medical management group was statistically significant (t-statistic = –9.25: p = 1.41E–17).
Medical management (n = 115) | Surgical management (n = 120) | |
---|---|---|
NHS contacts cost | 450.38 (6.72) | 1390.75 (6.44) |
Prescribing costs | 12.84 (0.14) | 11.40 (0.11) |
Total cost | 463.22 (6.71) | 1402.15 (6.42) |
The main factor which influenced the difference in mean total cost was the cost of the tonsillectomy: if this was removed the difference in mean cost between the two groups would be reduced. The mean cost in the surgical group was now lower at £205.92 than the mean cost of £229.99 in the medical management group; however, this was not a statistically significant difference (t-statistic = 0.87; p = 0.379). This indicates that the cost driver was the tonsillectomy.
Patient costs
Indirect patient costs for childhood conditions included loss of earnings and productivity due to the time that parents or carers had to take off work to look after their child and out-of-pocket expenses associated with the child’s sore throats such as over-the-counter prescriptions and travel costs.
The time costs of parents were considered for inclusion in the cost-effectiveness analysis. However, when examining the data returned, the numbers of parents who recorded that they had taken time off work because of their child’s condition was relatively low. Table 33 presents the mean number of days taken off work as reported by the parents and Table 34 presents the mean number of hours taken off work. As the numbers are small, estimates of the costs to participant have not been estimated or included in the economic analysis.
Questionnaire | Medical management (n = 115) | Surgical management (n = 120) | ||
---|---|---|---|---|
Mean number (SD) | Number of responses (%) | Mean number (SD) | Number of responses (%) | |
Baseline | 2.74 (1.87) | 35 (30.43) | 2.83 (1.71) | 36 (30.00) |
3 month | 2.53 (2.23) | 15 (13.04) | 3.36 (2.49) | 14 (11.67) |
12 month | 3.22 (4.18) | 9 (7.83) | 2 (0.00) | 5 (4.17) |
24 month | 3.50 (2.38) | 4 (3.48) | 1.67 (1.15) | 3 (2.50) |
Questionnaire | Medical management (n = 115) | Surgical management (n = 120) | ||
---|---|---|---|---|
Mean number (SD) | Number of responses (%) | Mean number (SD) | Number of responses (%) | |
Baseline | 6.10 (4.38) | 10 (7.83) | 9.47 (7.70) | 15 (12.50) |
3 month | 8.23 (6.37) | 13 (11.30) | 11.80 (6.24) | 10 (8.33) |
12 month | 12.67 (11.72) | 3 (2.61) | 0.00 (0.00) | 0 (0.00) |
24 month | 18.00 (19.70) | 3 (2.61) | 3.00 (0.00) | 1 (0.83) |
Information on parents’ or carers’ out-of-pocket expenses was collected through the questionnaires. These data were collected in three sections: money spent on over-the-counter medications, money spent on any additional expenses caused by the child’s condition, and the cost of child care. The mean cost for each of the groups was small at £14 for the medical management group and £18 for the surgical group, the difference between the two was not statistically significant (t-statistic = –0.7, p = 0.473). More data were returned by parents or carers on any out-of-pocket expenses they had incurred, with 190 (71%) reporting that they had some expenses related to their child’s condition.
Outcomes
Sore throat episodes
As reported in Chapter 3, the mean number of episodes of sore throat per child was less for the surgical management group than for the medical management group over the 2-year follow-up period. As described in Chapter 3, we adjusted the estimate of the number of episodes of sore throat for the reduction in diary response over time. The adjusted mean number of sore throats in the medical management group was 9.0 (standard deviation 7.7) and in the surgical management group 5.5 (standard deviation 5.2). Therefore, the estimated reduction in the mean number of sore throat episodes due to the surgical management group was 3.5 episodes (95% CI 1.8 to 5.2).
To calculate a QALY from the utility value estimated in the utility study, it was necessary to incorporate a time horizon. To calculate this, the average age of the children whose parents took part in the utility study was used; this was 8 years. The health-state scenarios used in the utility study stated that the condition would last until the child reached 18 years of age. Therefore, a 10-year time horizon was used in the calculation of the QALY gain. This is likely to be an over-estimation of the number of years for which the child would either experience the symptoms of tonsillitis or receive benefit from treatment, as we know that tonsillitis is a self-limiting disease. Further explanation of why the time horizon for the standard gamble exercise was chosen can be found in Chapter 5. As the QALY gain is estimated for 10 years, discounting at 3.5%62 has been applied.
As there were two possible ways (see Chapter 5) in which the health states could be ranked, the best estimate of QALY gain from treatment for tonsillitis based on this study is 0.3 QALYs and the worst estimate is 0.136 QALYs.
Cost-effectiveness
Incremental cost-effectiveness ratio
As reported above, the cost of treatment provided to the surgical management group was higher than that provided to the medical management group. However, the number of episodes of sore throat in the 2 years of follow-up was less. It was therefore necessary to calculate an ICER, as no strategy was dominant. 63 The estimated mean incremental cost for the surgical management group over the medical management group was £939. The estimated mean incremental effectiveness was 3.5 episodes of sore throat avoided. The ICER was therefore £261 per sore throat avoided (95% CI £161 to £586) – numbers may not calculate exactly due to rounding. The CI for the ICER was calculated using the non-parametric bootstrapping method. This method samples with replacement, cost and effectiveness values calculated for the trial participants and calculates the cost-effectiveness ratio. 1000 cost-effectiveness ratios were generated, which were then ordered and the 26th and the 975th percentiles were taken to generate the 95% CI. 64
Incremental cost per quality-adjusted life year
It was also possible to calculate the incremental cost per QALY. The estimated mean incremental cost of surgical management over medical management was £939. The QALY gain ranged between 0.136 and 0.3 QALYs. Using this information, the incremental cost per QALY ranged from £3129 to £6904 per QALY gained.
Chapter 7 Discussion
Tonsillectomy and adeno-tonsillectomy have been widely used surgical procedures for the treatment of children with chronic tonsillitis or recurrent sore throat in the UK since the 1930s. 2 Although the incidence of tonsillectomy has declined in recent years to some 50,000 tonsillectomy procedures on children per year,1 there remains little clear evidence of effectiveness and no evidence based on RCTs that might guide clinicians in their decisions about treatment for individual patients or guide NHS commissioners of services in their decisions about the cost-effectiveness of surgical or medical management. 26 This study was commissioned by the HTA programme in order to provide some evidence of clinical effectiveness and cost-effectiveness of tonsillectomy and adeno-tonsillectomy for the treatment of children with recurrent sore throat. The study does not apply to the effectiveness of these surgical procedures for children with obstructive sleep apnoea.
Target population
The true incidence of recurrent sore throat in children is difficult to estimate as it relies on the attitudes and behaviour of parents and children and GPs,1,11 which are likely to lead to significant variations for parents seeking treatment for their children from their GP in the referral of children with recurrent sore throat by GPs to ENT specialists and for rates of tonsillectomy. 14,70
Clinical guidelines for the treatment of recurrent sore throat suggest that tonsillectomy is indicated where there is typically a 2-year history of three to four episodes of moderate severity (5-day duration) per annum. 5–7 The impact of these guidelines on clinician behaviour, however, is unclear71 but they may not be uniformly implemented, and surgeons are more likely to perform tonsillectomies than not on children, whereas guidelines suggest watchful waiting or medical management. 5 Nevertheless, the inclusion and exclusion criteria for the present study were guided by the criteria for tonsillectomy in children indicated in these guidelines. The study therefore does not reflect the outcomes for all children currently undergoing tonsillectomy in the UK for recurrent sore throat.
Patient preference
Parental preference may play an important role in the incidence of tonsillectomy9 (see Chapter 5). As tonsillectomy has been a routine procedure for over 50 years, we anticipated that some clinicians and parents would not be in equipoise and would favour surgical management of recurrent sore throats in children. In developing the study, we anticipated that patient preference would increase the non-participation rate in a standard RCT design, and therefore combined a pragmatic RCT36 with a parallel non-randomised cohort in the design of the study72 (see Appendix 1).
We did not attempt to differentiate between the preferences of parents and children in the study. The proportion of parents and children participating in the study who stated a preference was 63% (461/729) (see Chapter 3). If we assume that all eligible children who declined to participate in the study (286) had a patient preference, this would suggest that the proportion of parents and children stating a patient preference is 74% [(461+286)/1015].
Referral from primary care is probably part of the process of stating a preference for a secondary care intervention. The design of the study does not capture the process of self-referral to primary care and the decision-making processes taken by the GP in partnership with parents and children. Therefore, it is not possible to estimate the number of children who would have been eligible for the study but were not referred. Nor is it possible to understand how patient preferences played a role in this process. However, the data revealed a potential gender difference in the demand and referral for secondary care opinion, with girls in the older age group presenting to the study ENT centres more frequently than boys (see Chapter 3). This is consistent with data from Denmark. 73
Of the 461 cohort participants who were not in ‘equipoise’, 16% (74/461) opted for medical management and 84% (387/461) for (adeno-)tonsillectomy. This strong preference for surgical removal was anticipated, given that the procedure is well established in clinical practice and ‘expected’ by many patients referred to ENT surgeons. Perhaps unanticipated was the minority, but not insignificant number, of participants who opted for medical management following referral to an ENT surgeon and a discussion with the participating consultants and research nurses of the possible risks and benefits of the procedure.
A number of factors may have influenced the 387 cohort participants who had elected for surgery. Earlier studies10,17,56,74 suggested that in addition to demographic and clinical variables, school attendance and performance were important. Sixty-two per cent of cohort participants opting for surgical management reported that their progress at school was impeded by recurrent sore throats compared with 29% of the cohort participants opting for medical management and 39% of trial participants. A multinomial regression model (see Table 8) confirms the importance of perceptions of school performance, along with the experience of chronic sore throat and female gender.
Characteristics of trial and cohort participants
An examination of participants’ reported health in the 6 months before randomisation (trial) or recruitment (cohort) suggests that overall the cohort participants who opted for surgery were likely to experience more of a range of sore throat symptoms than trial participants who in turn were likely to experience more symptoms than cohort participants who opted for medical management (see Table 6). There was a significant association between study group and the number of sore throats, the number of days a sore throat lasted in any one episode, the number of sore throats that lasted more than 2 weeks and the number of sore throats that involved an ear infection.
These findings were also reflected in the effect that sore throats had on school activity and quality of life in the 6 months prior to randomisation or recruitment. Cohort participants opting for surgical management were more likely to have taken days off school, they perceived that progress at school had been affected and scored lower on the PedsQL physical health and mental health summary scores (see Table 7). Sore throat symptoms were more likely to have affected trial participants than cohort participants who opted for medical management, with the exception of their PedsQL physical health scores which were very similar.
Observed differences in the characteristics of participants have an important bearing on the subsequent interpretation of outcome data.
Outcome of surgical or medical management
The key objective of surgical and medical management of recurrent sore throat is to reduce the frequency and severity of sore throats for children to a clinically significant extent. For the purposes of the study, we defined a priori the primary outcome as the reported number of episodes of sore throat in the 2 years after randomisation for trial participants and 2 years after recruitment for cohort participants. The source of these data was self-completed daily diaries returned by participants every 4 weeks for 24 months. In addition we collected information retrospectively about the reported experience of sore throats and other symptoms through telephone contact with participants who had not returned diaries and self-completed postal questionnaires at 3 months, 12 months and 24 months after randomisation (trial participants) or recruitment (cohort participants). A further source of information was abstracted from GP records: the recorded number of GP consultations for sore throat and prescribed medication used in the medical management of recurrent sore throats. The use of these different sources of information about sore throat experience for 24 months’ follow-up allowed some triangulation of the data.
External validity
The quality of the evidence reported from the study is seriously compromised by loss to follow-up, the high non-response rate to daily diaries and self-completed questionnaires, and missing data due to incompletion of diary and questionnaires. Figure 2 showed a decline in diary returns for trial and cohort participants over the 24-month follow-up from about 78% to 22% (trial) and from 63% to 15% (cohort). The CONSORT flow chart (see Figure 1) also highlights the significant loss to follow-up through the decline in response rates from 88% for the baseline survey to 33% for the 24-month outcome questionnaire (Table 35).
All groups (n = 729) | Surgical management (n = 131) | Trial | Cohort | ||
---|---|---|---|---|---|
Medical management (n = 137) | Surgical management (n = 387) | Medical management (n = 74) | |||
Baseline | 88% | 87% | 81% | 90% | 91% |
3 months | 56% | 66% | 63% | 49% | 62% |
12 months | 38% | 56% | 40% | 32% | 36% |
24 months | 33% | 49% | 39% | 29% | 34% |
The quality of evidence from GP records is also impaired by the number of records traced and from which data were abstracted (69% trial; 31% cohort).
Assessment of sore throat outcomes
The primary outcome was the number of reported sore throat episodes in the 24-month follow-up. In clinical guidelines an episode is defined as a period of 4–5 days’ duration. Diary reporting of sore throats was not that straightforward, and a period of sore throat reflected in the primary outcome variable was operationalised in the analysis as described in Box 2. This variable was adjusted using data from the telephone contact with non-respondents of diaries. The average number of diaries returned per child in the trial was 9.9. The response rates were very similar for both arms of the trial. By adding in responses to telephone interviews for months during which no diary was returned, we increased the number of responses per child by 1.6 to 11.5. Prior to undertaking the analysis, but in the knowledge of response rates, it was decided that the primary analysis would be based on the pooled data which are those reported in the final report. Because we adopted the same approach for both groups, any bias due to poor recall should be roughly equalised across them. Any bias in the magnitude of the effect of tonsillectomy in terms of episodes of sore throat is likely to be small in comparison with the bias due to the very poor overall diary return rate. The estimates of tonsillectomy using the above approach were consistent with those obtained from the analysis of interviews, which of course are totally based on patient/parent recall.
There was no imputation of missing data. A secondary outcome variable used in the analysis was the number of sore throat days – the number of days for which sore throats were recorded in the diary (or sore throat free days). A second sore throat related secondary outcome variable also used in the analysis was the number of recorded consultations for sore throat abstracted from GP records.
Clinical effectiveness
Primary outcome
Episodes of sore throat
Chapter 3 reports the findings of an intention-to-treat analysis. Analysis of the primary outcome variable, episodes of sore throat, shows that there is a decline in the number of episodes of sore throat across all study groups, reflecting the view that for many children it may be a self-limiting illness. 75 This is shown in Table 12 through a comparison of the mean number of sore throats in the first and second years after randomisation or recruitment – the incidence of sore throats for children receiving medical management was found to be much smaller in the second year than in the first year. Earlier studies29–31,76 of dubious quality32 reported that the benefits of tonsillectomy versus medical management controls were higher in the first year after tonsillectomy than in the second year. In one of the few acceptable but underpowered randomised trials,17 it was reported that the decline in the number of sore throats decreased over time. The intention-to-treat analysis of the present study suggests that surgical management has a larger relative benefit in the second year than in the first year. Comparison with earlier studies, however, is difficult and not to be advised because of their poor quality and the differences in case-mix and the analysis strategy (not an intention-to-treat analysis) in the Paradise trial. 17
The benefit of surgical management in this study may have been delayed due to the timing of surgery and the effects of surgery. The relatively high number of sore throat episodes reported in Table 12 for the trial and cohort surgical management groups may include sore throats between the date of randomisation or recruitment and surgery. For the trial participants, tonsillectomy was scheduled to take place within 12 weeks of randomisation, whereas cohort participants would more often be put on the standard waiting list which was normally longer than 12 weeks. The effects of tonsillectomy are well documented,16,17 with sore throat pain lasting for an average of 5–6 days after the operation.
Reviewing the primary outcome for trial participants only, the intention-to-treat analysis reported in Table 13 that controls for participating centre and age group suggests that surgical management confers a statistically significant benefit and has a larger relative benefit in the second year than the first despite children in the medical management group experiencing fewer episodes of sore throat during that second year. The robustness of this analysis is obviously challenged by the effect of ‘patient’ preferences (which can be estimated by comparing the outcomes for trial participants with those for cohort participants) and the poor response rate to daily dairies and outcome questionnaires.
Table 14 compares sore throat episodes at outcome for trial and cohort participants. Looking at those children in the trial and cohort in the surgical management groups we find a significant difference in primary outcome during the first year. Cohort participants in the surgical management group had significantly poorer outcomes than trial participants. This difference may reflect differences in trial and cohort participants at baseline: cohort participants in the surgical management group reported more of a range of sore throat symptoms than trial participants in the surgical management group. However, it may also reflect the timing of surgery, with cohort participants having a longer wait for surgery than trial participants. In the second year the difference in primary outcome between trial and cohort participants in the surgical management group was smaller and not statistically significant, although the 95% CI was between 0.57 and 1.25. We therefore cannot discount the possibility that cohort participants in the surgical management group were still reporting worse outcomes in year 2.
Looking at those children in the cohort and trial medical management groups we find that the primary outcome is similar. However, our interval estimates of the difference are fairly wide because of the relatively small number of cohort participants opting for medical management.
Secondary outcomes
Sore throat days
Intention-to-treat analysis of the number of days of sore throat reported in Table 17 and summarised in Box 3 reflects the primary outcome. The statistical models reported suggest that for trial participants those in the surgical management group were less likely than those in the medical management group to record a day of sore throat during both years of the study. Comparisons of trial participants with cohort participants suggest that trial participants in the surgical group were less likely to record a day of sore throat than cohort participants during both years of the study. As with the primary outcome, these differences may reflect differences in baseline characteristics or differences in the length of time that participants waited for surgery. A comparison of trial participants with cohort participants both in the medical management group suggests that trial participants were more likely to record a day of sore throat in both years of follow-up than cohort participants, although differences in the incidence rates in year 2 were not statistically significant. The very wide CI for the incidence rate in year 2 reflects the comparatively small number of children who returned diaries in this period. These differences may also reflect differences in baseline characteristics – cohort participants in the medical management group reporting less sore throat symptoms than trial participants.
GP consultations
Data abstracted from GP records concerning all consultations and consultations for sore throat for the 2 years of follow-up reported in an intention-to-treat analysis in Table 18 show that overall there was little difference between participants in the four groups. The mean number of consultations and sore throat consultations declined for each group between year 1 and year 2. Among trial participants, those in the medical management group had more consultations than those in the surgical management group [year 1, IRR 0.91 (95% CI 0.71 to 1.17); year 2, IRR 0.83 (95% CI 0.63 to 1.10)]. The trial medical management group also had more sore throat consultations than the surgical management group [year 1, IRR 0.81 (95% CI 0.59 to 1.10); year 2, IRR 0.67 (95% CI 0.46 to 0.97)]. These data, which for trial participants are more complete than participant reported data, suggest a similar trend in differences between the two arms of the trial, as is apparent for the primary outcome.
Quality of life
Assessment of quality of life is based on PedsQL. The analyses reported in Chapter 3 (see Table 19) suggests that trial participants in the surgical management group reported higher scores than participants in the medical management group for both subscales in years 1 and 2 before and after adjustment for baseline assessments. Outcomes were similar for trial and cohort medical and surgical management groups. However, effect sizes were relatively small (less than 0.25). The impact of surgical management on quality of life is more difficult to interpret given that a range of factors may have influenced outcome scores in addition to changes in sore throat experience. The wide CIs reported along with the low response rate to outcome questionnaires suggest that these results should be treated with caution. With these caveats in mind, however, there is some suggestion that surgical management had a more positive effect than medical management among trial participants; an interpretation that is in line with the primary outcome variable. That there was no difference between cohort and trial participants within management strategies suggests that the physical and psychosocial health PedsQL scores are less informative than the primary outcome in the interpretation of clinical effectiveness.
Secondary analysis
An intention-to-treat analysis of trial participants only was undertaken in an attempt to discover whether we could identify groups of participants who benefited from surgical management. The analysis described in Chapter 3 included a covariate to adjust for the poor response to diaries and outcome questionnaires.
In the discussion of primary and secondary outcomes we suggested that the results may have been influenced by the sore throat experience of participants prior to enrolment to the study. The overall effect of surgical management in the trial was estimated as IRR = 0.68 (95% CI 0.88 to 0.92) when fitting a negative binomial regression model. Fitting an interaction with symptom severity using different estimates of symptom severity (number of GP consultations for sore throat in 2 years prior to enrolment; number of sore throats in previous months reported in baseline questionnaire) was found not to have a significant effect.
Age
In Chapter 3 we reported the results of an analysis to identify whether surgical management benefits any particular age group. The results of negative binomial regression analysis using the primary outcome variable (reported number of sore throats episodes) are shown in Table 21. Overall we see a relative benefit for children who are aged 8–11 years. Children in this age group randomised to medical management were more likely to report an episode of sore throat than other children randomised to medical management during the follow-up period. It is in children aged 8–11 years that we see the largest effect of surgical management. However, it may be that the higher level of reporting of sore throats among children of this age group randomised to medical management is a chance anomaly due to the overall poor response rate for diaries.
Gender
We have seen that gender was a factor in patient preferences for surgical management among cohort participants. A secondary analysis that fitted gender as a main effect suggested that girls tended to report more sore throats over the follow-up period than boys. However, the interaction between gender and surgical management was not significant and the additional effect of surgical management for a female participant is estimated as IRR = 0.91 (95% CI 0.64 to 1.30).
Cost-effectiveness
Cost-effectiveness analysis based on intention to treat was performed on trial data using the approach outlined by Drummond et al. 63 Resources used by trial participants are reported in Chapter 6 (see Table 31). Prescription data were abstracted from GP records and data on contact with NHS services were collected through the outcome questionnaires. Estimates of NHS service use are therefore subject to the same caveats as the primary outcomes used for the clinical effectiveness analysis. The mean costs for trial participants of treatment for recurrent sore throats were calculated using resource data from participants and standard NHS unit costs. Table 32 reports that the cost of surgical management is significantly higher than that of medical management. The cost of surgery is the cost driver because when the cost of surgery is removed the difference in mean costs is substantially reduced. The estimated mean incremental cost for surgical management over medical management was £939.
For the purposes of the cost-effectiveness analysis, an estimate of the number of sore throats over the 2-year follow-up, adjusted for the reduction in diary response over time, was calculated (see Chapter 3). The estimated reduction in the mean number of sore throat episodes due to surgical management (the estimated mean incremental effectiveness) was estimated as 3.5 episodes (95% CI 1.8 to 5.2). Potentially this is an underestimate of the benefits of surgical management because trial participants reported fewer sore throat symptoms in the 6 months before enrolment to the trial than cohort participants who opted for surgical management. The estimated ICER was therefore estimated as £261 per sore throat avoided (95% CI £161 to £586). This estimate is certainly within the range identified in the WTP study of the amount that parents would be willing to pay for the successful treatment of their child’s recurrent sore throat (mean WTP £8059) (see Chapter 5).
Quality-adjusted life-years
The utility study described in Chapter 5 reports the results of preference elicitation using the standard gamble method and the WTP method with a sample of (non-trial) parents and teenagers attending either a tonsillectomy preoperative assessment clinic or an ENT outpatient clinic. Two health-state scenarios were developed; one that represented the experience of recurrent sore throat or tonsillitis (Health State X) and a second that represented possible outcomes following surgery (Health State Z). Each scenario was used in both preference elicitation exercises. In Tables 28 and 29, utility scores for parents and teenagers are reported for the situations in which Z was ranked above X or X was ranked higher than Z. Using these data it is possible to estimate the QALY gain for the two ranking combinations. Adjusting for the proportion of participants who selected each scenario, the estimated gain is between 0.136 and 0.3 QALYs (see Chapter 6). Using these estimates the estimated incremental cost per QALY ranges from £3129 to £6904 per QALY gained. Caution must be used when interpreting the results from the utility study, as the scenarios that were used to describe the health states associated with tonsillitis and tonsillectomy were not based on the clinical outcomes found in the trial. At the time of developing the utility study these data were not available, therefore, values from the literature were used. Following the completion of the trial, it was discovered that the change in the number of sore throats from treatment did not correspond with the numbers in the scenarios. Therefore the cost per QALY estimates do not correspond to the clinical benefits experienced by patients in this trial.
Conclusions
Clinical effectiveness
Overall this study has supported the view that the health of children with recurrent sore throat improves over time. However, trial participants randomised to surgical management tended to experience better outcomes than trial participants randomised to medical management, indicating some relative benefit of surgical management. This may be greatest for children aged 8–11 years. Study participants who expressed a preference for surgical management and experienced more sore throat symptoms prior to enrolment to the cohort study tended to report poorer outcomes than trial participants receiving surgical management. Trial participants who were randomised to medical management had poorer outcomes than children who opted for medical management in the cohort, but this difference decreased over time. The study highlights the role of patient preferences and the importance of taking account of these in the design of the trial.
Cost-effectiveness
The ICER was estimated as £261 per sore throat avoided (95% CI £161 to £586).
Trial quality
These conclusions are subject to a number of caveats. This was an intention-to-treat analysis and may therefore underestimate the effect of surgical management because 36 participants (36%) randomised to medical management received surgery within the 2-year follow-up. This compares with a smaller number of participants randomised to surgical management who had not received surgery at 2-year follow-up (11, 10%).
The main caveats surrounding these analyses, however, concern the poor response rates to daily diaries and self-completed questionnaires, particularly in year 2 of follow-up, which have seriously challenged the external validity of the trial.
Chapter 8 Conclusions
The recently updated Cochrane Review26 reported that there is no clear evidence of the clinical effectiveness and cost-effectiveness of (adeno-)tonsillectomy in the treatment of recurrent sore throat among children. The limitations of the present study suggest that the next review update will reaffirm the current review’s conclusion. The continuing careful use of ‘watchful waiting’ and medical management in both primary and secondary care is therefore recommended until clear-cut evidence of effectiveness is available.
For children meeting the NESSTAC eligibility criteria, we have shown that there are clinical benefits of tonsillectomy that persist for at least 2 years. Secondary analysis did not really identify subgroups of children for whom tonsillectomy produced greater benefits, but this may be because the study did not have adequate power to detect such effects. Logically there must be a level of disease severity at which the clinical benefits of tonsillectomy are not cost-effective. Current clinical guidelines suggest that (adeno-)tonsillectomy is indicated where there is typically a 2-year history of three to four episodes of moderate severity (episodes of 5-day or longer duration). 5–7 This study provides no evidence for a change in these recommendations in either direction.
Study participants were more likely to express a preference for tonsillectomy if they had experienced more severe symptoms of sore throat prior to entry to the study. Presumably the perceived benefits of the procedure were greater for such participants.
Evidence from this study confirms that there is a strong parental preference for (adeno-)tonsillectomy. A significant minority of study participants, however, opted for medical management within the cohort study, suggesting that consideration needs to be given to ensuring that parents and children are fully aware of the risks and benefits of (adeno-)tonsillectomy and are given an informed choice of what treatment strategy to follow. Surgeons should not assume that referral to ENT is indicative of parents’ and childrens’ preferences for surgery.
This report has adhered strictly to the principle that an intention-to-treat analysis of complex trials and comprehensive cohort studies is preferred. Secondary analysis is proposed in order to estimate the impact of surgical management on study participants whose tonsils were surgically removed (explanatory analysis36).
The poor response rates to postal outcome questionnaires and diaries suggest that other more expensive ways of capturing these data should be considered. Methodological research is recommended that determines the cost-effectiveness of different methods of data collection (e.g. postal questionnaires versus telephone interviews versus face-to-face interviews).
The utility and WTP studies were relatively small and were not based on the clinical outcomes found in this trial. In order to estimate patient preferences for surgical or medical management of recurrent sore throats, further investigation using revised scenarios, which are more reflective of the outcomes found in this trial, could be conducted on a larger sample to determine parent and patient preferences in terms of QALYs and WTP, as well as further work to understand patient preferences for surgical or medical management.
Implications for practice
-
There are clinical benefits of tonsillectomy that persist for at least 2 years.
-
Participants were more likely to express a preference for tonsillectomy if they had experienced more severe symptoms of sore throat.
-
There is a strong parental preference for tonsillectomy.
-
Careful use of ‘watchful waiting’ and medical management in both primary and secondary care is recommended until clear-cut evidence of effectiveness is available.
Recommendations for research
-
Exploratory secondary analysis to estimate the impact at surgical management on study participants whose tonsils were surgically removed.
-
Methodological research of alternative methods of data collection.
-
Larger utility elicitation/WTP studies.
Acknowledgements
We are most grateful and extend our sincere thanks to all the children and their parents who took part in the study as participants and to those many health professionals and NHS employees who facilitated its process.
We would like to thank our trial steering committee who provided expert advice and support throughout the study and commented on earlier drafts of the report: Professor John Birchall (Professor of Otolaryngology and Consultant Otolaryngologist, Nottingham University Hospitals NHS Trust), Emeritus Professor George Browning (Professor of Otorhinolaryngology, University of Glasgow), Professor John Gibson (Professor in Respiratory Medicine, Newcastle University), Professor John Matthews (Medical Statistician, Newcastle University), Dr Paul McNamee (Economist, University of Aberdeen) and Dr Luke Vale (Economist, University of Aberdeen).
The authors would also like to thank the research nurses (Vikki Dobson, Beverly Henderson, Susan Hurst, Siobhan McCormick, Kath Newham, Jane Sim and Carole Tyson); the project secretaries (Mary Dickinson, Emma Heenan, Erika Tandy, Clare Vint and Cheryl Wiscombe); the data collectors and data managers (Marie Poole, Cath Lunt, Pauline Potts, Benet Reid, Lorna Wake, Agnieszka Wincewicz and Ruth Wood); and research staff (Nigel Armstrong, Rachel Baker, Senga Bond, Julie Doughty, Nikki Rousseau and Chris Speed) for their help and support.
Contribution of authors
Contribution to the study
Professor John Bond (Professor of Social Gerontology and Health Services Research) was the lead investigator. He was responsible for the overall management of the study, developed the protocol and prepared the report for publication. Dr Katie Brittain (Lecturer in Social Gerontology) was the trial manager (December 2001 to August 2004) and contributed to the qualitative study. Mr Sean Carrie (Consultant Otolaryngologist) recruited participants and assisted in the acquisition and interpretation of data. Mr Ray Clarke (Consultant Otolaryngologist) developed the protocol, recruited participants and assisted in the acquisition and interpretation of data. Professor Martin Eccles (Professor of Clinical Effectiveness and Primary Care) developed the protocol, was responsible for the acquisition of clinical data from general practice and assisted in the analysis and interpretation of data. Mr Haytham Kubba (Consultant Otolaryngologist) recruited participants and assisted in the acquisition and interpretation of data. Dr Catherine Lock (Senior Research Associate) was the trial manager and main researcher on the project (August 2004 to August 2008). She was responsible for the day-to-day management of the trial and the analysis of qualitative data, and prepared the report for publication. Dr Helen Mason (Research Associate – economics from July 2007) was responsible for the economic evaluation and utility study and prepared the report for publication. Mr Chris Raine (Consultant Otolaryngologist) recruited participants and assisted in the acquisition and interpretation of data. Dr Nick Steen (Principal Research Associate – statistics) was the Trial Statistician. He developed the protocol, was responsible for the statistical analysis and prepared the report for publication. Professor Janet Wilson (Professor of Otolaryngology, Head & Neck Surgery and Consultant Otolaryngologist) was the lead clinical investigator, developed the protocol, was responsible for the acquisition of clinical data in secondary care and assisted in the analysis and interpretation of data. Ms Alessandra Vanoli (Senior Research Associate – health economics) was the Trial Health Economist until December 2005. She conceived and designed the economic and utility studies and data collection instruments. Mr Andrew Zarod (Consultant Otolaryngologist) developed the protocol, recruited participants and assisted in the acquisition and interpretation of data.
Contribution to the report
Professor John Bond prepared drafts of Chapters 7 and 8, and edited and finalised the report. Dr Catherine Lock prepared drafts for Chapters 1–3, 5, 7 and 8. Dr Helen Mason prepared drafts for Chapters 4 and 6 and Dr Nick Steen prepared a draft of Chapter 3. All members of the project team contributed ideas to the report, assisted in data analysis and interpretation and were responsible for critical review of the report.
Publication
Bond J, Wilson J, Eccles M, Vanoli A, Steen N, Clarke R, et al. Protocol for north of England and Scotland study of tonsillectomy and adeno-tonsillectomy in children (NESSTAC). BMC Ear Nose Throat Disord 2006;6:13.
Disclaimers
The views expressed in this publication are those of the authors and not necessarily those of the HTA programme or the Department of Health.
References
- Little P, Williamson I. Sore throat management in general practice. Fam Pract 1996;13:317-21.
- Glover JA. The incidence of tonsillectomy in school children. Proc R Soc Med 1938;XXXI:95-112.
- Fergusson DM, Horwood LJ. Private medical insurance and elective surgery during early childhood. N Z Med J 1985;98:538-40.
- Lloyd Faulconbridge RV, Fowler S, Horrocks J, Topham JH. Comparative audit of tonsillectomy. Clin Otolaryngol 2000;25:110-17.
- Donaldson L, Hayes JH, Barton AG, Howel D. The Development and Evaluation of Best Practice Guidelines: Tonsillectomy With or Without Adenoidectomy. Report to the Department of Health 1994.
- British Association of Otorhinolaryngologists Head and Neck Surgeons . Statements of clinical effectiveness. Otolaryngology 1998.
- American Academy of Otolaryngology Head and Neck Surgery . Clinical indicators compendium. American Academy of Otolaryngology Head and Neck Surgery Bulletin 2000;19.
- Paradise JL, Bluestone CD, Bachman RZ, Karantonis G, Smith IH, Saez CA, et al. History of recurrent sore throat as an indication for tonsillectomy. Predictive limitations of histories that are undocumented. N Engl J Med 1978;298:409-13.
- Fried D. On tonsillectomy: mom’s personal experience. Lancet 1995;346.
- Long CG, Smith DH. Parental pressure for tonsillectomy: attitudes and knowledge of parents accompanying their children to an ear, nose and throat clinic. Psychol Med 1985;15:689-93.
- Bain DJG, Sales CM. Referring children to an ENT department and prescribing psychotropic drugs to their mothers. Br Med J 1981;283:585-8.
- Howie JGR, Bigg AR. Family trends in psychotropic and antibiotic prescribing in general practice. Br Med J 1980;1:836-8.
- Rafuse J. Education, practice reviews needed to reduce surgical intervention, Quebec report says. Can Med Assoc J 1996;155:463-4.
- Blair RL, McKerrow WS, Carter NW, Fenton A. The Scottish tonsillectomy audit. Dundee: Scottish Otolaryngological Society; 1994.
- Randall DA, Hoffer ME. Complications of tonsillectomy and adenoidectomy. Otolaryngol Head Neck Surg 1998;118:61-8.
- Paradise JL, Bluestone CD, Colborn DK, Bernard BS, Smith CG, Rockette HE, et al. Adenoidectomy and adenotonsillectomy for recurrent acute otitis media: parallel randomized clinical trials in children not previoulsy treated with tympanostomy tubes. JAMA 1999;282:945-53.
- Paradise JL, Bluestone CD, Bachman RZ, Colborn DK, Bernard BS, Taylor FH, et al. Efficacy of tonsillectomy for recurrent throat infection in severely affected children. N Engl J Med 1984;310:674-83.
- Myatt HM, Myatt RA. The development of a paediatric quality of life questionnaire to measure post-operative pain following tonsillectomy. Int J Pediatr Otorhinolaryngol 1998;44:115-23.
- Crysdale WS, Russel D. Complications of tonsillectomy and adenoidectomy in 9409 children observed overnight. Can Med Assoc J 1986;135:1139-42.
- Klausner RD, Tom LWC, Schindler PD, Potsic WP. Depression in children after tonsillectomy. Arch Otolaryngol Head Neck Surg 1995;121:105-8.
- Kotiniemi LH, Ryhänen PT, Moilanen IK. Behavioural changes following routine ENT operations in two-to-ten-year-old children. Paediatr Anaesth 1996;6:45-9.
- Reissland N. Cognitive maturity and the experience of fear and pain in hospital. Soc Sci Med 1983;17:1389-95.
- Friday GA, Paradise JL, Rabin BS, Colborn DK, Taylor FH. Serum immunoglobulin changes in relation to tonsil and adenoid surgery. Ann Allergy 1992;69:225-30.
- Gledovic Z, Radovanovic Z. History of tonsillectomy and appendectomy in Hodgkin’s disease. Eur J Epidemiol 1991;7:612-15.
- Liaw KL, Adami J, Grindley G, Nyren O, Linet MS. Risk of Hodgkin’s disease subsequent to tonsillectomy: a population-based cohort study in Sweden. Int J Cancer 1997;72:711-13.
- Burton MJ, Towler B, Glasziou P. Tonsillectomy or adeno-tonsillectomy versus non-surgical treatment for chronic/recurrent acute tonsillitis [Cochrane Review]. Oxford: The Cochrane Library; 2008.
- van Staaij BK, van den Akker EH, Rovers MM, Hordijk GJ, Hoes AW, Schilder AGM. Effectiveness of adenotonsillectomy in children with mild symptoms of throat infections or adenotonsillar hypertrophy: open, randomised controlled trial. BMJ 2004;329.
- Roos LL, Roos NP, Hentelleff PD. Assessing the impact of tonsillectomies. Med Care 1978;16:502-18.
- Mawson SR, Adlington P, Evans M. A controlled study evaluation of adeno-tonsillectomy in children. J Laryngol Otol 1967;81:777-90.
- McKee WJE. A controlled study of the effects of tonsillectomy and adenoidectomy in children. Br J Prev Soc Med 1963;17:49-6.
- Roydhouse N. A controlled study of adenotonsillectomy. Lancet 1969;2:931-2.
- Marshall T. A review of tonsillectomy for recurrent throat infection. Br J Gen Pract 1998;48:1331-5.
- Camilleri AE, macKenzie K, Gatehouse S. The effect of recurrent tonsillitis and tonsillectomy on growth in childhood. Clin Otolaryngol Allied Sci 1995;20:153-7.
- Torgerson DJ, Klaber-Moffett J, Russell IT. Patient preferences in randomised trials: threat or opportunity?. J Health Serv Res Policy 1996;1:194-7.
- Bower P, King M, Nazareth I, Lampe F, Sibbald B. Patient preferences in randomised controlled trials: conceptual framework and implications for research. Soc Sci Med 2005;61:685-95.
- Schwartz D, Lellouch J. Explanatory and pragmatic attitudes in therapeutical trials. J Chron Dis 1967;20:637-48.
- Del Mar C. Sore throats and antibiotics. BMJ 2000;320:130-1.
- Varni JW, Seid M, Rode CA. The PedsQL: measurement model for the pediatric quality life inventory. Med Care 1999;37:126-39.
- Varni JW, Seid M, Kurtin PS. The PedsQL 4.0 2000. www.qlmed.org/PedsQL/Description.htm.
- Varni JW, Burwinkle TM. The PedsQL 4.0 generic core scales as a pediatric PRO instrument: experiences with over 18,000 children and their parents. Patient Reported Outcomes [Newsletter] 2005.
- Sacristan JA, Day SJ, Navarro O, Ramos J, Hernandez JM. Use of confidence intervals and sample size calculations in health economic studies. Ann Pharmacother 1995;29:719-25.
- Briggs AH, Gray AM. Power and sample size calculations for stochastic cost: effectiveness analysis. Med Decis Making 1998;18:S81-S92.
- Al MJ, Van Hout BA, Michel BC, Rutten FFH. Sample size calculation in economic evaluations. Health Econ 1998;7:327-35.
- McCullagh P, Nelder JA. Generalised linear models. London: Chapman and Hall; 1989.
- Weinstein MC, Stason WB. Foundations of cost-effectiveness analysis for health and medical practices. N Engl J Med 1977;296:716-21.
- Furlong W, Feeny D, Torrance GW, Barr R, Horsman J. Guide to design and development of health-state utility instrumentation. Hamilton, Ontario: McMaster University; 1990.
- Carithers JS, Gebhart DE, Williams JA. Postoperative risk of pediatric tonsilloadenoidectomy. Laryngoscope 1987;97:422-9.
- Richmond KH, Wetmore RF, Baranak CC. Postoperative complications following tonsillectomy and adenoidectomy. Who is at risk?. Int J Pediatr Otorhinolaryngol 1987;13:117-24.
- Haberman RS, Shattuck TG, Dion NM. Is outpatient suction cautery tonsillectomy safe in a Community Hospital Setting. Laryngoscope 1990;100:511-15.
- Kornblut A, Kornblut AD, Paparella MM, Shumrick DA, Gluckman JL, Mayerhoff WL. Otolaryngology. Philadelphia, PA: Saunders; 1991.
- Paradise JL, Bluestone CD, Rodgers KD. Comparative efficacy of tonsillectomy for recurrent throat infection in more vs. less severely affected children. Paediatric Research 1992;31.
- Singer JI. Evaluation of the patient with neck complaints following tonsillectomy or adenoidectomy. Pediatr Emerg Care 1992;8:276-9.
- Capper R, Canter RJ. How well do parents recognize the difference between tonsillitis and other sore throats?. Clin Otolaryngol 2001;26:458-64.
- Capper R, Canter RJ. Is there agreement among general practitioners, paediatricians and otolaryngologists about the management of children with recurrent tonsillitis?. Clin Otolaryngol 2001;26:371-8.
- Howel D, Webster S, Hayes J, Barton A, Donaldson L. The impact of recurrent throat infection on children and their families. Fam Pract 2002;19:242-6.
- Paradise JL, Bluestone CD, Colborn DK, Bernard BS, Rockette HE, Kurs-Lasky M. Tonsillectomy and adenotonsillectomy for recurrent throat infection in moderately affected children. Pediatrics 2002;110:7-15.
- Clark MPA, Waddell A. The surgical arrest of post-tonsillectomy haemorrhage: hospital episode statistics. Ann R Coll Surg Engl 2004;86:411-12.
- van den Akker EH. Adenotonsillectomy in children; facts and figures. Utrecht: Julius Center for Health Sciences and Primary Care; 2004.
- Donaldson C, Mason H, Shackley P, Jones A. The Elgar companion to health economics. Edward Elgar: Cheltenham; 2006.
- Pauly M, Sloan F. Valuing health care: costs, benefits and effectiveness of pharmaceuticals and other medical technologies. Cambridge: Cambridge University Press; 1995.
- Mitchell R, Carson R. Using surveys to value public goods: The contingent valuation method. Washington DC: John Hopkins University Press; 1989.
- HM Treasury . The Green Book n.d.
- Drummond MF, O’Brien BJ, Stoddart GL, Torrance GW. Methods for economic evaluation of health care programmes. New York, NY: Oxford University Press; 1997.
- Polsky D, Glick HA, Willke R, Schulman K. Confidence intervals for cost-effectiveness ratios: a comparison of four methods. Health Econ 1997;6:243-52.
- Flynn TN, Peters TJ. Use of the bootstrap in analysing cost data from cluster randomised trials: some simulation results. BMC Health Serv Res 2004;4.
- Department of Health . NHS Reference Costs 2005–06 2006.
- British Medical Association . British National Formulary 2005. www.bnf.org/bnf/.
- Curtis L. Unit Costs of Health & Social Care 2007. www.pssru.ac.uk/pdf/uc/uc2007/uc2007.pdf.
- Richards A, D, Godfrey L, Tawfik J, Ryan M, Meakins J, Dutton E, et al. NHS Direct versus general practice based triage for same day appointments in primary care: cluster randomised controlled trial. BMJ 2004;329:774-8.
- Blair RL, McKerrow WS, Carter NW, Fenton A. The Scottish tonsillectomy audit. J Laryngol Otol 1996;110.
- Donaldson LJ, Hayes JH, Barton AG, Howel D, Hawthorne M. Impact of clinical practice guidelines on clinicians’ behaviour: tonsillectomy in children. J Otolaryngol 1999;28:24-30.
- Bond J, Wilson J, Eccles M, Vanoli A, Steen N, Clarke R, et al. Protocol for north of England and Scotland study of tonsillectomy and adeno-tonsillectomy in children (NESSTAC). A pragmatic randomised controlled trial comparing surgical intervention with conventional medical treatment in children with recurrent sore throats. BMC Ear Nose Throat Disord 2006;6.
- Vestergaard H, Wohlfahrt J, Westergaard T, Pipper C, Rasmussen N, Melbye M. Incidence of tonsillectomy in Denmark, 1980–2001. Pediatr Infect Dis J 2007;26:1117-21.
- Conlon BJ, Donnelly MJ, McShane DP. Improvements in health and behaviour following childhood tonsillectomy: a parental perspective at 1 year. Int J Pediatr Otorhinolaryngol 1997;41:155-61.
- Donaldson L. The Chief Medical Officer on the State of Public Health – Annual Report 2005 2006.
- Roydhouse N. A controlled study of adenotonsillectomy. Arch Otolaryngol 1970;92:611-16.
Appendix 1 Study protocol
Protocol for north of England and Scotland study of tonsillectomy and adeno-tonsillectomy in children (NESSTAC). A pragmatic randomised controlled trial comparing surgical intervention with conventional medical treatment in children with recurrent sore throats
John Bond,1 Janet Wilson,1,2 Martin Eccles,1 Alessandra Vanoli,1 Nick Steen,1 Ray Clarke,3 Andrew Zarod,4 Catherine Lock,1* Katie Brittain,1 Chris Speed1 and Nikki Rousseau1
Addresses: 1Centre for Health Services Research, Newcastle University, Newcastle upon Tyne, UK; 2ENT, Freeman Hospital, Newcastle upon Tyne, UK; 3ENT, Alder Hey Children’s Hospital, Liverpool, UK; 4ENT, Booth Hall Children’s Hospital, Manchester, UK.
Email: John Bond – john.bond@newcastle.ac.uk; Janet Wilson – janet.wilson@nuth.nhs.uk; Martin Eccles – martin.eccles@newcastle.ac.uk; Alessandra Vanoli – Alessandra_Vanoli@yahoo.it; Nick Steen – nick.steen@newcastle.ac.uk; Ray Clarke – rayclarke@aol.com; Andrew Zarod – apzarod@aol.com; Catherine Lock – c.a.lock@newcastle.ac.uk; Katie Brittain – katie.brittain@newcastle.ac.uk; Chris Speed – chris.speed@newcastle.ac.uk; Nikki Rousseau – n.s.rousseau@newcastle.ac.uk.
*Corresponding author
Published 9 August 2006 in BMC Ear Nose Throat Disord6:13; DOI: 10.1186/1472-6815-6-13. Available online at: www.biomedcentral.com/1472-6815/6/13.
Abstract
Background: Uncertainties surrounding the effectiveness and cost-effectiveness of childhood tonsillectomy for recurrent sore throat led the NHS Health Technology Assessment Programme to commission this research to evaluate the effectiveness and cost-effectiveness of tonsillectomy and adeno-tonsillectomy in comparison with standard non-surgical management in children aged under 16 with recurrent throat infections. The aim is to evaluate if tonsillectomy and adeno-tonsillectomy reduces the number of episodes of sore throats among children to a clinically significant extent.
Methods/Design: A simple prospective pragmatic randomised controlled trial with economic analysis and prospective cohort study of non-trial participants comparing surgical intervention with conventional medical treatment. The treatment arm will receive tonsillectomy and adeno-tonsillectomy while in the control arm non-surgical conventional medical treatment only will be used. The primary outcome measure will be reported number of episodes of sore throat over two years with secondary outcomes measures of reported number of episodes of sore throat, otitis media and upper respiratory tract infection which invoke a GP consultation; reported number of symptom-free days; reported severity of sore throats and surgical and anaesthetic morbidity. The study will take place in five hospitals in the UK. The trial population will be 406 children aged 4–15 on their last birthday with recurrent sore throat referred by primary care to the five otolaryngology departments. The duration of the study is seven years (July 2001 – July 2008).
Discussion: As with all pragmatic randomised controlled trials it is impossible to control the external environment in which the research is taking place. Since this trial began a number of factors have arisen which could affect the outcome including; a reduction in the incidence of respiratory tract infections, marked socio-economic differences in consultation rates, the results from the National Prospective Tonsillectomy Audit and the Government’s waiting list initiatives.
Background
In the UK sore throats cost the NHS an estimated £60 million in GP consultations alone, result in 90,000 tonsillectomy procedures, approximately half of which are in children, and a loss of more than 35 million school or work days annually. 1 The incidence of tonsillectomy has risen since the early 1990s, although levels are still much lower than in the 1930s, when 100,000 operations were performed in UK school children. 2 Adenoidectomy is performed with tonsillectomy in about one-third of patients. Private medical insurance is associated with higher selective ENT surgical rates under the age of seven years3 and 16% of UK ENT activity is in the independent sector. Therefore figures based purely on NHS returns inevitably underestimate the total activity. In addition to the health care costs, tonsillectomy incurs parental costs as one parent usually resides in hospital overnight. Thereafter the average time to return to normal activity for under 15 year olds is 12 days. 4
There is a broad similarity in the criteria for tonsillectomy in clinical guidelines in the UK5,6 and North America. 7 The minimum criteria are typically a two year history of three to four sore throats of moderate severity (five day duration) per annum. This is despite evidence that even histories that seem impressive may not be confirmed on close scrutiny in the majority. 8 The complex psychosocial influences on tonsillectomy rates include parental enthusiasm for intervention,9 lack of information10 and maternal use of psychotropic drugs which increases two-fold the rate of consultation for childhood sore throat. 11,12 Guidelines may not be uniformly implemented, even when locally derived. Surgeons tend to break guidelines more often in favour of performing than withholding surgery. 5
National and international variations in the rates of adeno-tonsillectomy have been recognised for decades. Even in the 1930’s, 50% of UK and USA children received a tonsillectomy, while the rate was 0.5% or lower in Germany. 2 A survey of such variation in Quebec, highlighted the importance of clinical uncertainty among physicians about the recommendation of surgical intervention,13 providing further support for conducting primary research. The Scottish National Tonsil Audit showed that rates of tonsillectomy in childhood varied from <4/10,000 in Forth Valley to almost 10/10,000 in Dumfries and Galloway. 14
Differential costs and benefits of surgery at different age groups are not known. The tonsils are traditionally thought to undergo a period of physiological enlargement around school entry. At this time also, pathological sequelae may include otitis media. Older children and adolescents, may have a somewhat different natural history, and illness at this age has rather different (educational) implications.
Mortality from tonsillectomy has been estimated at 1/16000 to 1/35000,15 but surgical risk at this level is hard to measure, to conceptualise and to convey. The major non-fatal complications are infection, haemorrhage (2.15%), and pain which lasts on average five to six days16,17 and may be inadequately treated in children. 18 Haemorrhage is unpleasant, requires intravenous fluid administration, with or without blood transfusion and return to theatre. The reported rate of second anaesthetic for haemostasis varies widely from 0.75% in one British review,4 to as low as 0.06% in a study of almost 9409 children in Toronto. 19 The post-tonsillectomy readmission rate is up to 7%,4 but in Newcastle in childhood is only 2.3% (unpublished data; Department of Clinical Effectiveness, Freeman Hospital, Newcastle). The overall reported complication rate ranges from 8%14 to 14%,17 the majority being relatively minor such as sore throat, nausea, fever, dysphagia. Most 2 to 10 year olds undergoing ENT surgery show behavioural changes such as attention seeking, temper tantrums and night waking and there is also anecdotal evidence for depression after tonsillectomy. 20 Younger children, due to cognitive immaturity seem less well able to adapt to hospitalisation. 21,22 Late sequelae may include lower postoperative serum immunoglobulin levels but these have been ascribed to reduction in antigen stimulation. 23 There is continuing debate about the suggestion that tonsillectomy increases the risk of Hodgkin’s lymphoma. 24 A substantial Scandinavian population based cohort study found an increased risk of Hodgkin’s disease, especially in younger children. 25 The risk of transmission of nvCJD from contaminated tonsillectomy instruments remains quite unquantified. Some centres are costing the use of disposable tonsillectomy sets.
Despite the frequency of tonsil dissection, there is a remarkable lack of robust evidence for its efficacy. Uncontrolled patient reports suggest the procedure to be very effective but recurrent sore throat, particularly in childhood may be a self limiting disease. Where non-intervention control groups have been studied, the benefits of tonsillectomy seem almost to disappear after two years. Available studies are either 20 to 30 years old or confined to small numbers of severely affected individuals with limited general applicability. The most recently published Cochrane review concludes that there is no evidence from randomised controlled trials to guide the clinicians in formulating the indications for surgery in children or adults. 26 The authors state the need for high quality evidence from randomised controlled trials to establish its effectiveness and that these should assess the effectiveness of the procedure in patients with throat infections of differing severity and frequency. A recent Dutch randomised controlled trial of adenotonsillectomy versus watchful waiting reported no differences between treatment arms for children with mild symptoms and only a small difference of less than one episode of fever a year between treatment arms for children with moderate symptoms. 27
The Scottish National Tonsillectomy Audit14 showed high levels of patient satisfaction and that 80% of subjects did not consult a doctor in the subsequent 12 months. However, over the past 30 years a number of controlled studies with longer follow-up indicate marginal and diminishing levels of clinical benefit over a period of non-intervention. There are no substantial claims for the benefit of childhood tonsillectomy after 2 years. Roos28 assessed the benefit to be 1 to 1.5 fewer sore throats (0.5 to 1 episode per annum) over the first two years after surgery in those with three to four episodes per annum preoperatively. Other studies29–31 showed benefits of the order of ∼1.5 fewer sore throats versus controls in the first postoperative year and on average one fewer episode in the second year. All of these and other available studies provide inadequate evidence because of poor definition of entry and outcome criteria, failure to include intention to treat calculations and small or skewed samples. 32 Even the only scientifically acceptable study by Paradise and colleagues17 suffered from comparatively small numbers of a skewed population of more severely affected children. The benefits of surgery were more marked (approximately 1.75 fewer episodes in year 1, 1.5 in year 2) but equally short lived. The drop out rate was 34% by the end of year 2 and one in three of the control group underwent surgery and were excluded from analysis. Also, the very active therapy of the control arm may have mitigated any impact of surgery. The Paradise group went on to study a more typical i.e. less severely affected group of children, but the full results of this study, near completion in 1992 have never been reported.
Weight gain is a cited supplementary benefit of tonsillectomy. Two recent studies showed accelerated weight gain postoperatively, but as the children were shown to be of normal or above average height and weight preoperatively, this effect may be undesirable. 33 There appears so far to be only minimal additional benefit from adenoidectomy or adenotonsillectomy in recurrent acute otitis media. 16
A straw poll, for this protocol, of consultant otolaryngologists asked: what level of reduction in sore throat would justify removal of the tonsils? Replies were remarkably consistent – at least two sore throats fewer per annum. No published trial to date shows a benefit of this magnitude, even in the first year after surgery. There is a pressing need for a UK, pragmatic trial to evaluate the effectiveness and cost-effectiveness of childhood tonsillectomy.
The purpose of this study therefore is to answer the key research question “What is the effectiveness and cost-effectiveness of tonsillectomy/adeno-tonsillectomy in comparison with standard non-surgical management in children aged under 16 with recurrent throat infections?” Assessment of outcome will emphasise those which are important to children themselves and their parents or carers. Specific research questions are:
-
Does tonsillectomy/adeno-tonsillectomy reduce the number of episodes of recurrent sore throats among children to a clinically significant extent?
-
Are there differences in clinical outcome for the age groups: 4–7, 8–11, 12–15 years?
-
What is the cost-effectiveness of tonsillectomy/adeno-tonsillectomy among children and what are the costs and benefits to families?
-
What are the important outcomes of tonsillectomy/adeno-tonsillectomy for children and their parents/carers and what is the importance of these to children and their parents’ quality of life?
-
What are parents’ (and older children’s) preferences for different treatment options for recurrent sore throat?
-
How representative of the target population are trial participants?
Methods/Design
Trial design
A simple prospective pragmatic randomised controlled trial with economic analysis comparing surgical intervention with conventional medical treatment.
Cohort design
We anticipate that a large majority of participants who decline randomisation to the trial will opt for, and receive, surgery. Therefore, in order to assess the external validity of the trial results, we will recruit a cohort of children from those who decline to participate in the trial. The cohort will include both children who opt for surgery and those who choose conventional medical treatment. They will be followed up for 24 months.
Interventions
The treatment arm will receive tonsillectomy and adeno-tonsillectomy while in the control arm non-surgical conventional medical treatment only will be used.
Treatment
Tonsillectomy and adeno-tonsillectomy with adenoid curettage and tonsillectomy by dissection or bipolar diathermy. Most (80%) UK surgeons use the conventional dissection method4 and the remainder use bipolar diathermy. Both methods will be allowed in the trial according to surgical preference. Surgical intervention will take place within four weeks of randomisation.
Control
Non-surgical conventional medical treatment only will be used. There will be no active intervention protocol since no single prescribing strategy would be able to cover all patients. 34 The referring GP will be free to treat as in their current practice. The use of usual treatment rather than an active intervention protocol is considered important for the implementation of study findings since surgical enthusiasts may argue against the findings were the control group to be atypically and over rigorously treated.
Outcome measurement
The primary clinical outcome is the reported number of episodes of sore throat in the two years after randomisation. Secondary clinical outcomes include reported number of episodes of sore throat, otitis media and upper respiratory tract infection which invoke a GP consultation; reported number of symptom-free days; reported severity of sore throats and surgical and anaesthetic morbidity. In addition to the measurement of these clinical outcomes, the impact of the treatment on costs and quality of life will be assessed. There will also be an economic evaluation.
Setting
Inpatient facilities and outpatient clinics of five hospitals in the North of England and Scotland: Freeman Hospital, Newcastle upon Tyne; Alder Hey Children’s Hospital, Liverpool; Booth Hall Children’s Hospital, Manchester; Yorkhill Royal Hospital for Sick Children, Glasgow; and Bradford Royal Infirmary and general practices with which study participants are registered. Freeman Hospital, Newcastle is a large teaching hospital with a mixed adult and paediatric ENT unit. The Unit has a wide urban and rural catchment area including Newcastle and Gateshead, Northumberland and north west Durham. Alder Hey Hospital, Liverpool, and Booth Hall Hospital, Manchester, house two of the largest paediatric ENT units in the UK covering catchment areas in and around Liverpool and Manchester. Yorkhill is a busy university hospital with the largest children’s ENT unit in Scotland and Bradford Royal Infirmary is one of the major hospitals within West Yorkshire. It has recently obtained teaching hospital status with the opening of its medical school. The ENT unit acts as a hub and supports clinics in Airedale and Dewsbury. The unit supports the majority of adult and paediatric care.
Target population
The trial population will be children aged 4–15 on their last birthday with recurrent sore throat referred by primary care to five otolaryngology departments in Newcastle, Liverpool, Manchester, Glasgow and Bradford. In 1999 a total of 2683 tonsillectomy/adeno-tonsillectomy procedures were done for children in these centres: Liverpool (750), Manchester (440), Newcastle (545), Glasgow (498) and Bradford (450) of which some two-thirds will be referrals for recurrent sore throat.
Inclusion criteria
The study will use entry criteria drawn from the Northern regional guidelines. 5 Children (or carers) reporting experience of four or more episodes of sore throat within each of two years or six or more episodes of sore throat within one year will be eligible. We have considered pre-randomisation prospective data recording to operationalise stricter inclusion criteria for severity, but have rejected these as our aim is to operationalise current UK clinical practice.
Exclusion criteria
Children will be excluded if they require hospitalisation due to quinsy; have obstructive symptoms suggestive of clinically significant sleep apnoea syndrome, have rare medical conditions such as glomerulonephritis or Henoch Schonlein purpura; have previously had a tonsillectomy; have suspected velopharyngeal insufficiency, have co-morbidity that means they are unable to undergo the operation within the next six months, have a bleeding disorder, or have congenital/valvular heart disease.
Number of subjects required
We estimate a completed sample size at follow-up of 284 children. Allowing for an attrition rate of around 30% we will need to recruit a total of 406 children to the trial to achieve the estimated sample of 284 (who will complete the trial). Within the original three study hospitals some 1700 tonsillectomies/adeno-tonsillectomies are currently performed annually. Only two-thirds of these will have recurrent sore throats. In any trial where the intervention is widely used in current practice there are likely to be large numbers of eligible participants who opt for the intervention treatment and decline participation in the trial. We estimate that this could be up to one half of all eligible referrals from primary care. The maximum available for randomisation is therefore estimated as 566 per annum. Loss of eligible subjects in the trial is expected due to holiday periods and ‘winter pressures’. On the experience of loss in other trials (50%) a conservative estimate would be 283 per annum. If we assume a conservative rate of attrition of 30% over two years we would expect 198 completing trial participants to be recruited in a 12 month period. Given seasonal effects a full two years would be necessary to recruit the estimated sample size. The cohort sample will be identified from participants who indicated a preference not to be randomised within the trial and who agreed to data collection. An appropriate sampling fraction will be used once non-participation in the trial can be estimated.
Subject recruitment
Recruitment to the study will take place in secondary care. All GP referrals to study centres of children with recurrent sore throat will be considered by participating surgeons. Arrangements are in place in each centre for eligible children to be referred to the clinical applicants. GPs will be informed of this reorganisation. This will facilitate efficient use of outpatients clinics at which trial participants would be recruited. Trained Research Nurses will introduce the trial to patients who will be shown a video regarding the main aspects of the trial. Patients will also receive information sheets. Research Nurses will discuss the trial with patients in light of the information provided in the video and information sheets. Patients will then be able to have an informed discussion with the participating consultant. Research Nurses will obtain written consent from patients willing to participate in the trial. Information sheets and consent forms are provided for all parents involved in the trial however these have been amended accordingly in order to provide separate information sheets and consent form which are suitable for children and teenagers. All information sheets, consent forms and the video transcript have been translated into Bengali, Punjabi, Gujarati, and Urdu. There are also separate information sheets and consent forms for the cohort group.
Randomisation
Independent world wide web based computer randomisation will allocate participants to treatment arms. Randomisation will take place once informed consent to the study has been completed and baseline data collected. The sample will be stratified by age of child at last birthday. Blocked randomisation will be used to ensure that within each centre, within each of the three age groups (4–7, 8–11, 12–15) children will be allocated in equal numbers to each arm of the trial. Where trial sites are unable to access the world wide web they will telephone the coordinating centre (University of Newcastle) in order for web based randomisation to be completed on their behalf. Sampling for the cohort study will similarly be stratified by age.
Blinding
Health technology assessment is essentially a pragmatic activity conducted in normal clinical practice, rather than an exploratory activity conducted in highly controlled settings. It follows that blinding doctors and patients to treatment is not desirable since it distorts normal clinical practice. Nor is it practicable. In contrast, blinding assessors is important because it minimises subjective bias towards a given treatment. All research staff conducting interviews or processing postal questionnaires and diaries will be blind to treatment modalities of all participants. This will be facilitated by separating the responsibility for recruitment and randomisation from outcome assessment. Furthermore, participants will be encouraged to respond to questions without describing their treatment regime. In this way, we will minimise subjective bias towards a given treatment.
Data collection and follow-up
All participants will be followed up for 24 months from the date of initial randomisation. To minimise recall bias, data on sore throats will be gathered by a simple, structured daily health diary completed and returned by participants on a monthly basis for 24 months. Experience of similar studies suggests that with appropriate telephone reminders 90% of diaries will be returned completed. In addition simple outcome questionnaires, using two postal reminders and a telephone reminder, will be sent to trial and cohort study participants. Overall we anticipate an 80% response rate. Postal surveys will be done at 3, 12 and 24 months after randomisation. A baseline questionnaire will be completed by all participants upon recruitment to the trial. The greater frequency of data collection in the first 12 months is necessary in order to capture data on expected changes in direct and social costs to participants in the first 12 months. Experience also suggests that data on consultation rates and prescribed medication can be gathered most accurately and reliably from medical records. Manual abstraction will be performed by trained research nurses at the end of follow-up for all participants.
Adverse events will be recorded by self completion daily diaries (parent or child) which will be collected four weekly and GP records which will be examined at the end of the 24 months follow-up period. Expected adverse events include infection, haemorrhage and pain following tonsillectomy with possible hospital readmission as well as sore throat, nausea, fever and dysphagia. All adverse events will be managed as per normal care, since the intervention process of this study does not deviate from normal care.
Data handling and record keeping
Only anonymised non-identifiable data will be recorded by the site’s research teams from personal medical records. Health diaries and follow-up questionnaires will be anonymous and returned to the trial centre in reply-paid envelopes. For linking purposes these data sets will have unique study identifiers. Only the lead researcher, trial manager and trial administrator will have access to the key which links study identifiers to individual data sets. Personal details (participants full name and address) will be stored on a secure database at CHSR for the purpose of sending out questionnaires and diaries centrally. All data held for analysis will be held in accordance with the Data Protection Act. On completion of the study and associated dissemination the Trial Master File will be archived in the CHSR for 10 years. Trial sites will be responsible for archiving their own documentation.
Economic evaluation
An economic evaluation will be carried out alongside the clinical trial in order to ascertain the cost-effectiveness from a societal perspective with a focus on health service and families. 35 The cohort sample will not be included in the economic evaluation except for the purpose of validation and estimating the representativeness of cost and benefit data for trial participants.
Measure of benefits used and study type
Cost consequences analysis (CCA), cost-effectiveness analysis (CEA) and cost utility analysis (CUA) will be conducted. In CCA, all the outcomes used in the clinical study will be adopted as measures of benefits, including the QoL dimensions. In CEA, the benefits will be measured by the number of events of recurrent sore throat and the number of symptom-free days. In CUA, different health outcomes will be combined with QoL dimensions.
Resources data collected within the trial and costing methods
Medical resource data will relate to the interventions under investigation, any use of health care services due to ‘sore throat’ episodes not averted, treatment of drug side-effects, surgery complications and long term sequelae. Services to be monitored include: outpatient visits and hospitalisations, investigations, A&E admissions, visits and telephone consultations to and from the GP and any other health care professionals, use of medications (including antibiotics, analgesics, and drugs to manage antibiotic side-effects), and any other use of health care services in both the private and public sectors. Manpower data will be collected separately for each main category of staff. Participants’ out of pocket expenses such as over the counter medicines will be reported. Costing of health care resources will be undertaken in a parallel study and a mixed approach using micro-costing and gross-costing methods will be used. 36 We will cost resources using health service pay and price data. Where appropriate, these will be integrated using national published data. 37–39 Where relevant, costs will be broken down into capital, staff, consumable and overhead costs. This will aid the production of different cost scenarios. The impact of the interventions on the time ‘invested’ by children and carers because of illness, treatment and rehabilitation will also be assessed. Children’s days of restricted activity and their level of functioning; time off school; carers’ time off work; children’s and carers’ time involved in outpatients attendance (such as travel time, waiting time and the duration of the clinical visit) and impact on children’s and carers’ quality of life will be monitored. For carers’ in paid/unpaid work, time will be valued in monetary terms. Costing will be undertaken using the human capital approach and the friction cost method. 40 Those resources for which we find a statistically significant difference between the groups will be costed. Those which show no statistically significant difference but are of practical significance in their contribution to costs, will also be costed. The cost analysis will not differ across the different types of economic evaluations. However in the CUA, when carers’ preferences will be assessed, particular caution will be used to avoid double counting the loss of income due to work absences. 41 Whenever applicable, a discount rate of 6% will be used, which is the rate currently used by the public sector in the UK. Costs will be expressed in UK pounds sterling. Costs will be expressed in the prices of the year in which the final analysis will be carried out and if necessary inflation method will be used to update costs data.
Resources/costs data collected outwith the trial
The study is not powered to detect significant differences for rare events. Given the relatively low incidence of surgical complications, long-term sequelae due to surgery and drugs side-effects, data on the related use of resources, costs to the carers and impact on children will be gathered outwith the trial, from the literature and from experts’ opinions. Consensus estimates will be obtained by interviewing a panel of experts, including members of the study team and others. The source of the data will always be explicitly stated.
Synthesis of costs and benefits
Depending on the outcome measure, if there is no statistically significant evidence that one treatment strategy is more effective than another, a cost-minimisation framework will be used and the less expensive form of care will be recommended. If one strategy appears to be dominant (i.e. to be more effective and less costly than the alternative), the uptake will be recommended. If one form of care appears to be more effective and more expensive than the comparator, estimates of incremental cost-effectiveness (and cost utility) ratios will be generated. A judgement will be required in a policy making context to establish whether the additional benefits should be achieved sustaining the additional costs. In any case, recommendations will be made taking into account the generalisability of the results.
Sensitivity analysis
To handle uncertainty not related to sampling variations and to enhance the generalisability of the results, one-way; multi-way and extreme scenario analysis will be undertaken as appropriate and confidence intervals for cost-effectiveness ratios will be estimated under different scenarios. 42 A sensitivity analysis taking into account differences in resource use which are practically significant (i.e. potentially costly) but which have not been shown to be statistically significant, will also be undertaken. The sensitivity analysis will also make explicit all the simplifying assumptions made to collect the data. 43 The application of discounting to the benefits will also be tested in the sensitivity analysis, as well as a range of discount rates. Particular attention will also be given to whether the costs data used reflect the true marginal opportunity costs of the resources used. When more than one reliable source of information is available, such data will be used as a term of comparison. The use of different costing methods for multi-centre studies will be explored. Earlier studies28–31 suggest that longer term outcomes such as reduction in recurrent sore throat may show only marginal benefits. An equivalence trial with a substantially larger sample size would be necessary to capture significant longer-term outcomes. To contain the cost of the trial we have not proposed a three year follow-up. However, the future sequence of clinical events and economic impact will be modelled beyond two-year follow-up. The relevant data will be derived from studies which will be available and experts’ opinions.
Measuring participants’ preferences and utilities
There is a need to value the effectiveness of interventions taking account of the risk of surgery and its long-term sequelae (e.g. sleep, eating, speech, disturbances, regressive behaviour44). The utility assessments will also provide insight into informed choice models. 45 Older children’s and carers’ values will be used to elicit preferences for trade-off between the perceived risks and benefits of surgery versus drugs treatment. Preferences will relate to temporary and chronic scenarios associated with morbidity and QoL because of symptoms and treatment complications. The scenarios will be developed selecting the health outcomes and QoL domains relevant to the problem. Interviews will be carried out with a sample of older children and carers from the cohort group, and the Standard Gamble method46 will be used to derive utilities.
Statistical considerations
Sample size calculation
In this trial we anticipate a fairly large difference in the primary clinical outcome (the reported number of episodes of sore throat in the two years after randomisation) with an effect size of around 1.0, but a smaller difference in a number of psycho-social outcomes including health-related quality of life, with an effect size of 0.33. No standard sample size formula is available for economic evaluations, and a number of methods have been proposed. 47–49 The information which is currently available limit the use of such methods in practical applications. Published data17 suggest that tonsillectomy may lead to a reduction of approximately 1.5 days per year in missed schooling. Given a reported standard deviation of 4.5, to detect this difference with 80% power we would need approximately 142 children in each arm of the trial assuming a significance level of 5%. A sample size of 142 children in the cohort group will allow us to detect similar differences between the cohort group and propositi. The sample will be stratified by age (4–7, 8–11, 12–15). With a total of 284 children, we will have approximately 47 randomised to each treatment arm in each strata. Given that the standard deviation of the number of sore throats per year is 2.018, we will be able to estimate the difference between treatments in each strata with a standard error of 0.41. (Equivalently we would have 90% power to detect a difference of 1.35 episodes of sore throat per year in each strata assuming a type 1 error of 0.05). It is anticipated that the difference in outcome between the two arms of the trial will be approximately 2 episodes in the second year of follow-up. A sample size of 142 children in each arm should enable us to measure this difference with sufficient precision to undertake a meaningful economic analysis.
Main analysis
An intention to treat analysis will be performed. In particular, children randomised to non-surgical conventional medical treatment will be retained in that group for the analysis even if they subsequently receive a tonsillectomy. The primary clinical outcome measure will be the number of episodes of sore throat. This variable will be analysed using generalised linear modelling assuming a Poisson error structure with a log link function. 50 By fitting the difference between the two experimental groups as a fixed effect, interval estimates of the effect of tonsillectomy (in each of the first two years of follow-up) will be generated. These estimates will then be used in the economic analysis. The same approach will be used to analyse the other outcomes. A Poisson error structure will be assumed for data in the form or a count (such as the number of episodes of absence from school) and normal error structure adopted for continuous variables (such as the quality of life indices).
Secondary analysis
The aim of secondary analysis is to determine whether we can identify groups of children who benefit from surgical treatment. It is hypothesised that disease severity may be an important factor. A severity index based on history of the condition during the year before entry to the study will be derived using data recorded in GP records. The relationship between severity and the effect of tonsillectomy will then be investigated using the modelling approach described above.
Economic analysis
We expect skewness in the distribution of use of resources/costs. 51 In the presence of skewness, the logarithmic transformation of data is not recommended, and the application of non-parametric tests can provide misleading results (economic studies aim to base the analysis on arithmetic means and not median values). 52,53 The non-parametric bootstrap test can be the most appropriate,53 since it does not require any assumptions about the normality of data and equality of the variance or shape of the distributions. The t-test can be safely used if the sample size is not too small. 52 Depending on the level of skewness of data obtained we will make a judgement on which of these two methods can be safely applied. The mean costs estimates and (incremental) cost-effectiveness ratios, and conventional measures of variances will be reported. 42
Cohort analysis
The cohort of patients who decline to be randomised will be used to assess the external validity of the main study. Baseline characteristics of the cohort will be compared with those of the study population using standard tests for the comparison of two independent samples (e.g. the t-test or Mann–Whitney test as appropriate). Outcome for the cohort will be compared with outcome for the two groups of study participants using the modelling approach described above.
Trial steering committee
The study has a Trial Steering Committee which meets 6 monthly. The Trial Steering Committee is responsible for monitoring public interest and ensuring issues relating to research governance are met. The trial does not have a data monitoring committee since it examines routine therapies.
Consumer involvement
Consumer involvement will be encouraged and facilitated throughout the study by the establishment of a consumer advisory panel. We will use the advisory panel to help clarify important outcomes for children and their parents (or carers) and to assist in the development of participant-oriented data-collection methods. By consumer we include here children and their parents as well as representatives of appropriate advocacy groups such as the Patients Association. Our experience of consumer panels in the development and implementation of other studies (e.g. quality of life of people with dementia and treatment for primary biliary cirrhosis of the liver) have highlighted the different types of involvement and the different ways that consumers can be involved in primary research. Parents and children will be involved in an advisory capacity rather than in a full participatory role. We will establish and convene regularly the consumer advisory panel in which the group process will use focus group methods. Throughout the project (at least annually) we will use the advisory panel to voice participants’ concerns and to identify participant-oriented solutions to such concerns.
Ethical approval
The conduct of this study will be in accordance with the ethical principles set out in the Declaration of Helsinki. The trial has approval from MREC and all the associated LRECs. The trial also holds a Clinical Trial Authorisation from the MHRA. The trial has NHS R&D and Caldicott Guardian approval from each participating site. There are no particular ethical problems with this trial. The ethical challenge is as with any surgical randomised trial where one arm is an irreversible procedure under general anaesthesia and the other limb effectively maintenance of the status quo with reverting to surgery an outstanding choice. Set against the surgical risk, however, is the essentially curative nature of the intervention – no tonsillitis can occur once the tonsils have been removed. Further, the children under consideration all have qualifying levels of sore throat and would otherwise be eligible for surgery. In other words the issue is more the withholding of tonsillectomy rather than one of random allocation to intervention. All subjects will provide written informed consent before any study procedures are carried out and a participant information sheet will be provided. As part of the consent process participants must agree to researchers and regulatory representatives having access to their medical records. Participants will also be informed that they have the right to withdraw from the study at any time.
The NHS Trust has liability for clinical negligence that harms individuals toward whom they have a duty of care. NHS Indemnity covers NHS staff and medical academic staff with honorary contracts conducting the trial.
Discussion
As with all pragmatic randomised controlled trials it is impossible to control the external environment in which the research is taking place. Since this trial began a number of factors have arisen which could affect the outcome. Firstly there appears to be a reduction in the incidence of respiratory tract infections or at least a reduction in the number of patients presenting to primary health care with respiratory tract infections. 54 This will inevitably lead to a reduction in the number of children being referred to secondary care for recurrent throat infections. Secondly it has come to light that there are marked socio-economic differences in consultation rates in primary health care which are not reflected in operation rates for tonsillitis in secondary care. 55 Lower socio-economic groups use NHS services for tonsillitis less in relation to need than higher socio-economic groups. Again this has implications for the rate of referral to secondary care. The results from the recent National Prospective Tonsillectomy Audit56 may also have led to an alteration in the surgical techniques favoured by our trial consultants however surgical methods and any associated postoperative complications are recorded for the trial. In addition there is anecdotal evidence that the Government’s waiting list initiatives may impact the study by exporting surgery outside the NHS.
List of abbreviations used
Abbreviation | Definition |
---|---|
A&E | Accident and Emergency |
CCA | cost consequences analysis |
CEA | cost-effectiveness analysis |
CHSR | Centre for Health Services Research |
CUA | cost utility analysis |
ENT | Ear, Nose and Throat |
GP | General Practitioner |
LREC | Local Research Ethics Committee |
MREC | Multi-centre Research Ethics Committee |
MHRA | Medicines and Healthcare Products Regulatory Agency |
NHS | National Health Service |
nvCJD | new variant Creutzfeldt–Jakob Disease |
UK | United Kingdon |
USA | United States of America |
Competing interests
The authors declare that they have no competing interests.
Authors’ contibutions
JB, JW, ME, NS, RC, AZ were involved in the original conception and design of the study. AV designed the economic evaluation. CL, KB, CS, NR were involved in the management of the trial including acquisition and interpretation of data. CL drafted the manuscript. All authors were involved in revising the manuscript critically for important intellectual content and have given approval of the final manuscript.
Acknowledgements
The authors wish to acknowledge that this study is funded by the UK Department of Health through its Health Technology Assessment Programme. The opinions and conclusions expressed here are those of the authors and do not necessarily reflect those of the UK National Health Service or the Department of Health. The authors would like to thank the study secretaries, the consultants and their research nurses, the members of the trial steering committee and all the patients, parents and guardians involved in NESSTAC for their support.
References
- Little P, Williamson I. Sore throat management in general practice. Fam Pract 1996;13:317-21.
- Glover JA. The incidence of tonsillectomy in school children. Proc R Soc Med 1938;31:95-112.
- Fergusson DM, Horwood LJ. Private medical insurance and elective surgery during early childhood. N Z Med J 1985;98:538-40.
- Lloyd Faulconbridge RV, Fowler S, Horrocks J, Topham JH. Comparative audit of tonsillectomy. Clin Otolaryngol 2000;25:110-7.
- Donaldson L, Hayes JH, Barton AG, Howel D. The Development and Evaluation of Best Practice Guidelines: Tonsillectomy With or Without Adenoidectomy. Report to the Department of Health 1994.
- British Association of Otorhinolaryngologists Head and Neck Surgeons . Statements of Clinical Effectiveness. Otolaryngology 1998.
- American Academy of Otolaryngology Head and Neck Surgery . Clinical indicators compendium. Am Acad Otolaryngol Head Neck Surg Bull 2000;19.
- Paradise JL, Bluestone CD, Bachman RZ, Karantonis G, Smith IH, Saez CA. History of recurrent sore throat as an indication for tonsillectomy. Predictive limitations of histories that are undocumented. N Engl J Med 1978;298:409-13.
- Fried D. On tonsillectomy: mom’s personal experience [letter]. Lancet 1995;346.
- Long CG, Smith DH. Parental pressure for tonsillectomy: attitudes and knowledge of parents accompanying their children to an ear, nose and throat clinic. Psychol Med 1985;15:689-93.
- Bain DJG, Sales CM. Referring children to an ENT department and prescribing psychotropic drugs to their mothers. BMJ 1981;283:585-8.
- Howie JGR, Bigg AR. Family trends in psychotropic and antibiotic prescribing in general practice. BMJ 1980;1:836-8.
- Rafuse J. Education, practice reviews needed to reduce surgical intervention, Quebec report says. Can Med Assoc J 1996;155:463-4.
- Blair RL, McKerrow WS, Carter NW, Fenton A. The Scottish tonsillectomy audit. Dundee: Scottish Otolaryngological Society; 1994.
- Randall DA, Hoffer ME. Complications of tonsillectomy and adenoidectomy. Otolaryngol Head Neck Surg 1998;118:61-8.
- Paradise JL, Bluestone CD, Colborn DK, Bernard BS, Smith CG, Rockette HE. Adenoidectomy and adenotonsillectomy for recurrent acute otitis media: parallel randomized clinical trials in children not previoulsy treated with tympanostomy tubes. J Am Med Assoc 1999;282:945-53.
- Paradise JL, Bluestone CD, Bachman RZ, Colborn DK, Bernard BS, Taylor FH. Efficacy of tonsillectomy for recurrent throat infection in severely affected children. N Engl J Med 1984;310:674-83.
- Myatt HM, Myatt RA. The development of a paediatric quality of life questionnaire to measure post-operative pain following tonsillectomy. Int J Pediatr Otorhinolaryngol 1998;44:115-23.
- Crysdale WS, Russel D. Complications of tonsillectomy and adenoidectomy in 9409 children observed overnight. Can Med Assoc J 1986;135:1139-42.
- Klausner RD, Tom LWC, Schindler PD, Potsic WP. Depression in children after tonsillectomy. Arch Otolaryngol Head Neck Surg 1995;121:105-8.
- Kotiniemi LH, Ryhänen PT, Moilanen IK. Behavioural changes following routine ENT operations in two-to-ten-year-old children. Paediatr Anaesth 1996;6:45-9.
- Reissland N. Cognitive maturity and the experience of fear and pain in hospital. Soc Sci Med 1983;17:1389-95.
- Friday GA, Paradise JL, Rabin BS, Colborn DK, Taylor FH. Serum immunoglobulin changes in relation to tonsil and adenoid surgery. Ann Allergy 1992;69:225-30.
- Gledovic Z, Radovanovic Z. History of tonsillectomy and appendectomy in Hodgkin’s disease. Eur J Epidemiol 1991;7:612-5.
- Liaw KL, Adami J, Grindley G, Nyren O, Linet MS. Risk of Hodgkin’s disease subsequent to tonsillectomy: a population-based cohort study in Sweden. Int J Cancer 1997;72:711-3.
- Burton MJ, Towler B, Glasziou P. Tonsillectomy versus non-surgical treatment for chronic/recurrent acute tonsillitis. Cochrane Database Syst Rev 1999;4.
- Van Staaij BK, Van den Akker EH, Rovers MM, Hordijk GJ, Hoes AW, Schilder AGM. Effectiveness of adenotonsillectomy in children with mild symptoms of throat infections or adenotonsillar hypertrophy: open randomised controlled trial. BMJ 2004;329:651-4.
- Roos LL, Roos NP, Hentelleff PD. Assessing the impact of tonsillectomies. Med Care 1978;16:502-18.
- Mawson SR, Adlington P, Evans M. A controlled study evaluation of adeno-tonsillectomy in children. J Laryngol Otol 1967;81:777-90.
- McKee WJE. A controlled study of the effects of tonsillectomy and adenoidectomy in children. Br J Prev Soc Med 1963;17:49-6.
- Roydhouse N. A controlled study of adenotonsillectomy. Lancet 1969;2:931-2.
- Marshall T. A review of tonsillectomy for recurrent throat infection. Br J Gen Pract 1998;48:1331-5.
- Camilleri AE, MacKenzie K, Gatehouse S. The effect of recurrent tonsillitis and tonsillectomy on growth in childhood. Clin Otolaryngol Allied Sciences 1995;20:153-7.
- Del Mar C. Sore throats and antibiotics. BMJ 2000;320:130-1.
- Johnston K, Buxton MJ, Jones DR, Fitzpatrick R. Assessing the costs of healthcare technologies in clinical trials. Health Technol Assess 1999;3.
- Raftery J. Costing in economic evaluation. BMJ 2000;320.
- British National Formulary. London: British Medical Association and Royal Pharmaceutical Society of Great Britain; 1999.
- Netten A, Dennett J, Knight J. Unit Costs of Health and Social Care. Canterbury: Personal Social Services Research Unit; 1999.
- Department of Health . The New NHS: Reference Costs 1998.
- Brouwer WBF, Koopmanschap MA, Rutten FFH. Patient and informal caregiver time in cost-effectiveness analysis. Int J Technol Assess Health Care 2000;14:505-13.
- Brouwer WBF, Koopmanschap MA, Rutten FFH. Productivity costs in cost-effectiveness analysis: numerator or denominator: a further discussion. Health Econ 1997;6:511-4.
- Briggs AH, Gray AM. Handling uncertainty when performing economic evaluation of healthcare interventions. Health Technol Assess 1999;3.
- Raikou M, Briggs A, Gray A, McGuire A. Centre-specific or average unit costs in multi-centre studies? Some theory and simulation. Health Econ 2000;9:191-8.
- Shaikh W, Vayda E, Feldman W. A systematic review of the literature on evaluative studies of tonsillectomy and adenoidectomy. Pediatrics 1976;57:401-7.
- Gwyn R, Elwyn G. When is a shared decision not (quite) a shared decision? Negotiating preferences in a general practice encounter. Soc Sci Med 1999;49:437-4.
- Furlong W, Feeny D, Torrance GW, Barr R, Horsman J. Guide to Design and Development of Health-State Utility Instrumentation 1990.
- Sacristan JA, Day SJ, Navarro O, Ramos J, Hernandez JM. Use of confidence intervals and sample size calculations in health economic studies. Ann Pharmacother 1995;29:719-25.
- Briggs AH, Gray AM. Power and sample size calculations for stochastic cost-effectiveness analysis. Med Decis Mak 1998;18:S81-S92.
- Al MJ, Van Hout BA, Michel BC, Rutten FFH. Sample size calculation in economic evaluations. Health Econ 1998;7:327-35.
- McCullagh P, Nelder JA. Generalised linear models. London: Chapman and Hall; 1989.
- Powe NR, Griffiths RI. The clinical–economic trial: promise, problems, and challenges. Control Clin Trials 1995;16:377-94.
- Thompson SG, Barber JA. How should cost data in pragmatic randomised trials be analysed?. BMJ 2000;320:1197-200.
- Desgagne A, Castilloux A-M, Angers J-F, LeLorier J. The use of the bootstrap statistical method for the pharmacoeconomic cost analysis of skewed data. Pharmacoeconomics 1998;5:487-9.
- Fleming DM, Ross AM, Cross KW, Kendall H. The reducing incidence of respiratory tract infection and its relation to antibiotic prescribing. Br J Gen Pract 2003;53:778-83.
- Dixon A, Le Grand J, Henderson J, Murray R, Poteliakhoff E. Is the NHS equitable? A review of the evidence. London: LSE Health and Social Care; 2003.
- The Royal College of Surgeons of England . National Prospective Tonsilletomy Audit. Final Report of an Audit Carried Out in England and Northern Ireland Between July 2003 and September 2004 2005.
Appendix 2 Videoscript
NESSTAC patient recruitment video – DIALOGUE, 4 November 2004
Opening credit – NESTAC, North of England Study of Tonsillectomy and Adeno-tonsillectomy in Children.
-
Ȣ Explain addition of sites here, i.e. second text screen NESSTAC with addition of Bradford and Glasgow to x, y and z.
Dialogue: parent, child and doctor
Good morning. As you know, your GP has asked you to come up to clinic today so we can discuss the treatment options for John. In children who have recurrent sore throats and tonsillitis there really are two options. The first option, particularly in children who are getting better, is to keep an eye on the episodes of tonsillitis, we need to watch and see what happens. The second option in children who have more severe attacks of tonsillitis or sore throats is to take the tonsils out and this is done with an operation called a tonsillectomy. In some children it’s easy to decide what is best to do but in children who are having infrequent episodes of sore throat or tonsillitis or perhaps who are getting less frequent episodes than they had been previously, we can keep an eye on them and watch and wait and see what happens. In children who have more severe episodes of tonsillitis, perhaps those who’ve been admitted to hospital in the past because of it, then we would think about taking their tonsils out. However, there is a large group of children who are not having those two extremes of sore throats and tonsillitis, in whom we’re not so sure what is the best line of management.
That sounds like John.
Yes it’s probably the commonest group.
So what’s the best form of treatment for these in-between children?
Well, in the UK certainly in the past lots of tonsils have been taken out because it was felt it was the best thing to do. However in Europe the tonsillectomy procedure is actually very uncommon. Tonsillectomy is a safe operation but it’s never really been tested to see if it produces long-term benefits for a child’s health. On the one hand taking the tonsils out means the child won’t get tonsillitis again. But tonsillectomy requires a general anaesthetic and an overnight stay in hospital. In most children who keep the tonsils, the number of episodes of tonsillitis diminishes as time goes on, so we don’t really know what the best form of treatment is and that’s why the National Health Service have asked us to perform the NESSTAC Trial.
What sort of trial?
Simple animation showing people going through 2 doors
-
Ȣ Different – little coloured people walking into two groups!
Children will be divided into equal groups. Each group will be given one of two different treatments. Both treatments are safe and in common usage and have been used many times in the past, we just don’t know which treatment form is best.
What are the two treatments?
The first group is the keep tonsils group. Those children will not have a tonsillectomy and will see their general practitioner as and when required if they have a sore throat. In addition they will also have a hospital follow-up appointment at 9 months to see how they’re getting on.
What’s the other treatment?
The second group will be placed on a waiting list to have their tonsils out and when they get to the top of the waiting list then they’ll be admitted for a tonsillectomy. It may be at that time they also have their adenoids removed as well if the surgeon believes that’s the most appropriate treatment.
So who chooses which children go into which group?
No one will choose which group each of the children go into. The decision will be made by random by a computer. That means that each child has a 50/50 chance of going into either the tonsils out group or keeping tonsils group.
So why has John been chosen to take part in this study?
All children who are referred with recurrent tonsillitis or sore throats in the three (five) centres – that’s Newcastle, Manchester and Liverpool (and Bradford and Glasgow) – are being invited to take part in the trial. We need approximately 400 children in total.
Can you tell me a bit more about the keep tonsils group?
In the keep tonsils group children who suffer with recurrent episodes of tonsillitis or sore throat will seek the advice of their general practitioner as before. It’s quite likely that this group of children will suffer at least one further episode of tonsillitis or sore throat.
Presumably that would be similar to the usual attacks that John’s been getting?
Yes. Tonsillitis is unpleasant but it generally clears up within a few days. We know that children who suffer with recurrent sore throats and tonsillitis usually begin to get better after a couple of years or so and we know that hopefully within the next 2 years that John’s symptoms will be less severe than they have been previously.
Are there any risks with this treatment?
There are theoretical risks with recurrent tonsillitis but complications are very uncommon indeed. And John has been suffering with recurrent tonsillitis for a long time now and has never had a complication and indeed if he’d had a complication in the past then he wouldn’t be considered for the trial.
So what’s involved if the tonsils are taken out?
The operation involves coming into hospital usually for an overnight stay. The risks of the procedure are very small indeed and the risks are usually bleeding and infection. Approximately 2 children in every 100 are likely to suffer with an episode of bleeding that would possibly necessitate them having to return to theatre for a further operation. The usual side effects are nausea and vomiting and of course it’s normal for children to experience some pain after a tonsillectomy. But that’s rather like having another episode of tonsillitis.
Does having the tonsils out affect the immune system?
No, there’s no evidence at all that having a tonsillectomy leads to further infections.
How do I know that John’s going to get the best treatment for him?
If we knew exactly what the best treatment for John was then we’d offer him that treatment. However John falls into that group of children in whom we’re not sure whether a tonsillectomy or whether waiting and seeing is the best form of treatment and that’s what we hope to do with the NESTAC trial.
Are there any questions you want to ask, John?
Do I have to take any special medicine to take part in the trial?
No, there are no special medicines you need to take during this trial. If you have another episode of sore throat or tonsillitis then you may need to go to your general practitioner to get some medicine from him in the normal way. The only other thing we will ask you to do is to complete a diary and some questionnaires. These are to give us an idea of how well you’re getting on during the trial period.
Line appears on screen reading ‘only children aged 8 and over will be asked to help with the questionnaires and diaries’ – move to end for translation
What sort of diary?
These diaries aren’t like a normal sort of diary you keep on holiday where you write whole sentences in the diary. These diaries ask you questions and you ring your response to them. I’ve got a copy here to show you.
Diary appears full screen with animation showing number being circled as doctor talks.
For example this page asks which symptoms you have had today. If you’ve had a sore throat and difficulty swallowing you would ring 1 and 3. If you have no symptoms at all then you would ring 10. Do you see what I mean John?
Yeah.
So how long does each child stay in the study?
Each child stays in the study for 2 years and during that time we will also ask you to complete four questionnaires.
What happens if John’s condition gets much better or much worse during that time?
Well if that happens during the trial it may mean we need to reconsider and take a fresh decision and of course at any stage during the trial you’re free to decide to leave the trial if that’s what you want to do. If you do agree to let John take part in the trial then you’ll be helping us to answer some questions about the treatment of children with recurrent sore throats and tonsillitis in the future. We will ask you to sign a consent form before you take part in the study and we’ll also provide an information sheet which you can take home with you. If you have any other questions then you could contact us using the number on the information sheet.
The NESSTAC study team would like to thank you for watching this video.
Screen at end
-
Ȣ Five sites, not three (‘In addition to three sites mentioned, the study is now …
-
Ȣ Children over 8 ‘text’ diaries and questionnaires, + parents will be required …
-
Ȣ Keep tonsils group – very few children randomised to the GP have then crossed over and chosen to have their tonsils out ‘In the study so far, very few children …
Appendix 3 Patient information sheets
Appendix 4 Consent form
Appendix 5 Baseline and outcome questionnaire
Appendix 6 Health diary
Appendix 7 Topic guide for qualitative study
Appendix 8 Utility study interview manual
List of abbreviations
- CI
- confidence interval
- CONSORT
- Consolidated Standards of Reporting Trials
- ENT
- ear, nose and throat
- HTA
- Health Technology Assessment
- ICER
- incremental cost-effectiveness ratio
- IRR
- incidence rate ratio
- NESSTAC
- North of England and Scotland Study of Tonsillectomy and Adeno-tonsillectomy in Children
- nvCJD
- new variant Creutzfeldt–Jakob disease
- PedsQL™
- Pediatric Quality of Life Inventory™
- QALY
- quality-adjusted life-year
- RCT
- randomised controlled trial
- RGN
- registered general nurse
- RR
- relative risk
- WTP
- willingness to pay
All abbreviations that have been used in this report are listed here unless the abbreviation is well known (e.g. NHS), or it has been used only once, or it is a non-standard abbreviation used only in figures/tables/appendices, in which case the abbreviation is defined in the figure legend or in the notes at the end of the table.
Notes
Health Technology Assessment reports published to date
-
Home parenteral nutrition: a systematic review.
By Richards DM, Deeks JJ, Sheldon TA, Shaffer JL.
-
Diagnosis, management and screening of early localised prostate cancer.
A review by Selley S, Donovan J, Faulkner A, Coast J, Gillatt D.
-
The diagnosis, management, treatment and costs of prostate cancer in England and Wales.
A review by Chamberlain J, Melia J, Moss S, Brown J.
-
Screening for fragile X syndrome.
A review by Murray J, Cuckle H, Taylor G, Hewison J.
-
A review of near patient testing in primary care.
By Hobbs FDR, Delaney BC, Fitzmaurice DA, Wilson S, Hyde CJ, Thorpe GH, et al.
-
Systematic review of outpatient services for chronic pain control.
By McQuay HJ, Moore RA, Eccleston C, Morley S, de C Williams AC.
-
Neonatal screening for inborn errors of metabolism: cost, yield and outcome.
A review by Pollitt RJ, Green A, McCabe CJ, Booth A, Cooper NJ, Leonard JV, et al.
-
Preschool vision screening.
A review by Snowdon SK, Stewart-Brown SL.
-
Implications of socio-cultural contexts for the ethics of clinical trials.
A review by Ashcroft RE, Chadwick DW, Clark SRL, Edwards RHT, Frith L, Hutton JL.
-
A critical review of the role of neonatal hearing screening in the detection of congenital hearing impairment.
By Davis A, Bamford J, Wilson I, Ramkalawan T, Forshaw M, Wright S.
-
Newborn screening for inborn errors of metabolism: a systematic review.
By Seymour CA, Thomason MJ, Chalmers RA, Addison GM, Bain MD, Cockburn F, et al.
-
Routine preoperative testing: a systematic review of the evidence.
By Munro J, Booth A, Nicholl J.
-
Systematic review of the effectiveness of laxatives in the elderly.
By Petticrew M, Watt I, Sheldon T.
-
When and how to assess fast-changing technologies: a comparative study of medical applications of four generic technologies.
A review by Mowatt G, Bower DJ, Brebner JA, Cairns JA, Grant AM, McKee L.
-
Antenatal screening for Down’s syndrome.
A review by Wald NJ, Kennard A, Hackshaw A, McGuire A.
-
Screening for ovarian cancer: a systematic review.
By Bell R, Petticrew M, Luengo S, Sheldon TA.
-
Consensus development methods, and their use in clinical guideline development.
A review by Murphy MK, Black NA, Lamping DL, McKee CM, Sanderson CFB, Askham J, et al.
-
A cost–utility analysis of interferon beta for multiple sclerosis.
By Parkin D, McNamee P, Jacoby A, Miller P, Thomas S, Bates D.
-
Effectiveness and efficiency of methods of dialysis therapy for end-stage renal disease: systematic reviews.
By MacLeod A, Grant A, Donaldson C, Khan I, Campbell M, Daly C, et al.
-
Effectiveness of hip prostheses in primary total hip replacement: a critical review of evidence and an economic model.
By Faulkner A, Kennedy LG, Baxter K, Donovan J, Wilkinson M, Bevan G.
-
Antimicrobial prophylaxis in colorectal surgery: a systematic review of randomised controlled trials.
By Song F, Glenny AM.
-
Bone marrow and peripheral blood stem cell transplantation for malignancy.
A review by Johnson PWM, Simnett SJ, Sweetenham JW, Morgan GJ, Stewart LA.
-
Screening for speech and language delay: a systematic review of the literature.
By Law J, Boyle J, Harris F, Harkness A, Nye C.
-
Resource allocation for chronic stable angina: a systematic review of effectiveness, costs and cost-effectiveness of alternative interventions.
By Sculpher MJ, Petticrew M, Kelland JL, Elliott RA, Holdright DR, Buxton MJ.
-
Detection, adherence and control of hypertension for the prevention of stroke: a systematic review.
By Ebrahim S.
-
Postoperative analgesia and vomiting, with special reference to day-case surgery: a systematic review.
By McQuay HJ, Moore RA.
-
Choosing between randomised and nonrandomised studies: a systematic review.
By Britton A, McKee M, Black N, McPherson K, Sanderson C, Bain C.
-
Evaluating patient-based outcome measures for use in clinical trials.
A review by Fitzpatrick R, Davey C, Buxton MJ, Jones DR.
-
Ethical issues in the design and conduct of randomised controlled trials.
A review by Edwards SJL, Lilford RJ, Braunholtz DA, Jackson JC, Hewison J, Thornton J.
-
Qualitative research methods in health technology assessment: a review of the literature.
By Murphy E, Dingwall R, Greatbatch D, Parker S, Watson P.
-
The costs and benefits of paramedic skills in pre-hospital trauma care.
By Nicholl J, Hughes S, Dixon S, Turner J, Yates D.
-
Systematic review of endoscopic ultrasound in gastro-oesophageal cancer.
By Harris KM, Kelly S, Berry E, Hutton J, Roderick P, Cullingworth J, et al.
-
Systematic reviews of trials and other studies.
By Sutton AJ, Abrams KR, Jones DR, Sheldon TA, Song F.
-
Primary total hip replacement surgery: a systematic review of outcomes and modelling of cost-effectiveness associated with different prostheses.
A review by Fitzpatrick R, Shortall E, Sculpher M, Murray D, Morris R, Lodge M, et al.
-
Informed decision making: an annotated bibliography and systematic review.
By Bekker H, Thornton JG, Airey CM, Connelly JB, Hewison J, Robinson MB, et al.
-
Handling uncertainty when performing economic evaluation of healthcare interventions.
A review by Briggs AH, Gray AM.
-
The role of expectancies in the placebo effect and their use in the delivery of health care: a systematic review.
By Crow R, Gage H, Hampson S, Hart J, Kimber A, Thomas H.
-
A randomised controlled trial of different approaches to universal antenatal HIV testing: uptake and acceptability. Annex: Antenatal HIV testing – assessment of a routine voluntary approach.
By Simpson WM, Johnstone FD, Boyd FM, Goldberg DJ, Hart GJ, Gormley SM, et al.
-
Methods for evaluating area-wide and organisation-based interventions in health and health care: a systematic review.
By Ukoumunne OC, Gulliford MC, Chinn S, Sterne JAC, Burney PGJ.
-
Assessing the costs of healthcare technologies in clinical trials.
A review by Johnston K, Buxton MJ, Jones DR, Fitzpatrick R.
-
Cooperatives and their primary care emergency centres: organisation and impact.
By Hallam L, Henthorne K.
-
Screening for cystic fibrosis.
A review by Murray J, Cuckle H, Taylor G, Littlewood J, Hewison J.
-
A review of the use of health status measures in economic evaluation.
By Brazier J, Deverill M, Green C, Harper R, Booth A.
-
Methods for the analysis of quality-of-life and survival data in health technology assessment.
A review by Billingham LJ, Abrams KR, Jones DR.
-
Antenatal and neonatal haemoglobinopathy screening in the UK: review and economic analysis.
By Zeuner D, Ades AE, Karnon J, Brown J, Dezateux C, Anionwu EN.
-
Assessing the quality of reports of randomised trials: implications for the conduct of meta-analyses.
A review by Moher D, Cook DJ, Jadad AR, Tugwell P, Moher M, Jones A, et al.
-
‘Early warning systems’ for identifying new healthcare technologies.
By Robert G, Stevens A, Gabbay J.
-
A systematic review of the role of human papillomavirus testing within a cervical screening programme.
By Cuzick J, Sasieni P, Davies P, Adams J, Normand C, Frater A, et al.
-
Near patient testing in diabetes clinics: appraising the costs and outcomes.
By Grieve R, Beech R, Vincent J, Mazurkiewicz J.
-
Positron emission tomography: establishing priorities for health technology assessment.
A review by Robert G, Milne R.
-
The debridement of chronic wounds: a systematic review.
By Bradley M, Cullum N, Sheldon T.
-
Systematic reviews of wound care management: (2) Dressings and topical agents used in the healing of chronic wounds.
By Bradley M, Cullum N, Nelson EA, Petticrew M, Sheldon T, Torgerson D.
-
A systematic literature review of spiral and electron beam computed tomography: with particular reference to clinical applications in hepatic lesions, pulmonary embolus and coronary artery disease.
By Berry E, Kelly S, Hutton J, Harris KM, Roderick P, Boyce JC, et al.
-
What role for statins? A review and economic model.
By Ebrahim S, Davey Smith G, McCabe C, Payne N, Pickin M, Sheldon TA, et al.
-
Factors that limit the quality, number and progress of randomised controlled trials.
A review by Prescott RJ, Counsell CE, Gillespie WJ, Grant AM, Russell IT, Kiauka S, et al.
-
Antimicrobial prophylaxis in total hip replacement: a systematic review.
By Glenny AM, Song F.
-
Health promoting schools and health promotion in schools: two systematic reviews.
By Lister-Sharp D, Chapman S, Stewart-Brown S, Sowden A.
-
Economic evaluation of a primary care-based education programme for patients with osteoarthritis of the knee.
A review by Lord J, Victor C, Littlejohns P, Ross FM, Axford JS.
-
The estimation of marginal time preference in a UK-wide sample (TEMPUS) project.
A review by Cairns JA, van der Pol MM.
-
Geriatric rehabilitation following fractures in older people: a systematic review.
By Cameron I, Crotty M, Currie C, Finnegan T, Gillespie L, Gillespie W, et al.
-
Screening for sickle cell disease and thalassaemia: a systematic review with supplementary research.
By Davies SC, Cronin E, Gill M, Greengross P, Hickman M, Normand C.
-
Community provision of hearing aids and related audiology services.
A review by Reeves DJ, Alborz A, Hickson FS, Bamford JM.
-
False-negative results in screening programmes: systematic review of impact and implications.
By Petticrew MP, Sowden AJ, Lister-Sharp D, Wright K.
-
Costs and benefits of community postnatal support workers: a randomised controlled trial.
By Morrell CJ, Spiby H, Stewart P, Walters S, Morgan A.
-
Implantable contraceptives (subdermal implants and hormonally impregnated intrauterine systems) versus other forms of reversible contraceptives: two systematic reviews to assess relative effectiveness, acceptability, tolerability and cost-effectiveness.
By French RS, Cowan FM, Mansour DJA, Morris S, Procter T, Hughes D, et al.
-
An introduction to statistical methods for health technology assessment.
A review by White SJ, Ashby D, Brown PJ.
-
Disease-modifying drugs for multiple sclerosis: a rapid and systematic review.
By Clegg A, Bryant J, Milne R.
-
Publication and related biases.
A review by Song F, Eastwood AJ, Gilbody S, Duley L, Sutton AJ.
-
Cost and outcome implications of the organisation of vascular services.
By Michaels J, Brazier J, Palfreyman S, Shackley P, Slack R.
-
Monitoring blood glucose control in diabetes mellitus: a systematic review.
By Coster S, Gulliford MC, Seed PT, Powrie JK, Swaminathan R.
-
The effectiveness of domiciliary health visiting: a systematic review of international studies and a selective review of the British literature.
By Elkan R, Kendrick D, Hewitt M, Robinson JJA, Tolley K, Blair M, et al.
-
The determinants of screening uptake and interventions for increasing uptake: a systematic review.
By Jepson R, Clegg A, Forbes C, Lewis R, Sowden A, Kleijnen J.
-
The effectiveness and cost-effectiveness of prophylactic removal of wisdom teeth.
A rapid review by Song F, O’Meara S, Wilson P, Golder S, Kleijnen J.
-
Ultrasound screening in pregnancy: a systematic review of the clinical effectiveness, cost-effectiveness and women’s views.
By Bricker L, Garcia J, Henderson J, Mugford M, Neilson J, Roberts T, et al.
-
A rapid and systematic review of the effectiveness and cost-effectiveness of the taxanes used in the treatment of advanced breast and ovarian cancer.
By Lister-Sharp D, McDonagh MS, Khan KS, Kleijnen J.
-
Liquid-based cytology in cervical screening: a rapid and systematic review.
By Payne N, Chilcott J, McGoogan E.
-
Randomised controlled trial of non-directive counselling, cognitive–behaviour therapy and usual general practitioner care in the management of depression as well as mixed anxiety and depression in primary care.
By King M, Sibbald B, Ward E, Bower P, Lloyd M, Gabbay M, et al.
-
Routine referral for radiography of patients presenting with low back pain: is patients’ outcome influenced by GPs’ referral for plain radiography?
By Kerry S, Hilton S, Patel S, Dundas D, Rink E, Lord J.
-
Systematic reviews of wound care management: (3) antimicrobial agents for chronic wounds; (4) diabetic foot ulceration.
By O’Meara S, Cullum N, Majid M, Sheldon T.
-
Using routine data to complement and enhance the results of randomised controlled trials.
By Lewsey JD, Leyland AH, Murray GD, Boddy FA.
-
Coronary artery stents in the treatment of ischaemic heart disease: a rapid and systematic review.
By Meads C, Cummins C, Jolly K, Stevens A, Burls A, Hyde C.
-
Outcome measures for adult critical care: a systematic review.
By Hayes JA, Black NA, Jenkinson C, Young JD, Rowan KM, Daly K, et al.
-
A systematic review to evaluate the effectiveness of interventions to promote the initiation of breastfeeding.
By Fairbank L, O’Meara S, Renfrew MJ, Woolridge M, Sowden AJ, Lister-Sharp D.
-
Implantable cardioverter defibrillators: arrhythmias. A rapid and systematic review.
By Parkes J, Bryant J, Milne R.
-
Treatments for fatigue in multiple sclerosis: a rapid and systematic review.
By Brañas P, Jordan R, Fry-Smith A, Burls A, Hyde C.
-
Early asthma prophylaxis, natural history, skeletal development and economy (EASE): a pilot randomised controlled trial.
By Baxter-Jones ADG, Helms PJ, Russell G, Grant A, Ross S, Cairns JA, et al.
-
Screening for hypercholesterolaemia versus case finding for familial hypercholesterolaemia: a systematic review and cost-effectiveness analysis.
By Marks D, Wonderling D, Thorogood M, Lambert H, Humphries SE, Neil HAW.
-
A rapid and systematic review of the clinical effectiveness and cost-effectiveness of glycoprotein IIb/IIIa antagonists in the medical management of unstable angina.
By McDonagh MS, Bachmann LM, Golder S, Kleijnen J, ter Riet G.
-
A randomised controlled trial of prehospital intravenous fluid replacement therapy in serious trauma.
By Turner J, Nicholl J, Webber L, Cox H, Dixon S, Yates D.
-
Intrathecal pumps for giving opioids in chronic pain: a systematic review.
By Williams JE, Louw G, Towlerton G.
-
Combination therapy (interferon alfa and ribavirin) in the treatment of chronic hepatitis C: a rapid and systematic review.
By Shepherd J, Waugh N, Hewitson P.
-
A systematic review of comparisons of effect sizes derived from randomised and non-randomised studies.
By MacLehose RR, Reeves BC, Harvey IM, Sheldon TA, Russell IT, Black AMS.
-
Intravascular ultrasound-guided interventions in coronary artery disease: a systematic literature review, with decision-analytic modelling, of outcomes and cost-effectiveness.
By Berry E, Kelly S, Hutton J, Lindsay HSJ, Blaxill JM, Evans JA, et al.
-
A randomised controlled trial to evaluate the effectiveness and cost-effectiveness of counselling patients with chronic depression.
By Simpson S, Corney R, Fitzgerald P, Beecham J.
-
Systematic review of treatments for atopic eczema.
By Hoare C, Li Wan Po A, Williams H.
-
Bayesian methods in health technology assessment: a review.
By Spiegelhalter DJ, Myles JP, Jones DR, Abrams KR.
-
The management of dyspepsia: a systematic review.
By Delaney B, Moayyedi P, Deeks J, Innes M, Soo S, Barton P, et al.
-
A systematic review of treatments for severe psoriasis.
By Griffiths CEM, Clark CM, Chalmers RJG, Li Wan Po A, Williams HC.
-
Clinical and cost-effectiveness of donepezil, rivastigmine and galantamine for Alzheimer’s disease: a rapid and systematic review.
By Clegg A, Bryant J, Nicholson T, McIntyre L, De Broe S, Gerard K, et al.
-
The clinical effectiveness and cost-effectiveness of riluzole for motor neurone disease: a rapid and systematic review.
By Stewart A, Sandercock J, Bryan S, Hyde C, Barton PM, Fry-Smith A, et al.
-
Equity and the economic evaluation of healthcare.
By Sassi F, Archard L, Le Grand J.
-
Quality-of-life measures in chronic diseases of childhood.
By Eiser C, Morse R.
-
Eliciting public preferences for healthcare: a systematic review of techniques.
By Ryan M, Scott DA, Reeves C, Bate A, van Teijlingen ER, Russell EM, et al.
-
General health status measures for people with cognitive impairment: learning disability and acquired brain injury.
By Riemsma RP, Forbes CA, Glanville JM, Eastwood AJ, Kleijnen J.
-
An assessment of screening strategies for fragile X syndrome in the UK.
By Pembrey ME, Barnicoat AJ, Carmichael B, Bobrow M, Turner G.
-
Issues in methodological research: perspectives from researchers and commissioners.
By Lilford RJ, Richardson A, Stevens A, Fitzpatrick R, Edwards S, Rock F, et al.
-
Systematic reviews of wound care management: (5) beds; (6) compression; (7) laser therapy, therapeutic ultrasound, electrotherapy and electromagnetic therapy.
By Cullum N, Nelson EA, Flemming K, Sheldon T.
-
Effects of educational and psychosocial interventions for adolescents with diabetes mellitus: a systematic review.
By Hampson SE, Skinner TC, Hart J, Storey L, Gage H, Foxcroft D, et al.
-
Effectiveness of autologous chondrocyte transplantation for hyaline cartilage defects in knees: a rapid and systematic review.
By Jobanputra P, Parry D, Fry-Smith A, Burls A.
-
Statistical assessment of the learning curves of health technologies.
By Ramsay CR, Grant AM, Wallace SA, Garthwaite PH, Monk AF, Russell IT.
-
The effectiveness and cost-effectiveness of temozolomide for the treatment of recurrent malignant glioma: a rapid and systematic review.
By Dinnes J, Cave C, Huang S, Major K, Milne R.
-
A rapid and systematic review of the clinical effectiveness and cost-effectiveness of debriding agents in treating surgical wounds healing by secondary intention.
By Lewis R, Whiting P, ter Riet G, O’Meara S, Glanville J.
-
Home treatment for mental health problems: a systematic review.
By Burns T, Knapp M, Catty J, Healey A, Henderson J, Watt H, et al.
-
How to develop cost-conscious guidelines.
By Eccles M, Mason J.
-
The role of specialist nurses in multiple sclerosis: a rapid and systematic review.
By De Broe S, Christopher F, Waugh N.
-
A rapid and systematic review of the clinical effectiveness and cost-effectiveness of orlistat in the management of obesity.
By O’Meara S, Riemsma R, Shirran L, Mather L, ter Riet G.
-
The clinical effectiveness and cost-effectiveness of pioglitazone for type 2 diabetes mellitus: a rapid and systematic review.
By Chilcott J, Wight J, Lloyd Jones M, Tappenden P.
-
Extended scope of nursing practice: a multicentre randomised controlled trial of appropriately trained nurses and preregistration house officers in preoperative assessment in elective general surgery.
By Kinley H, Czoski-Murray C, George S, McCabe C, Primrose J, Reilly C, et al.
-
Systematic reviews of the effectiveness of day care for people with severe mental disorders: (1) Acute day hospital versus admission; (2) Vocational rehabilitation; (3) Day hospital versus outpatient care.
By Marshall M, Crowther R, Almaraz- Serrano A, Creed F, Sledge W, Kluiter H, et al.
-
The measurement and monitoring of surgical adverse events.
By Bruce J, Russell EM, Mollison J, Krukowski ZH.
-
Action research: a systematic review and guidance for assessment.
By Waterman H, Tillen D, Dickson R, de Koning K.
-
A rapid and systematic review of the clinical effectiveness and cost-effectiveness of gemcitabine for the treatment of pancreatic cancer.
By Ward S, Morris E, Bansback N, Calvert N, Crellin A, Forman D, et al.
-
A rapid and systematic review of the evidence for the clinical effectiveness and cost-effectiveness of irinotecan, oxaliplatin and raltitrexed for the treatment of advanced colorectal cancer.
By Lloyd Jones M, Hummel S, Bansback N, Orr B, Seymour M.
-
Comparison of the effectiveness of inhaler devices in asthma and chronic obstructive airways disease: a systematic review of the literature.
By Brocklebank D, Ram F, Wright J, Barry P, Cates C, Davies L, et al.
-
The cost-effectiveness of magnetic resonance imaging for investigation of the knee joint.
By Bryan S, Weatherburn G, Bungay H, Hatrick C, Salas C, Parry D, et al.
-
A rapid and systematic review of the clinical effectiveness and cost-effectiveness of topotecan for ovarian cancer.
By Forbes C, Shirran L, Bagnall A-M, Duffy S, ter Riet G.
-
Superseded by a report published in a later volume.
-
The role of radiography in primary care patients with low back pain of at least 6 weeks duration: a randomised (unblinded) controlled trial.
By Kendrick D, Fielding K, Bentley E, Miller P, Kerslake R, Pringle M.
-
Design and use of questionnaires: a review of best practice applicable to surveys of health service staff and patients.
By McColl E, Jacoby A, Thomas L, Soutter J, Bamford C, Steen N, et al.
-
A rapid and systematic review of the clinical effectiveness and cost-effectiveness of paclitaxel, docetaxel, gemcitabine and vinorelbine in non-small-cell lung cancer.
By Clegg A, Scott DA, Sidhu M, Hewitson P, Waugh N.
-
Subgroup analyses in randomised controlled trials: quantifying the risks of false-positives and false-negatives.
By Brookes ST, Whitley E, Peters TJ, Mulheran PA, Egger M, Davey Smith G.
-
Depot antipsychotic medication in the treatment of patients with schizophrenia: (1) Meta-review; (2) Patient and nurse attitudes.
By David AS, Adams C.
-
A systematic review of controlled trials of the effectiveness and cost-effectiveness of brief psychological treatments for depression.
By Churchill R, Hunot V, Corney R, Knapp M, McGuire H, Tylee A, et al.
-
Cost analysis of child health surveillance.
By Sanderson D, Wright D, Acton C, Duree D.
-
A study of the methods used to select review criteria for clinical audit.
By Hearnshaw H, Harker R, Cheater F, Baker R, Grimshaw G.
-
Fludarabine as second-line therapy for B cell chronic lymphocytic leukaemia: a technology assessment.
By Hyde C, Wake B, Bryan S, Barton P, Fry-Smith A, Davenport C, et al.
-
Rituximab as third-line treatment for refractory or recurrent Stage III or IV follicular non-Hodgkin’s lymphoma: a systematic review and economic evaluation.
By Wake B, Hyde C, Bryan S, Barton P, Song F, Fry-Smith A, et al.
-
A systematic review of discharge arrangements for older people.
By Parker SG, Peet SM, McPherson A, Cannaby AM, Baker R, Wilson A, et al.
-
The clinical effectiveness and cost-effectiveness of inhaler devices used in the routine management of chronic asthma in older children: a systematic review and economic evaluation.
By Peters J, Stevenson M, Beverley C, Lim J, Smith S.
-
The clinical effectiveness and cost-effectiveness of sibutramine in the management of obesity: a technology assessment.
By O’Meara S, Riemsma R, Shirran L, Mather L, ter Riet G.
-
The cost-effectiveness of magnetic resonance angiography for carotid artery stenosis and peripheral vascular disease: a systematic review.
By Berry E, Kelly S, Westwood ME, Davies LM, Gough MJ, Bamford JM, et al.
-
Promoting physical activity in South Asian Muslim women through ‘exercise on prescription’.
By Carroll B, Ali N, Azam N.
-
Zanamivir for the treatment of influenza in adults: a systematic review and economic evaluation.
By Burls A, Clark W, Stewart T, Preston C, Bryan S, Jefferson T, et al.
-
A review of the natural history and epidemiology of multiple sclerosis: implications for resource allocation and health economic models.
By Richards RG, Sampson FC, Beard SM, Tappenden P.
-
Screening for gestational diabetes: a systematic review and economic evaluation.
By Scott DA, Loveman E, McIntyre L, Waugh N.
-
The clinical effectiveness and cost-effectiveness of surgery for people with morbid obesity: a systematic review and economic evaluation.
By Clegg AJ, Colquitt J, Sidhu MK, Royle P, Loveman E, Walker A.
-
The clinical effectiveness of trastuzumab for breast cancer: a systematic review.
By Lewis R, Bagnall A-M, Forbes C, Shirran E, Duffy S, Kleijnen J, et al.
-
The clinical effectiveness and cost-effectiveness of vinorelbine for breast cancer: a systematic review and economic evaluation.
By Lewis R, Bagnall A-M, King S, Woolacott N, Forbes C, Shirran L, et al.
-
A systematic review of the effectiveness and cost-effectiveness of metal-on-metal hip resurfacing arthroplasty for treatment of hip disease.
By Vale L, Wyness L, McCormack K, McKenzie L, Brazzelli M, Stearns SC.
-
The clinical effectiveness and cost-effectiveness of bupropion and nicotine replacement therapy for smoking cessation: a systematic review and economic evaluation.
By Woolacott NF, Jones L, Forbes CA, Mather LC, Sowden AJ, Song FJ, et al.
-
A systematic review of effectiveness and economic evaluation of new drug treatments for juvenile idiopathic arthritis: etanercept.
By Cummins C, Connock M, Fry-Smith A, Burls A.
-
Clinical effectiveness and cost-effectiveness of growth hormone in children: a systematic review and economic evaluation.
By Bryant J, Cave C, Mihaylova B, Chase D, McIntyre L, Gerard K, et al.
-
Clinical effectiveness and cost-effectiveness of growth hormone in adults in relation to impact on quality of life: a systematic review and economic evaluation.
By Bryant J, Loveman E, Chase D, Mihaylova B, Cave C, Gerard K, et al.
-
Clinical medication review by a pharmacist of patients on repeat prescriptions in general practice: a randomised controlled trial.
By Zermansky AG, Petty DR, Raynor DK, Lowe CJ, Freementle N, Vail A.
-
The effectiveness of infliximab and etanercept for the treatment of rheumatoid arthritis: a systematic review and economic evaluation.
By Jobanputra P, Barton P, Bryan S, Burls A.
-
A systematic review and economic evaluation of computerised cognitive behaviour therapy for depression and anxiety.
By Kaltenthaler E, Shackley P, Stevens K, Beverley C, Parry G, Chilcott J.
-
A systematic review and economic evaluation of pegylated liposomal doxorubicin hydrochloride for ovarian cancer.
By Forbes C, Wilby J, Richardson G, Sculpher M, Mather L, Reimsma R.
-
A systematic review of the effectiveness of interventions based on a stages-of-change approach to promote individual behaviour change.
By Riemsma RP, Pattenden J, Bridle C, Sowden AJ, Mather L, Watt IS, et al.
-
A systematic review update of the clinical effectiveness and cost-effectiveness of glycoprotein IIb/IIIa antagonists.
By Robinson M, Ginnelly L, Sculpher M, Jones L, Riemsma R, Palmer S, et al.
-
A systematic review of the effectiveness, cost-effectiveness and barriers to implementation of thrombolytic and neuroprotective therapy for acute ischaemic stroke in the NHS.
By Sandercock P, Berge E, Dennis M, Forbes J, Hand P, Kwan J, et al.
-
A randomised controlled crossover trial of nurse practitioner versus doctor-led outpatient care in a bronchiectasis clinic.
By Caine N, Sharples LD, Hollingworth W, French J, Keogan M, Exley A, et al.
-
Clinical effectiveness and cost – consequences of selective serotonin reuptake inhibitors in the treatment of sex offenders.
By Adi Y, Ashcroft D, Browne K, Beech A, Fry-Smith A, Hyde C.
-
Treatment of established osteoporosis: a systematic review and cost–utility analysis.
By Kanis JA, Brazier JE, Stevenson M, Calvert NW, Lloyd Jones M.
-
Which anaesthetic agents are cost-effective in day surgery? Literature review, national survey of practice and randomised controlled trial.
By Elliott RA Payne K, Moore JK, Davies LM, Harper NJN, St Leger AS, et al.
-
Screening for hepatitis C among injecting drug users and in genitourinary medicine clinics: systematic reviews of effectiveness, modelling study and national survey of current practice.
By Stein K, Dalziel K, Walker A, McIntyre L, Jenkins B, Horne J, et al.
-
The measurement of satisfaction with healthcare: implications for practice from a systematic review of the literature.
By Crow R, Gage H, Hampson S, Hart J, Kimber A, Storey L, et al.
-
The effectiveness and cost-effectiveness of imatinib in chronic myeloid leukaemia: a systematic review.
By Garside R, Round A, Dalziel K, Stein K, Royle R.
-
A comparative study of hypertonic saline, daily and alternate-day rhDNase in children with cystic fibrosis.
By Suri R, Wallis C, Bush A, Thompson S, Normand C, Flather M, et al.
-
A systematic review of the costs and effectiveness of different models of paediatric home care.
By Parker G, Bhakta P, Lovett CA, Paisley S, Olsen R, Turner D, et al.
-
How important are comprehensive literature searches and the assessment of trial quality in systematic reviews? Empirical study.
By Egger M, Jüni P, Bartlett C, Holenstein F, Sterne J.
-
Systematic review of the effectiveness and cost-effectiveness, and economic evaluation, of home versus hospital or satellite unit haemodialysis for people with end-stage renal failure.
By Mowatt G, Vale L, Perez J, Wyness L, Fraser C, MacLeod A, et al.
-
Systematic review and economic evaluation of the effectiveness of infliximab for the treatment of Crohn’s disease.
By Clark W, Raftery J, Barton P, Song F, Fry-Smith A, Burls A.
-
A review of the clinical effectiveness and cost-effectiveness of routine anti-D prophylaxis for pregnant women who are rhesus negative.
By Chilcott J, Lloyd Jones M, Wight J, Forman K, Wray J, Beverley C, et al.
-
Systematic review and evaluation of the use of tumour markers in paediatric oncology: Ewing’s sarcoma and neuroblastoma.
By Riley RD, Burchill SA, Abrams KR, Heney D, Lambert PC, Jones DR, et al.
-
The cost-effectiveness of screening for Helicobacter pylori to reduce mortality and morbidity from gastric cancer and peptic ulcer disease: a discrete-event simulation model.
By Roderick P, Davies R, Raftery J, Crabbe D, Pearce R, Bhandari P, et al.
-
The clinical effectiveness and cost-effectiveness of routine dental checks: a systematic review and economic evaluation.
By Davenport C, Elley K, Salas C, Taylor-Weetman CL, Fry-Smith A, Bryan S, et al.
-
A multicentre randomised controlled trial assessing the costs and benefits of using structured information and analysis of women’s preferences in the management of menorrhagia.
By Kennedy ADM, Sculpher MJ, Coulter A, Dwyer N, Rees M, Horsley S, et al.
-
Clinical effectiveness and cost–utility of photodynamic therapy for wet age-related macular degeneration: a systematic review and economic evaluation.
By Meads C, Salas C, Roberts T, Moore D, Fry-Smith A, Hyde C.
-
Evaluation of molecular tests for prenatal diagnosis of chromosome abnormalities.
By Grimshaw GM, Szczepura A, Hultén M, MacDonald F, Nevin NC, Sutton F, et al.
-
First and second trimester antenatal screening for Down’s syndrome: the results of the Serum, Urine and Ultrasound Screening Study (SURUSS).
By Wald NJ, Rodeck C, Hackshaw AK, Walters J, Chitty L, Mackinson AM.
-
The effectiveness and cost-effectiveness of ultrasound locating devices for central venous access: a systematic review and economic evaluation.
By Calvert N, Hind D, McWilliams RG, Thomas SM, Beverley C, Davidson A.
-
A systematic review of atypical antipsychotics in schizophrenia.
By Bagnall A-M, Jones L, Lewis R, Ginnelly L, Glanville J, Torgerson D, et al.
-
Prostate Testing for Cancer and Treatment (ProtecT) feasibility study.
By Donovan J, Hamdy F, Neal D, Peters T, Oliver S, Brindle L, et al.
-
Early thrombolysis for the treatment of acute myocardial infarction: a systematic review and economic evaluation.
By Boland A, Dundar Y, Bagust A, Haycox A, Hill R, Mujica Mota R, et al.
-
Screening for fragile X syndrome: a literature review and modelling.
By Song FJ, Barton P, Sleightholme V, Yao GL, Fry-Smith A.
-
Systematic review of endoscopic sinus surgery for nasal polyps.
By Dalziel K, Stein K, Round A, Garside R, Royle P.
-
Towards efficient guidelines: how to monitor guideline use in primary care.
By Hutchinson A, McIntosh A, Cox S, Gilbert C.
-
Effectiveness and cost-effectiveness of acute hospital-based spinal cord injuries services: systematic review.
By Bagnall A-M, Jones L, Richardson G, Duffy S, Riemsma R.
-
Prioritisation of health technology assessment. The PATHS model: methods and case studies.
By Townsend J, Buxton M, Harper G.
-
Systematic review of the clinical effectiveness and cost-effectiveness of tension-free vaginal tape for treatment of urinary stress incontinence.
By Cody J, Wyness L, Wallace S, Glazener C, Kilonzo M, Stearns S, et al.
-
The clinical and cost-effectiveness of patient education models for diabetes: a systematic review and economic evaluation.
By Loveman E, Cave C, Green C, Royle P, Dunn N, Waugh N.
-
The role of modelling in prioritising and planning clinical trials.
By Chilcott J, Brennan A, Booth A, Karnon J, Tappenden P.
-
Cost–benefit evaluation of routine influenza immunisation in people 65–74 years of age.
By Allsup S, Gosney M, Haycox A, Regan M.
-
The clinical and cost-effectiveness of pulsatile machine perfusion versus cold storage of kidneys for transplantation retrieved from heart-beating and non-heart-beating donors.
By Wight J, Chilcott J, Holmes M, Brewer N.
-
Can randomised trials rely on existing electronic data? A feasibility study to explore the value of routine data in health technology assessment.
By Williams JG, Cheung WY, Cohen DR, Hutchings HA, Longo MF, Russell IT.
-
Evaluating non-randomised intervention studies.
By Deeks JJ, Dinnes J, D’Amico R, Sowden AJ, Sakarovitch C, Song F, et al.
-
A randomised controlled trial to assess the impact of a package comprising a patient-orientated, evidence-based self- help guidebook and patient-centred consultations on disease management and satisfaction in inflammatory bowel disease.
By Kennedy A, Nelson E, Reeves D, Richardson G, Roberts C, Robinson A, et al.
-
The effectiveness of diagnostic tests for the assessment of shoulder pain due to soft tissue disorders: a systematic review.
By Dinnes J, Loveman E, McIntyre L, Waugh N.
-
The value of digital imaging in diabetic retinopathy.
By Sharp PF, Olson J, Strachan F, Hipwell J, Ludbrook A, O’Donnell M, et al.
-
Lowering blood pressure to prevent myocardial infarction and stroke: a new preventive strategy.
By Law M, Wald N, Morris J.
-
Clinical and cost-effectiveness of capecitabine and tegafur with uracil for the treatment of metastatic colorectal cancer: systematic review and economic evaluation.
By Ward S, Kaltenthaler E, Cowan J, Brewer N.
-
Clinical and cost-effectiveness of new and emerging technologies for early localised prostate cancer: a systematic review.
By Hummel S, Paisley S, Morgan A, Currie E, Brewer N.
-
Literature searching for clinical and cost-effectiveness studies used in health technology assessment reports carried out for the National Institute for Clinical Excellence appraisal system.
By Royle P, Waugh N.
-
Systematic review and economic decision modelling for the prevention and treatment of influenza A and B.
By Turner D, Wailoo A, Nicholson K, Cooper N, Sutton A, Abrams K.
-
A randomised controlled trial to evaluate the clinical and cost-effectiveness of Hickman line insertions in adult cancer patients by nurses.
By Boland A, Haycox A, Bagust A, Fitzsimmons L.
-
Redesigning postnatal care: a randomised controlled trial of protocol-based midwifery-led care focused on individual women’s physical and psychological health needs.
By MacArthur C, Winter HR, Bick DE, Lilford RJ, Lancashire RJ, Knowles H, et al.
-
Estimating implied rates of discount in healthcare decision-making.
By West RR, McNabb R, Thompson AGH, Sheldon TA, Grimley Evans J.
-
Systematic review of isolation policies in the hospital management of methicillin-resistant Staphylococcus aureus: a review of the literature with epidemiological and economic modelling.
By Cooper BS, Stone SP, Kibbler CC, Cookson BD, Roberts JA, Medley GF, et al.
-
Treatments for spasticity and pain in multiple sclerosis: a systematic review.
By Beard S, Hunn A, Wight J.
-
The inclusion of reports of randomised trials published in languages other than English in systematic reviews.
By Moher D, Pham B, Lawson ML, Klassen TP.
-
The impact of screening on future health-promoting behaviours and health beliefs: a systematic review.
By Bankhead CR, Brett J, Bukach C, Webster P, Stewart-Brown S, Munafo M, et al.
-
What is the best imaging strategy for acute stroke?
By Wardlaw JM, Keir SL, Seymour J, Lewis S, Sandercock PAG, Dennis MS, et al.
-
Systematic review and modelling of the investigation of acute and chronic chest pain presenting in primary care.
By Mant J, McManus RJ, Oakes RAL, Delaney BC, Barton PM, Deeks JJ, et al.
-
The effectiveness and cost-effectiveness of microwave and thermal balloon endometrial ablation for heavy menstrual bleeding: a systematic review and economic modelling.
By Garside R, Stein K, Wyatt K, Round A, Price A.
-
A systematic review of the role of bisphosphonates in metastatic disease.
By Ross JR, Saunders Y, Edmonds PM, Patel S, Wonderling D, Normand C, et al.
-
Systematic review of the clinical effectiveness and cost-effectiveness of capecitabine (Xeloda®) for locally advanced and/or metastatic breast cancer.
By Jones L, Hawkins N, Westwood M, Wright K, Richardson G, Riemsma R.
-
Effectiveness and efficiency of guideline dissemination and implementation strategies.
By Grimshaw JM, Thomas RE, MacLennan G, Fraser C, Ramsay CR, Vale L, et al.
-
Clinical effectiveness and costs of the Sugarbaker procedure for the treatment of pseudomyxoma peritonei.
By Bryant J, Clegg AJ, Sidhu MK, Brodin H, Royle P, Davidson P.
-
Psychological treatment for insomnia in the regulation of long-term hypnotic drug use.
By Morgan K, Dixon S, Mathers N, Thompson J, Tomeny M.
-
Improving the evaluation of therapeutic interventions in multiple sclerosis: development of a patient-based measure of outcome.
By Hobart JC, Riazi A, Lamping DL, Fitzpatrick R, Thompson AJ.
-
A systematic review and economic evaluation of magnetic resonance cholangiopancreatography compared with diagnostic endoscopic retrograde cholangiopancreatography.
By Kaltenthaler E, Bravo Vergel Y, Chilcott J, Thomas S, Blakeborough T, Walters SJ, et al.
-
The use of modelling to evaluate new drugs for patients with a chronic condition: the case of antibodies against tumour necrosis factor in rheumatoid arthritis.
By Barton P, Jobanputra P, Wilson J, Bryan S, Burls A.
-
Clinical effectiveness and cost-effectiveness of neonatal screening for inborn errors of metabolism using tandem mass spectrometry: a systematic review.
By Pandor A, Eastham J, Beverley C, Chilcott J, Paisley S.
-
Clinical effectiveness and cost-effectiveness of pioglitazone and rosiglitazone in the treatment of type 2 diabetes: a systematic review and economic evaluation.
By Czoski-Murray C, Warren E, Chilcott J, Beverley C, Psyllaki MA, Cowan J.
-
Routine examination of the newborn: the EMREN study. Evaluation of an extension of the midwife role including a randomised controlled trial of appropriately trained midwives and paediatric senior house officers.
By Townsend J, Wolke D, Hayes J, Davé S, Rogers C, Bloomfield L, et al.
-
Involving consumers in research and development agenda setting for the NHS: developing an evidence-based approach.
By Oliver S, Clarke-Jones L, Rees R, Milne R, Buchanan P, Gabbay J, et al.
-
A multi-centre randomised controlled trial of minimally invasive direct coronary bypass grafting versus percutaneous transluminal coronary angioplasty with stenting for proximal stenosis of the left anterior descending coronary artery.
By Reeves BC, Angelini GD, Bryan AJ, Taylor FC, Cripps T, Spyt TJ, et al.
-
Does early magnetic resonance imaging influence management or improve outcome in patients referred to secondary care with low back pain? A pragmatic randomised controlled trial.
By Gilbert FJ, Grant AM, Gillan MGC, Vale L, Scott NW, Campbell MK, et al.
-
The clinical and cost-effectiveness of anakinra for the treatment of rheumatoid arthritis in adults: a systematic review and economic analysis.
By Clark W, Jobanputra P, Barton P, Burls A.
-
A rapid and systematic review and economic evaluation of the clinical and cost-effectiveness of newer drugs for treatment of mania associated with bipolar affective disorder.
By Bridle C, Palmer S, Bagnall A-M, Darba J, Duffy S, Sculpher M, et al.
-
Liquid-based cytology in cervical screening: an updated rapid and systematic review and economic analysis.
By Karnon J, Peters J, Platt J, Chilcott J, McGoogan E, Brewer N.
-
Systematic review of the long-term effects and economic consequences of treatments for obesity and implications for health improvement.
By Avenell A, Broom J, Brown TJ, Poobalan A, Aucott L, Stearns SC, et al.
-
Autoantibody testing in children with newly diagnosed type 1 diabetes mellitus.
By Dretzke J, Cummins C, Sandercock J, Fry-Smith A, Barrett T, Burls A.
-
Clinical effectiveness and cost-effectiveness of prehospital intravenous fluids in trauma patients.
By Dretzke J, Sandercock J, Bayliss S, Burls A.
-
Newer hypnotic drugs for the short-term management of insomnia: a systematic review and economic evaluation.
By Dündar Y, Boland A, Strobl J, Dodd S, Haycox A, Bagust A, et al.
-
Development and validation of methods for assessing the quality of diagnostic accuracy studies.
By Whiting P, Rutjes AWS, Dinnes J, Reitsma JB, Bossuyt PMM, Kleijnen J.
-
EVALUATE hysterectomy trial: a multicentre randomised trial comparing abdominal, vaginal and laparoscopic methods of hysterectomy.
By Garry R, Fountain J, Brown J, Manca A, Mason S, Sculpher M, et al.
-
Methods for expected value of information analysis in complex health economic models: developments on the health economics of interferon-β and glatiramer acetate for multiple sclerosis.
By Tappenden P, Chilcott JB, Eggington S, Oakley J, McCabe C.
-
Effectiveness and cost-effectiveness of imatinib for first-line treatment of chronic myeloid leukaemia in chronic phase: a systematic review and economic analysis.
By Dalziel K, Round A, Stein K, Garside R, Price A.
-
VenUS I: a randomised controlled trial of two types of bandage for treating venous leg ulcers.
By Iglesias C, Nelson EA, Cullum NA, Torgerson DJ, on behalf of the VenUS Team.
-
Systematic review of the effectiveness and cost-effectiveness, and economic evaluation, of myocardial perfusion scintigraphy for the diagnosis and management of angina and myocardial infarction.
By Mowatt G, Vale L, Brazzelli M, Hernandez R, Murray A, Scott N, et al.
-
A pilot study on the use of decision theory and value of information analysis as part of the NHS Health Technology Assessment programme.
By Claxton K, Ginnelly L, Sculpher M, Philips Z, Palmer S.
-
The Social Support and Family Health Study: a randomised controlled trial and economic evaluation of two alternative forms of postnatal support for mothers living in disadvantaged inner-city areas.
By Wiggins M, Oakley A, Roberts I, Turner H, Rajan L, Austerberry H, et al.
-
Psychosocial aspects of genetic screening of pregnant women and newborns: a systematic review.
By Green JM, Hewison J, Bekker HL, Bryant, Cuckle HS.
-
Evaluation of abnormal uterine bleeding: comparison of three outpatient procedures within cohorts defined by age and menopausal status.
By Critchley HOD, Warner P, Lee AJ, Brechin S, Guise J, Graham B.
-
Coronary artery stents: a rapid systematic review and economic evaluation.
By Hill R, Bagust A, Bakhai A, Dickson R, Dündar Y, Haycox A, et al.
-
Review of guidelines for good practice in decision-analytic modelling in health technology assessment.
By Philips Z, Ginnelly L, Sculpher M, Claxton K, Golder S, Riemsma R, et al.
-
Rituximab (MabThera®) for aggressive non-Hodgkin’s lymphoma: systematic review and economic evaluation.
By Knight C, Hind D, Brewer N, Abbott V.
-
Clinical effectiveness and cost-effectiveness of clopidogrel and modified-release dipyridamole in the secondary prevention of occlusive vascular events: a systematic review and economic evaluation.
By Jones L, Griffin S, Palmer S, Main C, Orton V, Sculpher M, et al.
-
Pegylated interferon α-2a and -2b in combination with ribavirin in the treatment of chronic hepatitis C: a systematic review and economic evaluation.
By Shepherd J, Brodin H, Cave C, Waugh N, Price A, Gabbay J.
-
Clopidogrel used in combination with aspirin compared with aspirin alone in the treatment of non-ST-segment- elevation acute coronary syndromes: a systematic review and economic evaluation.
By Main C, Palmer S, Griffin S, Jones L, Orton V, Sculpher M, et al.
-
Provision, uptake and cost of cardiac rehabilitation programmes: improving services to under-represented groups.
By Beswick AD, Rees K, Griebsch I, Taylor FC, Burke M, West RR, et al.
-
Involving South Asian patients in clinical trials.
By Hussain-Gambles M, Leese B, Atkin K, Brown J, Mason S, Tovey P.
-
Clinical and cost-effectiveness of continuous subcutaneous insulin infusion for diabetes.
By Colquitt JL, Green C, Sidhu MK, Hartwell D, Waugh N.
-
Identification and assessment of ongoing trials in health technology assessment reviews.
By Song FJ, Fry-Smith A, Davenport C, Bayliss S, Adi Y, Wilson JS, et al.
-
Systematic review and economic evaluation of a long-acting insulin analogue, insulin glargine
By Warren E, Weatherley-Jones E, Chilcott J, Beverley C.
-
Supplementation of a home-based exercise programme with a class-based programme for people with osteoarthritis of the knees: a randomised controlled trial and health economic analysis.
By McCarthy CJ, Mills PM, Pullen R, Richardson G, Hawkins N, Roberts CR, et al.
-
Clinical and cost-effectiveness of once-daily versus more frequent use of same potency topical corticosteroids for atopic eczema: a systematic review and economic evaluation.
By Green C, Colquitt JL, Kirby J, Davidson P, Payne E.
-
Acupuncture of chronic headache disorders in primary care: randomised controlled trial and economic analysis.
By Vickers AJ, Rees RW, Zollman CE, McCarney R, Smith CM, Ellis N, et al.
-
Generalisability in economic evaluation studies in healthcare: a review and case studies.
By Sculpher MJ, Pang FS, Manca A, Drummond MF, Golder S, Urdahl H, et al.
-
Virtual outreach: a randomised controlled trial and economic evaluation of joint teleconferenced medical consultations.
By Wallace P, Barber J, Clayton W, Currell R, Fleming K, Garner P, et al.
-
Randomised controlled multiple treatment comparison to provide a cost-effectiveness rationale for the selection of antimicrobial therapy in acne.
By Ozolins M, Eady EA, Avery A, Cunliffe WJ, O’Neill C, Simpson NB, et al.
-
Do the findings of case series studies vary significantly according to methodological characteristics?
By Dalziel K, Round A, Stein K, Garside R, Castelnuovo E, Payne L.
-
Improving the referral process for familial breast cancer genetic counselling: findings of three randomised controlled trials of two interventions.
By Wilson BJ, Torrance N, Mollison J, Wordsworth S, Gray JR, Haites NE, et al.
-
Randomised evaluation of alternative electrosurgical modalities to treat bladder outflow obstruction in men with benign prostatic hyperplasia.
By Fowler C, McAllister W, Plail R, Karim O, Yang Q.
-
A pragmatic randomised controlled trial of the cost-effectiveness of palliative therapies for patients with inoperable oesophageal cancer.
By Shenfine J, McNamee P, Steen N, Bond J, Griffin SM.
-
Impact of computer-aided detection prompts on the sensitivity and specificity of screening mammography.
By Taylor P, Champness J, Given- Wilson R, Johnston K, Potts H.
-
Issues in data monitoring and interim analysis of trials.
By Grant AM, Altman DG, Babiker AB, Campbell MK, Clemens FJ, Darbyshire JH, et al.
-
Lay public’s understanding of equipoise and randomisation in randomised controlled trials.
By Robinson EJ, Kerr CEP, Stevens AJ, Lilford RJ, Braunholtz DA, Edwards SJ, et al.
-
Clinical and cost-effectiveness of electroconvulsive therapy for depressive illness, schizophrenia, catatonia and mania: systematic reviews and economic modelling studies.
By Greenhalgh J, Knight C, Hind D, Beverley C, Walters S.
-
Measurement of health-related quality of life for people with dementia: development of a new instrument (DEMQOL) and an evaluation of current methodology.
By Smith SC, Lamping DL, Banerjee S, Harwood R, Foley B, Smith P, et al.
-
Clinical effectiveness and cost-effectiveness of drotrecogin alfa (activated) (Xigris®) for the treatment of severe sepsis in adults: a systematic review and economic evaluation.
By Green C, Dinnes J, Takeda A, Shepherd J, Hartwell D, Cave C, et al.
-
A methodological review of how heterogeneity has been examined in systematic reviews of diagnostic test accuracy.
By Dinnes J, Deeks J, Kirby J, Roderick P.
-
Cervical screening programmes: can automation help? Evidence from systematic reviews, an economic analysis and a simulation modelling exercise applied to the UK.
By Willis BH, Barton P, Pearmain P, Bryan S, Hyde C.
-
Laparoscopic surgery for inguinal hernia repair: systematic review of effectiveness and economic evaluation.
By McCormack K, Wake B, Perez J, Fraser C, Cook J, McIntosh E, et al.
-
Clinical effectiveness, tolerability and cost-effectiveness of newer drugs for epilepsy in adults: a systematic review and economic evaluation.
By Wilby J, Kainth A, Hawkins N, Epstein D, McIntosh H, McDaid C, et al.
-
A randomised controlled trial to compare the cost-effectiveness of tricyclic antidepressants, selective serotonin reuptake inhibitors and lofepramine.
By Peveler R, Kendrick T, Buxton M, Longworth L, Baldwin D, Moore M, et al.
-
Clinical effectiveness and cost-effectiveness of immediate angioplasty for acute myocardial infarction: systematic review and economic evaluation.
By Hartwell D, Colquitt J, Loveman E, Clegg AJ, Brodin H, Waugh N, et al.
-
A randomised controlled comparison of alternative strategies in stroke care.
By Kalra L, Evans A, Perez I, Knapp M, Swift C, Donaldson N.
-
The investigation and analysis of critical incidents and adverse events in healthcare.
By Woloshynowych M, Rogers S, Taylor-Adams S, Vincent C.
-
Potential use of routine databases in health technology assessment.
By Raftery J, Roderick P, Stevens A.
-
Clinical and cost-effectiveness of newer immunosuppressive regimens in renal transplantation: a systematic review and modelling study.
By Woodroffe R, Yao GL, Meads C, Bayliss S, Ready A, Raftery J, et al.
-
A systematic review and economic evaluation of alendronate, etidronate, risedronate, raloxifene and teriparatide for the prevention and treatment of postmenopausal osteoporosis.
By Stevenson M, Lloyd Jones M, De Nigris E, Brewer N, Davis S, Oakley J.
-
A systematic review to examine the impact of psycho-educational interventions on health outcomes and costs in adults and children with difficult asthma.
By Smith JR, Mugford M, Holland R, Candy B, Noble MJ, Harrison BDW, et al.
-
An evaluation of the costs, effectiveness and quality of renal replacement therapy provision in renal satellite units in England and Wales.
By Roderick P, Nicholson T, Armitage A, Mehta R, Mullee M, Gerard K, et al.
-
Imatinib for the treatment of patients with unresectable and/or metastatic gastrointestinal stromal tumours: systematic review and economic evaluation.
By Wilson J, Connock M, Song F, Yao G, Fry-Smith A, Raftery J, et al.
-
Indirect comparisons of competing interventions.
By Glenny AM, Altman DG, Song F, Sakarovitch C, Deeks JJ, D’Amico R, et al.
-
Cost-effectiveness of alternative strategies for the initial medical management of non-ST elevation acute coronary syndrome: systematic review and decision-analytical modelling.
By Robinson M, Palmer S, Sculpher M, Philips Z, Ginnelly L, Bowens A, et al.
-
Outcomes of electrically stimulated gracilis neosphincter surgery.
By Tillin T, Chambers M, Feldman R.
-
The effectiveness and cost-effectiveness of pimecrolimus and tacrolimus for atopic eczema: a systematic review and economic evaluation.
By Garside R, Stein K, Castelnuovo E, Pitt M, Ashcroft D, Dimmock P, et al.
-
Systematic review on urine albumin testing for early detection of diabetic complications.
By Newman DJ, Mattock MB, Dawnay ABS, Kerry S, McGuire A, Yaqoob M, et al.
-
Randomised controlled trial of the cost-effectiveness of water-based therapy for lower limb osteoarthritis.
By Cochrane T, Davey RC, Matthes Edwards SM.
-
Longer term clinical and economic benefits of offering acupuncture care to patients with chronic low back pain.
By Thomas KJ, MacPherson H, Ratcliffe J, Thorpe L, Brazier J, Campbell M, et al.
-
Cost-effectiveness and safety of epidural steroids in the management of sciatica.
By Price C, Arden N, Coglan L, Rogers P.
-
The British Rheumatoid Outcome Study Group (BROSG) randomised controlled trial to compare the effectiveness and cost-effectiveness of aggressive versus symptomatic therapy in established rheumatoid arthritis.
By Symmons D, Tricker K, Roberts C, Davies L, Dawes P, Scott DL.
-
Conceptual framework and systematic review of the effects of participants’ and professionals’ preferences in randomised controlled trials.
By King M, Nazareth I, Lampe F, Bower P, Chandler M, Morou M, et al.
-
The clinical and cost-effectiveness of implantable cardioverter defibrillators: a systematic review.
By Bryant J, Brodin H, Loveman E, Payne E, Clegg A.
-
A trial of problem-solving by community mental health nurses for anxiety, depression and life difficulties among general practice patients. The CPN-GP study.
By Kendrick T, Simons L, Mynors-Wallis L, Gray A, Lathlean J, Pickering R, et al.
-
The causes and effects of socio-demographic exclusions from clinical trials.
By Bartlett C, Doyal L, Ebrahim S, Davey P, Bachmann M, Egger M, et al.
-
Is hydrotherapy cost-effective? A randomised controlled trial of combined hydrotherapy programmes compared with physiotherapy land techniques in children with juvenile idiopathic arthritis.
By Epps H, Ginnelly L, Utley M, Southwood T, Gallivan S, Sculpher M, et al.
-
A randomised controlled trial and cost-effectiveness study of systematic screening (targeted and total population screening) versus routine practice for the detection of atrial fibrillation in people aged 65 and over. The SAFE study.
By Hobbs FDR, Fitzmaurice DA, Mant J, Murray E, Jowett S, Bryan S, et al.
-
Displaced intracapsular hip fractures in fit, older people: a randomised comparison of reduction and fixation, bipolar hemiarthroplasty and total hip arthroplasty.
By Keating JF, Grant A, Masson M, Scott NW, Forbes JF.
-
Long-term outcome of cognitive behaviour therapy clinical trials in central Scotland.
By Durham RC, Chambers JA, Power KG, Sharp DM, Macdonald RR, Major KA, et al.
-
The effectiveness and cost-effectiveness of dual-chamber pacemakers compared with single-chamber pacemakers for bradycardia due to atrioventricular block or sick sinus syndrome: systematic review and economic evaluation.
By Castelnuovo E, Stein K, Pitt M, Garside R, Payne E.
-
Newborn screening for congenital heart defects: a systematic review and cost-effectiveness analysis.
By Knowles R, Griebsch I, Dezateux C, Brown J, Bull C, Wren C.
-
The clinical and cost-effectiveness of left ventricular assist devices for end-stage heart failure: a systematic review and economic evaluation.
By Clegg AJ, Scott DA, Loveman E, Colquitt J, Hutchinson J, Royle P, et al.
-
The effectiveness of the Heidelberg Retina Tomograph and laser diagnostic glaucoma scanning system (GDx) in detecting and monitoring glaucoma.
By Kwartz AJ, Henson DB, Harper RA, Spencer AF, McLeod D.
-
Clinical and cost-effectiveness of autologous chondrocyte implantation for cartilage defects in knee joints: systematic review and economic evaluation.
By Clar C, Cummins E, McIntyre L, Thomas S, Lamb J, Bain L, et al.
-
Systematic review of effectiveness of different treatments for childhood retinoblastoma.
By McDaid C, Hartley S, Bagnall A-M, Ritchie G, Light K, Riemsma R.
-
Towards evidence-based guidelines for the prevention of venous thromboembolism: systematic reviews of mechanical methods, oral anticoagulation, dextran and regional anaesthesia as thromboprophylaxis.
By Roderick P, Ferris G, Wilson K, Halls H, Jackson D, Collins R, et al.
-
The effectiveness and cost-effectiveness of parent training/education programmes for the treatment of conduct disorder, including oppositional defiant disorder, in children.
By Dretzke J, Frew E, Davenport C, Barlow J, Stewart-Brown S, Sandercock J, et al.
-
The clinical and cost-effectiveness of donepezil, rivastigmine, galantamine and memantine for Alzheimer’s disease.
By Loveman E, Green C, Kirby J, Takeda A, Picot J, Payne E, et al.
-
FOOD: a multicentre randomised trial evaluating feeding policies in patients admitted to hospital with a recent stroke.
By Dennis M, Lewis S, Cranswick G, Forbes J.
-
The clinical effectiveness and cost-effectiveness of computed tomography screening for lung cancer: systematic reviews.
By Black C, Bagust A, Boland A, Walker S, McLeod C, De Verteuil R, et al.
-
A systematic review of the effectiveness and cost-effectiveness of neuroimaging assessments used to visualise the seizure focus in people with refractory epilepsy being considered for surgery.
By Whiting P, Gupta R, Burch J, Mujica Mota RE, Wright K, Marson A, et al.
-
Comparison of conference abstracts and presentations with full-text articles in the health technology assessments of rapidly evolving technologies.
By Dundar Y, Dodd S, Dickson R, Walley T, Haycox A, Williamson PR.
-
Systematic review and evaluation of methods of assessing urinary incontinence.
By Martin JL, Williams KS, Abrams KR, Turner DA, Sutton AJ, Chapple C, et al.
-
The clinical effectiveness and cost-effectiveness of newer drugs for children with epilepsy. A systematic review.
By Connock M, Frew E, Evans B-W, Bryan S, Cummins C, Fry-Smith A, et al.
-
Surveillance of Barrett’s oesophagus: exploring the uncertainty through systematic review, expert workshop and economic modelling.
By Garside R, Pitt M, Somerville M, Stein K, Price A, Gilbert N.
-
Topotecan, pegylated liposomal doxorubicin hydrochloride and paclitaxel for second-line or subsequent treatment of advanced ovarian cancer: a systematic review and economic evaluation.
By Main C, Bojke L, Griffin S, Norman G, Barbieri M, Mather L, et al.
-
Evaluation of molecular techniques in prediction and diagnosis of cytomegalovirus disease in immunocompromised patients.
By Szczepura A, Westmoreland D, Vinogradova Y, Fox J, Clark M.
-
Screening for thrombophilia in high-risk situations: systematic review and cost-effectiveness analysis. The Thrombosis: Risk and Economic Assessment of Thrombophilia Screening (TREATS) study.
By Wu O, Robertson L, Twaddle S, Lowe GDO, Clark P, Greaves M, et al.
-
A series of systematic reviews to inform a decision analysis for sampling and treating infected diabetic foot ulcers.
By Nelson EA, O’Meara S, Craig D, Iglesias C, Golder S, Dalton J, et al.
-
Randomised clinical trial, observational study and assessment of cost-effectiveness of the treatment of varicose veins (REACTIV trial).
By Michaels JA, Campbell WB, Brazier JE, MacIntyre JB, Palfreyman SJ, Ratcliffe J, et al.
-
The cost-effectiveness of screening for oral cancer in primary care.
By Speight PM, Palmer S, Moles DR, Downer MC, Smith DH, Henriksson M, et al.
-
Measurement of the clinical and cost-effectiveness of non-invasive diagnostic testing strategies for deep vein thrombosis.
By Goodacre S, Sampson F, Stevenson M, Wailoo A, Sutton A, Thomas S, et al.
-
Systematic review of the effectiveness and cost-effectiveness of HealOzone® for the treatment of occlusal pit/fissure caries and root caries.
By Brazzelli M, McKenzie L, Fielding S, Fraser C, Clarkson J, Kilonzo M, et al.
-
Randomised controlled trials of conventional antipsychotic versus new atypical drugs, and new atypical drugs versus clozapine, in people with schizophrenia responding poorly to, or intolerant of, current drug treatment.
By Lewis SW, Davies L, Jones PB, Barnes TRE, Murray RM, Kerwin R, et al.
-
Diagnostic tests and algorithms used in the investigation of haematuria: systematic reviews and economic evaluation.
By Rodgers M, Nixon J, Hempel S, Aho T, Kelly J, Neal D, et al.
-
Cognitive behavioural therapy in addition to antispasmodic therapy for irritable bowel syndrome in primary care: randomised controlled trial.
By Kennedy TM, Chalder T, McCrone P, Darnley S, Knapp M, Jones RH, et al.
-
A systematic review of the clinical effectiveness and cost-effectiveness of enzyme replacement therapies for Fabry’s disease and mucopolysaccharidosis type 1.
By Connock M, Juarez-Garcia A, Frew E, Mans A, Dretzke J, Fry-Smith A, et al.
-
Health benefits of antiviral therapy for mild chronic hepatitis C: randomised controlled trial and economic evaluation.
By Wright M, Grieve R, Roberts J, Main J, Thomas HC, on behalf of the UK Mild Hepatitis C Trial Investigators.
-
Pressure relieving support surfaces: a randomised evaluation.
By Nixon J, Nelson EA, Cranny G, Iglesias CP, Hawkins K, Cullum NA, et al.
-
A systematic review and economic model of the effectiveness and cost-effectiveness of methylphenidate, dexamfetamine and atomoxetine for the treatment of attention deficit hyperactivity disorder in children and adolescents.
By King S, Griffin S, Hodges Z, Weatherly H, Asseburg C, Richardson G, et al.
-
The clinical effectiveness and cost-effectiveness of enzyme replacement therapy for Gaucher’s disease: a systematic review.
By Connock M, Burls A, Frew E, Fry-Smith A, Juarez-Garcia A, McCabe C, et al.
-
Effectiveness and cost-effectiveness of salicylic acid and cryotherapy for cutaneous warts. An economic decision model.
By Thomas KS, Keogh-Brown MR, Chalmers JR, Fordham RJ, Holland RC, Armstrong SJ, et al.
-
A systematic literature review of the effectiveness of non-pharmacological interventions to prevent wandering in dementia and evaluation of the ethical implications and acceptability of their use.
By Robinson L, Hutchings D, Corner L, Beyer F, Dickinson H, Vanoli A, et al.
-
A review of the evidence on the effects and costs of implantable cardioverter defibrillator therapy in different patient groups, and modelling of cost-effectiveness and cost–utility for these groups in a UK context.
By Buxton M, Caine N, Chase D, Connelly D, Grace A, Jackson C, et al.
-
Adefovir dipivoxil and pegylated interferon alfa-2a for the treatment of chronic hepatitis B: a systematic review and economic evaluation.
By Shepherd J, Jones J, Takeda A, Davidson P, Price A.
-
An evaluation of the clinical and cost-effectiveness of pulmonary artery catheters in patient management in intensive care: a systematic review and a randomised controlled trial.
By Harvey S, Stevens K, Harrison D, Young D, Brampton W, McCabe C, et al.
-
Accurate, practical and cost-effective assessment of carotid stenosis in the UK.
By Wardlaw JM, Chappell FM, Stevenson M, De Nigris E, Thomas S, Gillard J, et al.
-
Etanercept and infliximab for the treatment of psoriatic arthritis: a systematic review and economic evaluation.
By Woolacott N, Bravo Vergel Y, Hawkins N, Kainth A, Khadjesari Z, Misso K, et al.
-
The cost-effectiveness of testing for hepatitis C in former injecting drug users.
By Castelnuovo E, Thompson-Coon J, Pitt M, Cramp M, Siebert U, Price A, et al.
-
Computerised cognitive behaviour therapy for depression and anxiety update: a systematic review and economic evaluation.
By Kaltenthaler E, Brazier J, De Nigris E, Tumur I, Ferriter M, Beverley C, et al.
-
Cost-effectiveness of using prognostic information to select women with breast cancer for adjuvant systemic therapy.
By Williams C, Brunskill S, Altman D, Briggs A, Campbell H, Clarke M, et al.
-
Psychological therapies including dialectical behaviour therapy for borderline personality disorder: a systematic review and preliminary economic evaluation.
By Brazier J, Tumur I, Holmes M, Ferriter M, Parry G, Dent-Brown K, et al.
-
Clinical effectiveness and cost-effectiveness of tests for the diagnosis and investigation of urinary tract infection in children: a systematic review and economic model.
By Whiting P, Westwood M, Bojke L, Palmer S, Richardson G, Cooper J, et al.
-
Cognitive behavioural therapy in chronic fatigue syndrome: a randomised controlled trial of an outpatient group programme.
By O’Dowd H, Gladwell P, Rogers CA, Hollinghurst S, Gregory A.
-
A comparison of the cost-effectiveness of five strategies for the prevention of nonsteroidal anti-inflammatory drug-induced gastrointestinal toxicity: a systematic review with economic modelling.
By Brown TJ, Hooper L, Elliott RA, Payne K, Webb R, Roberts C, et al.
-
The effectiveness and cost-effectiveness of computed tomography screening for coronary artery disease: systematic review.
By Waugh N, Black C, Walker S, McIntyre L, Cummins E, Hillis G.
-
What are the clinical outcome and cost-effectiveness of endoscopy undertaken by nurses when compared with doctors? A Multi-Institution Nurse Endoscopy Trial (MINuET).
By Williams J, Russell I, Durai D, Cheung W-Y, Farrin A, Bloor K, et al.
-
The clinical and cost-effectiveness of oxaliplatin and capecitabine for the adjuvant treatment of colon cancer: systematic review and economic evaluation.
By Pandor A, Eggington S, Paisley S, Tappenden P, Sutcliffe P.
-
A systematic review of the effectiveness of adalimumab, etanercept and infliximab for the treatment of rheumatoid arthritis in adults and an economic evaluation of their cost-effectiveness.
By Chen Y-F, Jobanputra P, Barton P, Jowett S, Bryan S, Clark W, et al.
-
Telemedicine in dermatology: a randomised controlled trial.
By Bowns IR, Collins K, Walters SJ, McDonagh AJG.
-
Cost-effectiveness of cell salvage and alternative methods of minimising perioperative allogeneic blood transfusion: a systematic review and economic model.
By Davies L, Brown TJ, Haynes S, Payne K, Elliott RA, McCollum C.
-
Clinical effectiveness and cost-effectiveness of laparoscopic surgery for colorectal cancer: systematic reviews and economic evaluation.
By Murray A, Lourenco T, de Verteuil R, Hernandez R, Fraser C, McKinley A, et al.
-
Etanercept and efalizumab for the treatment of psoriasis: a systematic review.
By Woolacott N, Hawkins N, Mason A, Kainth A, Khadjesari Z, Bravo Vergel Y, et al.
-
Systematic reviews of clinical decision tools for acute abdominal pain.
By Liu JLY, Wyatt JC, Deeks JJ, Clamp S, Keen J, Verde P, et al.
-
Evaluation of the ventricular assist device programme in the UK.
By Sharples L, Buxton M, Caine N, Cafferty F, Demiris N, Dyer M, et al.
-
A systematic review and economic model of the clinical and cost-effectiveness of immunosuppressive therapy for renal transplantation in children.
By Yao G, Albon E, Adi Y, Milford D, Bayliss S, Ready A, et al.
-
Amniocentesis results: investigation of anxiety. The ARIA trial.
By Hewison J, Nixon J, Fountain J, Cocks K, Jones C, Mason G, et al.
-
Pemetrexed disodium for the treatment of malignant pleural mesothelioma: a systematic review and economic evaluation.
By Dundar Y, Bagust A, Dickson R, Dodd S, Green J, Haycox A, et al.
-
A systematic review and economic model of the clinical effectiveness and cost-effectiveness of docetaxel in combination with prednisone or prednisolone for the treatment of hormone-refractory metastatic prostate cancer.
By Collins R, Fenwick E, Trowman R, Perard R, Norman G, Light K, et al.
-
A systematic review of rapid diagnostic tests for the detection of tuberculosis infection.
By Dinnes J, Deeks J, Kunst H, Gibson A, Cummins E, Waugh N, et al.
-
The clinical effectiveness and cost-effectiveness of strontium ranelate for the prevention of osteoporotic fragility fractures in postmenopausal women.
By Stevenson M, Davis S, Lloyd-Jones M, Beverley C.
-
A systematic review of quantitative and qualitative research on the role and effectiveness of written information available to patients about individual medicines.
By Raynor DK, Blenkinsopp A, Knapp P, Grime J, Nicolson DJ, Pollock K, et al.
-
Oral naltrexone as a treatment for relapse prevention in formerly opioid-dependent drug users: a systematic review and economic evaluation.
By Adi Y, Juarez-Garcia A, Wang D, Jowett S, Frew E, Day E, et al.
-
Glucocorticoid-induced osteoporosis: a systematic review and cost–utility analysis.
By Kanis JA, Stevenson M, McCloskey EV, Davis S, Lloyd-Jones M.
-
Epidemiological, social, diagnostic and economic evaluation of population screening for genital chlamydial infection.
By Low N, McCarthy A, Macleod J, Salisbury C, Campbell R, Roberts TE, et al.
-
Methadone and buprenorphine for the management of opioid dependence: a systematic review and economic evaluation.
By Connock M, Juarez-Garcia A, Jowett S, Frew E, Liu Z, Taylor RJ, et al.
-
Exercise Evaluation Randomised Trial (EXERT): a randomised trial comparing GP referral for leisure centre-based exercise, community-based walking and advice only.
By Isaacs AJ, Critchley JA, See Tai S, Buckingham K, Westley D, Harridge SDR, et al.
-
Interferon alfa (pegylated and non-pegylated) and ribavirin for the treatment of mild chronic hepatitis C: a systematic review and economic evaluation.
By Shepherd J, Jones J, Hartwell D, Davidson P, Price A, Waugh N.
-
Systematic review and economic evaluation of bevacizumab and cetuximab for the treatment of metastatic colorectal cancer.
By Tappenden P, Jones R, Paisley S, Carroll C.
-
A systematic review and economic evaluation of epoetin alfa, epoetin beta and darbepoetin alfa in anaemia associated with cancer, especially that attributable to cancer treatment.
By Wilson J, Yao GL, Raftery J, Bohlius J, Brunskill S, Sandercock J, et al.
-
A systematic review and economic evaluation of statins for the prevention of coronary events.
By Ward S, Lloyd Jones M, Pandor A, Holmes M, Ara R, Ryan A, et al.
-
A systematic review of the effectiveness and cost-effectiveness of different models of community-based respite care for frail older people and their carers.
By Mason A, Weatherly H, Spilsbury K, Arksey H, Golder S, Adamson J, et al.
-
Additional therapy for young children with spastic cerebral palsy: a randomised controlled trial.
By Weindling AM, Cunningham CC, Glenn SM, Edwards RT, Reeves DJ.
-
Screening for type 2 diabetes: literature review and economic modelling.
By Waugh N, Scotland G, McNamee P, Gillett M, Brennan A, Goyder E, et al.
-
The effectiveness and cost-effectiveness of cinacalcet for secondary hyperparathyroidism in end-stage renal disease patients on dialysis: a systematic review and economic evaluation.
By Garside R, Pitt M, Anderson R, Mealing S, Roome C, Snaith A, et al.
-
The clinical effectiveness and cost-effectiveness of gemcitabine for metastatic breast cancer: a systematic review and economic evaluation.
By Takeda AL, Jones J, Loveman E, Tan SC, Clegg AJ.
-
A systematic review of duplex ultrasound, magnetic resonance angiography and computed tomography angiography for the diagnosis and assessment of symptomatic, lower limb peripheral arterial disease.
By Collins R, Cranny G, Burch J, Aguiar-Ibáñez R, Craig D, Wright K, et al.
-
The clinical effectiveness and cost-effectiveness of treatments for children with idiopathic steroid-resistant nephrotic syndrome: a systematic review.
By Colquitt JL, Kirby J, Green C, Cooper K, Trompeter RS.
-
A systematic review of the routine monitoring of growth in children of primary school age to identify growth-related conditions.
By Fayter D, Nixon J, Hartley S, Rithalia A, Butler G, Rudolf M, et al.
-
Systematic review of the effectiveness of preventing and treating Staphylococcus aureus carriage in reducing peritoneal catheter-related infections.
By McCormack K, Rabindranath K, Kilonzo M, Vale L, Fraser C, McIntyre L, et al.
-
The clinical effectiveness and cost of repetitive transcranial magnetic stimulation versus electroconvulsive therapy in severe depression: a multicentre pragmatic randomised controlled trial and economic analysis.
By McLoughlin DM, Mogg A, Eranti S, Pluck G, Purvis R, Edwards D, et al.
-
A randomised controlled trial and economic evaluation of direct versus indirect and individual versus group modes of speech and language therapy for children with primary language impairment.
By Boyle J, McCartney E, Forbes J, O’Hare A.
-
Hormonal therapies for early breast cancer: systematic review and economic evaluation.
By Hind D, Ward S, De Nigris E, Simpson E, Carroll C, Wyld L.
-
Cardioprotection against the toxic effects of anthracyclines given to children with cancer: a systematic review.
By Bryant J, Picot J, Levitt G, Sullivan I, Baxter L, Clegg A.
-
Adalimumab, etanercept and infliximab for the treatment of ankylosing spondylitis: a systematic review and economic evaluation.
By McLeod C, Bagust A, Boland A, Dagenais P, Dickson R, Dundar Y, et al.
-
Prenatal screening and treatment strategies to prevent group B streptococcal and other bacterial infections in early infancy: cost-effectiveness and expected value of information analyses.
By Colbourn T, Asseburg C, Bojke L, Philips Z, Claxton K, Ades AE, et al.
-
Clinical effectiveness and cost-effectiveness of bone morphogenetic proteins in the non-healing of fractures and spinal fusion: a systematic review.
By Garrison KR, Donell S, Ryder J, Shemilt I, Mugford M, Harvey I, et al.
-
A randomised controlled trial of postoperative radiotherapy following breast-conserving surgery in a minimum-risk older population. The PRIME trial.
By Prescott RJ, Kunkler IH, Williams LJ, King CC, Jack W, van der Pol M, et al.
-
Current practice, accuracy, effectiveness and cost-effectiveness of the school entry hearing screen.
By Bamford J, Fortnum H, Bristow K, Smith J, Vamvakas G, Davies L, et al.
-
The clinical effectiveness and cost-effectiveness of inhaled insulin in diabetes mellitus: a systematic review and economic evaluation.
By Black C, Cummins E, Royle P, Philip S, Waugh N.
-
Surveillance of cirrhosis for hepatocellular carcinoma: systematic review and economic analysis.
By Thompson Coon J, Rogers G, Hewson P, Wright D, Anderson R, Cramp M, et al.
-
The Birmingham Rehabilitation Uptake Maximisation Study (BRUM). Homebased compared with hospital-based cardiac rehabilitation in a multi-ethnic population: cost-effectiveness and patient adherence.
By Jolly K, Taylor R, Lip GYH, Greenfield S, Raftery J, Mant J, et al.
-
A systematic review of the clinical, public health and cost-effectiveness of rapid diagnostic tests for the detection and identification of bacterial intestinal pathogens in faeces and food.
By Abubakar I, Irvine L, Aldus CF, Wyatt GM, Fordham R, Schelenz S, et al.
-
A randomised controlled trial examining the longer-term outcomes of standard versus new antiepileptic drugs. The SANAD trial.
By Marson AG, Appleton R, Baker GA, Chadwick DW, Doughty J, Eaton B, et al.
-
Clinical effectiveness and cost-effectiveness of different models of managing long-term oral anti-coagulation therapy: a systematic review and economic modelling.
By Connock M, Stevens C, Fry-Smith A, Jowett S, Fitzmaurice D, Moore D, et al.
-
A systematic review and economic model of the clinical effectiveness and cost-effectiveness of interventions for preventing relapse in people with bipolar disorder.
By Soares-Weiser K, Bravo Vergel Y, Beynon S, Dunn G, Barbieri M, Duffy S, et al.
-
Taxanes for the adjuvant treatment of early breast cancer: systematic review and economic evaluation.
By Ward S, Simpson E, Davis S, Hind D, Rees A, Wilkinson A.
-
The clinical effectiveness and cost-effectiveness of screening for open angle glaucoma: a systematic review and economic evaluation.
By Burr JM, Mowatt G, Hernández R, Siddiqui MAR, Cook J, Lourenco T, et al.
-
Acceptability, benefit and costs of early screening for hearing disability: a study of potential screening tests and models.
By Davis A, Smith P, Ferguson M, Stephens D, Gianopoulos I.
-
Contamination in trials of educational interventions.
By Keogh-Brown MR, Bachmann MO, Shepstone L, Hewitt C, Howe A, Ramsay CR, et al.
-
Overview of the clinical effectiveness of positron emission tomography imaging in selected cancers.
By Facey K, Bradbury I, Laking G, Payne E.
-
The effectiveness and cost-effectiveness of carmustine implants and temozolomide for the treatment of newly diagnosed high-grade glioma: a systematic review and economic evaluation.
By Garside R, Pitt M, Anderson R, Rogers G, Dyer M, Mealing S, et al.
-
Drug-eluting stents: a systematic review and economic evaluation.
By Hill RA, Boland A, Dickson R, Dündar Y, Haycox A, McLeod C, et al.
-
The clinical effectiveness and cost-effectiveness of cardiac resynchronisation (biventricular pacing) for heart failure: systematic review and economic model.
By Fox M, Mealing S, Anderson R, Dean J, Stein K, Price A, et al.
-
Recruitment to randomised trials: strategies for trial enrolment and participation study. The STEPS study.
By Campbell MK, Snowdon C, Francis D, Elbourne D, McDonald AM, Knight R, et al.
-
Cost-effectiveness of functional cardiac testing in the diagnosis and management of coronary artery disease: a randomised controlled trial. The CECaT trial.
By Sharples L, Hughes V, Crean A, Dyer M, Buxton M, Goldsmith K, et al.
-
Evaluation of diagnostic tests when there is no gold standard. A review of methods.
By Rutjes AWS, Reitsma JB, Coomarasamy A, Khan KS, Bossuyt PMM.
-
Systematic reviews of the clinical effectiveness and cost-effectiveness of proton pump inhibitors in acute upper gastrointestinal bleeding.
By Leontiadis GI, Sreedharan A, Dorward S, Barton P, Delaney B, Howden CW, et al.
-
A review and critique of modelling in prioritising and designing screening programmes.
By Karnon J, Goyder E, Tappenden P, McPhie S, Towers I, Brazier J, et al.
-
An assessment of the impact of the NHS Health Technology Assessment Programme.
By Hanney S, Buxton M, Green C, Coulson D, Raftery J.
-
A systematic review and economic model of switching from nonglycopeptide to glycopeptide antibiotic prophylaxis for surgery.
By Cranny G, Elliott R, Weatherly H, Chambers D, Hawkins N, Myers L, et al.
-
‘Cut down to quit’ with nicotine replacement therapies in smoking cessation: a systematic review of effectiveness and economic analysis.
By Wang D, Connock M, Barton P, Fry-Smith A, Aveyard P, Moore D.
-
A systematic review of the effectiveness of strategies for reducing fracture risk in children with juvenile idiopathic arthritis with additional data on long-term risk of fracture and cost of disease management.
By Thornton J, Ashcroft D, O’Neill T, Elliott R, Adams J, Roberts C, et al.
-
Does befriending by trained lay workers improve psychological well-being and quality of life for carers of people with dementia, and at what cost? A randomised controlled trial.
By Charlesworth G, Shepstone L, Wilson E, Thalanany M, Mugford M, Poland F.
-
A multi-centre retrospective cohort study comparing the efficacy, safety and cost-effectiveness of hysterectomy and uterine artery embolisation for the treatment of symptomatic uterine fibroids. The HOPEFUL study.
By Hirst A, Dutton S, Wu O, Briggs A, Edwards C, Waldenmaier L, et al.
-
Methods of prediction and prevention of pre-eclampsia: systematic reviews of accuracy and effectiveness literature with economic modelling.
By Meads CA, Cnossen JS, Meher S, Juarez-Garcia A, ter Riet G, Duley L, et al.
-
The use of economic evaluations in NHS decision-making: a review and empirical investigation.
By Williams I, McIver S, Moore D, Bryan S.
-
Stapled haemorrhoidectomy (haemorrhoidopexy) for the treatment of haemorrhoids: a systematic review and economic evaluation.
By Burch J, Epstein D, Baba-Akbari A, Weatherly H, Fox D, Golder S, et al.
-
The clinical effectiveness of diabetes education models for Type 2 diabetes: a systematic review.
By Loveman E, Frampton GK, Clegg AJ.
-
Payment to healthcare professionals for patient recruitment to trials: systematic review and qualitative study.
By Raftery J, Bryant J, Powell J, Kerr C, Hawker S.
-
Cyclooxygenase-2 selective non-steroidal anti-inflammatory drugs (etodolac, meloxicam, celecoxib, rofecoxib, etoricoxib, valdecoxib and lumiracoxib) for osteoarthritis and rheumatoid arthritis: a systematic review and economic evaluation.
By Chen Y-F, Jobanputra P, Barton P, Bryan S, Fry-Smith A, Harris G, et al.
-
The clinical effectiveness and cost-effectiveness of central venous catheters treated with anti-infective agents in preventing bloodstream infections: a systematic review and economic evaluation.
By Hockenhull JC, Dwan K, Boland A, Smith G, Bagust A, Dundar Y, et al.
-
Stepped treatment of older adults on laxatives. The STOOL trial.
By Mihaylov S, Stark C, McColl E, Steen N, Vanoli A, Rubin G, et al.
-
A randomised controlled trial of cognitive behaviour therapy in adolescents with major depression treated by selective serotonin reuptake inhibitors. The ADAPT trial.
By Goodyer IM, Dubicka B, Wilkinson P, Kelvin R, Roberts C, Byford S, et al.
-
The use of irinotecan, oxaliplatin and raltitrexed for the treatment of advanced colorectal cancer: systematic review and economic evaluation.
By Hind D, Tappenden P, Tumur I, Eggington E, Sutcliffe P, Ryan A.
-
Ranibizumab and pegaptanib for the treatment of age-related macular degeneration: a systematic review and economic evaluation.
By Colquitt JL, Jones J, Tan SC, Takeda A, Clegg AJ, Price A.
-
Systematic review of the clinical effectiveness and cost-effectiveness of 64-slice or higher computed tomography angiography as an alternative to invasive coronary angiography in the investigation of coronary artery disease.
By Mowatt G, Cummins E, Waugh N, Walker S, Cook J, Jia X, et al.
-
Structural neuroimaging in psychosis: a systematic review and economic evaluation.
By Albon E, Tsourapas A, Frew E, Davenport C, Oyebode F, Bayliss S, et al.
-
Systematic review and economic analysis of the comparative effectiveness of different inhaled corticosteroids and their usage with long-acting beta2 agonists for the treatment of chronic asthma in adults and children aged 12 years and over.
By Shepherd J, Rogers G, Anderson R, Main C, Thompson-Coon J, Hartwell D, et al.
-
Systematic review and economic analysis of the comparative effectiveness of different inhaled corticosteroids and their usage with long-acting beta2 agonists for the treatment of chronic asthma in children under the age of 12 years.
By Main C, Shepherd J, Anderson R, Rogers G, Thompson-Coon J, Liu Z, et al.
-
Ezetimibe for the treatment of hypercholesterolaemia: a systematic review and economic evaluation.
By Ara R, Tumur I, Pandor A, Duenas A, Williams R, Wilkinson A, et al.
-
Topical or oral ibuprofen for chronic knee pain in older people. The TOIB study.
By Underwood M, Ashby D, Carnes D, Castelnuovo E, Cross P, Harding G, et al.
-
A prospective randomised comparison of minor surgery in primary and secondary care. The MiSTIC trial.
By George S, Pockney P, Primrose J, Smith H, Little P, Kinley H, et al.
-
A review and critical appraisal of measures of therapist–patient interactions in mental health settings.
By Cahill J, Barkham M, Hardy G, Gilbody S, Richards D, Bower P, et al.
-
The clinical effectiveness and cost-effectiveness of screening programmes for amblyopia and strabismus in children up to the age of 4–5 years: a systematic review and economic evaluation.
By Carlton J, Karnon J, Czoski-Murray C, Smith KJ, Marr J.
-
A systematic review of the clinical effectiveness and cost-effectiveness and economic modelling of minimal incision total hip replacement approaches in the management of arthritic disease of the hip.
By de Verteuil R, Imamura M, Zhu S, Glazener C, Fraser C, Munro N, et al.
-
A preliminary model-based assessment of the cost–utility of a screening programme for early age-related macular degeneration.
By Karnon J, Czoski-Murray C, Smith K, Brand C, Chakravarthy U, Davis S, et al.
-
Intravenous magnesium sulphate and sotalol for prevention of atrial fibrillation after coronary artery bypass surgery: a systematic review and economic evaluation.
By Shepherd J, Jones J, Frampton GK, Tanajewski L, Turner D, Price A.
-
Absorbent products for urinary/faecal incontinence: a comparative evaluation of key product categories.
By Fader M, Cottenden A, Getliffe K, Gage H, Clarke-O’Neill S, Jamieson K, et al.
-
A systematic review of repetitive functional task practice with modelling of resource use, costs and effectiveness.
By French B, Leathley M, Sutton C, McAdam J, Thomas L, Forster A, et al.
-
The effectiveness and cost-effectivness of minimal access surgery amongst people with gastro-oesophageal reflux disease – a UK collaborative study. The reflux trial.
By Grant A, Wileman S, Ramsay C, Bojke L, Epstein D, Sculpher M, et al.
-
Time to full publication of studies of anti-cancer medicines for breast cancer and the potential for publication bias: a short systematic review.
By Takeda A, Loveman E, Harris P, Hartwell D, Welch K.
-
Performance of screening tests for child physical abuse in accident and emergency departments.
By Woodman J, Pitt M, Wentz R, Taylor B, Hodes D, Gilbert RE.
-
Curative catheter ablation in atrial fibrillation and typical atrial flutter: systematic review and economic evaluation.
By Rodgers M, McKenna C, Palmer S, Chambers D, Van Hout S, Golder S, et al.
-
Systematic review and economic modelling of effectiveness and cost utility of surgical treatments for men with benign prostatic enlargement.
By Lourenco T, Armstrong N, N’Dow J, Nabi G, Deverill M, Pickard R, et al.
-
Immunoprophylaxis against respiratory syncytial virus (RSV) with palivizumab in children: a systematic review and economic evaluation.
By Wang D, Cummins C, Bayliss S, Sandercock J, Burls A.
-
Deferasirox for the treatment of iron overload associated with regular blood transfusions (transfusional haemosiderosis) in patients suffering with chronic anaemia: a systematic review and economic evaluation.
By McLeod C, Fleeman N, Kirkham J, Bagust A, Boland A, Chu P, et al.
-
Thrombophilia testing in people with venous thromboembolism: systematic review and cost-effectiveness analysis.
By Simpson EL, Stevenson MD, Rawdin A, Papaioannou D.
-
Surgical procedures and non-surgical devices for the management of non-apnoeic snoring: a systematic review of clinical effects and associated treatment costs.
By Main C, Liu Z, Welch K, Weiner G, Quentin Jones S, Stein K.
-
Continuous positive airway pressure devices for the treatment of obstructive sleep apnoea–hypopnoea syndrome: a systematic review and economic analysis.
By McDaid C, Griffin S, Weatherly H, Durée K, van der Burgt M, van Hout S, Akers J, et al.
-
Use of classical and novel biomarkers as prognostic risk factors for localised prostate cancer: a systematic review.
By Sutcliffe P, Hummel S, Simpson E, Young T, Rees A, Wilkinson A, et al.
-
The harmful health effects of recreational ecstasy: a systematic review of observational evidence.
By Rogers G, Elston J, Garside R, Roome C, Taylor R, Younger P, et al.
-
Systematic review of the clinical effectiveness and cost-effectiveness of oesophageal Doppler monitoring in critically ill and high-risk surgical patients.
By Mowatt G, Houston G, Hernández R, de Verteuil R, Fraser C, Cuthbertson B, et al.
-
The use of surrogate outcomes in model-based cost-effectiveness analyses: a survey of UK Health Technology Assessment reports.
By Taylor RS, Elston J.
-
Controlling Hypertension and Hypotension Immediately Post Stroke (CHHIPS) – a randomised controlled trial.
By Potter J, Mistri A, Brodie F, Chernova J, Wilson E, Jagger C, et al.
-
Routine antenatal anti-D prophylaxis for RhD-negative women: a systematic review and economic evaluation.
By Pilgrim H, Lloyd-Jones M, Rees A.
-
Amantadine, oseltamivir and zanamivir for the prophylaxis of influenza (including a review of existing guidance no. 67): a systematic review and economic evaluation.
By Tappenden P, Jackson R, Cooper K, Rees A, Simpson E, Read R, et al.
-
Improving the evaluation of therapeutic interventions in multiple sclerosis: the role of new psychometric methods.
By Hobart J, Cano S.
-
Treatment of severe ankle sprain: a pragmatic randomised controlled trial comparing the clinical effectiveness and cost-effectiveness of three types of mechanical ankle support with tubular bandage. The CAST trial.
By Cooke MW, Marsh JL, Clark M, Nakash R, Jarvis RM, Hutton JL, et al. , on behalf of the CAST trial group.
-
Non-occupational postexposure prophylaxis for HIV: a systematic review.
By Bryant J, Baxter L, Hird S.
-
Blood glucose self-monitoring in type 2 diabetes: a randomised controlled trial.
By Farmer AJ, Wade AN, French DP, Simon J, Yudkin P, Gray A, et al.
-
How far does screening women for domestic (partner) violence in different health-care settings meet criteria for a screening programme? Systematic reviews of nine UK National Screening Committee criteria.
By Feder G, Ramsay J, Dunne D, Rose M, Arsene C, Norman R, et al.
-
Spinal cord stimulation for chronic pain of neuropathic or ischaemic origin: systematic review and economic evaluation.
By Simpson, EL, Duenas A, Holmes MW, Papaioannou D, Chilcott J.
-
The role of magnetic resonance imaging in the identification of suspected acoustic neuroma: a systematic review of clinical and cost-effectiveness and natural history.
By Fortnum H, O’Neill C, Taylor R, Lenthall R, Nikolopoulos T, Lightfoot G, et al.
-
Dipsticks and diagnostic algorithms in urinary tract infection: development and validation, randomised trial, economic analysis, observational cohort and qualitative study.
By Little P, Turner S, Rumsby K, Warner G, Moore M, Lowes JA, et al.
-
Systematic review of respite care in the frail elderly.
By Shaw C, McNamara R, Abrams K, Cannings-John R, Hood K, Longo M, et al.
-
Neuroleptics in the treatment of aggressive challenging behaviour for people with intellectual disabilities: a randomised controlled trial (NACHBID).
By Tyrer P, Oliver-Africano P, Romeo R, Knapp M, Dickens S, Bouras N, et al.
-
Randomised controlled trial to determine the clinical effectiveness and cost-effectiveness of selective serotonin reuptake inhibitors plus supportive care, versus supportive care alone, for mild to moderate depression with somatic symptoms in primary care: the THREAD (THREshold for AntiDepressant response) study.
By Kendrick T, Chatwin J, Dowrick C, Tylee A, Morriss R, Peveler R, et al.
-
Diagnostic strategies using DNA testing for hereditary haemochromatosis in at-risk populations: a systematic review and economic evaluation.
By Bryant J, Cooper K, Picot J, Clegg A, Roderick P, Rosenberg W, et al.
-
Enhanced external counterpulsation for the treatment of stable angina and heart failure: a systematic review and economic analysis.
By McKenna C, McDaid C, Suekarran S, Hawkins N, Claxton K, Light K, et al.
-
Development of a decision support tool for primary care management of patients with abnormal liver function tests without clinically apparent liver disease: a record-linkage population cohort study and decision analysis (ALFIE).
By Donnan PT, McLernon D, Dillon JF, Ryder S, Roderick P, Sullivan F, et al.
-
A systematic review of presumed consent systems for deceased organ donation.
By Rithalia A, McDaid C, Suekarran S, Norman G, Myers L, Sowden A.
-
Paracetamol and ibuprofen for the treatment of fever in children: the PITCH randomised controlled trial.
By Hay AD, Redmond NM, Costelloe C, Montgomery AA, Fletcher M, Hollinghurst S, et al.
-
A randomised controlled trial to compare minimally invasive glucose monitoring devices with conventional monitoring in the management of insulin-treated diabetes mellitus (MITRE).
By Newman SP, Cooke D, Casbard A, Walker S, Meredith S, Nunn A, et al.
-
Sensitivity analysis in economic evaluation: an audit of NICE current practice and a review of its use and value in decision-making.
By Andronis L, Barton P, Bryan S.
-
Trastuzumab for the treatment of primary breast cancer in HER2-positive women: a single technology appraisal.
By Ward S, Pilgrim H, Hind D.
-
Docetaxel for the adjuvant treatment of early node-positive breast cancer: a single technology appraisal.
By Chilcott J, Lloyd Jones M, Wilkinson A.
-
The use of paclitaxel in the management of early stage breast cancer.
By Griffin S, Dunn G, Palmer S, Macfarlane K, Brent S, Dyker A, et al.
-
Rituximab for the first-line treatment of stage III/IV follicular non-Hodgkin’s lymphoma.
By Dundar Y, Bagust A, Hounsome J, McLeod C, Boland A, Davis H, et al.
-
Bortezomib for the treatment of multiple myeloma patients.
By Green C, Bryant J, Takeda A, Cooper K, Clegg A, Smith A, et al.
-
Fludarabine phosphate for the firstline treatment of chronic lymphocytic leukaemia.
By Walker S, Palmer S, Erhorn S, Brent S, Dyker A, Ferrie L, et al.
-
Erlotinib for the treatment of relapsed non-small cell lung cancer.
By McLeod C, Bagust A, Boland A, Hockenhull J, Dundar Y, Proudlove C, et al.
-
Cetuximab plus radiotherapy for the treatment of locally advanced squamous cell carcinoma of the head and neck.
By Griffin S, Walker S, Sculpher M, White S, Erhorn S, Brent S, et al.
-
Infliximab for the treatment of adults with psoriasis.
By Loveman E, Turner D, Hartwell D, Cooper K, Clegg A
-
Psychological interventions for postnatal depression: cluster randomised trial and economic evaluation. The PoNDER trial.
By Morrell CJ, Warner R, Slade P, Dixon S, Walters S, Paley G, et al.
-
The effect of different treatment durations of clopidogrel in patients with non-ST-segment elevation acute coronary syndromes: a systematic review and value of information analysis.
By Rogowski R, Burch J, Palmer S, Craigs C, Golder S, Woolacott N.
-
Systematic review and individual patient data meta-analysis of diagnosis of heart failure, with modelling of implications of different diagnostic strategies in primary care.
By Mant J, Doust J, Roalfe A, Barton P, Cowie MR, Glasziou P, et al.
-
A multicentre randomised controlled trial of the use of continuous positive airway pressure and non-invasive positive pressure ventilation in the early treatment of patients presenting to the emergency department with severe acute cardiogenic pulmonary oedema: the 3CPO trial.
By Gray AJ, Goodacre S, Newby DE, Masson MA, Sampson F, Dixon S, et al. , on behalf of the 3CPO study investigators.
-
Early high-dose lipid-lowering therapy to avoid cardiac events: a systematic review and economic evaluation.
By Ara R, Pandor A, Stevens J, Rees A, Rafia R.
-
Adefovir dipivoxil and pegylated interferon alpha for the treatment of chronic hepatitis B: an updated systematic review and economic evaluation.
By Jones J, Shepherd J, Baxter L, Gospodarevskaya E, Hartwell D, Harris P, et al.
-
Methods to identify postnatal depression in primary care: an integrated evidence synthesis and value of information analysis.
By Hewitt CE, Gilbody SM, Brealey S, Paulden M, Palmer S, Mann R, et al.
-
A double-blind randomised placebo-controlled trial of topical intranasal corticosteroids in 4- to 11-year-old children with persistent bilateral otitis media with effusion in primary care.
By Williamson I, Benge S, Barton S, Petrou S, Letley L, Fasey N, et al.
-
The effectiveness and cost-effectiveness of methods of storing donated kidneys from deceased donors: a systematic review and economic model.
By Bond M, Pitt M, Akoh J, Moxham T, Hoyle M, Anderson R.
-
Rehabilitation of older patients: day hospital compared with rehabilitation at home. A randomised controlled trial.
By Parker SG, Oliver P, Pennington M, Bond J, Jagger C, Enderby PM, et al.
-
Breastfeeding promotion for infants in neonatal units: a systematic review and economic analysis.
By Renfrew MJ, Craig D, Dyson L, McCormick F, Rice S, King SE, et al.
-
The clinical effectiveness and cost-effectiveness of bariatric (weight loss) surgery for obesity: a systematic review and economic evaluation.
By Picot J, Jones J, Colquitt JL, Gospodarevskaya E, Loveman E, Baxter L, et al.
-
Rapid testing for group B streptococcus during labour: a test accuracy study with evaluation of acceptability and cost-effectiveness.
By Daniels J, Gray J, Pattison H, Roberts T, Edwards E, Milner P, et al.
-
Screening to prevent spontaneous preterm birth: systematic reviews of accuracy and effectiveness literature with economic modelling.
By Honest H, Forbes CA, Durée KH, Norman G, Duffy SB, Tsourapas A, et al.
-
The effectiveness and cost-effectiveness of cochlear implants for severe to profound deafness in children and adults: a systematic review and economic model.
By Bond M, Mealing S, Anderson R, Elston J, Weiner G, Taylor RS, et al.
-
Gemcitabine for the treatment of metastatic breast cancer.
By Jones J, Takeda A, Tan SC, Cooper K, Loveman E, Clegg A.
-
Varenicline in the management of smoking cessation: a single technology appraisal.
By Hind D, Tappenden P, Peters J, Kenjegalieva K.
-
Alteplase for the treatment of acute ischaemic stroke: a single technology appraisal.
By Lloyd Jones M, Holmes M.
-
Rituximab for the treatment of rheumatoid arthritis.
By Bagust A, Boland A, Hockenhull J, Fleeman N, Greenhalgh J, Dundar Y, et al.
-
Omalizumab for the treatment of severe persistent allergic asthma.
By Jones J, Shepherd J, Hartwell D, Harris P, Cooper K, Takeda A, et al.
-
Rituximab for the treatment of relapsed or refractory stage III or IV follicular non-Hodgkin’s lymphoma.
By Boland A, Bagust A, Hockenhull J, Davis H, Chu P, Dickson R.
-
Adalimumab for the treatment of psoriasis.
By Turner D, Picot J, Cooper K, Loveman E.
-
Dabigatran etexilate for the prevention of venous thromboembolism in patients undergoing elective hip and knee surgery: a single technology appraisal.
By Holmes M, C Carroll C, Papaioannou D.
-
Romiplostim for the treatment of chronic immune or idiopathic thrombocytopenic purpura: a single technology appraisal.
By Mowatt G, Boachie C, Crowther M, Fraser C, Hernández R, Jia X, et al.
-
Sunitinib for the treatment of gastrointestinal stromal tumours: a critique of the submission from Pfizer.
By Bond M, Hoyle M, Moxham T, Napier M, Anderson R.
-
Vitamin K to prevent fractures in older women: systematic review and economic evaluation.
By Stevenson M, Lloyd-Jones M, Papaioannou D.
-
The effects of biofeedback for the treatment of essential hypertension: a systematic review.
By Greenhalgh J, Dickson R, Dundar Y.
-
A randomised controlled trial of the use of aciclovir and/or prednisolone for the early treatment of Bell’s palsy: the BELLS study.
By Sullivan FM, Swan IRC, Donnan PT, Morrison JM, Smith BH, McKinstry B, et al.
-
Lapatinib for the treatment of HER2-overexpressing breast cancer.
By Jones J, Takeda A, Picot J, von Keyserlingk C, Clegg A.
-
Infliximab for the treatment of ulcerative colitis.
By Hyde C, Bryan S, Juarez-Garcia A, Andronis L, Fry-Smith A.
-
Rimonabant for the treatment of overweight and obese people.
By Burch J, McKenna C, Palmer S, Norman G, Glanville J, Sculpher M, et al.
-
Telbivudine for the treatment of chronic hepatitis B infection.
By Hartwell D, Jones J, Harris P, Cooper K.
-
Entecavir for the treatment of chronic hepatitis B infection.
By Shepherd J, Gospodarevskaya E, Frampton G, Cooper, K.
-
Febuxostat for the treatment of hyperuricaemia in people with gout: a single technology appraisal.
By Stevenson M, Pandor A.
-
Rivaroxaban for the prevention of venous thromboembolism: a single technology appraisal.
By Stevenson M, Scope A, Holmes M, Rees A, Kaltenthaler E.
-
Cetuximab for the treatment of recurrent and/or metastatic squamous cell carcinoma of the head and neck.
By Greenhalgh J, Bagust A, Boland A, Fleeman N, McLeod C, Dundar Y, et al.
-
Mifamurtide for the treatment of osteosarcoma: a single technology appraisal.
By Pandor A, Fitzgerald P, Stevenson M, Papaioannou D.
-
Ustekinumab for the treatment of moderate to severe psoriasis.
By Gospodarevskaya E, Picot J, Cooper K, Loveman E, Takeda A.
-
Endovascular stents for abdominal aortic aneurysms: a systematic review and economic model.
By Chambers D, Epstein D, Walker S, Fayter D, Paton F, Wright K, et al.
-
Clinical and cost-effectiveness of epoprostenol, iloprost, bosentan, sitaxentan and sildenafil for pulmonary arterial hypertension within their licensed indications: a systematic review and economic evaluation.
By Chen Y-F, Jowett S, Barton P, Malottki K, Hyde C, Gibbs JSR, et al.
-
Cessation of attention deficit hyperactivity disorder drugs in the young (CADDY) – a pharmacoepidemiological and qualitative study.
By Wong ICK, Asherson P, Bilbow A, Clifford S, Coghill D, R DeSoysa R, et al.
-
ARTISTIC: a randomised trial of human papillomavirus (HPV) testing in primary cervical screening.
By Kitchener HC, Almonte M, Gilham C, Dowie R, Stoykova B, Sargent A, et al.
-
The clinical effectiveness of glucosamine and chondroitin supplements in slowing or arresting progression of osteoarthritis of the knee: a systematic review and economic evaluation.
By Black C, Clar C, Henderson R, MacEachern C, McNamee P, Quayyum Z, et al.
-
Randomised preference trial of medical versus surgical termination of pregnancy less than 14 weeks’ gestation (TOPS).
By Robson SC, Kelly T, Howel D, Deverill M, Hewison J, Lie MLS, et al.
-
Randomised controlled trial of the use of three dressing preparations in the management of chronic ulceration of the foot in diabetes.
By Jeffcoate WJ, Price PE, Phillips CJ, Game FL, Mudge E, Davies S, et al.
-
VenUS II: a randomised controlled trial of larval therapy in the management of leg ulcers.
By Dumville JC, Worthy G, Soares MO, Bland JM, Cullum N, Dowson C, et al.
-
A prospective randomised controlled trial and economic modelling of antimicrobial silver dressings versus non-adherent control dressings for venous leg ulcers: the VULCAN trial
By Michaels JA, Campbell WB, King BM, MacIntyre J, Palfreyman SJ, Shackley P, et al.
-
Communication of carrier status information following universal newborn screening for sickle cell disorders and cystic fibrosis: qualitative study of experience and practice.
By Kai J, Ulph F, Cullinan T, Qureshi N.
-
Antiviral drugs for the treatment of influenza: a systematic review and economic evaluation.
By Burch J, Paulden M, Conti S, Stock C, Corbett M, Welton NJ, et al.
-
Development of a toolkit and glossary to aid in the adaptation of health technology assessment (HTA) reports for use in different contexts.
By Chase D, Rosten C, Turner S, Hicks N, Milne R.
-
Colour vision testing for diabetic retinopathy: a systematic review of diagnostic accuracy and economic evaluation.
By Rodgers M, Hodges R, Hawkins J, Hollingworth W, Duffy S, McKibbin M, et al.
-
Systematic review of the effectiveness and cost-effectiveness of weight management schemes for the under fives: a short report.
By Bond M, Wyatt K, Lloyd J, Welch K, Taylor R.
-
Are adverse effects incorporated in economic models? An initial review of current practice.
By Craig D, McDaid C, Fonseca T, Stock C, Duffy S, Woolacott N.
-
Multicentre randomised controlled trial examining the cost-effectiveness of contrast-enhanced high field magnetic resonance imaging in women with primary breast cancer scheduled for wide local excision (COMICE).
By Turnbull LW, Brown SR, Olivier C, Harvey I, Brown J, Drew P, et al.
-
Bevacizumab, sorafenib tosylate, sunitinib and temsirolimus for renal cell carcinoma: a systematic review and economic evaluation.
By Thompson Coon J, Hoyle M, Green C, Liu Z, Welch K, Moxham T, et al.
-
The clinical effectiveness and cost-effectiveness of testing for cytochrome P450 polymorphisms in patients with schizophrenia treated with antipsychotics: a systematic review and economic evaluation.
By Fleeman N, McLeod C, Bagust A, Beale S, Boland A, Dundar Y, et al.
-
Systematic review of the clinical effectiveness and cost-effectiveness of photodynamic diagnosis and urine biomarkers (FISH, ImmunoCyt, NMP22) and cytology for the detection and follow-up of bladder cancer.
By Mowatt G, Zhu S, Kilonzo M, Boachie C, Fraser C, Griffiths TRL, et al.
-
Effectiveness and cost-effectiveness of arthroscopic lavage in the treatment of osteoarthritis of the knee: a mixed methods study of the feasibility of conducting a surgical placebo-controlled trial (the KORAL study).
By Campbell MK, Skea ZC, Sutherland AG, Cuthbertson BH, Entwistle VA, McDonald AM, et al.
-
A randomised 2 × 2 trial of community versus hospital pulmonary rehabilitation for chronic obstructive pulmonary disease followed by telephone or conventional follow-up.
By Waterhouse JC, Walters SJ, Oluboyede Y, Lawson RA.
-
The effectiveness and cost-effectiveness of behavioural interventions for the prevention of sexually transmitted infections in young people aged 13–19: a systematic review and economic evaluation.
By Shepherd J, Kavanagh J, Picot J, Cooper K, Harden A, Barnett-Page E, et al.
-
Dissemination and publication of research findings: an updated review of related biases.
By Song F, Parekh S, Hooper L, Loke YK, Ryder J, Sutton AJ, et al.
-
The effectiveness and cost-effectiveness of biomarkers for the prioritisation of patients awaiting coronary revascularisation: a systematic review and decision model.
By Hemingway H, Henriksson M, Chen R, Damant J, Fitzpatrick N, Abrams K, et al.
-
Comparison of case note review methods for evaluating quality and safety in health care.
By Hutchinson A, Coster JE, Cooper KL, McIntosh A, Walters SJ, Bath PA, et al.
-
Clinical effectiveness and cost-effectiveness of continuous subcutaneous insulin infusion for diabetes: systematic review and economic evaluation.
By Cummins E, Royle P, Snaith A, Greene A, Robertson L, McIntyre L, et al.
-
Self-monitoring of blood glucose in type 2 diabetes: systematic review.
By Clar C, Barnard K, Cummins E, Royle P, Waugh N.
Health Technology Assessment programme
-
Director, NIHR HTA programme, Professor of Clinical Pharmacology, University of Liverpool
-
Director, Medical Care Research Unit, University of Sheffield
Prioritisation Strategy Group
-
Director, NIHR HTA programme, Professor of Clinical Pharmacology, University of Liverpool
-
Director, Medical Care Research Unit, University of Sheffield
-
Dr Bob Coates, Consultant Advisor, NETSCC, HTA
-
Dr Andrew Cook, Consultant Advisor, NETSCC, HTA
-
Dr Peter Davidson, Director of Science Support, NETSCC, HTA
-
Professor Robin E Ferner, Consultant Physician and Director, West Midlands Centre for Adverse Drug Reactions, City Hospital NHS Trust, Birmingham
-
Professor Paul Glasziou, Professor of Evidence-Based Medicine, University of Oxford
-
Dr Nick Hicks, Director of NHS Support, NETSCC, HTA
-
Dr Edmund Jessop, Medical Adviser, National Specialist, National Commissioning Group (NCG), Department of Health, London
-
Ms Lynn Kerridge, Chief Executive Officer, NETSCC and NETSCC, HTA
-
Dr Ruairidh Milne, Director of Strategy and Development, NETSCC
-
Ms Kay Pattison, Section Head, NHS R&D Programme, Department of Health
-
Ms Pamela Young, Specialist Programme Manager, NETSCC, HTA
HTA Commissioning Board
-
Director, NIHR HTA programme, Professor of Clinical Pharmacology, University of Liverpool
-
Director, Medical Care Research Unit, University of Sheffield
-
Senior Lecturer in General Practice, Department of Primary Health Care, University of Oxford
-
Professor Ann Ashburn, Professor of Rehabilitation and Head of Research, Southampton General Hospital
-
Professor Deborah Ashby, Professor of Medical Statistics, Queen Mary, University of London
-
Professor John Cairns, Professor of Health Economics, London School of Hygiene and Tropical Medicine
-
Professor Peter Croft, Director of Primary Care Sciences Research Centre, Keele University
-
Professor Nicky Cullum, Director of Centre for Evidence-Based Nursing, University of York
-
Professor Jenny Donovan, Professor of Social Medicine, University of Bristol
-
Professor Steve Halligan, Professor of Gastrointestinal Radiology, University College Hospital, London
-
Professor Freddie Hamdy, Professor of Urology, University of Sheffield
-
Professor Allan House, Professor of Liaison Psychiatry, University of Leeds
-
Dr Martin J Landray, Reader in Epidemiology, Honorary Consultant Physician, Clinical Trial Service Unit, University of Oxford?
-
Professor Stuart Logan, Director of Health & Social Care Research, The Peninsula Medical School, Universities of Exeter and Plymouth
-
Dr Rafael Perera, Lecturer in Medical Statisitics, Department of Primary Health Care, Univeristy of Oxford
-
Professor Ian Roberts, Professor of Epidemiology & Public Health, London School of Hygiene and Tropical Medicine
-
Professor Mark Sculpher, Professor of Health Economics, University of York
-
Professor Helen Smith, Professor of Primary Care, University of Brighton
-
Professor Kate Thomas, Professor of Complementary & Alternative Medicine Research, University of Leeds
-
Professor David John Torgerson, Director of York Trials Unit, University of York
-
Professor Hywel Williams, Professor of Dermato-Epidemiology, University of Nottingham
-
Ms Kay Pattison, Section Head, NHS R&D Programme, Department of Health
-
Dr Morven Roberts, Clinical Trials Manager, Medical Research Council
Diagnostic Technologies & Screening Panel
-
Professor of Evidence-Based Medicine, University of Oxford
-
Consultant Paediatrician and Honorary Senior Lecturer, Great Ormond Street Hospital, London
-
Professor Judith E Adams, Consultant Radiologist, Manchester Royal Infirmary, Central Manchester & Manchester Children’s University Hospitals NHS Trust, and Professor of Diagnostic Radiology, Imaging Science and Biomedical Engineering, Cancer & Imaging Sciences, University of Manchester
-
Ms Jane Bates, Consultant Ultrasound Practitioner, Ultrasound Department, Leeds Teaching Hospital NHS Trust
-
Dr Stephanie Dancer, Consultant Microbiologist, Hairmyres Hospital, East Kilbride
-
Professor Glyn Elwyn, Primary Medical Care Research Group, Swansea Clinical School, University of Wales
-
Dr Ron Gray, Consultant Clinical Epidemiologist, Department of Public Health, University of Oxford
-
Professor Paul D Griffiths, Professor of Radiology, University of Sheffield
-
Dr Jennifer J Kurinczuk, Consultant Clinical Epidemiologist, National Perinatal Epidemiology Unit, Oxford
-
Dr Susanne M Ludgate, Medical Director, Medicines & Healthcare Products Regulatory Agency, London
-
Dr Anne Mackie, Director of Programmes, UK National Screening Committee
-
Dr Michael Millar, Consultant Senior Lecturer in Microbiology, Barts and The London NHS Trust, Royal London Hospital
-
Mr Stephen Pilling, Director, Centre for Outcomes, Research & Effectiveness, Joint Director, National Collaborating Centre for Mental Health, University College London
-
Mrs Una Rennard, Service User Representative
-
Dr Phil Shackley, Senior Lecturer in Health Economics, School of Population and Health Sciences, University of Newcastle upon Tyne
-
Dr W Stuart A Smellie, Consultant in Chemical Pathology, Bishop Auckland General Hospital
-
Dr Nicholas Summerton, Consultant Clinical and Public Health Advisor, NICE
-
Ms Dawn Talbot, Service User Representative
-
Dr Graham Taylor, Scientific Advisor, Regional DNA Laboratory, St James’s University Hospital, Leeds
-
Professor Lindsay Wilson Turnbull, Scientific Director of the Centre for Magnetic Resonance Investigations and YCR Professor of Radiology, Hull Royal Infirmary
-
Dr Tim Elliott, Team Leader, Cancer Screening, Department of Health
-
Dr Catherine Moody, Programme Manager, Neuroscience and Mental Health Board
-
Dr Ursula Wells, Principal Research Officer, Department of Health
Pharmaceuticals Panel
-
Consultant Physician and Director, West Midlands Centre for Adverse Drug Reactions, City Hospital NHS Trust, Birmingham
-
Professor in Child Health, University of Nottingham
-
Mrs Nicola Carey, Senior Research Fellow, School of Health and Social Care, The University of Reading
-
Mr John Chapman, Service User Representative
-
Dr Peter Elton, Director of Public Health, Bury Primary Care Trust
-
Dr Ben Goldacre, Research Fellow, Division of Psychological Medicine and Psychiatry, King’s College London
-
Mrs Barbara Greggains, Service User Representative
-
Dr Bill Gutteridge, Medical Adviser, London Strategic Health Authority
-
Dr Dyfrig Hughes, Reader in Pharmacoeconomics and Deputy Director, Centre for Economics and Policy in Health, IMSCaR, Bangor University
-
Professor Jonathan Ledermann, Professor of Medical Oncology and Director of the Cancer Research UK and University College London Cancer Trials Centre
-
Dr Yoon K Loke, Senior Lecturer in Clinical Pharmacology, University of East Anglia
-
Professor Femi Oyebode, Consultant Psychiatrist and Head of Department, University of Birmingham
-
Dr Andrew Prentice, Senior Lecturer and Consultant Obstetrician and Gynaecologist, The Rosie Hospital, University of Cambridge
-
Dr Martin Shelly, General Practitioner, Leeds, and Associate Director, NHS Clinical Governance Support Team, Leicester
-
Dr Gillian Shepherd, Director, Health and Clinical Excellence, Merck Serono Ltd
-
Mrs Katrina Simister, Assistant Director New Medicines, National Prescribing Centre, Liverpool
-
Mr David Symes, Service User Representative
-
Dr Lesley Wise, Unit Manager, Pharmacoepidemiology Research Unit, VRMM, Medicines & Healthcare Products Regulatory Agency
-
Ms Kay Pattison, Section Head, NHS R&D Programme, Department of Health
-
Mr Simon Reeve, Head of Clinical and Cost-Effectiveness, Medicines, Pharmacy and Industry Group, Department of Health
-
Dr Heike Weber, Programme Manager, Medical Research Council
-
Dr Ursula Wells, Principal Research Officer, Department of Health
Therapeutic Procedures Panel
-
Consultant Physician, North Bristol NHS Trust
-
Professor of Psychiatry, Division of Health in the Community, University of Warwick, Coventry
-
Professor Jane Barlow, Professor of Public Health in the Early Years, Health Sciences Research Institute, Warwick Medical School, Coventry
-
Ms Maree Barnett, Acting Branch Head of Vascular Programme, Department of Health
-
Mrs Val Carlill, Service User Representative
-
Mrs Anthea De Barton-Watson, Service User Representative
-
Mr Mark Emberton, Senior Lecturer in Oncological Urology, Institute of Urology, University College Hospital, London
-
Professor Steve Goodacre, Professor of Emergency Medicine, University of Sheffield
-
Professor Christopher Griffiths, Professor of Primary Care, Barts and The London School of Medicine and Dentistry
-
Mr Paul Hilton, Consultant Gynaecologist and Urogynaecologist, Royal Victoria Infirmary, Newcastle upon Tyne
-
Professor Nicholas James, Professor of Clinical Oncology, University of Birmingham, and Consultant in Clinical Oncology, Queen Elizabeth Hospital
-
Dr Peter Martin, Consultant Neurologist, Addenbrooke’s Hospital, Cambridge
-
Dr Kate Radford, Senior Lecturer (Research), Clinical Practice Research Unit, University of Central Lancashire, Preston
-
Mr Jim Reece Service User Representative
-
Dr Karen Roberts, Nurse Consultant, Dunston Hill Hospital Cottages
-
Dr Phillip Leech, Principal Medical Officer for Primary Care, Department of Health
-
Ms Kay Pattison, Section Head, NHS R&D Programme, Department of Health
-
Dr Morven Roberts, Clinical Trials Manager, Medical Research Council
-
Professor Tom Walley, Director, NIHR HTA programme, Professor of Clinical Pharmacology, University of Liverpool
-
Dr Ursula Wells, Principal Research Officer, Department of Health
Disease Prevention Panel
-
Medical Adviser, National Specialist, National Commissioning Group (NCG), London
-
Director, NHS Sustainable Development Unit, Cambridge
-
Dr Elizabeth Fellow-Smith, Medical Director, West London Mental Health Trust, Middlesex
-
Dr John Jackson, General Practitioner, Parkway Medical Centre, Newcastle upon Tyne
-
Professor Mike Kelly, Director, Centre for Public Health Excellence, NICE, London
-
Dr Chris McCall, General Practitioner, The Hadleigh Practice, Corfe Mullen, Dorset
-
Ms Jeanett Martin, Director of Nursing, BarnDoc Limited, Lewisham Primary Care Trust
-
Dr Julie Mytton, Locum Consultant in Public Health Medicine, Bristol Primary Care Trust
-
Miss Nicky Mullany, Service User Representative
-
Professor Ian Roberts, Professor of Epidemiology and Public Health, London School of Hygiene & Tropical Medicine
-
Professor Ken Stein, Senior Clinical Lecturer in Public Health, University of Exeter
-
Dr Kieran Sweeney, Honorary Clinical Senior Lecturer, Peninsula College of Medicine and Dentistry, Universities of Exeter and Plymouth
-
Professor Carol Tannahill, Glasgow Centre for Population Health
-
Professor Margaret Thorogood, Professor of Epidemiology, University of Warwick Medical School, Coventry
-
Ms Christine McGuire, Research & Development, Department of Health
-
Dr Caroline Stone, Programme Manager, Medical Research Council
Expert Advisory Network
-
Professor Douglas Altman, Professor of Statistics in Medicine, Centre for Statistics in Medicine, University of Oxford
-
Professor John Bond, Professor of Social Gerontology & Health Services Research, University of Newcastle upon Tyne
-
Professor Andrew Bradbury, Professor of Vascular Surgery, Solihull Hospital, Birmingham
-
Mr Shaun Brogan, Chief Executive, Ridgeway Primary Care Group, Aylesbury
-
Mrs Stella Burnside OBE, Chief Executive, Regulation and Improvement Authority, Belfast
-
Ms Tracy Bury, Project Manager, World Confederation for Physical Therapy, London
-
Professor Iain T Cameron, Professor of Obstetrics and Gynaecology and Head of the School of Medicine, University of Southampton
-
Dr Christine Clark, Medical Writer and Consultant Pharmacist, Rossendale
-
Professor Collette Clifford, Professor of Nursing and Head of Research, The Medical School, University of Birmingham
-
Professor Barry Cookson, Director, Laboratory of Hospital Infection, Public Health Laboratory Service, London
-
Dr Carl Counsell, Clinical Senior Lecturer in Neurology, University of Aberdeen
-
Professor Howard Cuckle, Professor of Reproductive Epidemiology, Department of Paediatrics, Obstetrics & Gynaecology, University of Leeds
-
Dr Katherine Darton, Information Unit, MIND – The Mental Health Charity, London
-
Professor Carol Dezateux, Professor of Paediatric Epidemiology, Institute of Child Health, London
-
Mr John Dunning, Consultant Cardiothoracic Surgeon, Papworth Hospital NHS Trust, Cambridge
-
Mr Jonothan Earnshaw, Consultant Vascular Surgeon, Gloucestershire Royal Hospital, Gloucester
-
Professor Martin Eccles, Professor of Clinical Effectiveness, Centre for Health Services Research, University of Newcastle upon Tyne
-
Professor Pam Enderby, Dean of Faculty of Medicine, Institute of General Practice and Primary Care, University of Sheffield
-
Professor Gene Feder, Professor of Primary Care Research & Development, Centre for Health Sciences, Barts and The London School of Medicine and Dentistry
-
Mr Leonard R Fenwick, Chief Executive, Freeman Hospital, Newcastle upon Tyne
-
Mrs Gillian Fletcher, Antenatal Teacher and Tutor and President, National Childbirth Trust, Henfield
-
Professor Jayne Franklyn, Professor of Medicine, University of Birmingham
-
Mr Tam Fry, Honorary Chairman, Child Growth Foundation, London
-
Professor Fiona Gilbert, Consultant Radiologist and NCRN Member, University of Aberdeen
-
Professor Paul Gregg, Professor of Orthopaedic Surgical Science, South Tees Hospital NHS Trust
-
Bec Hanley, Co-director, TwoCan Associates, West Sussex
-
Dr Maryann L Hardy, Senior Lecturer, University of Bradford
-
Mrs Sharon Hart, Healthcare Management Consultant, Reading
-
Professor Robert E Hawkins, CRC Professor and Director of Medical Oncology, Christie CRC Research Centre, Christie Hospital NHS Trust, Manchester
-
Professor Richard Hobbs, Head of Department of Primary Care & General Practice, University of Birmingham
-
Professor Alan Horwich, Dean and Section Chairman, The Institute of Cancer Research, London
-
Professor Allen Hutchinson, Director of Public Health and Deputy Dean of ScHARR, University of Sheffield
-
Professor Peter Jones, Professor of Psychiatry, University of Cambridge, Cambridge
-
Professor Stan Kaye, Cancer Research UK Professor of Medical Oncology, Royal Marsden Hospital and Institute of Cancer Research, Surrey
-
Dr Duncan Keeley, General Practitioner (Dr Burch & Ptnrs), The Health Centre, Thame
-
Dr Donna Lamping, Research Degrees Programme Director and Reader in Psychology, Health Services Research Unit, London School of Hygiene and Tropical Medicine, London
-
Mr George Levvy, Chief Executive, Motor Neurone Disease Association, Northampton
-
Professor James Lindesay, Professor of Psychiatry for the Elderly, University of Leicester
-
Professor Julian Little, Professor of Human Genome Epidemiology, University of Ottawa
-
Professor Alistaire McGuire, Professor of Health Economics, London School of Economics
-
Professor Rajan Madhok, Medical Director and Director of Public Health, Directorate of Clinical Strategy & Public Health, North & East Yorkshire & Northern Lincolnshire Health Authority, York
-
Professor Alexander Markham, Director, Molecular Medicine Unit, St James’s University Hospital, Leeds
-
Dr Peter Moore, Freelance Science Writer, Ashtead
-
Dr Andrew Mortimore, Public Health Director, Southampton City Primary Care Trust
-
Dr Sue Moss, Associate Director, Cancer Screening Evaluation Unit, Institute of Cancer Research, Sutton
-
Professor Miranda Mugford, Professor of Health Economics and Group Co-ordinator, University of East Anglia
-
Professor Jim Neilson, Head of School of Reproductive & Developmental Medicine and Professor of Obstetrics and Gynaecology, University of Liverpool
-
Mrs Julietta Patnick, National Co-ordinator, NHS Cancer Screening Programmes, Sheffield
-
Professor Robert Peveler, Professor of Liaison Psychiatry, Royal South Hants Hospital, Southampton
-
Professor Chris Price, Director of Clinical Research, Bayer Diagnostics Europe, Stoke Poges
-
Professor William Rosenberg, Professor of Hepatology and Consultant Physician, University of Southampton
-
Professor Peter Sandercock, Professor of Medical Neurology, Department of Clinical Neurosciences, University of Edinburgh
-
Dr Susan Schonfield, Consultant in Public Health, Hillingdon Primary Care Trust, Middlesex
-
Dr Eamonn Sheridan, Consultant in Clinical Genetics, St James’s University Hospital, Leeds
-
Dr Margaret Somerville, Director of Public Health Learning, Peninsula Medical School, University of Plymouth
-
Professor Sarah Stewart-Brown, Professor of Public Health, Division of Health in the Community, University of Warwick, Coventry
-
Professor Ala Szczepura, Professor of Health Service Research, Centre for Health Services Studies, University of Warwick, Coventry
-
Mrs Joan Webster, Consumer Member, Southern Derbyshire Community Health Council
-
Professor Martin Whittle, Clinical Co-director, National Co-ordinating Centre for Women’s and Children’s Health, Lymington