Discussion
The APPY trial is based on the hypothesis that a high proportion of children with acute uncomplicated appendicitis can be successfully treated with broad-spectrum antibiotics thereby avoiding a large number of appendectomies. Previous studies of the use of antibiotics in both adults and children suggest that this is likely to be achievable. Whether non-operative treatment with antibiotics is as effective a treatment as appendectomy for this patient population, however, is a more complex question. We believe this is determined by other factors in addition to the success of the initial treatment. For this reason these parameters are included in our composite primary outcome and include incidence of complications in each group, incidence of negative appendectomy and recurrence of appendicitis.
The selection of an appropriate and relevant primary outcome is important for any RCT. Selection of a primary end point which does not reflect the interests of the stakeholder groups involved in treatment selection for a given pathology is likely to lessen the relevance and impact of a trial. For this reason it has been proposed that core outcome sets (COS) be developed. A COS is an established set of outcomes to be measured when evaluating treatment efficacy for a given condition and is usually arrived at by consensus among multiple stakeholder groups (eg, clinicians, researchers, patients/parents, treatment commissioners). The adoption of a COS will likely ensure that outcomes reported are relevant and of importance to multiple stakeholder groups. Further, use of a COS will ensure that a standardised set of outcome measures is reported as a minimum for a given pathology thereby minimising the heterogeneity in outcome reporting between studies. This will improve comparability between studies in quantitative data synthesis such as meta-analysis. Although efforts are underway to develop a COS for children with acute appendicitis,28 a COS does not exist at present.
We have therefore selected a primary end point that we believe reflects the important aspects of treatment outcomes on which we as clinicians and researchers would base future treatment decisions for children with acute appendicitis. We have also been influenced by our discussions with our patients and their parents. Negative appendectomy is a frequent finding in most series of paediatric appendectomy and suggests that an unnecessary operation has been performed. A benefit of a non-operative approach would be to avoid an unnecessary operation, although at the cost of an unnecessary course of antibiotics. Complications of treatment are important when evaluating treatment efficacy. Our definition of complications has been designed to capture the failure of non-operative treatment as well as complications requiring general anaesthesia in either treatment group. General anaesthesia has been selected as a marker of the impact of the complication on the patient as per the widely used Clavien-Dindo classification of surgical complications.22 Finally we have included recurrent appendicitis in our primary outcome. If the rate of recurrent appendicitis is high then the benefit of initial non-operative treatment is less. If an appendectomy is going to be required for recurrence then it may as well be performed at first presentation. As the primary motivation of non-operative treatment is to avoid an operation and general anaesthesia, we felt the components of the primary outcome should reflect this motivation and therefore be centred around general anaesthesia. Other complications not requiring a general anaesthetic are extremely important to capture and are therefore included as a specific secondary outcome measure (ie, complications not resulting in general anaesthesia classified according to the Clavien-Dindo Scale). In addition the resource utilisation aspect of these complications will be captured in the economic analysis.
Currently diagnosis of acute appendicitis in participating centres results in a false positive rate of 4%–6%, that is, a 4%–6% rate of negative appendectomy. Thus, some of those recovering from non-operative management of suspected acute appendicitis will likely be those false positives who did not have acute appendicitis in the first place, in addition to children with antibiotic-responsive acute appendicitis. As no pathological specimen is taken from those who recover effectively with non-operative treatment, we will not accurately know how many of these patients actually had appendicitis. It would not be ethically acceptable to undertake additional tests (eg, CT, laparoscopic biopsy) in order to determine whether these patients actually had appendicitis or not, but we believe that not operating on patients who do not have acute appendicitis is one of the potential benefits of non-operative management.
An additional challenge is how to define efficacy in an RCT such as this. We have selected a non-inferiority design since we wish to evaluate whether non-operative treatment is as effective, but not necessarily more effective, than the current standard of care (appendectomy). If non-operative treatment is as effective as appendectomy, the potential benefits include avoiding surgery and its inherent risks, avoiding general anaesthesia, a potential shorter recovery time, and reduced costs to the institution and the healthcare system. Similar trials in adults have used comparative designs. To determine the efficacy of non-operative treatment we will compare how inferior it is to appendectomy. The non-inferiority margin we are willing to accept will in part determine its efficacy.
There is no accepted guidance regarding the magnitude of a non-inferiority margin for surgical trials. A previous similar study in adults8 comparing surgery with non-operative treatment for acute appendicitis in adults used a non-inferiority margin of 10%, which has been criticised by some as being too narrow.29 A Cochrane review of appendectomy versus antibiotic treatment for acute appendicitis3 proposed a non-inferiority margin of 20% on the basis that non-operative treatment may be marginally less effective but be more patient friendly, thereby justifying a wider non-inferiority margin. We believe that avoidance of an abdominal operation and general anaesthesia provides enough benefit to the patient to justify this wider non-inferiority margin of 20%. A recently reported RCT in adults used a 24% non-inferiority margin.9 It was felt by the trial investigators that setting a non-inferiority margin of more than 20% would be too wide, as negative appendectomy is included in the appendectomy group so that a wider margin would be too ‘generous’ to the non-operative group. In addition, even if the treatment failure rate of non-operative treatment falls outside the non-inferiority limits, the trial will usefully inform the discussion between surgeons, patients and their parents, and non-operative treatment might still be regarded as a viable treatment option, although with a lower success rate.
In the protocol, each centre is allowed to maintain current antibiotic protocols. This is in keeping with current concepts of local antibiotic stewardship and the fact that no single antibiotic regime for acute appendicitis is of proven efficacy over another. It is not the aim of the study to determine an optimal antibiotic therapy for acute appendicitis, but to effectively answer the question ‘Is non-operative management of acute appendicitis in children, using current local antibiotic policies, non-inferior to operative management’. It is possible that some individual regimens may be more effective than others, and data from the trial might be used as hypothesis-generating in order to design future studies to optimise antibiotic therapy. However, the trial is not powered to examine differences in antibiotic regimens and as a result of this, comparison of antibiotic regimens is not listed as a specific secondary end point. All centres will use a broad-spectrum approach to overcome the limitations of a narrow-spectrum antibiotic regime encountered by others8 29
We have specifically designed the APPY trial as an RCT. We believe the RCT design is the most appropriate methodology to determine the comparative effectiveness of non-operative treatment compared with appendectomy.30 We are aware of the use of a ‘parent/patient choice’ design used by other studies in both adults31 and children.32 Although parental choice may ultimately prove to be important in the treatment of acute appendicitis in children, we believe this parental choice must be informed by high quality evidence of the treatment failure rates of each approach in identical groups of patients. A parent preference design runs the risk of introducing bias between the treatment arms, indeed such a bias is almost implicit in the act of choice itself. Despite the challenges and limitations of an RCT, we therefore strongly believe that a randomised study introduces less bias and is superior to a parent preference-based study. The 40% recruitment rate from the pilot RCT suggests that many children and parents are uncomfortable with the possibility of not having the appendix removed, and while we believe that even if the current large-scale trial indicates non-inferiority of non-operative management, there will likely always be some children and their parents who will opt to have an operation. The recruitment rate from the current trial will also be an important metric to gauge potential generalisability on a wider scale.
An additional challenge for many surgical trials in particular is to ensure generalisability of trial findings after completion. This trial will therefore be a pragmatic trial in which we will aim to use existing treatment pathways in use at participating centres yet with adequate standardisation across treatment groups to allow meaningful comparison. Our entry criteria will therefore be based on a clinical and/or radiological diagnosis of acute, uncomplicated (non-perforated) appendicitis. There will be no strict requirement for the diagnosis to be based on US or CT scan. The patients who will be eligible for recruitment to this trial are the very ones who are currently being treated with appendectomy for acute appendicitis no matter how the diagnosis is currently made. Children with a faecolith on imaging or raised white cell count or C-reactive protein will all be eligible for inclusion. Finally the laparoscopic approach will be the standard for children in the appendectomy arm since this is the approach in current standard use at participating institutions.