Aim of the study Probiotic administration to preterm infants has the potential to prevent necrotising enterocolitis (NEC). Data from randomised controlled trials (RCT) are conflicting but meta-analyses seem to support this intervention. To date, these analyses have not focused on surgical NEC. We aimed to determine the effect of probiotic administration to preterm infants on prevention of surgical NEC.
Methods A systematic review of RCTs of probiotic administration to preterm infants was performed. Studies were included if RCT outcomes included any of (1) Bell’s stage 3 NEC; (2) surgery for NEC; and (3) deaths attributable to NEC. Article selection and data extraction were performed independently by two authors; conflicts were adjudicated by a third author. Data were meta-analysed using Review Manager V.5.3. A random effects model was decided on a priori because of the heterogeneity of study design; data are risk ratio (RR) with 95% CI.
Main results Thirty-five RCTs reported NEC as an outcome. Seventeen reported surgical NEC; all RCTs were included. A variety of probiotic products was administered across studies. Description of surgical NEC in most studies was poor. Only 6/16 specifically reported incidence of surgery for NEC, 12/17 Bell’s stage 3 and 13/17 NEC-associated mortality. Although there was a trend towards probiotic administration reducing stage 3 NEC, this was not significant (RR 0.74 (0.52–1.05), p=0.09). There was no effect of probiotics on the RR of surgery for NEC (RR 0.84 (0.56–1.25), p=0.38). Probiotics did, however, reduce the risk of NEC-associated mortality (RR 0.56 (0.34–0.93), p=0.03).
Conclusion Despite 35 RCTs on probiotic prevention of NEC, evidence for prevention of surgical NEC is not strong, partly due to poor reporting. In studies included in this meta-analysis, probiotic administration was associated with a reduction in NEC-related mortality.
This is an Open Access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/
Statistics from Altmetric.com
What is already known on this topic?
In various randomised controlled trials (RCT) and meta-analyses, it was suggested that probiotic administration is associated with decrease in incidence of definite necrotising enterocolitis (NEC).
The evidence that probiotic administration is associated with a decreased incidence of surgical NEC is limited.
This is due to poor reporting of surgical NEC in RCTs and we urge better reporting of surgical aspects of NEC in future trials.
What this study hopes to add?
The reporting of surgical aspects of NEC in RCTs of probiotic administration is poor.
Probiotic administration is associated with a decrease in NEC-associated mortality.
Although necrotising enterocolitis (NEC) is the most common life-threatening surgical emergency affecting neonates, we still do not know how to prevent or medically treat the disease.1 Many infants with NEC may have surgery with the aim of removal of necrotic intestine. Although the indications for surgery are not well defined, radiological evidence for intestinal perforation is often regarded as an absolute indication for surgery, and many surgeons would operate for failure to improve, or clinical deterioration, in response to medical management such as cessation of enteral feeds, antibiotic treatment and supportive treatment.2 In the last few years, there has been a surge of interest in the potential role of probiotics to prevent NEC and this has resulted in the publication of many randomised controlled trials (RCT), followed by systematic reviews and meta-analyses of these RCTs.3–6 Some commentators have asserted that it is ‘almost unethical’ to withhold probiotic administration to all preterm infants in order to prevent NEC.6 As the type/strain, dose, duration and timing of probiotics are not standardised, others find the evidence less compelling.7 The American Pediatric Surgical Association Outcomes and Clinical Trials Committee8 considered the level of evidence for routine probiotic supplementation and concluded that available data supported the routine supplementation of premature infants with probiotics although no conclusions could be drawn for the extremely low birth weight population (ie, those with the highest incidence of NEC) due to lack of data. However, most RCTs, and the systematic reviews and meta-analyses that result, focus on the development of confirmed NEC (ie, Bell’s stage 2) and not on the potential effect of probiotic administration on surgical NEC. We focused on surgical NEC since there is general recognition that infants who are treated surgically have more advanced disease than those who are managed medically and importantly are noted to have worse outcomes including higher mortality, more frequent need for further surgery and greater long-term neurodevelopmental impairment. The aim of this study was to perform a systematic review and meta-analysis in order to compare the effects of probiotic administration and placebo on surgical NEC in preterm infants.
A systematic review of available literature (Ovid Medline January 1974–June 2017) was conducted using the search strategy (probiotic* OR pro-biotic* or probio* OR lactobacill* OR bifidobacter* OR saccharomyces* OR bacillus) AND ((necrotizing enterocolitis or necrotising enterocolitis or necrotizing entero-colitis or necrotising entero-colitis) OR (necrot* and (enterocoli* or entero-coli*)) OR (‘necrotizing’ or ‘entero-colitis’ or ‘enterocolitis’) and NEC) AND publication type randomized controlled trial. A similar search was also conducted in Ovid Embase (January 1980–June 2017). Hand searching of the reference lists of published studies and citation searching using Web of Knowledge (Thomson-Reuter) were also performed in order to identify additional studies. A formal protocol was not prepared for this study.
Inclusion criteria were defined as follows: (1) RCT; (2) study compared enteral probiotics to placebo or no treatment; (3) study population defined as premature infants; (4) explicit data available on incidence of either (A) Bell’s stage 3 NEC, (B) surgery for NEC or (C) NEC-associated mortality. Initial screening for inclusion was performed independently by two authors using the online tool Covidence systematic review software (Veritas Health Innovation, Melbourne, Australia, available at http://www.covidence.org). Adjudication regarding inclusion/exclusion was performed by the other two authors. The following data were extracted: number of infants treated with probiotic/placebo, infants with/without Bell’s stage 3 NEC, infants having surgery for NEC (including peritoneal drain), Bell’s stage 2/3 NEC, deaths attributable to NEC. Data on Bell’s stage 2/3 NEC, the outcome measure most frequently reported in meta-analyses of probiotics for prevention of NEC, were extracted from included papers (ie, only those including surgical outcomes) in order to determine whether this subset of papers was representative of the larger group of studies with broader inclusion criteria.
Data were meta-analysed using Review Manager V.5.3. A random effects model was decided on a priori because of the heterogeneity of study design; data are risk ratio (RR) with 95% CI; heterogeneity was assessed using I2 and associated χ2 test, and funnel plots prepared for assessment of bias across studies. An additional analysis (not preplanned) using bacterial products only was also performed. Power calculations were performed using an online tool (Sealed Envelope 2012), power calculator for binary outcome superiority trial, available at: https://www.sealedenvelope.com/power/binary-superiority/ using an α error of 5% and β of 80%.
The search strategy yielded 169 abstracts, and further searching an additional abstract that was potentially eligible. Full-text screening as described in the Methods section led to the selection of 19 articles for inclusion9–27 and 24 articles for exclusion.28–51 A flow chart indicating screening, inclusion and exclusion of studies is shown in figure 1. Characteristics of the 19 included studies are shown in table 1. The lack of consistency and clarity regarding definition of NEC as an RCT outcome, and reporting of surgical NEC (Bell’s stage 3, infants having surgery for NEC) were notable. Most excluded papers did not report surgical NEC; two further papers26 27 were included as it was possible to extract data on surgical outcomes from the papers only because there was a zero incidence of NEC in either arm (and therefore a zero incidence of surgical NEC) rather than explicit reporting of surgical NEC in the RCT outcomes.
Bell’s stage 2/3 NEC
Data on Bell’s stage 2/3 NEC were obtainable from 19/19 included studies9–27; incidence in the placebo group varied between 16% and 0%. Probiotic administration was associated with a significant reduction in the incidence of Bell’s stage 2/3 NEC (RR 0.64 (0.48, 0.84), p<0.002). There was a low degree of heterogeneity between studies (I2=14%, p=0.29).
Bell’s stage 3 NEC
Data on Bell’s stage 3 as an outcome were available from 14/19 included studies,9–12 14 16–18 21 22 24–27 of which 12/19 explicitly reported Bell’s stage 39–12 14 16–18 21 22 24 25; incidence in the placebo group varied between 7% and 0%. Probiotic usage was not associated with a significant effect on the incidence of stage 3 NEC, although there was a trend towards a decrease, with a similar RR to that of Bell’s stage 2–3 NEC (RR 0.74 (0.51–1.05), p=0.09, figure 2). There was no evidence for significant heterogeneity (I2=0%, p=0.73).
Surgery for NEC
Data on surgery for NEC were available from only 8/19 studies10 12 13 17 18 22 26 27 of which only 6/19 explicitly reported incidence of surgery for NEC.10 12 13 17 18 22 There was no effect of probiotics on the RR of surgery for NEC (RR 0.84 (0.56–1.25), p=0.38, figure 2). There was no evidence for significant heterogeneity (I2=0%, p=0.83).
Deaths attributable to NEC
Data on death attributable to NEC were available from 15/19 studies9 11–15 17 19–23 25–27; of these 13/19 explicitly reported death attributable to NEC.9 11–15 17 19–23 25 In one study, some deaths were reported as being from Bell’s stage 1; however, by consensus these deaths were not included as the diagnosis of NEC had not been confirmed.25 Probiotic administration was associated with a significant reduction in the risk of NEC-associated mortality (figure 2, RR 0.56 (0.34–0.93), p=0.03) with no evidence for significant heterogeneity (I2=0%, p=0.85).
Analysis by probiotic product
We repeated the analyses, excluding those using only a fungal probiotic product.14 23 26 Administration of bacterial probiotic products was associated with a significant reduction in the incidence of Bell’s stage 2/3 NEC (RR 0.57 (0.41, 0.80), p=0.001), a trend towards a decrease in Bell’s stage 3 NEC (RR 0.73 (0.50–1.05), p=0.09), no effect on the RR of surgery for NEC (RR 0.84 (0.56–1.25), p=0.38) and a significant reduction in the risk of NEC-associated mortality (RR 0.53 (0.31–0.90), p=0.02).
Assessment of bias
The risk of bias in individual studies is shown in online supplementary table 1. In order to assess evidence for publication bias, funnel plots for each of the outcomes (Bell’s stage 2/3, Bell’s stage 3, surgery for NEC and mortality attributable to NEC) were generated (figure 3). For each outcome, the apex of the funnel plot is an RR of <1, providing some limited evidence for bias towards publication of studies favouring probiotic administration, although the ability to detect publication bias is limited by the low number of publications for some of these outcomes.
Supplementary file 1
Over the past 10 years, there have been many meta-analyses and Cochrane Reviews evaluating probiotic administration for the prevention of NEC.3–6 To our knowledge, none to date has specifically focused on whether or not probiotics reduce NEC requiring surgery. In our present systematic review, we found that surgical aspects of NEC were rather poorly reported in RCTs of probiotic administration; of 37 papers reporting any data on NEC as an RCT outcome, only 18 (49%) specifically reported surgical NEC (and in a further two data could be extrapolated due to the zero incidence of any NEC), and in one of these, data could not be used due to unconventional reporting of Bell’s staging.51
The available data from included papers suggest that probiotic administration was not associated with a significant decrease in the risk of developing Bell’s stage 3 NEC or having surgery for this condition. Previous meta-analyses of probiotics have shown a significant effect of probiotic administration in decreasing the incidence of Bell’s stage 2–3 NEC. In order to determine whether the 16 papers that specifically reported surgical NEC were representative of the larger group of papers that report Bell’s stage 2–3 NEC, we also analysed the effect of probiotic administration on Bell’s stage 2–3 NEC in the 16 papers reporting surgical NEC. Consistent with the findings of other meta-analyses with less restrictive inclusion criteria,3–5 52 we also demonstrated a significant decrease in the risk of developing Bell’s stage 2–3 NEC with probiotic administration. Although the risk of developing Bell’s stage 3 NEC was similar to that of developing stage 2–3 NEC, the difference in risk of Bell’s stage 3 disease was non-significant. This was due to wider CIs associated with a smaller number of patients.
This review has demonstrated a statistically significant effect of probiotics in reducing mortality attributed to NEC, with a relative risk of 0.56. It is of interest to analyse specifically mortality attributable to NEC as most meta-analyses examine all-cause mortality3–5 52 and we are not aware of any that have analysed mortality attributable to NEC. It may seem counterintuitive that probiotics significantly decrease the risk of NEC-associated mortality without a significant effect on the risk of surgical NEC. This can be explained first because more studies reported deaths than reported either Bell’s stage 3 or surgery for NEC. Second, up to 20% of infants who have been diagnosed as having definite NEC die without ever having an operation or a postmortem examination,53 and in addition, many of the studies reporting mortality from NEC did not have mortality as a defined primary or secondary endpoint.
There are a number of potentially confounding factors that should be considered when interpreting these results. None of the RCTs reviewed for this study included a protocol for the decision to proceed to surgery nor precise indications for surgery in infants with NEC. This is an important factor to consider given the decision or indication to perform surgery may differ between surgeons and centre.2 A further confounding issue is the likely inclusion of infants with spontaneous intestinal perforation (SIP) in reports of infants with NEC. Many surgeons have debated whether SIP and NEC are a similar disease but there is now greater acceptance that they are distinct disease entities. We are not aware of any reports that suggest probiotics influence the risk of developing SIP. Although our present study does not show evidence that probiotics reduce surgical NEC, we acknowledge that in the absence of consistent reporting of both indications for surgery and definitions of NEC/SIP, we should be cautious when generalising our findings. Diagnosis of NEC, staging of the disease according to Bell’s criteria, is a problematic area, and both pneumatosis intestinalis (the main criterion used to define Bell’s stage 2 NEC) and pneumoperitoneum (the main criterion used to define Bell’s stage 3 NEC) have poor interobserver agreement—even between expert radiologists.54–56 It is also worth noting that not all probiotic RCTs had independent radiologists.
There are many difficulties in meta-analysing probiotic trials. Cross colonisation of the placebo group is one, with data from one RCT12 suggesting that up to 37% of placebo allocated participants were colonised with the probiotic intervention after 2 weeks. Inconsistent and limited data reporting trial outcomes by colonisation status precluded such analyses in our present study, though data from one large RCT suggest non-significant trends towards reduced NEC in babies successfully colonised with probiotics. Furthermore, probiotics work through a diverse range of mechanistic actions and not all probiotics act via the same mechanism.57 One of the controversies in using probiotics relates to the uncertainty of which probiotic will achieve optimum benefit. In this meta-analysis, a variety of different probiotic products were used. Even if we concluded that probiotics were effective in preventing surgical NEC, we would not be able to recommend a specific product, strain, concentration or even species. Too few studies are available to be able to be meaningfully analysed by the type of probiotic administered.
Given the observed data, in order to detect a significant difference in Bell’s stage 3 NEC, an RCT would need to recruit 2757 patients in each arm. This is likely prohibitive, so we may never have robust evidence to answer the question of whether probiotic administration prevents surgical NEC. However, recent advances in understanding the microbiological basis for the development of NEC58 provide some hope that appropriately targeted probiotic therapies could be effective in reducing the devastating effects of this disease. In conducting future RCTs we recommend that robust reporting of surgical NEC, SIP and any abdominal surgery (eg, indications for surgery, operation performed, surgical outcomes) will allow us to more clearly assess the benefits of probiotic interventions.
Funding SE gratefully acknowledges support from Great Ormond Street Children’s Charity and the NIHR Great Ormond Street Biomedical Research Centre.
Disclaimer The funders had no input into the systematic review.
Competing interests SE has received consultancy fees from Fresenius-Kabi and a speakers honorarium from Danone.
If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.