Review articleSystematic review of paediatric track and trigger systems for hospitalised children☆
Introduction
Effective management of clinical deterioration in hospitalised children is a priority for healthcare professionals, patients and carers alike. Optimal care for a deteriorating child is complex.1 It requires that: signs and symptoms of deterioration are recognised by ward staff; staff are empowered to call for assistance promptly; the assistance is readily available and appropriately skilled; and the interventions arising from this response improve outcomes. The first ‘link’ in this chain is early, accurate recognition of clinical deterioration. This is frequently inadequate.2, 3, 4
A number of tools are available to help staff identify deteriorating children. These ‘early warning systems’ prompt calls for senior assistance with changes in vital signs or other parameters.5 In 2005 21.5% of UK paediatric centres reported using an ‘early warning system’6; this rose to 85% by 2013.7 Many different systems are in use but they appear in two main forms: ‘score’ and ‘trigger’-based systems. Score-based systems assign values to vital signs, and other clinical indicators, representing the extent of deviation from ‘normal.’ These component values are combined to generate an overall score. Higher scores should represent an increased risk of deterioration, prompting review by senior clinicians. Trigger-based systems contain a number of pre-defined thresholds. When one or more thresholds are breeched, this ‘triggers’ a pre-determined response. Unlike score-based systems, trigger-based systems result in a dichotomous ‘all or nothing’ response. This typically means activation of a rapid response system (RRS) (also known as ‘critical care outreach’, ‘rapid response’ or ‘medical emergency’ teams). Although there are differences between these types of tools, they share two common characteristics: the ability to ‘track’ the child’s condition through ongoing monitoring and the facility to ‘trigger’ a request for an appropriate clinical review. Therefore, for the purpose of this review, score and trigger-based systems will be collectively referred to as paediatric track and trigger systems (PTTS).
The ideal PTTS utilises routinely monitored clinical signs, is simple to use and acceptable to users with robust validation in a relevant population.5 As with all clinical prediction tools, there is an important trade-off between sensitivity and specificity. The overall predictive performance of a tool is most commonly summarised by the area under the receiver operator characteristic (AUROC) curve, with values greater than 0.7 regarded as useful. Score-based systems should also have acceptable calibration, and accurately classify children into low, medium and high risk categories.8 As score-based PTTS are generally used with an action/escalation plan, calibration indicates the appropriateness of the response to each PTTS score in light of the degree of risk.
We conducted a systematic review of PTTS performance in 2009 and reported that the evidence on validity, calibration, reliability and utility was weak, and adoption of PTTS into clinical practice could not be recommended (findings summarised in Supplemental data Table A).5 Since this work there has been widespread implementation of PTTS and an increase in the literature describing their predictive performance. This updated systematic review is necessary to reconsider these recommendations.
Section snippets
Objectives
This review was undertaken to examine the key characteristics of PTTS and to appraise the evidence on their validity, calibration and clinical utility.
Methods
Paediatric track and trigger systems were defined to be any system which attempts to identify hospitalised children who are at risk of, or suffering from, critical deterioration through ongoing monitoring of clinical signs. Children in critical care, emergency room and theatres were excluded as they have differing staffing and monitoring strategies.
The review protocol rigorously adhered to the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) approach.9 The review was
Search results
The search was conducted on 27th May 2016 (Fig. 1, Supplemental data Table B). Thirty-three PTTS were identified from 55 papers. Different PTTS with the same name were numbered in order of publication to distinguish between them.
Main characteristics of paediatric track and trigger systems
Table 3 summarises the included studies, PTTS characteristics and quality rating. Many systems were minor modifications of previously published systems. Twenty-one were classified as ‘scoring systems’, and 12 as ‘trigger systems’. Fourteen were ‘age-dependent’ and 19
Death—very low evidence
The 2 observational studies29, 41 had small sample sizes and low event rates. The studies demonstrated that death on intensive care following unplanned admission from the ward had a relative risk of 1.28 (95% CI 0.66–2.52), however results were not significant41. Relative risk of unexpected death on the ward could not be calculated as there was only 1 death in the study population29.
Cardiac arrest—very low evidence
Three studies examined cardiac arrest.27, 49, 54 Two studies were severely limited by methodological concerns.49,
Paediatric track and trigger systems as part of a package of intervention
Ten observational studies described the introduction of PTTS as part of instigating a RRS.18, 32, 36, 37, 57, 61, 62, 63, 66, 67 A further study52 in a hospital with an established RRS examined a package of interventions designed to increase situational awareness.
Discussion
PTTS are now an established part of care for children in hospital. Most paediatric centres report using them.7 There is striking diversity in the components, thresholds and efficacy of the systems. The Paediatric Early Warning System Score I59 remains the most complex, with nineteen parameters. By contrast, the Paediatric Early Warning Score I48, 49 and its derivatives42, 51, 55, 58, 60, 64 has far fewer parameters. However, these ‘simpler’ systems are constituted from parameters which have
Conclusion
Although there remains low levels evidence on the effect of PTTS as a single intervention, there is moderate evidence of its impact on mortality and cardiac and respiratory arrests when delivered as a care package. The high (and increasing) number of systems, outcomes and metrics is a significant confounder. Further research is needed on the optimal characteristics, diagnostic accuracy and calibration of PTTS in different settings.
Conflict of interest statement
No conflicts of interest to declare.
Acknowledgements
This study received no direct funding but was supported by the National Institute for Health Research Biomedical Research Centre at Great Ormond Street Hospital for Children NHS Foundation Trust and University College London.
References (77)
- et al.
Comparison of three acute care pediatric early warning scoring tools
J Pediatr Nurs
(2013) - et al.
Promoting care for acutely ill children-development and evaluation of a paediatric early warning tool
Intensive Crit Care Nurs
(2006) - et al.
The Cardiac Children's Hospital Early Warning Score (C-CHEWS)
J Pediatr Nurs
(2013) - et al.
Pediatric Early Warning Score and unplanned readmission to the pediatric intensive care unit
J Crit Care
(2015) - et al.
Attitudes and barriers to a Medical Emergency Team system at a tertiary paediatric hospital
Resuscitation
(2011) - et al.
What impact did a Paediatric Early Warning system have on emergency admissions to the paediatric intensive care unit? An observational cohort study
Intensive Crit Care Nurs
(2015) - et al.
The Pediatric Early Warning System score: a severity of illness score to predict urgent medical need in hospitalized children
J Crit Care
(2006) - et al.
The Texas Children’s Hospital Pediatric Advanced Warning Score as a predictor of clinical deterioration in hospitalized infants and children: a modification of the PEWS tool
J Pediatr Nurs
(2013) - et al.
Implementation and impact of a rapid response team in a children's hospital
Jt Comm J Qual Patient Saf
(2007) - et al.
Evaluation of a paediatric early warning tool—claims unsubstantiated
Intensive Crit Care Nurs
(2006)
Short-term health system costs of paediatric in-hospital acute life-threatening events including cardiac arrest
Resuscitation
The promise and potential of continuous improvement in the pediatric intensive care unit: the evolving story from the United kingdom paediatric intensive care audit network
J Pediatr
Reduction in hospital mortality over time in a hospital without a pediatric medical emergency team: limitations of before-and-after study designs
Arch Pediatr Adolesc Med
Patient safety factors in children dying in a paediatric intensive care unit (PICU): a case notes review study
BMJ Qual Saf
Systematic review of paediatric alert criteria for identifying hospitalised children at risk of critical deterioration
Intensive Care Med
Survey of early identification systems to identify inpatient children at risk of physiological deterioration
Arch Dis Child
Use of paediatric early warning systems in Great Britain: has there been a change of practice in the last 7 years?
Arch Dis Child
Performance of the Pediatric Index of Mortality 2 in a pediatric intensive care unit
Rev Bras Ter Intensiva
Grading quality of evidence and strength of recommendations for diagnostic tests and strategies
BMJ
QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies
Ann Intern Med
GRADE handbook for grading quality of evidence and strength of recommendation. Version 3.2
Development and initial validation of the Bedside Paediatric Early Warning System score
Crit Care
Implementing the Bedside Paediatric Early Warning System in a community hospital: a prospective observational study
Paediatr Child Health
Multicentre validation of the bedside paediatric early warning system score: a severity of illness score to detect evolving critical illness in hospitalised children
Crit Care
Impact of rapid response system implementation on critical deterioration events in children
JAMA Pediatr
Validation of a Paediatric Early Warning Score: first results and implications of usage
Eur J Pediatr
Implementation of the Bedside Paediatric Early Warning System (BedsidePEWS) for nurse identification of deteriorating patients
J Spec Pediatr Nurs
Accuracy of Bedside Paediatric Early Warning System (BedsidePEWS) in a Pediatric Stem Cell Transplant Unit
J Pediatr Oncol Nurs
The deterioration of children in ward areas in a specialist children's hospital
Nurs Crit Care
Validation of the Cardiac Children's Hospital Early Warning Score: an early warning scoring tool to prevent cardiopulmonary arrests in children with heart disease
Congenit Heart Dis
A pilot study to validate the Burn Center Pediatric Early Warning Score Tool in clinical practice
J Burn Care Res
Prospective cohort study to test the predictability of the Cardiff and Vale paediatric early warning system
Arch Dis Child
Validation of a Pediatric Early Warning Score in hospitalized pediatric oncology and hematopoietic stem cell transplant patients
Pediatr Crit Care Med
Effect of a multifaceted intervention on documentation of vital signs and staff communication regarding deteriorating paediatric patients
J Paediatr Child Health
Cited by (67)
Classification of health deterioration by geometric invariants
2023, Computer Methods and Programs in BiomedicineDevelopment of an evidence-based ESCALATION system for recognition and response to paediatric clinical deterioration
2022, Australian Critical CareCitation Excerpt :Vital signs parameters for each age range were selected from evidence, practice benchmarking, and clinical expertise and preferences of clinicians. A composite scoring system was selected based on evidence that this approach is more specific and less overtly sensitive than single trigger systems in predicting deterioration.27,28 There are 10 weighted variables with ranges of scores for a possible total of 24 (Fig. 2).
Beyond objective measurements: Danish nurses' identification of hospitalized pediatric patients at risk of clinical deterioration – A qualitative study
2022, Journal of Pediatric NursingCitation Excerpt :Within the pediatric population, this is particularly challenging due to unique age-specific physiological response patterns to illness and the children's predisposition to drastic and sudden deterioration(Mecham, 2006; Murray et al., 2015). Pediatric Track and Trigger Tools (PTTT) are widely used assessment tools developed to support healthcare professionals in identifying pediatric patients at risk of clinical deterioration through objective determination of the patient's clinical status (Chapman et al., 2016). A great variety of PTTTs exist.
- ☆
A Spanish translated version of the abstract of this article appears as Appendix in the final online version at http://dx.doi.org/10.1016/j.resuscitation.2016.07.230.