You are here

Article Text

Article menu

Download PDFPDF

XML
Accident & emergency
Original research
Management of children visiting the emergency department during out-of-office hours: an observational study
  1. Gina Schinkelshoek1,
  2. Dorine M Borensztajn1,
  3. Joany M Zachariasse1,
  4. Ian K Maconochie2,
  5. Claudio F Alves3,
  6. Paulo Freitas4,
  7. Frank J Smit5,
  8. Johan van der Lei6,
  9. Ewout W Steyerberg7,
  10. Susanne Greber-Platzer8,
  11. Henriëtte A Moll1
  1. 1Department of General Paediatrics, Erasmus MC Sophia Children Hospital, Rotterdam, Zuid-Holland, The Netherlands
  2. 2Department of Paediatric Accident and Emergency, Imperial College Healthcare NHS Trust, London, UK
  3. 3Department of Paediatrics, Professor Doutor Fernando Fonseca Hospital, Amadora, Lisboa, Portugal
  4. 4Intensive Care Unit, Professor Doutor Fernando Fonseca Hospital, Amadora, Lisboa, Portugal
  5. 5Department of Paediatrics, Maasstad Hospital, Rotterdam, Zuid-Holland, The Netherlands
  6. 6Department of Medical Informatics, Erasmus Medical Center, Rotterdam, Zuid-Holland, The Netherlands
  7. 7Department of Public Health, Erasmus Medical Center, Rotterdam, Zuid-Holland, The Netherlands
  8. 8Department of Pediatrics and Adolescent Medicine, Medical University of Vienna, Vienna, Austria
  1. Correspondence to Prof. Dr. Henriëtte A Moll; h.a.moll{at}erasmusmc.nl

Abstract

Background The aim was to study the characteristics and management of children visiting the emergency department (ED) during out-of-office hours.

Methods We analysed electronic health record data from 119 204 children visiting one of five EDs in four European countries. Patient characteristics and management (diagnostic tests, treatment, hospital admission and paediatric intensive care unit admission) were compared between children visiting during office hours and evening shifts, night shifts and weekend day shifts. Analyses were corrected for age, gender, Manchester Triage System urgency, abnormal vital signs, presenting problems and hospital.

Results Patients presenting at night were younger (median (IQR) age: 3.7 (1.4–8.2) years vs 4.8 (1.8–9.9)), more often classified as high urgent (16.3% vs 9.9%) and more often had ≥2 abnormal vital signs (22.8% vs 18.1%) compared with office hours. After correcting for disease severity, laboratory and radiological tests were less likely to be requested (adjusted OR (aOR): 0.82, 95% CI 0.78–0.86 and aOR: 0.64, 95% CI 0.60–0.67, respectively); treatment was more likely to be undertaken (aOR: 1.56, 95% CI 1.49–1.63) and patients were more likely to be admitted to the hospital (aOR: 1.32, 95% CI 1.24–1.41) at night. Patterns in management during out-of-office hours were comparable between the different hospitals, with variability remaining.

Conclusions Children visiting during the night are relatively more seriously ill, highlighting the need to keep improving emergency care on a 24-hour-a-day basis. Further research is needed to explain the differences in management during the night and how these differences affect patient outcomes.

  • accident & emergency
  • general paediatrics
  • paediatric practice
https://creativecommons.org/licenses/by/4.0/

This is an open access article distributed in accordance with the Creative Commons Attribution 4.0 Unported (CC BY 4.0) license, which permits others to copy, redistribute, remix, transform and build upon this work for any purpose, provided the original work is properly cited, a link to the licence is given, and indication of whether changes were made. See: https://creativecommons.org/licenses/by/4.0/.

https://doi.org/10.1136/bmjpo-2020-000687

Statistics from Altmetric.com

    Request Permissions

    If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

    What is known about the subject?

    • Concerns exist that emergency care may differ during out-of-office hours and office hours. There has been growing attention for paediatric emergency care at the emergency department (ED) recently. However, little is known about children visiting the ED during out-of-office hours.

    What this study adds?

    • Children visiting the ED during the night were relatively more seriously ill than during office hours. Fewer diagnostic tests, more treatment and more hospital admissions were reported during the night, which could not be explained by correcting for illness severity.

    Introduction

    Concerns exist that emergency care may differ during out-of-office hours, that is, evening, night and/or weekend shifts compared with office hours. For example, higher mortality rates were found during weekend visits in adult patients with sepsis presenting to the emergency department (ED).1 Some suggest that worse patient outcomes during out-of-office hours can, partly, be explained by higher illness severity and not by the time of arrival as an independent factor.2 3 When looking at the paediatric population, higher mortality rates were observed among children admitted to the paediatric intensive care unit (PICU) during out-of-office hours.4 However, other studies analysing PICU patients are in conflict with this finding.5–9

    Over the past few years, increasing attention has been paid to paediatric emergency care, leading to different guidelines and standards for children visiting the ED.10–14 These guidelines aim to achieve optimal utilisation of available resources, optimise patient outcomes and thereby improve the quality of care. A recent study reported that main standards of care are fulfilled in European EDs, but some areas of improvement still exist.15

    However, little research has focused specifically on children visiting the ED during out-of-office hours. Recently, variation in paediatric ED utilisation patterns and the presentation of these children by the shift of arrival has been reported.16 But this study was a single-centre study, which may limit generalisability. Moreover, no study has analysed resource utilisation at paediatric EDs during out-of-office hours, except for studies analysing children with a specific presenting problem.17–19

    It is important to obtain insight into the characteristics and management of the whole paediatric patient population attending the ED with its variable presenting problems, as this may be helpful in optimising guidelines and resource allocation, thereby improving the quality of care on a 24-hour-a-day basis.

    The aim of this study was to compare patient characteristics and management of paediatric patients visiting the ED during out-of-office hours to office hours in four different European countries.

    Methods

    Study design, setting and patients

    This study is part of the TrIAGE project (Triage Improvement Across General Emergency departments for paediatric patients), a prospective observational study.20 This project captured routinely collected, standardised, electronic health record data of all non-scheduled ED visits of children <16 years in five different hospitals in four different countries. The five participating hospitals, selected by convenience sampling, were: Erasmus Medical Centre, the Netherlands; Maasstad Hospital, the Netherlands; St Mary’s Hospital Imperial College Healthcare National Health Service Trust, UK; Hospital Professor Doutor Fernando Fonseca, Portugal; and Vienna General Hospital, Austria. The enrolment period varied from 8 to 36 months between 2012 and 2015.

    At the beginning of the study, a minimum dataset of variables for the collection was defined. If necessary, entries in the electronic health data were added or modified. Nurses at the ED were informed about the study and encouraged to fill in the entire medical records, including vital signs, which is in principle routine data. During the study, these routinely collected data were documented in the electronic, medical records by nurses at the ED. Data completeness and accuracy of the data were reviewed using a checklist of quality control. Sometimes, data were completed by information or vital signs from medical records documented by physicians at the ED. Coded data were extracted from the electronic hospital information systems and thereafter transferred to the principal investigator as an encrypted file. Careful data harmonisation and quality checks were conducted. The requirement for informed consent was obtained by all hospitals and the study was approved by the medical ethical committees of all participating institutions.

    Patient and public involvement statement

    Patients or the public were not involved in this research.

    Definitions

    Office hours versus out-of-office hours

    Office hours were defined as Monday until Friday, between 08:00 and 17:59, also referred to as day shift week. We compared office hours, as reference shift, to out-of-office hours, divided into evening shifts, night shifts and day shifts during the weekend. Evening shifts were defined as Monday until Sunday between 18:00 and 22:59 and night shifts as Monday until Sunday between 23:00 and 07:59, based on the previous literature.5 9 17 Weekend day shifts were defined as Saturday and Sunday between 08:00 and 17:59.

    Patient characteristics

    For this study, the following data were extracted from the database: age, gender, time and date of arrival, Manchester Triage System (MTS) urgency, vital signs and presenting symptom (based on the MTS flowchart). The MTS urgency consists of five categories: emergent, very urgent, urgent, standard and non-urgent.21–23 These categories were divided into three groups: high urgent (emergent or very urgent, <10 min waiting time), urgent (urgent, <60 min waiting time) and low urgent (standard or non-urgent, ≥60 min waiting time). Vital signs included heart rate, respiratory rate, oxygen saturation and temperature. Vital signs were considered abnormal based on the Advanced Paediatric Life Support reference values, with fever defined as temperature ≥38.5°C.24 The MTS flowchart was used to create subgroups of presenting problems. These subgroups, based on a previous study,25 included medical (respiratory, ear, nose and throat problems, gastrointestinal problems, neurological or psychiatric problems, general malaise, urological or gynaecological problems, dermatological and others) and trauma (trauma or muscular and wounds) (online supplementary table 1.1).

    Supplemental material

    Management

    Management was defined as diagnostics (laboratory tests and imaging), treatment at the ED and hospital or PICU admission directly after ED visit. Laboratory tests were divided into blood tests, including cultures, and urine tests, including cultures. Imaging was divided into: X-ray, ultrasound and CT.

    Treatment was divided into: oral medication, inhalation medication, intravenous medication or intravenous fluids and immediate lifesaving interventions (ILI) (online supplementary table 2).26

    In the multivariable regression models, we defined laboratory diagnostics as any form of laboratory tests, radiological diagnostics as any form of imaging and treatment as any form of treatment.

    Hospital admission included patients who were admitted to the general ward or the PICU. PICU admission was defined as admission to the PICU directly from the ED.

    Statistical analysis

    In descriptive statistics of patient characteristics, continuous, skewed variables are shown as median with IQR. Nominal and ordinal variables are shown as the number of patients with percentage within the shift. Nominal and ordinal variables considering management are shown as percentages within the shift, with interhospital ranges.

    In multivariable regression analyses, differences in management were compared between office hours and evening, night and weekend day shifts. To study the independent role of the shift of arrival, the regression analyses were adjusted for age, gender, MTS urgency, abnormal vital signs, presenting problem and hospital. We performed stratified analyses, by conducting the adjusted regression analyses for each hospital separately, to provide insight into interhospital differences.

    Missing data for vital signs were imputed using a multiple imputation model (table 1). These missing data were assumed to be conditional on other variables included in the database, that is, missing at random (online supplementary 3). Sensitivity analyses were performed by analysing a database restricted to complete cases (online supplementary 4).27 28

    View this table:
    Table 1

    Missing data for vital signs and imputation model

    Results were considered statistically significant at a p value of ≤0.05.

    Initial analyses were performed with SPSS software V.21 (IBM SPSS Statistics, IBM Corporation).

    Results

    Patient population

    In total, 119 209 patients, ≤16 years, visited the participating EDs. Five patients were excluded owing to missing arrival time or date, leaving 119 204 patients for analysis, with 50 417 (42.3%) of these patients who visited the ED during office hours versus 68 787 (57.7%) during out-of-office hours. Of those, 18 220 (15.3%) visited during weekend day shifts, 36 429 (30.6%) during the evening and 14 138 (11.9%) during the night.

    Patients who visited the ED during the night were younger, were more often classified by MTS as high urgent and more often had two or more abnormal vital signs (table 2).

    View this table:
    Table 2

    Patient characteristics

    During office hours, general malaise (20.0%), trauma or muscular (19.4%) and gastrointestinal problems (15.1%) were the most common presenting problems (figure 1). During the night, relatively more general malaise (24.6%), gastrointestinal problems (20.2%) and respiratory problems (17.6%) and fewer trauma cases (8.2%) were observed. Presenting problems during the evening and weekend day shifts were similar compared with office hours (online supplementary table 1.2).

    Figure 1
    Figure 1

    Presenting problems.

    Management

    During out-of-office hours, fewer diagnostic tests, more treatment and more hospital and PICU admissions were conducted (table 3).

    View this table:
    Table 3

    Management (diagnostics, treatment, hospital admission and PICU admission), descriptive

    During the evening and weekend day shift, fewer urine and blood tests were performed. During the evening, night and weekend day shifts, imaging was performed less often, except for X-ray during the evening shift. Treatments with oral, inhaled and intravenous medication were given more often, especially during the night. Also, during the night, slightly more ILIs were seen, while more hospital and ICU admissions were observed.

    In multivariable regression analyses, the results were adjusted for age, gender, urgency, abnormal vital signs, presenting problem and hospital (table 4).

    View this table:
    Table 4

    The association between management (laboratory tests, imaging, treatment, hospital and PICU admission) and time of arrival at the ED, adjusted regression analyses

    View this table:
    Table 5

    Hospital characteristics

    Laboratory and imaging diagnostics were significantly less likely to be performed during the evening and night shifts. Also, patients were significantly more likely to receive treatment during all out-of-office hours shifts and more likely to be admitted to the hospital during the night shift. After adjusting, no association was found between PICU admission and out-of-office hours visits.

    When analysing a database consisting only of complete cases for vital signs, overall results were comparable with the analyses in the imputation database (online supplementary 4).

    Interhospital analyses

    Hospital characteristics are shown in table 5 and online supplementary table 5.1-5.5. Some interhospital variation in management was observed (table 2). The multivariable regression analyses, adjusted for age, gender, urgency level, abnormal vital signs and presenting problem, were performed for each hospital separately in stratified analyses (online supplementary table 6). Overall patterns in management during out-of-office hours were comparable between the different hospitals, with some variation remaining. For example, at two hospitals, no significant difference was found in hospital admissions during the night. At another hospital, imaging was requested more frequently during evening and weekend shifts.

    Discussion

    In this large observational study of 119 204 visits in five EDs in Europe, we demonstrate differences in acuity level and management of children visiting the ED during out-of-office hours compared with office hours.

    We found that children visiting during the night were relatively more seriously ill. Second, after correcting for patient characteristics, illness severity and hospital, we observed fewer laboratory and radiological tests while children were more likely to receive treatment at the ED and to be admitted to the hospital especially during the night. No association was found between out-of-office hours visits and PICU admission, after statistically correcting for disease severity.

    Overall, the trends in out-of-office hours care were comparable between the different hospitals, with variability remaining.

    In a recent study, ED utilisation patterns of paediatric patients throughout the day was analysed.16 The distribution of visits over the evening and night shifts was quite similar to our results. Also, in line with our results, they observed that children during the night are relatively more ill. So, although the proportion of patients visiting during the night is the smallest, the acuity of this group is the highest, which shows the importance of the same quality of care on a 24-hour-a day basis. In contrast to our results, no association between the shift of arrival and hospital admission was reported. However, this was a single-centre study, which limits generalisability.

    Variation in management during out-of-office hours, most pronounced during the night, could not be explained by illness severity. Reducing variation in care could result in lower resource utilisation and costs and could improve the use of time, space and staff.29 To obtain more standardised care, also during out-of-office hours, it is essential to understand which factors contribute to the differences we observed.

    At first, different levels of staff during the night might influence management. Several studies found differences in resource use30–34 and admission rates35 depending on physician background and experience.

    Second, the availability of resources during night shifts, such as imaging resources or the availability of specialised radiologists to assess these results during the night, might contribute to the lower use of imaging during the night.36

    Our results raise the question of whether these higher treatment and admission rates and the lower use of diagnostic imaging during the night might have been unwarranted and contribute to unnecessary costs. Earlier research reported that higher resource utilisation is related to higher costs, but not to lower admission rates.37–39 One of the hospitals in our study showed no difference in diagnostics during the night, in contrast to the other hospitals, but still showed higher admission rates compared with office hours.

    We speculate that our results might also partly be explained by a more pragmatic approach of the patient during the night, resulting in fewer diagnostic tests, more treatment and more hospital admissions. The previous literature did report higher rates of antibiotic prescriptions17 and recommendations to admit to the hospital,40 in children visiting the ED during the night. Additionally, parental demand might contribute to these results.41 Furthermore, in contrast to general hospital admission, the higher rates of PICU admission during the night could be explained by illness severity and case mix. The indications for PICU admissions are more standardised compared with indications for general hospital and therefore less influenced by non-patient factors.

    These results point to the need for further research to explain the differences in clinical decisions during the night, by assessing differences in standards of care during out-of-office hours, such as availability of experienced staff and availability of diagnostics and equipment.14 Moreover, it is important to obtain insight into how these differences in management affect patient outcomes, for example, rehospitalisation, morbidity and 30-day mortality. Implementing guidelines for the management of children with specific conditions could help to reduce variation in management within and between hospitals, which optimise resource allocation and costs. Moreover, these guidelines could allow for better comparisons between the hospitals in further research.

    Other studies on the topic of out-of-office hours care, including adult patients at the ED and paediatric patients at the PICU, described worse patient outcomes during the night and evening, represented by higher mortality rates.1 4 42 We did not use mortality as the main outcome as the mortality in our dataset was very low (16 patients, 0.01%), which is in line with the previous literature.43 44

    Strengths and limitations

    A major strength of this study is large number of patients from different centres, including both universities as teaching hospitals. This increases the generalisability of the results. Moreover, we adjusted for multiple variables concerning illness severity to analyse the independent role of time of the visit to management.

    To appreciate the results, some limitations have to be considered. Hospitals were selected by convenience sampling, which influences the generalisability of the study. The enrolment period varied between the different hospitals. However, each hospital was followed for at least 8 months and in all hospitals a winter season was included to increase the comparability of the periods. Also, to our knowledge, there were no major changes or differences in for example vaccination status, occurrence of epidemics or other incidents during the total enrolment period (2012–2015).

    Second, the analyses were based on routinely collected data. This results in some missing data, which we dealt with using multiple imputation for vital signs. The proportion of missing data for vital signs was comparable with previous studies45–47 and varied between the hospitals, which can be expected due to patient mix and differences in local policies.

    Moreover, it is possible that there are more variables representing illness severity and influencing management, that were not included. These factors can be divided into patient-related and hospital-related factors. Patient-related factors are, for example, comorbidity, socioeconomic status or ethnic background. When looking at hospital-related factors, (experience level of) staff, resource availability and bed availability could possibly contribute to the differences in management. To deal with hospital-related differences, we adjusted our regression analyses for the hospital. Furthermore, we performed the regression analyses for each hospital separately. These stratified analyses demonstrated that overall results were comparable between the hospitals, but some variation remained. However, we did not have the specific information about the aforementioned hospital-level factors for each individual visit to include in the analyses. It would be interesting to analyse the potential effects of these factors in future research.

    Conclusion

    Children visiting during the night are relatively more seriously ill than those visiting during office hours. This highlights the need to keep improving emergency care on a 24-hour-a-day basis. Furthermore, differences in management are present depending on the time of the ED visit. Especially during the night, diagnostic tests are performed less frequently, while treatment is initiated more often and more children are admitted to the hospital than during office hours. These patterns are not explained by illness severity. Further research should focus on exploring the reasons for these differences and how these differences affect patient outcomes.

    References

    1. ↵
      1. Powell ES,
      2. Khare RK,
      3. Courtney DM, et al
      . The weekend effect for patients with sepsis presenting to the emergency department. J Emerg Med 2013;45:641–8.doi:10.1016/j.jemermed.2013.04.042pmid:http://www.ncbi.nlm.nih.gov/pubmed/23993937
      OpenUrlPubMed
    2. ↵
      1. Mikulich O,
      2. Callaly E,
      3. Bennett K, et al
      . The increased mortality associated with a weekend emergency admission is due to increased illness severity and altered case-mix. Acute Med 2011;10:182–7.pmid:http://www.ncbi.nlm.nih.gov/pubmed/22111090
      OpenUrlPubMed
    3. ↵
      1. Walker AS,
      2. Mason A,
      3. Quan TP, et al
      . Mortality risks associated with emergency admissions during weekends and public holidays: an analysis of electronic health records. Lancet 2017;390:62–72.doi:10.1016/S0140-6736(17)30782-1pmid:http://www.ncbi.nlm.nih.gov/pubmed/28499548
      OpenUrlCrossRefPubMed
    4. ↵
      1. Arias Y,
      2. Taylor DS,
      3. Marcin JP
      . Association between evening admissions and higher mortality rates in the pediatric intensive care unit. Pediatrics 2004;113:e530–4.doi:10.1542/peds.113.6.e530pmid:http://www.ncbi.nlm.nih.gov/pubmed/15173533
      OpenUrlAbstract/FREE Full Text
    5. ↵
      1. Peeters B,
      2. Jansen NJG,
      3. Bollen CW, et al
      . Off-hours admission and mortality in two pediatric intensive care units without 24-h in-house senior staff attendance. Intensive Care Med 2010;36:1923–7.doi:10.1007/s00134-010-2020-4pmid:http://www.ncbi.nlm.nih.gov/pubmed/20721531
      OpenUrlCrossRefPubMedWeb of Science
    6. ↵
      1. McShane P,
      2. Draper ES,
      3. McKinney PA, et al
      . Effects of out-of-hours and winter admissions and number of patients per unit on mortality in pediatric intensive care. J Pediatr 2013;163:1039–44.doi:10.1016/j.jpeds.2013.03.061pmid:http://www.ncbi.nlm.nih.gov/pubmed/23623513
      OpenUrlPubMed
    7. ↵
      1. Thabet FC,
      2. alHaffaf FA,
      3. Bougmiza IM, et al
      . Off-Hours admissions and mortality in PICU without 24-hour Onsite intensivist coverage. J Intensive Care Med 2020;35:694–9.doi:10.1177/0885066618778824pmid:http://www.ncbi.nlm.nih.gov/pubmed/29788796
      OpenUrlPubMed
    8. ↵
      1. Hixson ED,
      2. Davis S,
      3. Morris S, et al
      . Do weekends or evenings matter in a pediatric intensive care unit? Pediatr Crit Care Med 2005;6:523–30.doi:10.1097/01.PCC.0000165564.01639.CBpmid:http://www.ncbi.nlm.nih.gov/pubmed/16148810
      OpenUrlCrossRefPubMed
    9. ↵
      1. Numa A,
      2. Williams G,
      3. Awad J, et al
      . After-hours admissions are not associated with increased risk-adjusted mortality in pediatric intensive care. Intensive Care Med 2008;34:148–51.doi:10.1007/s00134-007-0904-8pmid:http://www.ncbi.nlm.nih.gov/pubmed/17943272
      OpenUrlCrossRefPubMedWeb of Science
    10. ↵
      1. American Academy of Pediatrics Committee on Pediatric Emergency Medicine
      2. American College of Emergency Physicians Pediatric Committee
      3. Emergency Nurses Association Pediatric Committee
      . Joint policy statement--guidelines for care of children in the emergency department. Ann Emerg Med 2009;54:543–52.doi:10.1016/j.annemergmed.2009.08.010pmid:http://www.ncbi.nlm.nih.gov/pubmed/19769888
      OpenUrlCrossRefPubMed
    11. ↵
      1. Gausche-Hill M,
      2. Wiebe RA
      . Guidelines for preparedness of emergency departments that care for children: a call to action. Ann Emerg Med 2001;37:389–91.doi:10.1067/mem.2001.114069pmid:http://www.ncbi.nlm.nih.gov/pubmed/11275831
      OpenUrlCrossRefPubMedWeb of Science
    12. ↵
      1. Remick K,
      2. Gausche-Hill M,
      3. Joseph MM, et al
      . Pediatric readiness in the emergency department. Pediatrics 2018;142:e20182459. doi:10.1542/peds.2018-2459pmid:http://www.ncbi.nlm.nih.gov/pubmed/30389843
      OpenUrlAbstract/FREE Full Text
    13. ↵
      1. Royal College of Paediatrics and Child Health
      . Facing the future: standards for children in emergency care settings, 2018. Available: https://www.rcpch.ac.uk/sites/default/files/2018-06/FTFEC%20Digital%20updated%20final.pdf [Accessed Oct 2019].
    14. ↵
      1. Standards of Care for Children in Emergency Departments (Third version)
      . International Federation for emergency medicine, 2012. Available: https://www.ifem.cc/wp-content/uploads/2019/06/Standards-of-Care-for-Children-in-Emergency-Departments-V3-2019.pdf [Accessed Oct 2019].
    15. ↵
      1. Mintegi S,
      2. Maconochie IK,
      3. Waisman Y, et al
      . Pediatric preparedness of European emergency departments: a multicenter international survey. Pediatr Emerg Care 2020. doi:doi:10.1097/PEC.0000000000001934. [Epub ahead of print: 08 May 2020].pmid:http://www.ncbi.nlm.nih.gov/pubmed/32398594
    16. ↵
      1. Almubarak H,
      2. Meckler G,
      3. Doan Q
      . Factors and outcomes associated with paediatric emergency department arrival patterns through the day. Paediatr Child Health 2019;24:323–9.doi:10.1093/pch/pxy173pmid:http://www.ncbi.nlm.nih.gov/pubmed/31379434
      OpenUrlPubMed
    17. ↵
      1. Roggen I,
      2. van Berlaer G,
      3. Gordts F, et al
      . Acute sore throat in children at the emergency department: best medical practice? Eur J Emerg Med 2015;22:343–7.doi:10.1097/MEJ.0000000000000175pmid:http://www.ncbi.nlm.nih.gov/pubmed/24999672
      OpenUrlPubMed
    18. ↵
      1. Johnson EK,
      2. Graham DA,
      3. Chow JS, et al
      . Nationwide emergency department imaging practices for pediatric urolithiasis: room for improvement. J Urol 2014;192:200–6.doi:10.1016/j.juro.2014.01.028pmid:http://www.ncbi.nlm.nih.gov/pubmed/24518772
      OpenUrlPubMed
    19. ↵
      1. Daverio M,
      2. Bressan S,
      3. Gregori D, et al
      . Patient and process factors associated with type of first neuroimaging and delayed diagnosis in childhood arterial ischemic stroke. Acad Emerg Med 2016;23:1040–7.doi:10.1111/acem.13001pmid:http://www.ncbi.nlm.nih.gov/pubmed/27155309
      OpenUrlPubMed
    20. ↵
      1. Zachariasse JM,
      2. Nieboer D,
      3. Maconochie IK, et al
      . Development and validation of a paediatric early warning score for use in the emergency department: a multicentre study. Lancet Child Adolesc Health 2020;4:583–91.doi:10.1016/S2352-4642(20)30139-5pmid:http://www.ncbi.nlm.nih.gov/pubmed/32710839
      OpenUrlPubMed
    21. ↵
      1. De Caluwé R,
      2. Manchester Triage G
      . Triage voor de spoedeisende hulp. Elsevier Gezondheidszorg, 2007.
    22. ↵
      1. van Veen M,
      2. Steyerberg EW,
      3. Van't Klooster M, et al
      . The Manchester triage system: improvements for paediatric emergency care. Emerg Med J 2012;29:654–9.doi:10.1136/emermed-2011-200562pmid:http://www.ncbi.nlm.nih.gov/pubmed/22334644
      OpenUrlAbstract/FREE Full Text
    23. ↵
      1. Mackway-Jones K,
      2. Marsden J,
      3. Windle J
      . Emergency triage: Manchester triage group. 3rd ed. Oxford, UK: John Wiley & Sons, 2013.
    24. ↵
      1. Turner NM
      . Advanced paediatric life support. In: Druk V, ed. De Nederlandse editie. Houten: Bohn Stafleu van Loghum, 2017.
    25. ↵
      1. Zachariasse JM,
      2. Seiger N,
      3. Rood PPM, et al
      . Validity of the Manchester triage system in emergency care: a prospective observational study. PLoS One 2017;12:e0170811. doi:10.1371/journal.pone.0170811pmid:http://www.ncbi.nlm.nih.gov/pubmed/28151987
      OpenUrlPubMed
    26. ↵
      1. Lee JY,
      2. Oh SH,
      3. Peck EH, et al
      . The validity of the Canadian triage and acuity scale in predicting resource utilization and the need for immediate life-saving interventions in elderly emergency department patients. Scand J Trauma Resusc Emerg Med 2011;19:68. doi:10.1186/1757-7241-19-68pmid:http://www.ncbi.nlm.nih.gov/pubmed/22050641
      OpenUrlCrossRefPubMed
    27. ↵
      1. Donders ART,
      2. van der Heijden GJMG,
      3. Stijnen T, et al
      . Review: a gentle introduction to imputation of missing values. J Clin Epidemiol 2006;59:1087–91.doi:10.1016/j.jclinepi.2006.01.014pmid:http://www.ncbi.nlm.nih.gov/pubmed/16980149
      OpenUrlCrossRefPubMedWeb of Science
    28. ↵
      1. Sterne JAC,
      2. White IR,
      3. Carlin JB, et al
      . Multiple imputation for missing data in epidemiological and clinical research: potential and pitfalls. BMJ 2009;338:b2393. doi:10.1136/bmj.b2393pmid:http://www.ncbi.nlm.nih.gov/pubmed/19564179
      OpenUrlFREE Full Text
    29. ↵
      1. Neuman MI,
      2. Chiang VW
      . Variation in pediatric care at US hospitals. Pediatrics 2013;132:369–70.doi:10.1542/peds.2013-1569pmid:http://www.ncbi.nlm.nih.gov/pubmed/23878042
      OpenUrlFREE Full Text
    30. ↵
      1. Pitts SR,
      2. Morgan SR,
      3. Schrager JD, et al
      . Emergency department resource use by supervised residents vs attending physicians alone. JAMA 2014;312:2394–400.doi:10.1001/jama.2014.16172pmid:http://www.ncbi.nlm.nih.gov/pubmed/25490330
      OpenUrlPubMed
    31. ↵
      1. White AL,
      2. Armstrong PAR,
      3. Thakore S
      . Impact of senior clinical review on patient disposition from the emergency department. Emerg Med J 2010;27:262–5. 96.doi:10.1136/emj.2009.077842pmid:http://www.ncbi.nlm.nih.gov/pubmed/20385673
      OpenUrlAbstract/FREE Full Text
    32. ↵
      1. Hampers LC,
      2. Faries SG
      . Practice variation in the emergency management of croup. Pediatrics 2002;109:505–8.doi:10.1542/peds.109.3.505pmid:http://www.ncbi.nlm.nih.gov/pubmed/11875148
      OpenUrlAbstract/FREE Full Text
    33. ↵
      1. Melo MR,
      2. Ferreira-Magalhães M,
      3. Flor-Lima F, et al
      . Dedicated pediatricians in emergency department: shorter waiting times and lower costs. PLoS One 2016;11:e0161149. doi:10.1371/journal.pone.0161149pmid:http://www.ncbi.nlm.nih.gov/pubmed/27564093
      OpenUrlPubMed
    34. ↵
      1. Knapp JF,
      2. Simon SD,
      3. Sharma V
      . Variation and trends in ED use of radiographs for asthma, bronchiolitis, and croup in children. Pediatrics 2013;132:245–52.doi:10.1542/peds.2012-2830pmid:http://www.ncbi.nlm.nih.gov/pubmed/23878045
      OpenUrlAbstract/FREE Full Text
    35. ↵
      1. Scott-Jupp R,
      2. Carter E,
      3. Brown N
      . Effects of consultant residence out-of-hours on acute paediatric admissions. Arch Dis Child 2020;105:661–3.doi:10.1136/archdischild-2019-317553pmid:http://www.ncbi.nlm.nih.gov/pubmed/31937571
      OpenUrlAbstract/FREE Full Text
    36. ↵
      1. Fullerton K,
      2. Depinet H,
      3. Iyer S, et al
      . Association of hospital resources and imaging choice for appendicitis in pediatric emergency departments. Acad Emerg Med 2017;24:400–9.doi:10.1111/acem.13156pmid:http://www.ncbi.nlm.nih.gov/pubmed/28039951
      OpenUrlPubMed
    37. ↵
      1. Kharbanda AB,
      2. Hall M,
      3. Shah SS, et al
      . Variation in resource utilization across a national sample of pediatric emergency departments. J Pediatr 2013;163:230–6.doi:10.1016/j.jpeds.2012.12.013pmid:http://www.ncbi.nlm.nih.gov/pubmed/23332463
      OpenUrlCrossRefPubMedWeb of Science
    38. ↵
      1. Florin TA,
      2. French B,
      3. Zorc JJ, et al
      . Variation in emergency department diagnostic testing and disposition outcomes in pneumonia. Pediatrics 2013;132:237–44.doi:10.1542/peds.2013-0179pmid:http://www.ncbi.nlm.nih.gov/pubmed/23878049
      OpenUrlAbstract/FREE Full Text
    39. ↵
      1. Bourgeois FT,
      2. Monuteaux MC,
      3. Stack AM, et al
      . Variation in emergency department admission rates in US children's hospitals. Pediatrics 2014;134:539–45.doi:10.1542/peds.2014-1278pmid:http://www.ncbi.nlm.nih.gov/pubmed/25113291
      OpenUrlAbstract/FREE Full Text
    40. ↵
      1. El Khoury AC,
      2. Durden E,
      3. Ma L, et al
      . Perception and management of fever in infants up to six months of age: a survey of US pediatricans. BMC Pediatr 2010;10:95. doi:10.1186/1471-2431-10-95pmid:http://www.ncbi.nlm.nih.gov/pubmed/21176190
      OpenUrlPubMed
    41. ↵
      1. Pachter LM,
      2. Ludwig S,
      3. Groves A
      . Night people: utilization of a pediatric emergency department during the late night. Pediatr Emerg Care 1991;7:12–14.doi:10.1097/00006565-199102000-00003pmid:http://www.ncbi.nlm.nih.gov/pubmed/2027803
      OpenUrlCrossRefPubMed
    42. ↵
      1. Duvald I,
      2. Moellekaer A,
      3. Boysen MA, et al
      . Linking the severity of illness and the weekend effect: a cohort study examining emergency department visits. Scand J Trauma Resusc Emerg Med 2018;26:72. doi:10.1186/s13049-018-0542-xpmid:http://www.ncbi.nlm.nih.gov/pubmed/30185223
      OpenUrlPubMed
    43. ↵
      1. Lopez E,
      2. Udaondo J,
      3. Olabarri M, et al
      . Mortality in Spanish pediatric emergency departments: a 5-year multicenter survey. Eur J Emerg Med 2017;24:392–7.doi:10.1097/MEJ.0000000000000365pmid:http://www.ncbi.nlm.nih.gov/pubmed/26716998
      OpenUrlPubMed
    44. ↵
      1. O'Malley P,
      2. Barata I,
      3. Snow S, et al
      . Death of a child in the emergency department. Pediatrics 2014;134:e313–30.doi:10.1542/peds.2014-1246pmid:http://www.ncbi.nlm.nih.gov/pubmed/24958580
      OpenUrlAbstract/FREE Full Text
    45. ↵
      1. van de Maat J,
      2. Jonkman H,
      3. van de Voort E, et al
      . Measuring vital signs in children with fever at the emergency department: an observational study on adherence to the NICE recommendations in Europe. Eur J Pediatr 2020;179:1097–106.doi:10.1007/s00431-020-03601-ypmid:http://www.ncbi.nlm.nih.gov/pubmed/32036433
      OpenUrlPubMed
    46. ↵
      1. Gravel J,
      2. Opatrny L,
      3. Gouin S
      . High rate of missing vital signs data at triage in a paediatric emergency department. Paediatr Child Health 2006;11:211–5.doi:10.1093/pch/11.4.211pmid:http://www.ncbi.nlm.nih.gov/pubmed/19030273
      OpenUrlPubMed
    47. ↵
      1. Seiger N,
      2. van Veen M,
      3. Almeida H, et al
      . Improving the Manchester triage system for pediatric emergency care: an international multicenter study. PLoS One 2014;9:e83267. doi:10.1371/journal.pone.0083267pmid:http://www.ncbi.nlm.nih.gov/pubmed/24454699
      OpenUrlPubMed

    Footnotes

    • Contributors GS and DMB: conceptualisation, data curation, formal analysis, investigation, writing original draft, review and editing. JMZ: data curation, formal analysis, investigation, review and editing. SG-P, CFA, PF, FJS and IKM: data curation, investigation, review and editing. JvdL: conceptualisation, data curation, review and editing. EWS: data curation, review and editing. HAM: conceptualisation, data curation, investigation, project administration, supervision, review and editing.

    • Funding The authors have not declared a specific grant for this research from any funding agency in the public, commercial or not-for-profit sectors.

    • Competing interests None declared.

    • Patient and public involvement Patients and/or the public were not involved in the design, or conduct, or reporting, or dissemination plans of this research.

    • Patient consent for publication Not required.

    • Ethics approval Medical Ethics Committee Erasmus MC: MEC-2013-567 Raad van Bestuur Maasstad Ziekenhuis: Protocol L2013-103 Joint Research Complicance Office Imperial College London and Imperial College Healthcare NHS Trust: 14/WA/1051 Comissâo de Ética para a Saúde do Hospital Prof. Dr. Fernando Fonseca, EPE: reunião 06 Dezembro de 2017 Ethik Kommission Medizinische Universität Wien: 1405/2014.

    • Provenance and peer review Not commissioned; externally peer reviewed.

    • Data availability statement Data are available upon reasonable request. Data from this study are available upon request to the corresponding author of the study (h.a.moll@erasmusmc.nl), subject to local rules and regulations.