Skip to main content
  • Research article
  • Open access
  • Published:

Helping Babies Breathe (HBB) training: What happens to knowledge and skills over time?

Abstract

Background

The first minutes after birth are critical to reducing neonatal mortality. Helping Babies Breathe (HBB) is a simulation-based neonatal resuscitation program for low resource settings. We studied the impact of initial HBB training followed by refresher training on the knowledge and skills of the birth attendants in facilities.

Methods

We conducted HBB trainings in 71 facilities in the NICHD Global Network research sites (Nagpur and Belgaum, India and Eldoret, Kenya), with a 6:1 ratio of facility trainees to Master Trainers (MT). Because of staff turnover, some birth attendants (BA) were trained as they joined the delivery room staff, after the initial training was completed (catch-up initial training). We compared pass rates for skills and knowledge pre- and post- initial HBB training and following refresher training among active BAs. An Objective Structured Clinical Examination (OSCE) B tested resuscitation skill retention by comparing post-initial training performance with pre-refresher training performance. We identified factors associated with loss of skills in pre-refresher training performance using multivariable logistic regression analysis. Daily bag and mask ventilation practice, equipment checks and supportive supervision were stressed as part of training.

Results

One hundred five MT (1.6 MT per facility) conducted initial and refresher HBB trainings for 835 BAs; 76% had no prior resuscitation training. Initial training improved knowledge and skills: the pass percentage for knowledge tests improved from 74 to 99% (p < 0.001). Only 5% could ventilate a newborn mannequin correctly before initial training but 97% passed the post-initial ventilation training test (p < 0.0001) and 99% passed the OSCE B resuscitation evaluation. During pre-refresher training evaluation, a mean of 6.7 (SD 2.49) months after the initial training, 99% passed the knowledge test, but the successful completion rate fell to 81% for the OSCE B resuscitation skills test. Characteristics associated with deterioration of resuscitation skills were BAs from tertiary care facilities, no prior resuscitation training, and the timing of training (initial vs. catch-up training).

Conclusions

HBB training significantly improved neonatal resuscitation knowledge and skills. However, skills declined more than knowledge over time. Ongoing skills practice and monitoring, more frequent retesting, and refresher trainings are needed to maintain neonatal resuscitation skills.

Trial registration

ClinicalTrials.gov Identifier: NCT01681017; 04 September 2012, retrospectively registered.

Peer Review reports

Background

Millennium Development Goal 4 called for a two-thirds reduction in mortality of children under 5 years of age from 1990 rates by 2015 [1]. Between 1990 and 2013 under five mortality decreased from 12.7 to 6.3 million annual deaths, but the Millennium Development Goal was not met because the neonatal mortality rate decreased by only 40%, from 4.7 to 2.8 million, during this same time period. Because the decline in neonatal mortality was slower than the decline in post neonatal mortality, neonatal mortality represents an increasing proportion of the under five deaths (~45%). At current rates, it will be over 150 years before African newborns have the same chance of survival as a baby born today in Europe or North America [2]. Hence, attention is increasingly focusing on reducing neonatal mortality in order to achieve sustainable progress toward future global goals [26].

The three leading causes of neonatal mortality worldwide are prematurity (36%), birth asphyxia (23%), and infections (23%) [3]. Neonates who survive birth asphyxia may have such long-term consequences as cerebral palsy, epilepsy, and learning disabilities [7]. An additional 1.2 million intrapartum stillbirths are not included in neonatal mortality rates [3]. Neonatal resuscitation has the potential to prevent perinatal mortality caused by intrapartum related asphyxia for almost two million babies annually [3]. However to be successful, birth attendants (BAs) must be trained to perform appropriate and adequate neonatal resuscitation in the critical first minutes after birth.

The Neonatal Resuscitation Program (NRP) has been the standard of care for resuscitating newborns since 1987 [8, 9]. First Breath, the first controlled resuscitation trial, used simplified versions of NRP and essential newborn care to train BAs in low and middle income countries and demonstrated that essential newborn care, including resuscitation training, significantly reduced still births without increasing the early neonatal mortality rate [10]. Subsequently the American Academy of Pediatrics (AAP), in collaboration with global partners, including Laerdal Medical and The Eunice Kennedy Shriver National Institute of Child Health and Human Development (NICHD) Global Network for Women’s and Children’s Health Research (Global Network), developed Helping Babies Breathe (HBB), a simulation-based curriculum to train facility BAs in resuscitation, in resource limited settings [1114].

HBB focuses on the initial steps of resuscitation, including immediate drying of the baby, providing warmth and additional stimulation to breathe, followed by bag and mask ventilation (BMV) if needed, within the first 60 seconds after birth (The Golden MinuteTM). HBB training materials use multiple approaches (color, graphic icons outlining three simple care paths, and illustrations depicting the key elements of skills); draw attention to critical decision points; and stress the need to initiate ventilation no later than the end of the first minute after birth [15]. Teaching materials include a Learner Workbook, Facilitator Flip Chart, a neonatal simulator (NeoNatalieTM) that allows trainers to manipulate cardinal evaluation signs (crying, breathing, heart rate), and an Action Plan that uses these evaluation signs to guide decision-making and management of the newborn who may range from a healthy wailing newborn to one who needs extra attention before crying and breathing well, or one who needs BMV and advanced care.

Cohort studies suggest that BAs at various skill levels [14, 1624] can be trained to effectively resuscitate newborns using the HBB methods; however, less is known about the durability of knowledge and skills and the need for re-training [14, 16, 20, 23]. We recently conducted a study of the effect of HBB training on perinatal survival in three sites of the NICHD Global Network, two sites in India and one in western Kenya [25]. The primary outcomes of the study have already been published [26]. Here we evaluate the effect of HBB training on neonatal resuscitation skills and knowledge, as well as retention of knowledge and skills by physicians and nurses who attended deliveries in facilities. The objectives were to evaluate (1) baseline knowledge and skills of BAs; (2) change in knowledge and skills after HBB training; (3) retention of skills and knowledge until refresher training; (4) the effect of refresher training on knowledge and skills of the BAs: and (5) factors associated with loss of skills before refresher training.

Methods

This study was conducted in Global Network sites in Belgaum and Nagpur, India, and Eldoret, Kenya, areas covered by a prospective, population-based registry which was established in 2008 and included all pregnancy and neonatal outcomes through 42 days postpartum in defined geographic catchment areas. The training intervention was delivered in selected health facilities that provided 24-h coverage for deliveries 7 days/week, served a population that had a minimum perinatal mortality rate of 30 per 1000 registry deliveries in the pre-study period, and delivered 40% of the total registry births in the three sites. The study protocol detailing the design was published previously [25].

HBB training

The intervention consisted of the following: (1) planning phase; (2) selection of facility staff to be trained as facility-level MTs and identification of all BAs in the participating facilities; (3) rapid scale up of HBB training done in three stages: (a) training of facility-level MTs (b) facility-level training of BAs, (c) refresher training of active BAs (defined as those who regularly attended deliveries); and (4) introduction of a multi-faceted monitoring program soon after the facility-level trainings.

  1. 1.

    Planning Phase

    The goal of the planning phase was to develop and implement an optimal HBB training curriculum for two types of trainees—the facility-level MTs and the facility BAs. The Global Network team worked with the central AAP MT group to develop a two-level HBB training curriculum based on the lessons learned from the HBB training programs to date. Concurrently each of the three study sites identified three HBB country MTs who were experienced in HBB training methodology. These country MTs and the central AAP MTs were a mix of female and male physicians and nurses. Together they trained a select group of new facility MTs who then would train facility BAs.

    For all trainings, we followed the HBB training guidelines, a package designed for adult trainees from different backgrounds, knowledge, professional training and skills, with minimal modifications [15, 27]. The interactive program used multiple learning methods, including self-study/learning, short verbal explanations, demonstrations, practicing in pairs, practical exercises, and group discussions. All training sessions followed the core steps of course preparation and delivery: assembling the teaching materials, distributing learner workbooks in advance, preparing content and teaching methods for each learning group, preparing the classroom space, engaging the learners and evaluating the learners and the course. In addition, trainers provided ongoing monitoring and continued learning in the clinical setting. Detailed agendas of the three training sessions are provided (Additional file 1).

  2. 2.

    Selection of Facility-Level MTs and BAs

    The facility-level MTs at each health facility were pediatricians, obstetricians, anesthetists, general physicians, and staff nurses with adult education experience or an aptitude for teaching who regularly attended deliveries and had expertise in neonatal resuscitation. The initial facility-level BA training included all providers from pediatrics, obstetrics, anesthesia, and nursing departments, as well as facility administrators. However, refresher training was restricted to those providers who had received initial HBB training and attended deliveries regularly (active BAs), based on delivery logs at each facility. The baseline characteristics of BAs were recorded at both initial and refresher training to help evaluate the initial skill level and experience, as well as skill retention at refresher training; these characteristics included age, type of health provider (physicians or nurses), health facility level (primary, secondary, or tertiary), prior resuscitation training (HBB, NRP, NSSK, essential newborn care or others), the average monthly number of births attended and, at refresher training, the average monthly number of births attended in the prior six months, and the interval between initial and refresher training. The general and specialist doctors were categorized as physicians and the trained nurses, nurse midwives, auxiliary nurse midwives were categorized as nurses. Health facilities were classified as primary level if they did not perform Caesarean sections (C-sections), secondary level if C-section staff was available on call, and tertiary level when C-sections were available 24 h a day.

  3. 3.

    Rapid Scale Up of HBB Training

    1. (a)

      Country-level training of facility MTs: As above, a group of three experienced central AAP MTs were paired with three experienced MTs at each of the participating Global Network sites to form a female–male, multi-disciplinary (physicians and nurses) country team of MTs to conduct a four-day training of the new facility MTs. The goals of this training of trainers were to rapidly scale up HBB training by training at least one MT per facility (vs. a training cascade), to preserve the integrity of the intervention and to minimize time and training costs. The training agenda was developed in collaboration with the AAP, based on lessons learned to date, including the need for trainers to do pre-training preparation by phone and in person and through post-training evaluation meetings. Each country MT trained a team of six new multidisciplinary facility MTs. The first two days were dedicated to hands-on learning of HBB. During the last two days, the new facility MTs taught small segments of HBB to their fellow team members and developed plans for rolling out training, as the central AAP MTs and country MTs monitored their teaching skills. A roving monitor observed whether the training groups were functioning well and provided feedback after consultations with the team members. Whenever needed, the new facility MT was provided an opportunity to improve his/her skills and extra training was provided until every trainee MT was proficient in resuscitation training. The unique features of these training sessions are summarized in Table 1. The MTs at each facility also facilitated ongoing monitoring and continued learning opportunities in their clinical settings, e.g., participated in monitoring activities such as regular observation of deliveries, resuscitation debriefing.

      Table 1 Unique features of the Global Network HBB training
    2. (b)

      Facility-level training of BAs: The study provided sufficient equipment for facility delivery rooms and resuscitation practice corners. The facility BAs were trained as HBB teams in three-day on-site facility courses by the newly-trained site MTs at their respective facilities between June and October 2012. This course included pre- and post-tests for all participants. Unlike the facility MT training, the primary focus of the BA courses was on training to optimally perform delivery room resuscitation. The BA trainees were taught to prepare for every birth; to focus on immediate, thorough, and vigorous drying of every newborn; to provide routine care (provision of warmth, delayed cord cutting between 1 and 3 min, and initiation of breastfeeding) for babies that breathed spontaneously; to provide more vigorous stimulation and, if needed, suction of mouth and nose, for babies that did not breathe well after drying; and finally to initiate and establish early and effective ventilation within The Golden MinuteTM for all babies that did not breathe after the above initial steps. Rather than didactic sessions, skill training and open discussion were provided (in the local language as required) to ensure that every BA could effectively resuscitate newborns. BAs were instructed to resuscitate every non-macerated birth, including those that might previously have been considered fresh stillbirths. High-quality HBB teaching materials and methods were used throughout the training. The HBB teaching materials included a neonatal simulator that felt and weighed like a newborn which could be manipulated by the MT to demonstrate the presence or absence of chest rise, cry and cord pulsations (Laerdal NeoNatalieTM); a Learner Workbook for each participant; a large Action Plan poster mounted near each group of six participants that pictured the color-coded paths for the three resuscitation outcomes; and a Facilitator Flipchart that guided teaching and discussions with pictures for the BA on the front and learning content for the MT on the back of each page. The teaching methods included demonstrations of each resuscitation step by the MTs, followed by individual and paired practice to encourage peer teaching and paired learning and standardized case scenarios and exercises for problem solving. This group training included a maximum ratio of six BAs per MT. Because all sites experienced staff turnover, newly-hired BAs were trained by the facility MTs in catch-up individual training or small group sessions, using the same materials and approach as in the initial training sessions.

    3. (c)

      Refresher training: A half-day refresher training course for all “active” BAs was prospectively planned for approximately six months after the initial training course. If required to accommodate the staff schedules and clinical duties, multiple refresher training sessions were conducted in each participating health facility. The refresher training included a group review of the entire resuscitation algorithm and demonstration of critical skills through video clips developed by AAP, along with instructional narration by the MTs in local languages as required [28]. The standard facilitator video script was used as a guide to maintain the uniformity of this instructional narration [29]. This was followed by practice in pairs and discussions among the BAs. Lastly, the BAs discussed the details of various monitoring activities—the need for each monitoring activity, the benefits, challenges and successful solutions. As with the initial training, the refresher training included pre- and post-tests to assess retention of the content.

  4. 4.

    Monitoring Activities

    Monitoring activities were introduced immediately after the initial facility-level training of BAs and carried out as a part of continuation of learning/training techniques best described as supportive supervision [25, 30]. The study staff at each facility monitored daily BMV practice sessions when BAs reported for work and signed the logbooks; daily BA checks of availability, cleanliness, and function of resuscitation equipment; regular observation of deliveries; debriefing after every resuscitation; and audits of every perinatal death on a continuous ongoing basis. Additionally, once a month, the MTs made a one full-day quality assurance (QA) visit to observe HBB skills directly during deliveries or test the BAs using a neonatal simulator if no deliveries were available.

    Information from all the participating facilities was compiled by the site HBB coordinators. This included compliance with monitoring activities, details of each resuscitation event in each of the participating facilities, and the outcomes, using a standard format. Calls were conducted every two weeks between the central staff (NICHD and RTI International) and each site coordinator to discuss individually every baby that had required resuscitation in the 72 participating facilities, including confirming whether each live born baby (non-macerated) was immediately dried, whether the baby cried or breathed spontaneously after drying, required additional stimulation, whether the baby received BMV, and whether the baby was alive or dead (fresh stillbirth) at discharge from the delivery room (Additional file 2)—data required for standard newborn indicator metrics. Quantitative practice data were not recorded, but physicians were described as less compliant with daily BMV practice than nurses. After the biweekly calls, the site coordinators discussed the content of the calls with their facility staff to close the monitoring loop. The facility staff were encouraged to track their own progress as well, e.g., proportion of BAs performing daily practice; the number of macerated stillbirths (for whom resuscitation was not required); and the percent of non-macerated births that did not cry at birth, responded to additional stimulation after drying, required BMV, and survived until discharge from the delivery room. A monthly consolidated report from the data coordinating center at RTI International included compliance rates of individual facilities with each of the four monitoring parameters- one QA visit every month, one unannounced visit every three months, resuscitation debriefings done for at least 90% of babies not crying at birth, and death audits done for at least 90% of perinatal deaths.

Evaluation of knowledge and skills

The knowledge evaluation of the BA trainees was done using the standard HBB Knowledge Check before and after (pre-post scores) initial and refresher training. The Knowledge Check was a 17-item written multiple choice questionnaire [31]. The trainee was expected to answer 14 out of 17 of the questions correctly to successfully complete the written knowledge evaluation.

The skills evaluation was done with the neonatal simulator and included ability to perform BMV effectively (appropriate chest rise and ventilation rate) and successful completion of the Objective Structured Clinical Evaluation (OSCE) A and OSCE B. These evaluations were performed according to study protocol to minimize potential bias and inter-rater variability. The Facilitator Flip Chart provided detailed instructions for administering the three skill tests i.e. BMV, OSCE A and OSCE B. Every trainee was required to successfully complete the BMV Performance Evaluation (seven out of seven steps) before attempting the OSCE evaluations [32]. OSCEs were developed from the NRP megacode (validated by Lockyer et al. [33]) and required an 80% correct performance with a small number of critical elements required to “pass.” OSCE A tested the skills and decision-making in routine care and the initial steps of The Golden MinuteTM [34]. The trainees were expected to correctly perform three key steps with the simulator (dries thoroughly, recognizes baby is not crying, and positions head and clears airway) and perform a total of 10 out of 13 steps to successfully complete OSCE A. OSCE B was a comprehensive skill testing that included elements of OSCE A, the skills of BMV and additional decision making based on assessment of heart rate [34]. Trainees were expected to correctly perform four key steps (recognizes baby is not breathing, ventilates at 40 breaths per minute, looks for chest movement, and performs the five steps to improve ventilation) and perform a total of 14 out of 18 steps correctly to successfully complete OSCE B. OSCE A and OSCE B were not tested before the initial training as trainees were not expected to have these skills prior to their training. After the initial training, the trainees received positive supervision and monitoring to assist in the retention and mastery of the knowledge and skills of HBB during daily practice, site visits and deliveries. Therefore trainees’ skills were evaluated using the comprehensive OSCE B just prior to and after the refresher training. Those who passed OSCE B after initial training and failed the evaluation prior to the refresher training were considered to have a decline in OSCE B skills.

Data management

The study data were recorded on paper forms and then entered into a password protected electronic data base by study staff at each site. Data were securely transmitted on a regular basis to the central data center. Data entry software included consistency checks, with cross-form edits performed centrally at the data center and resolved locally. Each site performed local data review and edits.

Statistical analysis

Chi-square tests of proportion were used to test differences in pass rates between the types of health providers. McNemar’s test was used for paired comparisons to test the proportion of BAs who passed the MCQ after initial training but failed it in the pre-refresher training. A logistic regression model was used to assess the association between BA characteristics and loss of skills. Those that were significant (p < 0.05) in univariate models were retained as predictors in the final model. The variables in the final model were type of training (group vs. individual), type of health facility (primary, secondary, or tertiary), type of health provider (physician, nurse), exposure to prior resuscitation training, number of births attended per month in the last six months (based on recall), study site, and age of the BAs. The dependent variable was the probability of failing the pre-refresher OSCE B test after passing the post-initial OSCE B. Unadjusted odds ratios (ORs) and 95% confidence intervals (CIs) were estimated by fitting univariate models with each of the predictors. Adjusted ORs and 95% CIs were estimated by fitting a multi-variable logistic regression model with all of the predictors included.

Ethical considerations

The HBB study protocol was approved by the institutional review committees of all the participating sites, partner institutions, and the Indian Council of Medical Research. A Data Monitoring Committee appointed by NICHD reviewed the study protocol and progress. All the MTs and BAs participating in the training signed the approved written informed consent form that informed them about the study including the testing of knowledge and skills.

Results

The 105 MTs trained 2227 BAs in the HBB curriculum during 236 workshops (Fig. 1) from June to October 2012. 835 active BAs (35% physicians, 65% nurses) received refresher training and were included in the analysis of knowledge and skills over time. The characteristics of these 835 active BAs are shown in Table 2: 17%, 28% and 55% were from Eldoret, Nagpur and Belgaum sites respectively. 76% of the BAs across all three sites reported no prior resuscitation training before HBB training. At refresher training, 47% estimated that they delivered between 11 and 40 babies/month and 19% estimated that they delivered more than 40 babies per month. One third of BAs in Belgaum and Kenya, as compared to only 8% in Nagpur, were trained later through catch-up training, after the initial group training, reflecting higher BA turnover in Belgaum and Kenya. The mean (SD) time interval in months between the initial and refresher trainings for these catch-up trainees was significantly less than that for the initial cohort of trainees (3.8 ± 2.9 vs. 7.8 ± 0.9, p < 0.0001). Of the 291 physicians who participated in refresher training, 130 (45%) had received their initial training as catch-up training. All these physicians served in primary care facilities. Among nurse BAs, 99 (18%) had received their initial training as catch-up training. Of these nurse BAs, 98% were in secondary level facilities and 2% were in tertiary facilities.

Fig. 1
figure 1

CONSORT flow diagram of the Global Network HBB training study

Table 2 Characteristics of Active Birth Attendantsa

All BAs from the Kenya site were nurse midwives from either primary level facilities (no C-sections performed) or secondary level facilities (C-section staff available on call). In contrast, many of the BAs in Nagpur and Belgaum were physicians; deliveries in Nagpur were predominantly in tertiary level facilities where C-sections were available 24 h a day.

Table 3 shows the proportion of BAs with a “passing” knowledge score (by multiple choice testing) before and after the initial HBB and refresher trainings. Initial HBB training improved knowledge significantly: 99% of the trainees passed the knowledge test post-training compared to 74% who passed it pre-training (p < 0.0001). Physicians were significantly more likely than nurses to have a passing knowledge score before the initial HBB training (86% vs 68%, p < 0.0001), but, after the initial HBB training, all physicians and 98% nurses passed the post-training knowledge exam.

Table 3 Training Outcomes for Active Birth Attendants—Initial and Refresher Trainings

Improvements in resuscitation skills after training were more impressive than the gains in knowledge, in part because BMV skills were so low initially. Prior to the initial HBB training, only 4.6% of BAs (3% of physicians and 5% of nurses) could ventilate a newborn mannequin effectively, as measured by the straightforward BMV skills test, but all physicians and 96% of nurses passed the test after initial training (p < 0.0001 pre- vs. post-initial training). OSCE A was assessed after initial and refresher trainings with 99.4 and 99.8% of BAs passing the test at both time points, respectively.

Table 3 also shows the proportion of BAs passing the OSCE B skills test post-initial training (99%). Prior to refresher training, the proportion passing fell to 81% (p < 0.0001), but after refresher training 99% passed the OSCE B. Physicians were less likely than nurses to retain OSCE B skills pre-refresher training (p < 0.002). The interval from initial to refresher training for those who failed the pre-refresher OSCE B after passing it in post-initial assessment was not longer than for those that passed both (mean [SD], 6.9 [2.8] vs 6.5 [2.5] months, p = 0.1).

Table 4 shows factors associated with deterioration of OSCE B skills. 25% of physicians and 16% of nurses (p = 0.002) failed pre-refresher training OSCE B. Among the seven characteristics in the regression model, facility type (p < 0.0001) and prior training (p < 0.01) were the two significant predictors of deterioration of OSCE B skills. BAs from tertiary facilities (adjusted OR 8.83; 95% CI 2.91, 26.78) and those with no prior resuscitation training (adjusted OR 2.56; 95% CI 1.28, 5.11) were most likely to fail the pre-refresher training OSCE B. However, those who received their initial training during catch-up rounds in individual or small-group training (adjusted OR 0.497; 95% CI 0.28, 0.88); and the BAs from Nagpur site (adjusted OR 0.154; 95% CI 0.05, 0.50) were less likely to lose the skills over time.

Table 4 Factors associated with loss of resuscitation skills as assessed by (OSCE B) at the time of refresher training

Discussion

Our study is the first large multi-national pre-post study of the impact of initial HBB training, followed by refresher training, on resuscitation knowledge and skills over time, using a state-of-the-art curriculum, standardized training protocol and evaluation methods, and ongoing supportive supervision and monitoring activities. Our goal was to address the methodologic problems of previous research in resuscitation training [35].

One of the most striking findings of our study of a large cohort of 835 active BAs trained and retrained in the HBB curriculum in 71 facilities in India and Kenya was that 76% of active BAs reported no prior training in neonatal resuscitation, despite efforts in India, Africa and other low and middle income countries to encourage facility deliveries and the relatively high BA delivery rates (47% of the BAs delivered between 11 and 40 babies per month and 19% delivered more than 40 babies per month.

The lack of resuscitation training was evidenced by a large initial knowledge-skills gap among the BAs: at the initial HBB training, 74% of BAs passed the pre-training knowledge assessment but only 5% were able to demonstrate effective ventilation of the neonatal mannequin. Our findings are consistent with Singhal et al., who also found a low concordance between knowledge and skills [13]. A majority of their trainees in Kenya and Pakistan required additional practice before they could demonstrate mastery of BMV skills at post-training assessment. Successful neonatal resuscitation requires rapid assessment, prompt decision making, and immediate action. It is a composite of adequate knowledge related to basic resuscitation, good technical skills, and the ability to synthesize these two domains into a complex behavior pattern, in addition to ongoing practice to maintain these complex skills. To achieve this end, we trained a large number of MTs (an average of 1.6 per facility) and BAs using four-day MT and three-day BA small-group training workshops with hands-on sessions and generous opportunities for individuals and pairs of BAs to practice resuscitation skills and lead skill sessions for the group. The combination of this unique training and sufficient equipment resulted in nearly 100% of BAs successfully passing knowledge and skills tests after the initial HBB training. The significant difference in pre-training knowledge and ventilation tests between physicians and nurses (p < 0.0001) disappeared after HBB training when more than 98% of both doctors and nurses passed the knowledge tests and the proportion of both nurses and doctors who correctly ventilated a neonatal model increased from approximately 4% to 97%.

Our study provided sufficient ventilation equipment for facility delivery rooms, resuscitation practice corners, and adequate numbers of MTs to ensure ongoing mentoring and supportive supervision of BAs: daily ventilation practice, equipment checks, death audits, resuscitation debriefings, and announced and unannounced site visits at each facility, as well as unique biweekly site conference calls to review the management of each resuscitated newborn in detail and the outcomes of all births before discharge at each facility.

However, the knowledge-skills gap that was evident before the initial HBB training recurred months later at refresher training despite ongoing mentoring and supportive supervision, when resuscitation skills, as measured by OSCE B, were less likely to be retained than knowledge (81% vs. 99%). At pre-refresher testing, BAs from tertiary facilities had nine times higher risk than those at lower-level facilities of failing the OSCE B, after having passed it at the end of initial training—a surrogate for loss of resuscitation skills. The higher skill-deterioration rate of BAs in tertiary facilities who care for high risk patients was unexpected. It may be due to a combination of factors, including less daily practice, whether due to busy schedules, timing of resident rotation, understaffing, increased workload or even a higher proportion of physicians in tertiary-level facilities, resulting in a less frequent BMV practice. During the biweekly reviews, the qualitative reports suggested that physicians were less compliant to daily BMV practice than the nurses, with assertions that they were ‘too busy” or “not in the delivery area.” Lack of previous resuscitation training prior to HBB training was associated with a 2.5 times greater risk of pre-refresher OSCE B failure. This may mean that all or a subset of BAs need repeated trainings to decrease the risk of failure. Those whose initial training was late (catch-up training) were less prone to skill deterioration; the mean time between initial and refresher trainings was also almost half compared to the initially trained BA cohort (3.8 ± 2.9 months vs. 7.8 ± 0.9 months, p < 0.0001), suggesting that recent training may be associated with improved skill performance. The lack of information on the optimal interval for training was recently noted in the Part 7 2015 Neonatal Resuscitation Consensus document: no evidence-based, effective strategy for teaching, assessing, and maintaining resuscitation knowledge and skills has been identified and that the existing evidence is of low quality [35]. Hands-on simulation training is widely accepted as the best available model for teaching complex behavior; however, the published evidence to date is of very low quality and there is no published evidence for improvement in patient outcome. Despite the lack of evidence for an optimal retraining interval, refresher training at least once a year was recommended to maintain skills.

Conclusions

Our large, rigorous pre-post cohort training study documented that facility BAs in 71 facilities in India and Kenya improved their knowledge and neonatal resuscitation skills after HBB training by MTs and supportive supervision during active monitoring and evaluation over the subsequent year. That 18% of BAs failed pre-refresher training skills tests suggests the need to identify such BAs earlier in order to provide the individualized training, supervision, and practice necessary to ensure that their resuscitation skills are durable over time or to reassign them to a less critical care area. The 18% failure rate should also prompt future researchers to compare different time intervals, structures or content of daily practice or different supervisory models to improve resuscitation skill retention. The risk factors for deterioration of resuscitation skills also suggest that resuscitation training should take place earlier and that administrators should ensure that staffing patterns in tertiary facilities with high delivery volume provide adequate time, motivation and accountability to maintain BA resuscitation skills.

As the HBB program paves the way for its successor, Helping Babies Survive, which includes the HBB 2nd edition and care of a newborn after immediate delivery room resuscitation, it will provide opportunities to incorporate standardized data collection, quality improvement activities, and institutional support for registries [36].

Given the low quality of evidence for simulation training, it is essential that future research addresses the knowledge gaps identified by the recent Wyllie et al. report [35], including different content/structures of daily practice or different supervisory models and documents the critical link between skill training and improved early neonatal survival in different medical and cultural settings.

Abbreviations

AAP:

American Academy of Pediatrics

BA:

Birth attendant

BMV:

Bag and mask ventilation

CI:

Confidence interval

Global Network:

The NICHD Global Network for Women’s and Children’s Health Research

HBB:

Helping Babies Breathe

MT:

Master trainer

NICHD:

The Eunice Kennedy Shriver National Institute of Child Health and Human Development

NRP:

Neonatal Resuscitation Program

NSSK:

Navjaat Shishu Suraksha Karyakram- a state run basic neonatal resuscitation training in India

OR:

Odds ratio

OSCE:

Objective structured clinical evaluation

QA:

Quality assurance

SD:

Standard deviation

References

  1. Shiffman J. Issue attention in global health: the case of newborn survival. Lancet. 2010;375(9730):2045–9.

    Article  PubMed  Google Scholar 

  2. Oestergaard MZ, Inoue M, Yoshida S, Mahanani WR, Gore FM, Cousens S, Lawn JE, Mathers CD, United Nations Inter-Agency Group for Child Mortality Estimation and the Child Health Epidemiology Reference Group. Neonatal mortality levels for 193 countries in 2009 with trends since 1990: a systematic analysis of progress, projections, and priorities. PLoS Med. 2011;8(8):e1001080.

    Article  PubMed  PubMed Central  Google Scholar 

  3. Lawn JE, Blencowe H, Oza S, You D, Lee AC, Waiswa P, Lalli M, Bhutta Z, Barros AJ, Christian P, Mathers C, Cousens SN, Lancet Every Newborn Study Group. Every Newborn: progress, priorities, and potential beyond survival. Lancet. 2014;384(9938):189–205.

    Article  PubMed  Google Scholar 

  4. Rajaratnam JK, Marcus JR, Flaxman AD, Wang H, L-R A, Dwyer L, Lopex AD, Murray CJL. Neonatal, postneonatal, childhood, and under-5-mortality for 187 countries, 1970–2010; a systematic analysis of progress towards Millennium Development Goal 4. Lancet. 2010;375:1988–2008.

    Article  PubMed  Google Scholar 

  5. Lee AC, Cousens S, Wall SN, Niermeyer S, Darmstadt GL, Carlo WA, Keenan WJ, Bhutta ZA, Gill C, Lawn JE. Neonatal resuscitation and immediate newborn assessment and stimulation for the prevention of neonatal deaths: a systematic review, meta-analysis and Delphi estimation of mortality effect. BMC Public Health. 2011;11 Suppl 3:S12. doi:10.1186/1471-2458-11-S3-S12.

    Article  PubMed  Google Scholar 

  6. Kamath-Rayne BD, Griffin JB, Moran K, Jones B, Downs A, McClure EM, Goldenberg RL, Rouse D, Jobe AH. Resuscitation and obstetrical care to reduce intrapartum-related neonatal deaths: A MANDATE Study. Matern Child Health J. 2015;19(8):1853–63.

    Article  PubMed  Google Scholar 

  7. Lee AC, Kozuki N, Blencowe H, Vos T, Bahalim A, Darmstadt GL, Niermeyer S, Ellis M, Robertson NJ, Cousens S, Lawn JE. Intrapartum-related neonatal encephalopathy incidence and impairment at regional and global levels for 2010 with trends from 1990. Pediatr Res. 2013;74 Suppl 1:50–72.

    Article  PubMed  PubMed Central  Google Scholar 

  8. Bloom RS, Cropley C, American Heart Association and American Academy of Pediatrics. Textbook of neonatal resuscitation. Los Angeles: American Heart Association; 1987.

    Google Scholar 

  9. Wyckoff MH, Aziz K, Escobedo MB, Kapadia VS, Kattwinkel J, Perlman JM, Simon WM, Weiner GM, Zaichkin JG. Part 13: Neonatal Resuscitation: 2015 American Heart Association Guidelines Update for Cardiopulmonary Resuscitation and Emergency Cardiovascular Care. Circulation. 2015;132(18 Suppl 2):S543–60.

    Article  PubMed  Google Scholar 

  10. Carlo WA, Goudar SS, Jehan I, Chomba E, Tshefu A, Garces A, Parida S, Althabe F, McClure EM, Derman RJ, Goldenberg RL, Bose C, Krebs NF, Panigrahi P, Buekens P, Chakraborty H, Hartwell TD, Wright LL. Newborn care training and perinatal mortality in developing countries. N Engl J Med. 2010;362(7):614–23.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  11. American Academy of Pediatrics. Helping Babies Breathe Training Program—A neonatal resuscitation curriculum for resource limited circumstances. 2011.https://www.aap.org/en-us/advocacy-and-policy/aap-health-initiatives/helping-babies-survive/Pages/Helping-Babies-Breathe.aspx. Accessed 1 Nov 2016.

  12. Little GA, Keenan WJ, Singhal N, Niermeyer S. International perspectives: Helping Babies Breathe: Evolution of a global neonatal resuscitation program for resource-limited areas. Neoreviews. 2014;15:e369.

    Article  Google Scholar 

  13. Singhal N, Lockyer J, Fidler H, Keenan W, Little G, Bucher S, Qadir M, Niermeyer S. Helping Babies Breathe: global neonatal resuscitation program development and formative educational evaluation. Resuscitation. 2012;83(1):90–6.

    Article  PubMed  Google Scholar 

  14. Enweronu-Laryea C, Engmann C, Osafo A, Bose C. Evaluating the effectiveness of a strategy for teaching neonatal resuscitation in West Africa. Resuscitation. 2009;80(11):1308–11.

    Article  PubMed  Google Scholar 

  15. American Academy of Pediatrics. Tool 8: Understanding the Educational Design of Helping Babies Breathe. 2011. https://www.aap.org/en-us/Documents/hbs_implementationguide_english.pdf#page=56. Accessed 1 Nov 2016.

  16. Wall SN, Lee AC, Carlo W, Goldenberg R, Niermeyer S, Darmstadt GL, Keenan W, Bhutta ZA, Perlman J, Lawn JE. Reducing intrapartum-related neonatal deaths in low- and middle-income countries-what works? Semin Perinatol. 2010;34(6):395–407.

    Article  PubMed  Google Scholar 

  17. Wall SN, Lee AC, Niermeyer S, English M, Keenan WJ, Carlo W, Bhutta ZA, Bang A, Narayanan I, Ariawan I, Lawn JE. Neonatal resuscitation in low resource settings: what, who, how and overcoming challenges to scale up? Int J Gynaecol Obstet. 2009;107:S47–64.

    Article  PubMed  PubMed Central  Google Scholar 

  18. Goudar SS, Somannavar MS, Clark R, Lockyer JM, Revankar AP, Fidler HM, Sloan NL, Niermeyer S, Keenan WJ, Singhal N. Stillbirth and newborn mortality in India after helping babies breathe training. Pediatrics. 2013;131(2):e344–52.

    Article  PubMed  Google Scholar 

  19. Mduma E, Ersdal H, Svensen E, Kidanto H, Auestad B, Perlman J. Frequent brief on-site simulation training and reduction in 24-h neonatal mortality-An educational intervention study. Resuscitation. 2015;93:1–7.

    Article  PubMed  Google Scholar 

  20. Ersdal HL, Vossius C, Bayo E, Mduma E, Perlman J, Lippert A, Søreide E. A one-day “Helping Babies Breathe” course improves simulated performance but not clinical management of neonates. Resuscitation. 2013;84(10):1422–7.

    Article  CAS  PubMed  Google Scholar 

  21. Seto TL, Tabangin ME, Josyula S, Taylor KK, Vasquez JC, Kamath-Rayne BD. Educational outcomes of Helping Babies Breathe training at a community hospital in Honduras. Perspect Med Educ. 2015;4(5):225–32.

    Article  PubMed  PubMed Central  Google Scholar 

  22. Hoban R, Bucher S, Neuman I, Chen M, Tesfaye N, Spector JM. Helping babies breathe’ training in sub-saharan Africa: educational impact and learner impressions. J Trop Pediatr. 2013;59(3):180–6.

    Article  PubMed  Google Scholar 

  23. Musafili A, Essén B, Baribwira C, Rukundo A, Persson LÅ. Evaluating Helping Babies Breathe: training for healthcare workers at hospitals in Rwanda. Acta Paediatr. 2013;102(1):e34–8.

    Article  PubMed  Google Scholar 

  24. Msemo G, Massawe A, Mmbando D, Rusibamayila N, Manji K, Kidanto HL, Mwizamuholya D, Ringia P, Ersdal HL, Perlman J. Newborn mortality and fresh stillbirth rates in Tanzania after helping babies breathe training. Pediatrics. 2013;131(2):e353–60.

    Article  PubMed  Google Scholar 

  25. Bang A, Bellad R, Gisore P, Hibberd P, Patel A, Goudar S, Esamai F, Goco N, Meleth S, Derman RJ, Liechty EA, McClure E, Carlo WA, Wright LL. Implementation and evaluation of the Helping Babies Breathe curriculum in three resource limited settings: Does Helping Babies Breathe save lives? A study protocol. BMC Pregnancy Childbirth. 2014;14(1):116.

    Article  PubMed  PubMed Central  Google Scholar 

  26. Bellad RM, Bang A, Carlo WA, McClure EM, Meleth S, Goco N, Goudar SS, Derman RJ, Hibberd PL, Patel A, Esamai F, Bucher S, Gisore P, Wright LL, HBB Study Group. A pre-post study of a multi-country scale up of resuscitation training of facility birth attendants: does Helping Babies Breathe training save lives? BMC Pregnancy Childbirth. 2016;16(1):222.

    Article  PubMed  Google Scholar 

  27. American Academy of Pediatrics. Guide for implementation of Helping Babies Breathe. 2011. https://www.aap.org/en-us/Documents/hbs_implementationguide_english.pdf#page=12. Accessed 1 Nov 2016.

  28. American Academy of Pediatrics: Helping Babies Breathe Video- Helping Babies Breathe Skills #1 and #2. https://www.aap.org/en-us/advocacy-and-policy/aap-health-initiatives/helping-babies-survive/Pages/Instructional-Videos.aspx. Accessed 1 Nov 2016.

  29. American Academy of Pediatrics: Helping Babies Breathe Facilitator Video. https://www.aap.org/en-us/Documents/hbs_facilitatorvideoscript.pdf. Accessed 1 Nov 2016.

  30. Marshall A, Fehringer J. Supportive supervision in monitoring and evaluation with community-based health staff in HIV programs: A case study from Haiti. MEASURE Evaluation. 2013. http://www.cpc.unc.edu/measure/resources/publications/sr-13-83. Accessed 16 Apr 2016.

  31. American Academy of Pediatrics: Helping Babies Breathe Facilitator tools- Knowledge check. https://www.aap.org/en-us/Documents/hbs_hbb_knowledgecheck.pdf. Accessed 1 Nov 2016.

  32. American Academy of Pediatrics. Helping Babies Breathe Facilitator tools-Bag-Mask Skill check. https://www.aap.org/en-us/Documents/hbs_hbb_bagmask_skillcheck.pdf. Accessed 1 Nov 2016.

  33. Lockyer J, Singhal N, Fidler H, Weiner G, Aziz K, Curran V. The development and testing of a performance checklist to assess neonatal resuscitation megacode skill. Pediatrics. 2006;118(6):e1739–44.

    Article  PubMed  Google Scholar 

  34. American Academy of Pediatrics. Helping Babies Breathe Facilitator tools- OSCEs A & B. https://www.aap.org/en-us/Documents/hbs_hbb_osces_andB.pdf. Accessed 1 Nov 2016.

  35. Wyllie J, Perlman JM, Kattwinkel J, Wyckoff MH, Aziz K, Guinsburg R, Kim HS, Liley HG, Mildenhall L, Simon WM, Szyld E, Tamura M, Velaphi S, Neonatal Resuscitation Chapter Collaborators. Part 7: Neonatal resuscitation: 2015 International Consensus on Cardiopulmonary Resuscitation and Emergency Cardiovascular Care Science With Treatment Recommendations. Resuscitation. 2015;95:e169–201.

    Article  PubMed  Google Scholar 

  36. American Academy of Pediatrics: Helping Babies Survive. https://www.aap.org/en-us/advocacy-and-policy/aap-health-initiatives/helping-babies-survive/Pages/About.aspx. Accessed 1 Nov 2016.

Download references

Acknowledgements

We thank the Scientific Advisory Board members, Alan H Jobe, MD, PhD; William J Keenan, MD; and Petter Andreas Steen, MD, for their oversight and guidance. We also thank all HBB Master Trainers and Facilitators and Birth Attendants who made the HBB trainings possible.

Funding

This study was funded with grants from the Laerdal Foundation, Norwegian Agency for Development Cooperation (Norad), and the NICHD (grant numbers U01 HD040636; U01 HD058322 and U10 HD078439; HD U01058326; U01 HD058326-04S1, U10 HD076461, U01 HD042372, U10 HD076457).

Availability of data and materials

Studies conducted by the NICHD Global Network for Women’s and Children’s Health Research will have data loaded into the NICHD Data and Specimen Hub (DASH) system, a publicly accessible online archive: : https://dash.nichd.nih.gov/.

Authors’ contributions

LLW and WAC conceived the original study. LLW, EMM, WAC, in collaboration with SM; SSG, AP, EAL, developed the proposal. NG, LLW, EMM, and SM prepared the manual. LLW and NG coordinated the overall execution of the study. SN, LLW, SC, BKR, EMM, NG developed the training agendas. SN, BKR, SC, RB, AB, NM, MB, SD, MJ, NM, VJ were MT in India; WK, GL, VF, SB, PG, JR were MTs in Kenya. AB, AP, PLH wrote the protocol for the analysis of the training results. RB, SSG; AB, AP; FE, PG, SB, EAL implemented/monitored the study. AB, AP, PLH wrote the plan of analysis in collaboration with SM, LLW, WAC and EMM. SM performed the statistical analysis in collaboration with AB, AP, PLH, LLW, NG, WAC, EMM. AB wrote the first draft of the report; AB, AP, PLH and LLW wrote the report with input from the authors, especially SM, NG, and EMM. All authors approved the final manuscript.

Competing interests

The authors declare that they have no competing interests.

Consent for publication

Not applicable.

Ethics approval and consent to participate

The HBB study protocol was approved by the ethics review committees of the sites and partner institutions, RTI International Office of Research Protection Institutional Review Board, Durham, NC, USA; Christiana Care Institutional Review Board, Newark, DE; Jawaharlal Nehru Medical College (JNMC) Institutional Ethics Committee on Human Subjects Research, Belgaum, India; Karnataka State Health & Family Welfare Society, Bangalore, India; Partners Human Research Committee, Boston, MA, USA, Lata Medical Research Foundation Research Ethics Review Committee, Nagpur, India; the India Council of Medical Research; Indiana University Office of Research Administration, Indianapolis, IN, USA, Moi University School of Medicine Institutional Research and Ethics Committee, Eldoret, Kenya. An independent data-monitoring committee appointed by the NICHD reviewed the study protocol and progress. The study was registered (clinicaltrials.gov NCT01681017).

Written informed consent was obtained from all trained birth attendants who participated in the HBB study.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Linda L. Wright.

Additional files

Additional file 1:

Detailed agendas of the Global Network HBB trainings. (DOC 114 kb)

Additional file 2:

Biweekly HBB monitoring report format for calls between central and site teams. (XLSX 30 kb)

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Bang, A., Patel, A., Bellad, R. et al. Helping Babies Breathe (HBB) training: What happens to knowledge and skills over time?. BMC Pregnancy Childbirth 16, 364 (2016). https://doi.org/10.1186/s12884-016-1141-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12884-016-1141-3

Keywords