Article Text
PDF
Abstract
Objectives Both general and subspecialty paediatric trainees undertake attachments in highly specialised tertiary hospitals. Trainee feedback suggests that mismatches in expectations between trainees and supervisors and a perceived lack of educational opportunities may lead to trainee dissatisfaction in such settings. With the ‘Shape of Training’ review (reshaping postgraduate training in the UK to focus on more general themes), this issue is likely to become more apparent. We wished to explore the factors that contribute to a positive educational environment and training experience and identify how this may be improved in highly specialised settings.
Methods General paediatric trainees working at all levels in subspecialty teams at a tertiary hospital were recruited (n=12). Semistructured interviews were undertaken to explore the strengths and weaknesses of training in such a setting and how this could be optimised. Appreciative inquiry methodology was used to identify areas of perceived best practice and consider how these could be promoted and disseminated.
Results Twelve best practice themes were identified: (1) managing expectations by acknowledging the challenges; (2) educational contracting to identify learning needs and opportunities; (3) creative educational supervision; (4) centralised teaching events; (5) signposting learning opportunities; (6) curriculum-mapped pan-hospital teaching programmes; (7) local faculty groups with trainee representation; (8) interprofessional learning; (9) pastoral support systems; (10) crossover weeks to increase clinical exposure; (11) adequate clinical supervision; and (12) rota design to include teaching and clinic time.
Conclusions Tertiary settings have strengths, as well as challenges, for general paediatric training. Twelve trainee-generated tips have been identified to capitalise on the educational potential within these settings. Trainee feedback is essential to diagnose and improve educational environments and appreciative inquiry is a useful tool for this purpose.
- health services research
- medical education
- qualitative research
- paediatric practice
- multidisciplinary team-care
This is an Open Access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/
Statistics from Altmetric.com
- health services research
- medical education
- qualitative research
- paediatric practice
- multidisciplinary team-care
What is already known on this topic?
The educational environment is a key component of effective learning at postgraduate levels.
In highly specialised tertiary hospitals, mismatches in expectations between trainees and supervisors and a perceived lack of educational opportunities may lead to trainee dissatisfaction.
The ‘Shape of Training’ review will lead to a greater focus on generalist training and rotations.
What this study hopes to add?
The study suggests 12 trainee-generated ideas to optimise training in a tertiary centre and divides these into trainee, trainer and organisational factors.
Suggestions include the use of educational contracting, effective educational supervision, pastoral support systems and signposted educational activities.
This study identifies components of the educational environment that are valued by trainees, including interprofessional learning.
Introduction
In the UK paediatric trainees undertake 5–8 years of training across three levels1 as shown in figure 1. Levels 1 and 2 training are in general paediatrics, neonatology and community paediatrics. Level 3 trainees can choose to either subspecialise or continue in general paediatric training. Trainees at all levels may undertake attachments in tertiary-level hospitals for part of their training and are expected to achieve general paediatric competencies during this time.
The structure of postgraduate paediatric training in the UK (Royal College of Paediatrics and Child Health (RCPCH) 2017).1 MRCPCH, membership of the Royal College of Paediatrics and Child Health; ST, specialty trainee;
Local training surveys have indicated that trainees in such settings may experience dissatisfaction, mismatched trainee–trainer expectations and a perceived lack of educational opportunities.2 This study examines the challenges faced by general paediatric trainees (GPTs) undertaking rotational placements in highly specialised settings and how the training experience and educational environment may be optimised.
The educational environment is recognised as a key component of effective learning. It consists of the physical environment, opportunities, trainee and teacher attitudes, sociocultural and emotional aspects of learning that take place there.3 It contributes towards the ‘hidden curriculum’ through attitudes and role-modelled behaviour that are passed onto learners.4 Other key components of the educational environment including communicative teams, role-modelling, relationships, reduced hierarchy and the ability to discuss mistakes.5 6 In July 2015, the General Medical Council (GMC) published ‘Promoting excellence: standards for medical education’,7 in which they emphasised the importance of institutions’ learning environment and culture. The GMC is emphatic that having an ‘effective learning culture’ enables learners to meet curriculum and training goals and optimise their training.
Objective of this study
Using appreciative inquiry methodology and semistructured interviews, we aim to explore the following questions:
How can we best deliver high-quality general paediatric training in tertiary training settings?
What can we learn from the experiences of the trainees currently undertaking such placements about the strengths, challenges and opportunities of training in this environment?
The most widely used questionnaire-based instruments for measuring educational environments are the Dundee Ready Educational Environment Measure8, its postgraduate counterpart the Postgraduate Hospital Educational Environment Measure (PHEEM)9 and the newer Scan of Postgraduate Educational Environment Domains (SPEED) tool.10 These are validated, widely used, self-administered questionnaires that have been cited in over 90 papers internationally and have high reliability scores. However, their simplicity and feasibility may compromise the depth of their responses, and their psychometric properties are not as reproducible as first intended.3
The current tools to measure educational environments have limitations, and there is a lack of literature that focuses on the trainee perspectives. Furthermore, generalist training in paediatrics is likely to become increasingly popular with the Shape of Training review11 and discussions about making general paediatric a subspecialty in its own right. The experiences of GPTs are therefore an important and interesting area to study. This study aims to understand the factors that contribute to high-quality educational environments and training experiences for GPTs in a tertiary setting, using appreciative inquiry and semistructured interviews to explore the issues and generate suggestions on how this can be optimised.
Methods
Data collection method
Semistructured interviews were used to collect the data. These were chosen over questionnaires or the ready-made tools as they enable richer responses and allow participants to use their own terms of reference, rather than being preframed by the researcher.12 Interviews were chosen in preference to focus groups to provide a greater level of confidentiality, prevent pressure to conform to ‘normative disclosures’,13 and due to rota and shift-working, it was more feasible to coordinate to meet with one person rather than a group. The interviewer was a paediatric trainee who has undertaken qualitative research training as part of a higher degree in medical education. The interviews took place in the tertiary hospital setting and were between 20 and 40 minutes in length.
Theoretical perspectives and guiding principles
The methodology was informed by grounded theory,14 and an inductive approach was taken to data interpretation enabling hypotheses to be generated from the responses given. This allowed for themes to emerge organically rather than being influenced by pre-existing ideas. The semistructured interview permitted us to set structure to the interview, while ensuring that participants had flexibility and the freedom to set the agenda.15
Sampling method
Participants were identified from a list provided by the local training provider. Total population sampling was used, and all GPTs at the study hospital were invited to participate through emails and recruitment posters. Subspecialty trainees and non-training grades were excluded. Interviews were undertaken with all the GPTs who volunteered.
Interviewing strategy
The interviewing strategy and design was inspired by appreciative inquiry (AI) pioneered by Cooperrider and Whitney.16 This is a strength-based model that aims to ‘understand the organization's potential strengths by looking at an organisation's good experiences and its potential’.16 It consists of a cycle with four processes: (1) discover: identifying good practice; (2) dream: envision what would work well in the future; (3) design interventions; and (4) deploy: implementation. Trainees were asked to describe the strengths and challenges of their training experience in the tertiary setting. They were asked to identify any areas of current best practice or to make suggestions for improvement. The interview guide is included in online supplementary file 1.
Supplementary file 1
Data analysis
The interviews were audio-recorded and transcribed. The qualitative data from the interviews was thematically analysed, using open-coding and axial-coding, ensuring that constant comparisons were made to the results to reduce the chance of codes being missed. The codes were then integrated into themes and the themes were arrainged into categories and finally a theoretical framework.12 17
Results
Twelve of 37 GPTs were interviewed. These were 9/13 Senior House Officers (ST1–ST3 training years) and 3/24 registrars (ST4–ST8) from a variety of departments. The small number of registrars in the study is acknowledged as a limitation. This may be due to time demands on senior trainees as well as the fact that most senior trainees are subspecialty trainees who was not the targeted population. Results that are very specific to the study hospital have been removed, as they limit the anonymity and generalisability of the results.
Strengths of training
Participants identified many strengths of training in a specialist setting. These included the sense that these settings were often special, with unique opportunities and interesting patients. Many felt that the settings enabled them to explore subspecialty career options; one trainee had received mentoring for subspecialty applications from her consultant and another had changed her choice of subspecialty as a result of her good experience. A common theme identified was that trainees felt they understood the workings of tertiary hospitals better, which would enable them to make more appropriate referrals in the future. Working in tertiary hospitals also enabled trainees to manage patients at the ceilings of care and those with multiple comorbidities and complex or life-limiting conditions.
Participants felt that the hospital had many educational strengths (see table 1) including team-based teaching, access to internal courses including with affiliated institutions, multidisciplinary team meetings, specialist clinics, procedural skills and the ability to get involved in research projects and to learn from working with other specialised teams.
A summary of the main themes regarding the positive aspects of training in a tertiary setting
Weaknesses of training
Participants mentioned many challenges associated with working in a specialised hospital setting (see table 2). Some mentioned that there was a mismatch in the expectations of trainees and trainers, especially when it came to specialty-specific knowledge. Some felt that these were high-stakes attachments and had often been specifically chosen by trainees for particular purposes (eg, in order to have access to research opportunities or to explore a subspecialty career option), but this was not always recognised or supported.
A summary of the main themes regarding the challenges of training in a tertiary setting
A common theme was that the specialised level of care, and complex patient cases, meant that trainees had less of an opportunity to get involved in making decisions about patients or for ‘stepping up’ in their roles. In some cases, this meant trainees were involved in what was perceived as more administrative tasks or service provision rather than learning or training.
There was a feeling that different specialist teams worked very independently of each other (‘in silos’), and therefore trainees did not always benefit from working with and learning from other specialties.
Suggestions for improvement
The main focus of the interviews was in exploring the ways that the training experience and educational environment can be improved. These are summarised in table 3. Suggestions included preparation for the attachment to align trainee–trainer expectations and setting clear educational objectives. The majority of participants mentioned that they would like to see a pan-hospital teaching programme in order to focus on general competencies and learn from other specialties. They suggested ways to optimise existing learning opportunities, for example, dedicated teaching clinics, opportunity to do research projects and potentially shadowing or cross-covering in other specialties. The need for feedback collection mechanisms was mentioned, and the importance of pastoral support was also emphasised. As part of the AI process, trainees identified sources of current good practice including team-based teaching, allocated time for workplace-based assessments and interprofessional learning within the hospital community of practice.
A summary of the suggestions for improvement
Discussion
Principle findings
The training experiences of our participants were very heterogeneous; however, the emerging narrative is that specialised hospitals are special places with unique opportunities including career development, educational opportunities and interesting patients. However, they can have challenges including limited clinical autonomy, mismatched trainee–trainer expectations and siloed team working.
The participants highlighted common themes about the way their educational environments and training experience could be improved, and many of the suggestions are generalisable for postgraduate medical training as a whole. The suggestions from trainees can be categorised as trainee, trainer and organisational factors (table 4).
Factors perceived by trainees to enhance an educational environment: trainee, trainer and organisational factors
Trainee factors include ensuring that a personal development plan or ‘educational contract’ is discussed with the educational supervisor at the start of the attachment. This is a ‘negotiated agreement addressing the needs, expectations, roles, and content of an attachment’.18 It enables the challenges and opportunities of the placement to be openly discussed and planned for. This can help reduce trainee–trainer mismatch in expectations and may facilitate a deeper more collaborative relationship. As a result of the work of the ‘Junior doctors committee’, this idea has been introduced to the study hospital in the form of a ‘work schedule’. This is a document that sets out the educational component of each post in an individualised way, after agreement between the trainee and educational supervisor. This intervention has recently been introduced and is yet to be evaluated but is hoped that it will enable trainee–trainer expectations to be more closely matched and educational opportunities to be more clearly outlined.
Trainer factors are important in contributing to the educational experience in a specialised attachment. This may necessitate the development of creative models of educational supervision, for example, longer relationships with a supervisor enabling longitudinal continuity of supervision across different rotations, or educational supervisors who are outside the direct clinical team enabling a broader educational agenda to be set. The trainees also mentioned the importance of robust feedback collection mechanisms. The GMC7 requires all educational departments to have local faculty group meetings in which trainee progress is reviewed and workforce issues and unfulfilled training requirements identified and actioned early. Pastoral support was highlighted as requiring improvement. Pantaleoni et al 19 found that paediatric residents had significant increase in burnout as training progresses and that preventative strategies are required. This could be through proactive educational supervision, psychological support for trainees, or promotion of deanery-based mentoring schemes.
Organisational factors are fundamental to the establishment of a positive educational environment. These can include ensuring that regular, protected teaching sessions are arranged for trainees. Specialised hospitals are often affiliated to universities or scientific institutions, many of which will have an active educational programme. Centralising these events and signposting them as opportunities to trainees may improve the perceived culture of teaching and learning. Interprofessional learning was also identified as an area of good practice. Members of the multiprofessional team often have enhanced specialist skills and knowledge and some may formally take on advanced roles (eg, advanced practitioners). They are a rich source of knowledge and learning within the community of practice in these specialist settings. Interprofessional or multidisciplinary education can contribute to ‘better team dynamics, more holistic approach to patients and an improvement in knowledge and skills when it comes to complex conditions’.20
Not all trainees may enjoy, benefit from or be suited to highly specialised rotations. There is a need for continued close collaboration between hospital educational leaders and training programme directors to best select and prepare trainees for these posts so that there can be the best match between expectations and training needs.
Comparison with existing literature
The findings of our study were compared with those of the PHEEM9 and SPEED10 studies, which are currently the most widely used measures of the quality of educational environments (table 5).
Implications at our institution
As a result of trainee feedback from this study and others, our institution has started a regular cross-specialty study afternoon, with specialists from the hospital delivering curriculum-mapped teaching. The sessions are open to trainees from outside of the hospital too and have received positive feedback. The postgraduate medical education department has also developed a smartphone application where all teaching opportunities (across departments and in different affiliated institutions) are advertised and timetabled, enabling trainees to access a wide-range of learning. All educational supervisors have been accredited, and local faculty groups have been set up with trainee representation.
Many of our ‘twelve tips’ can be implemented through restructuring of current practice, enabling changes to be made without significant time or resource implications. For example, most hospitals have a wide range of educational opportunities on offer, but the signposting of these could be made more explicit. Similarly, regular educational supervision meetings are a compulsory part of training; however, using educational contracting can help to structure this relationship. The GMC is committed to improving educational supervisor’s and skills attainment and making sure that funding (including supporting professional activities time) is available for them to fulfil their role. Annual appraisal of educational supervisors is an important tool to support supervisors in reviewing their activities and ensuring that they adopt best practice.7
Implications to clinicians and policymakers
We hope that the 12 tips, and the trainee/trainer/organisation model, will be useful tools in designing and evaluating rotational placements for GPTs in tertiary settings as well as postgraduate training placements more generally. We hope that the study will promote the use of AI as a tool in the evaluation of complex learning environments. This study is a reminder that trainee buy-in and feedback are essential in order to evaluate and improve training programmes.
Strengths and weaknesses of the study
The strength of this study was that it was an in-depth interview-based study, which resulted in 12 actionable points to improve the educational experience for paediatric trainees. This study has added to our understanding of what is important to trainees in their educational environments.
There are limitations to the applicability of the findings including the fact that this study was undertaken solely on paediatric trainees and in a unique highly specialised setting. The study included a relatively smaller number of senior trainees (ST4–8). GPTs at all levels have similar curriculum competencies to acquire, in terms of knowledge, communication and procedural skills. However, more senior trainees may require more opportunities for independent clinical decision making, team-leading and management competencies, and these aspects may therefore have not been fully explored due to the low participation from senior trainees.
The limitations of this study relate to the theory of contextualism, in which it is accepted that ‘knowledge emerges from different contexts and also reflects the researcher’s position so it is always local, situated and provisional’21; therefore, wide applicability is not always a realistic outcome.
Footnotes
Contributors AA and AL designed the work. AA conducted the literature review and the semistructured interviews. AA and AL were both involved in analysing the results of the data. AA drafted the first version of the manuscript, and AL revised and approved the final version. JM contributed to project conceptualisation and design, advised on data collection methods and was involved in critical revision of the article and approval of the final version to be submitted. SS contributed to project conceptualisation including defining the research question and was involved in critical revision of the article and approval of the final version to be submitted.
Competing interests None declared.
Ethics approval Ethical approval was obtained both from UCL and from the study hospital.
Provenance and peer review Not commissioned; externally peer reviewed.