Table 2

Implementation and process evaluation key elements and research questions within Better Start Bradford

Areas to measureGeneral process questionsExample data collection methodExample data
(a) Content
(fidelity)
Was the intervention delivered as planned?Quarterly monitoring data submitted by intervention teams
Observation of intervention delivery
Qualitative interviews with staff/facilitators
Eg, average staff caseload, content of each course session and adherence to manual (for manualised interventions)
(b) Frequency/duration (dosage, dose delivery)What was the duration and frequency of support received by each family?
What proportion of families completed an intervention? (as per the definition of completion agreed during service design for each intervention)
Quarterly monitoring data submitted by intervention teamsDate of each visit/attendance
Duration of visit (where applicable)
(c) Reach (coverage)What were the demographic characteristics of families referred and taking up support from each intervention?
What were the characteristics of volunteers (where intervention delivered by volunteers or peer supporters)
Quarterly monitoring data submitted by intervention teams Sociodemographic background data on parents including ethnicity, gender, language spoken, religion, disability, number and age of children
Reason for referral, referral source
Sociodemographic data on volunteers including gender, ethnicity, languages spoken, appointment start and end dates
(d) Participant responsivenessWere parents satisfied with the support they received? How did parents perceive the impact of the intervention for example, which elements did they find to be most helpful and unhelpful in meeting their needs?
What proportion of parents accessed further support?
How did staff/volunteers perceive the impact of the intervention?
Questionnaire survey and/or qualitative interviews with parents
Quarterly monitoring data submitted by intervention teams
Interviews or focus groups with staff/volunteers
Questionnaire for parents to measure satisfaction
Qualitative interviews with parents exploring satisfaction
Number and type of referrals made to external agencies
(e) RecruitmentWhat recruitment procedures were used to engage families and staff?
Did the intervention recruit to target (targets as agreed in service design)?
What constituted barriers to maintaining involvement of individuals?
Quarterly monitoring data submitted by intervention teams
Qualitative interviews with parents including
Qualitative interviews or focus groups with staff/volunteers
Analysis of quarterly/annual reports
Dates of all engagement activities
Type of activity
Setting/location
Target audience and numbers
No of staff/volunteers present
No of parents/children engaged/attended
Target no of staff and volunteers recruited and trained
Target no of families supported per year
Actual no of families supported per year
Reasons for drop-out/non-completion/unplanned ending, service declined
Key challenges of implementation and corresponding action plans
(f) Strategies to facilitate implementationWhat proportion of parents completed the intervention?
What are the key factors that enabled or were barriers to engagement and completion of intervention?
Quarterly monitoring data submitted by intervention teams
Qualitative interviews with parents
Qualitative interviews or focus groups with staff/volunteers
Date of each visit/attendance
(g) ContextWhat factors at political, economical, organisational and work group levels affected the implementation?Qualitative interviews or focus groups with staff/volunteers
Analysis of quarterly/annual review reports
Meeting minutes and diary of local/national initiatives