Areas to measure | General process questions | Example data collection method | Example data |
(a) Content (fidelity) | Was the intervention delivered as planned? | Quarterly monitoring data submitted by intervention teams Observation of intervention delivery Qualitative interviews with staff/facilitators | Eg, average staff caseload, content of each course session and adherence to manual (for manualised interventions) |
(b) Frequency/duration (dosage, dose delivery) | What was the duration and frequency of support received by each family? What proportion of families completed an intervention? (as per the definition of completion agreed during service design for each intervention) | Quarterly monitoring data submitted by intervention teams | Date of each visit/attendance Duration of visit (where applicable) |
(c) Reach (coverage) | What were the demographic characteristics of families referred and taking up support from each intervention? What were the characteristics of volunteers (where intervention delivered by volunteers or peer supporters) | Quarterly monitoring data submitted by intervention teams | Sociodemographic background data on parents including ethnicity, gender, language spoken, religion, disability, number and age of children Reason for referral, referral source Sociodemographic data on volunteers including gender, ethnicity, languages spoken, appointment start and end dates |
(d) Participant responsiveness | Were parents satisfied with the support they received? How did parents perceive the impact of the intervention for example, which elements did they find to be most helpful and unhelpful in meeting their needs? What proportion of parents accessed further support? How did staff/volunteers perceive the impact of the intervention? | Questionnaire survey and/or qualitative interviews with parents Quarterly monitoring data submitted by intervention teams Interviews or focus groups with staff/volunteers |
Questionnaire for parents to measure satisfaction Qualitative interviews with parents exploring satisfaction Number and type of referrals made to external agencies |
(e) Recruitment | What recruitment procedures were used to engage families and staff? Did the intervention recruit to target (targets as agreed in service design)? What constituted barriers to maintaining involvement of individuals? | Quarterly monitoring data submitted by intervention teams Qualitative interviews with parents including Qualitative interviews or focus groups with staff/volunteers Analysis of quarterly/annual reports | Dates of all engagement activities Type of activity Setting/location Target audience and numbers No of staff/volunteers present No of parents/children engaged/attended Target no of staff and volunteers recruited and trained Target no of families supported per year Actual no of families supported per year Reasons for drop-out/non-completion/unplanned ending, service declined Key challenges of implementation and corresponding action plans |
(f) Strategies to facilitate implementation | What proportion of parents completed the intervention? What are the key factors that enabled or were barriers to engagement and completion of intervention? | Quarterly monitoring data submitted by intervention teams Qualitative interviews with parents Qualitative interviews or focus groups with staff/volunteers | Date of each visit/attendance |
(g) Context | What factors at political, economical, organisational and work group levels affected the implementation? | Qualitative interviews or focus groups with staff/volunteers Analysis of quarterly/annual review reports | Meeting minutes and diary of local/national initiatives |