Research
Background to the study
The Incredible Years (IY) programmes were developed by Professor Carolyn Webster-Stratton (University of Washington, Seattle) as early prevention programmes that children, parents and teachers of young children can use to promote social, emotional, and academic competence. These programmes have been rigorously researched over the last 30 years - mainly in the US - using a number of Randomised Controlled Trials, with positive results, which have been replicated by independent researchers. However, there is a need to develop a robust evidence base within Ireland in order to inform the implementation of the IY programme and to influence the appropriate allocation of funding.
The principal aims of the study are:
- to assess the effectiveness of the BASIC Preschool/Early School Years Parent Training programme on children (between the ages of 3-8 yrs) and on parent behaviour;
- to consider the impact of the Teacher Classroom Management (TCM) programme on child behaviour;
- to assess the combination of Parent, Teacher and Child training on child, teacher and parent behaviour (and child school performance);
- to examine the cost-effectiveness of each of the above; and
- to monitor and appraise all aspects of the implementation of the programme (including implementation fidelity).
The key research questions which flow from the above aims and objectives are as follows:
- To what extent does the Incredible Years programme, or parts thereof, lead to improvements in the behaviour and competencies of young children (aged 3-8 years)?
- How effective is the programme in improving parental well being and parental and teacher skills and competencies?
- To what extent are any improvements maintained over time?
- Do some elements of the programme work better than others (either singly or in combination)?
- How cost-effective is the programme?
- How do the results compare with previous work undertaken both in the US and elsewhere including the UK?
- What are the experiences of key stakeholders (eg. participants and facilitators) and which factors facilitate or inhibit the effective implementation of the programme?
- Are there any problems or issues in delivering the programme which are peculiar to an Irish context?
Design and methodology
The research will be conducted and completed over an approximate three-year period. As the evaluation will need to reflect the community or ‘real world’ setting in which it is conducted, a Randomised Controlled Trial (RCT) methodology will be employed. A randomised control trial (RCT) is the ‘gold standard’ and one of the most commonly reported methods for evaluating the effectiveness of different types of interventions or treatments. RCTs are essentially a bias-free method of assigning participants to either a ‘control’ or ‘experimental’, group. This ensures that both groups are 'statistically equivalent’ enabling valid conclusions to be drawn regarding the effect of a treatment or intervention (in this case, the Incredible Years programme) on the experimental group.
The primary focus of the evaluation is a multi-site, longitudinal follow-up study incorporating three RCTs which will consider the impact of: (1) BASIC Preschool/Early School Years Parent Training programme; (2) the Teacher Classroom Management (TCM) training; and (3) a combination of BASIC parent, TCM and child (small group DINA) training respectively. In each RCT, participants will be assessed at baseline (i.e. before they receive the intervention) and then again six and 12 months later. The waiting list control group will receive the training after 6 months. The fieldwork during each trial will involve the administration of a battery of questionnaires, stakeholder interviews, home and school visits, one-on-one sessions with parents, and the observation of both parents in the home and teachers and children in the classroom.
A brief outline of the research 2008 - 2010
Year 1 (2008): An evaluation of the Incredible Years BASIC Preschool/Early School Years Parent Training programme will be conducted with a sample of approximately 145 parents who have been allocated randomly to control and experimental groups. This trial will assess the impact of the BASIC Preschool/Early School Years Parent Training programme primarily on child outcomes as well as parental skills.
Year 2 (2009): an evaluation of The Incredible Years Teacher Classroom Management Training Programme will be carried out in up to 12 schools in the Limerick area. The teachers in each school will be randomly allocated to control and experimental groups. This trial will assess the extent to which the Teacher Classroom Management (TCM) training has an effect on teacher behaviour and overall classroom management, in addition to child behaviour in the classroom.
Year 3 (2010); An evaluation of the combined Incredible Years Parent, Teacher and Child Training Programmes will be conducted (insofar as possible) using parents, teachers and children who have been randomly allocated to control and experimental groups. This third and most complex trial will explore the combined effect of parent, teacher and child training on both the school performance and behaviour of the participating children as well as the impact of all training on parents’ and teachers’ behaviour.
The national evaluation will also include two important additional elements including: (1) two smaller qualitative sub-studies on the process and experience of implementing the IY parent and teacher training programmes amongst a sample of key stakeholders in Ireland; and (2) an economic evaluation based on a cost-effectiveness analysis for each of the above trials.
