Realist evaluation framework is particularly suited for unpacking how contextual factors and intervention mechanisms or processes influence the outcome [23, 25]. Ethnographic methods comprising participant observation, interviews, and focus groups were employed over 15 weeks in the field. The nature, presentation and use of findings from realist evaluation 6. Programme theory (ideas and assumptions of how a particular intervention works) development is the first step in a realist evaluation or a realist synthesis, with literature reviews providing important evidence to support this. Realist impact evaluation is an approach to impact evaluation that emphasises the importance of context for programme outcomes. A REALIST EVALUATION OF THE PROCESSES AND OUTCOMES OF INFANT MASSAGE PROGRAMS ANGELA UNDERDOWN University of Warwick RHONDA NORWOOD Louisiana State University JANE BARLOW University of Warwick ABSTRACT: The sensitivity of early interactions conveyed through eye contact, voice tone, facial expression, and gentle touch plays a crucial role in … Contents: Introduction 1. Methods: This study was designed as a realist evaluation. • Realist evaluation is useful when we don’t yet understand how, why and for whom programmes work/don’t work… And when we want to know how to adapt a programme to new contexts and new people 4 . < i> Realistic evaluation: by Ray Pawson and Nick Tilley, Sage Publications, 1997, 235 pp In 2018, the Realist Evaluation Learning Group was formed to discuss and reflect on Itad’s experiences and distil what has been learned along the way.2 This paper presents examples and lessons from four evaluations: BCURE (2013–18). Consider, in some detail, five principles of realist methodology, which may be applied to research practice including evaluation. Realist evaluation is a largely qualitative approach to developing, testing and refining ideas or theories about the effectiveness of certain interventions or programs in the real world.12 Drawing on the philosophical position of realism, the realist evaluation approach focuses particular attention on … We have organized the article in four main sections. Thus, its focus is on not just whether or not a programme such as an NZ regional DHB grouping ‘works’ but how, for whom and in what contexts it ‘works’. This means understanding what works, in which circumstances, and for whom. Realist evaluation uses a theory-driven approach to evaluate healthcare or social programmes. The theory is then translated into CMO terminology. In this cycle, the first step is to understand the formal theory upon which the programme is based. Realistic Evaluation, Pawson & Tilley, 2001), focussing on the identification of processes and contexts supportive of reflective practice, would contribute to the development of knowledge in the field. 87, No. 1999); the evaluation researchers Pawson and Tilley (1997; Pawson, 2006) and Henry, Julnes, and Mark (1998; Mark, Henry, & Julnes, 2000); and the quali- tative researchers Huberman and Miles (1985; Miles & Huberman 1994) and Hammersley (1992a, 1998, 2002, 2009). In addition, to aid explan-ation we have used a hypothetical smoking cessation programme to illustrate the issues that we discuss. Lastly, substantive theory feeds realist evaluation with clues on the mechanisms (e.g. Realist evaluation itself is a particular evaluation theory. Basic concepts in the explanation and understanding of programmes 3. Keywords: Realist evaluation, context and mechanisms, curriculum evaluation, curriculum model, realist program theory, formal theory in realist evaluation, curriculum model abstract Realist evaluation is based on the premise that aspects of context trigger particular mechanisms in response to an intervention, which result in observable outcomes. current realist evaluation position is weak, and discuss the methodological consequences of taking a critical realist approach to them. In stage 1, … How Do You Modernize a Health Service: a Realist Evaluation of Whole-Scale Transformation in London The Milbank Quarterly, Vol. (2011) provide a typical example. Realist Evaluation develops a particular kind of programme theory, structured as Context- Mechanism-Outcome Configuration (CMOCs). TCAT is a five year programme funded by Macmillan Cancer Support. The information gathered was analysed in accordance with realist evaluation methodology. Routine communication is beneficial to verify data, share concerns and check risk; however, ongoing partnership working can foster assurance. … Realist methodologies are increasingly being used to evaluate complex interventions in health and social care. Realist evaluation 24 is a theory-driven evaluation approach 25 used to understand how, for whom and in what circumstances an intervention ‘works’ to produce intended outcomes. Figure 2: the Realist evaluation cycle. It is based on a philosophy (realism), and is primarily concerned with identifying causal mechanisms. Realist evaluation is an approach within theory-driven evaluation [29]. Interviews were held with staff from the SN teams and managers, both on an individual basis and in groups. The second realist evaluation study explore: How, why, and for whom a community engagement intervention (titled Community Conversations [CCs]) influences behavior change communication for health within Marsabit, Kenya. Kazi et al. The second step is to develop CMO hypotheses that the evaluator thinks should be tested. Realism's place in the policy cycle: formative, summative and synthetic approaches 5. 7. Realist evaluation follows a cycle as shown in figure 2: 9 . Why choose realist evaluation? realist evaluation is a specific type of theory-based evaluation. This realist evaluation (RE) is located within a 5 year na-tional programme of Transforming Care After Treat-ment in Scotland (TCAT) [24, 25]. While standardised approaches are implemented, interventions need to be contextually proportionate. Methods/design: This mixed method realist evaluation will develop theories about the relationship between the context, mechanisms and outcomes of the diabetes programme. 391–416) Paper by Trisha Greenhalgh about applying realist evaluation to understand a range of factors supporting change across four large health care organisations and their delivery of three areas of health services. Where relevant to our discussions we highlight instances of later refi nements. Presented at the Founding Conference of the Danish Evaluation Society, September 2000 Thank you very much for inviting me to speak at the Inaugural Conference of the Danish Evaluation Society. This second evaluation involves conducting four case studies, each one involving one CC group, from initiation to completion of a behavior change … The second report (Chapter 3) provides an account of an illuminative small scale research study. conduct of the qualitative interview within a realist evaluation research study, and it will focus exclusively on Pawson’s approach to realist qualitative interviewing. 3. I hope that your Society thrives and that you spend some time working out ways in which evaluation can best serve the needs of your communities. Conclusions This realist evaluation substantiates the literature and reveals deeper understandings about quality assuring medical education. Realist evaluation is avowedly theory-driven; it searches for and refines explanations of programme effectiveness. 2, 2009 (pp. Participant recruitment occurred through purposive and theoretical sampling of children and parents participating in the Local Environment Model intervention at Beitostolen Healthsports Centre in Norway. This realist evaluation protocol sets out the approach that will be used to identify and explain which aspects of the programme are working, for whom and in what circumstances to produce the outcomes intended. The nature of programmes and how they work 2. Can provide generalisable insights on how to scale a programme up or roll it out to different contexts, therefore provides findings with external validity. For us, this means that what manifests in terms of CBPR process and outcomes can be understood in terms of layers of reality. One can find, however, several self-professed realist studies that lack this essential process. The reader should note, additionally, that there are several approaches to realist evaluation (e.g., Henry, Julnes, and Mark, 1998) and to qualitative research (e.g., Hammersley, 1992, 2008; Maxwell, 2012, 2013). Propositions 1-3 . 1998) and Realistic Evaluation (Pawson and Tilley, 1997). This makes it particularly suitable for evaluations of certain topics and questions – for example, complex interventions and programmes that involve human decisions and actions. Briefly consider a realist research design. Strategies and methods of realist evaluation 4. Realist evaluation acknowledges ‘ontological depth’, [24]. Realist Research and Evaluation FIVE DAY INTENSIVE WORKSHOP 30 September - 4 October 2019 (La Trobe University, Melbourne) _____ This intensive workshop will introduce participants to the philosophical assumptions of a realist philosophy of science and their implications for understanding how policies and programs work. Realist evaluation is a theory-driven approach, rooted in a realist philosophy of science, which emphasises an understanding of causation and how causal mechanisms are shaped and constrained by context. This introduction will help evaluators and commissioners of evaluations to decide whether a realist approach is appropriate for evaluating the impact of … Realistic evaluation: by Ray Pawson and Nick Tilley, Sage Publications, 1997, 235 pp The evaluation traces the outcome patterns associated with a care coordination programme called ‘Wraparound’. REALIST EVALUATION •Drawn from Pawson and Tilley’s ’Realistic Evaluation’ (1997) •Realism is a school of philosophy and sits between positivism and constructivism •A member of the family of theory-based evaluation approaches - start by clarifying the ‘program theory’