The main body of this book is devoted to the articulation of a new evaluation paradigm, which promises greater validity and utility from the findings of evaluation studies. The authors call this new approach `realistic evaluation'. The name reflects the paradigm's foundation in scientific realist philosophy, its commitment to the idea that programmes deal with real problems rather than mere social constructions, and its primary intention, which is to inform realistic developments in policy making that benefit programme participants and the public. Ray Pawson and Nicholas Tilley argue with passion that scientific evaluation requires a careful blend of theory and method, quality and quantity, ambition and realism.
The book offers a complete blueprint for evaluation activities, running from design to data collection and analysis to the cumulation of findings across programmes and onto the realization of research into policy. The argument is developed using practical examples throughout and is grounded in the major fields of programme evaluation.
This book will be essential reading for all those involved in the evaluation process especially those researchers, students and practitioners in the core disciplines of sociology, social policy, criminology, health and education.
`This book is a must for those engaged in the field, providing a fully illustrated text on evaluation with numerous examples from the criminal justice system. Unusually, it offers something for the academic, practitioner and student alike. I found Pawson and Tilley's latest work on evaluation an enjoyable and informative read. For myself their "realistic evaluation" clarified and formalised a jumbled set of ideas I had already been developing. Although not everyone will agree with the methodology proposed by the authors, this book is a valuable read as it will cause most of us at least to review our methodological stance' - International Journal of Police Science and Management
`This is an engaging book with a strong sense of voice and communicative task. The voice is sometimes strident, but always clear. Its communicative qualities are evident equally in its structure: lots of signposting for the reader within and across chapters' - Language Teaching Research
`This provocative, elegant and highly insightful book focuses on the effective incorporation of actual practice into the formulation of evaluation methodology. What a pleasure to read sentences like: "The research act involves "learning" a stakeholder's theories, formalizing them, and "teaching" them back to that informant who is then in a position to comment upon, clarify and further refine the key ideas". Pawson and Tilley have given us a wise, witty and persuasive account of how real practitioner experience might be encouraged to intrude on (and modify) researchers' concepts about program processes and outcomes. This holds important promise for achieving something that is devoutly to be wished: closer interaction among at least some researchers and some policy makers' - Eleanor Chelimsky, Past-President of the American Evaluation Association
`This is a sustained methodological argument by two wordly-wise social scientists. Unashamedly intellectual, theoretically ambitious yet with a clear but bounded conception of evaluation. It is articulate, occasionally eloquent and always iconoclastic, whilst eschewing "paradigm wars". The Pawson and Tilley "realist" call to arms threatens to take no prisoners among experimentalists, constructivists or pluralists. It is the kind of book that clarifies your thoughts, even when you disagree with everything they say' - Elliot Stern, The Tavistock Institute
Given my job title, it will come as no surprise that my main interest lies in research methodology. This does not quite bracket me with the technical nerds, however, for I have written widely on the philosophy and practice of research, covering methods qualitative and quantitative, pure and applied, contemporaneous and historical. There is a common 'realist' thread underlying every word, albeit a modest, middle-range, empirically-rich kind of realism.
Nick Tilley is a professor in the UCL Department of Security and Crime Science, Emeritus Professor of Sociology at Nottingham Trent University, and an adjunct professor at the Griffith Criminology Institute in Brisbane. His academic work has been devoted to developing and delivering theoretically informed applied social science. Specific interests lie in evaluation methodology, the international crime drop, problem-oriented policing, and situational crime prevention, about all of which he has published extensively. Books include Realistic Evaluation (1997, with Ray Pawson); Crime Prevention (2009); Economic Analysis and Efficiency in Policing. Criminal Justice and Crime Prevention: What Works? (2016, with Matthew Manning, Shane Johnson, Gabriel Wong, and Margarita Vorsina); and Reducing Burglary (2018, with Andromachi Tseloni and Rebecca Thompson). Nick was awarded an OBE for Services to Policing and Crime Reduction in 2005 and elected a Fellow of the Academy of Social Sciences (FAcSS) in 2009.
This is the consensual starting point for Ray Pawson's latest foray into the world of evaluative research. But this is social science after all and harmony prevails only in the first chapter. Thereafter, Pawson presents a devastating critique of the dominant approach to systematic review - namely the 'meta-analytic' approach as sponsored by the Cochrane and Campbell collaborations. In its place is commended an approach that he terms 'realist synthesis'. On this vision, the real purpose of systematic review is better to understand programme theory, so that policies can be properly targeted and developed to counter an ever-changing landscape of social problems.
The book will be essential reading for all those who loved (or loathed) the arguments developed in Realistic Evaluation (Sage, 1997). It offers a complete blueprint for research synthesis, supported by detailed illustrations and worked examples from across the policy waterfront. It will be of especial interest to policy-makers, practitioners, researchers and students working in health, education, employment, social care, criminal justice, regeneration and welfare.
• Your students will learn the practical aspects of evaluating research, not just how to apply a laundry list of technical terms from their textbooks.
• Each chapter is organized around evaluation questions. For each question, there is a concise explanation of how to apply it in the evaluation of research reports.
• Numerous examples from journals in the social and behavioral sciences illustrate the application of the evaluation questions. Students see actual examples of strong and weak features of published reports.
• Commonsense models for evaluation combined with a lack of jargon make it possible for students to start evaluating research articles the first week of class.
• The structure of this book enables students to work with confidence while evaluating articles for homework.
• Avoids oversimplification in the evaluation process by describing the nuances that may make an article publishable even though it has serious methodological flaws. Students learn when and why certain types of flaws may be tolerated. They learn why evaluation should not be performed mechanically.
• This book received very high student evaluations when field-tested with students just beginning their study of research methods.
• Contains more than 60 new examples from recently published research. In addition, minor changes have been made throughout for consistency with the latest edition of the Publication Manual of the American Psychological Association.