Realist reviews in medicine

From HLWIKI Canada
Jump to: navigation, search
For more information about realist reviews, see: Pawson & Tilley, 2004
Are you interested in contributing to HLWIKI International? contact: dean.giustini@ubc.ca

To browse other articles on a range of HSL topics, see the A-Z index.

Contents

Last Update

  • Updated.jpg 31 August 2017

Keywords

  • critical realist methodology, realist methodology, realist evaluation, realist synthesis/reviews
  • See also: rapid review, rapid realist review, rapid approach, rapid synthesis, meta-method, meta-evaluation, rapid evidence assessment, expedited review, accelerated review and realist review

Introduction

See also Evidence-based health care | Expert searching | Hand-searching | Network meta-analysis | Positivism | Systematic review searching | Systematic narrative review methods

"..[the] realist review is a theory-driven interpretive approach to evidence synthesis. [As such] it applies realist logic of inquiry to produce an explanatory analysis of an intervention that is, what works, for whom, in what circumstances, in what respects. The search strategy will have a number of phases including a combination of: (1) electronic database searching, for example, EMBASE, MEDLINE, the Cochrane Library, ASSIA, (2) 'cited by' articles search, (3) citation searching, (4) contacting authors and (5) grey literature searching... — Brennan et al, 2014
"...the realist review was originally developed by Pawson, 2005 for complex social interventions to explore systematically how contextual factors influence the link between intervention and outcome
(summed up in the question "what works, how, for whom, in what circumstances and to what extent?")...
" — Greenhalgh et al, 2011
"...a realist review differs from empirically focused qualitative or quantitative methods in a number of ways, including its theory-driven and abductive (informed-intuitive) approach to understanding context, mechanism, and outcome..." — Jagosh et al, 2012

Realist reviews are a new form of knowledge synthesis that opens the ‘black box’ of an intervention by showing how it triggers mechanisms in specific contexts to produce outcomes. Their aim is to produce middle-range theories (MRTs) that specify how interventions work, for which populations, and under what circumstances (Pawson et al. 2005; Pawson 2006). MRTs (Merton 1968) are considered a suitable level of abstraction to maintain the operationality needed for applied research while producing cross-cutting lessons (Weick 1989; Hercot et al. 2011), especially on access to care (Dixon-Woods et al. 2006). Further, RRs are a way for researchers to examine the complexity of programs in medicine, and seek to understand "...what works, for who, in what circumstances and why" rather than providing one-off verdicts on the success or failure of a program (or intervention) (Pawson and Tilley 2007). There is growing interest in theory-driven, qualitative and mixed-method approaches to systematic reviews as an alternative to conventional Cochrane-style reviews. Realist reviews and evaluation offer the potential to expand the knowledge base in policy-relevant areas - for example by explaining the success, failure or mixed fortunes of complex interventions. Realist evaluation recognizes the value in drawing on a wide range of evidence, including qualitative research, grey literature and the insights of program staff. In each case it seeks to attend to the relative rigour of the data gathered, and looks for insights that will illuminate the theory of change, and as with other evaluation methods, triangulation across different kinds of evidence is vital for drawing relatively robust conclusions.

The term realist has a number of connotations in medicine. Researchers make distinctions among the types of scientific reviews that might be viewed as realist. Hammersley distinguishes ‘naïve realism’ and ‘subtle realism’ whereas Pawson and Tilley say ‘scientific realism’ is what is relevant in medicine. Holden uses realism in the way Hammersley uses it (‘naïve realism’) which some say is simply a form of positivism. ‘Subtle realism’, critical realism, scientific realism are all constructed to sit between positivism and constructivism. That said, a) words have many meanings, b) interpretations vary and evolve, and c) ‘there’s no such thing as final truth or knowledge’ (a realist tenet is that all knowledge is tentative). Thus there is no ‘correct’ description except as one might ensure that something can be understood by what one author is discussing at any one time. Finally there are at least two meanings for ‘stratified reality’; one of ‘systems within systems’ in that every system comprises sub-systems and is part of a larger system (regardless of whether one is discussing material reality, social reality or ideas); the other is Bhaskar’s philosophical construct of the empirical, the actual and the real. Both are thought to be necessary to understand the concept of realism.

Ray Pawson discusses 'realist reviews'

Pawson's Five (5) Practice Steps

Pawson’s five practical steps for conducting a realist review are:

  1. clarifying the scope of the review
  2. determining the search strategy, including adopting broad inclusion/exclusion criteria and purposive snowballing techniques
  3. ensuring proper article selection and study quality assessment using multiple methods, #extracting and organising data through the process of note taking, annotation and conceptualization and
  4. synthesizing the evidence and drawing conclusions through a process of reasoning.

Literature Searching for Realist Reviews

With respect to the search strategy in the realist review, Mogre et al (2014) suggest the following: "...A combination of MeSH/thesauri and free text terms will be employed in the search strategy. Truncation and appropriate Boolean operators will be employed. Scoping searches will be conducted to refine the search terms further...". For more background, see Literature searching for realist reviews. The Realist Hive blog. June 2014 and Literature searching for realist reviews (Simon Briscoe)

Realist reviews & their impact

This introduction to realist reviews was developed to help evaluators decide whether a realist impact evaluation is appropriate and feasible for a particular policy or program. It does rehash introductory material about realist approaches but also addresses more ‘applied’ questions and issues, such as

  • For what purposes is realist impact evaluation most appropriate?
  • In what circumstances is a realist approach more appropriate than other methods?
  • What circumstances make it easier to undertake a realist impact evaluation?
  • Understanding program theory and designing realist evaluations

The paper is available at either of the following:

Issues in realist reviews

  • As a researcher, if you have identified an outcome of interest, and worked back to understand the underlying mechanisms that have manifested within key contextual conditions, and identified and developed relevant (mid-range) theories to support your explanatory analysis, you have indeed used a realist review methodology; check your methods back against the Rameses standards and decide whether or not you have in fact modified them.
  • Realist reviews help to recognize the complex array of factors involved in production of interventions, but researchers are always working with partial knowledge so they are justified to pick one specific outcome and theorize the intervention around that outcome. Describe it clearly and provide your rationale.
  • A realist review does not have to be 'completely comprehensive'; emphasize the theoretical output of your work and how it contributes to cumulation of knowledge in the field over time; include a strong section on 'direction for future research' which can be informed by the results of your review. Transparency in your reporting is key.
  • Realist reviews do not necessarily flow from previous studies; usually SRs, for example, do not reveal the information needed to do a realist review
  • realist reviewers do not need to report all of a previous SR; report only what's relevant to the realist question under consideration
  • one question might be: For what aspect(s) of your rough theory of change does the previous review provide evidence?
  • What evidence does the previous review provide? Is it about outcomes? outcomes for whom? outcomes for particular contexts?
  • How does the evidence in the previous review 'fit' (or not) with the evidence from other sources? What analytical processes will you use to make sense of the relationship between that evidence and the evidence from other sources? (EG Pawson 2006, p 74-76: juxtaposing, reconciling, adjudicating, consolidating, situating)
  • How does the evidence from the previous review suggest that your rough theory should be refined?
  • If you can move towards answering these questions, you would better know 'where' in your synthesis the information from the previous review fitted, what information I'd be drawing from it, how to approach the analysis, and what it implied for your findings
  • Realist methodologies have been gaining ground in primary healthcare research and in other disciplines; it helps to think of RMs as 'scientific outlooks' rather than a set of methods which can really be applied to research questions in most disciplines.;
  • As you may know RMs are inspired by the philosophy of critical realism, and transformed into an applied form through the sociological expertise of Ray Pawson and Nick Tilley (1997) and by the realist research community. RMs are being applied innovatively in many fields.
  • Creating sustained change with RMs is a challenge because there is a complex host of factors that play into the success or failure of sustainability. A realist approach can support sense-making in understanding how sustainability is achieved, for whom, and under what circumstances/context.
  • For example, in linked Context-Mechanism-Outcome configurations, where outcomes from one phase create changes in another, there is a time sensitive analysis where 'ripple effects' create unexpected outcomes, all of which shape the nature and extent of sustainability in certain settings.

RAMESES Standards

The research into conducting a realist review in medicine and nursing is in a very fertile period. Meta-narrative reviews are one of the emerging approaches to qualitative and mixed-methods systematic reviews. A meta-narrative review seeks to illuminate a heterogeneous topic by highlighting contrasting and complementary ways researchers have studied the topic. The standards below will guide researchers according; according to the authors, no previous publication standards exist for the reporting of meta-narrative reviews. See also Systematic narrative review methods

  • This listserv is for researchers interested in learning about realist and meta-narrative reviews. The group hopes to build a community that enables peer-to-peer knowledge construction ultimately leading to a community of members with greater understanding and competence in undertaking these types of reviews. If you would like to join this list, please email Geoff Wong.

Realist Synthesis Training

Mendeley Group

Realist blog

  • Ongoing trials and tribulations of applying realist methods in primary research and research synthesis – aiming to promote understanding of the method and give insight into methodological developments.

References

  • Some examples of realist reviews published and indexed in PubMed...
  • Weick KE. Theory construction as disciplined imagination. Academy of Management Review. 1989;14:516–531.

Realist reviews in health informatics

  • Carrington JM. Meta-narrative to examine the purpose of the electronic health record. Communicating Nursing Research. 2011;44:535-535.
  • Danermark B, Ekstrom M, Jakobsen L. Explaining society: an introduction to critical realism in the social sciences. Routledge; 2001 Nov 22.
  • de Lusignan S. Informatics as tool for quality improvement: rapid implementation of guidance for the management of chronic kidney disease in England as an exemplar. Healthcare Informatics Research. 2013;19(1), 9-15.
  • Edgley A, Stickley T, Timmons S, Meal A. Critical realist review: exploring the real, beyond the empirical. J Further Higher Ed. 2014 Sep 28:1-5.
  • Ekeland AG, Bowes A, Flottorp S. Effectiveness of telemedicine: a systematic review of reviews. Int J Med Informatics. 2010;79(11):736-771.
  • Hebert MA. Realist Review approach to e-health: the case of type 2 diabetes in youth. Studies in Health Technology & Informatics. 2013;183:74-78.
  • Liaw ST, Rahimi A, Ray P, Taggart J, Dennis S, de Lusignan S. et al. Towards an ontology for data quality in integrated chronic disease management: a realist review of the literature. Int J Med Informatics. 82(1):10-24. Corrigendum in International Journal of Medical Informatics, 82(2), 139.
  • Otte-Trojel T, de Bont A, Rundall TG, van de Klundert J. How outcomes are achieved through patient portals: a realist review. J Am Med Inform Assoc. 2014 Jul-Aug;21(4):751-7.
  • Vichitvanichphong S, Talaei-Khoei A, Kerr D, Ghapanchi AH. Adoption of Assistive Technologies for Aged Care: A Realist Review of Recent Studies. 2014 47th Hawaii International Conference on System Sciences (Hicss), 2706-2715.
Personal tools
Namespaces

Variants
Actions
Navigation
Toolbox