Are you interested in contributing to HLWIKI International? contact Reviews of increasing complexity, from narrative reviews to systematic reviews... with complexity comes an increase in time & resources needed
To browse other articles on a range of HSL topics, see the A-Z index.
- 5 December 2014
See also Evidence-based health care | Question scans | Horizon scans | Scoping reviews | Snowballing | Systematic narrative review methods
"...Rapid reviews are increasingly undertaken in health care to meet the demands of decision-makers and clinicians, who ultimately need timely evidence to inform their decisions. Under time and resource constraints, scoping reviews may be a suitable alternative to the traditional systematic review (though it depends on the research question)...limited budgets to fund systematic reviews, may also increase pressure to fund a rapid review...."
"...Rapid evidence reviews are a resource-efficient way to identify and summarise the general characteristics, issues, data and knowledge gaps surrounding a problem. They aim to be rigorous, transparent and explicit in method, but make concessions for the timeliness and utility of the output, and thus are not full systematic reviews of the literature or wider evidence..." — Rand Corporation Paper, 2014
Rapid reviews (also rapid evidence reviews or rapid evidence assessments) are a type of accelerated systematic review that can be viewed, according to Khangura S et al, 2014, as part of a continuum of methodologies in assessing the evidence. In rapid reviews, you find common elements such as expert searching and the use of extended search techniques such as locating the grey literature. Rapid reviews are generally undertaken as evidence producers look at urgent (or emerging) needs (i.e., clinical urgency), new medical technologies and public policy. The RR is also critical in decision-making processes for politicians, public health policy experts and medical officials, who must use inclusive summaries of the evidence before they make their decisions.
The rapid review is a research methodology that uses shorter timeframes than for other evidence-based summaries. It provides a timely and valid view of evidence but sacrifices rigour. As such, RRs are both review and assessment, and respond to urgent clinical and public health-related questions. They aim to provide robust analyses of easily-retrievable evidence in less than six weeks (sometimes four weeks), typically requiring fewer resources and funding. Due to their rapid nature, the grey literature might not always be sought and preference may be given to the more readily available research published and written in English (introducing bias). In terms of methodology, rapid reviews follow most of the same principles of the systematic review but within a shorter time frame and in less detail. Some concessions are made in terms of methodological rigour in the rapid review. That said, RRs have their place in the field, and have gained favour in Canada, the United States and UK within the educational, government and policy sectors.
What is their value ?
According to the research, RRs are (re)appraisals of evidence that fall between health technology assessments (HTAs) and fully-developed systematic reviews. They are, in that sense, similar to scoping studies and question scans in the educational sector. RRs order the research similar to systematic reviews but meet shorter and urgent timelines, usually in two months or less. The prominence of evidence-based medicine and its principles have led some health organizations to develop more rapid methods for accessing, appraising and synthesizing evidence in health care. Typically this can be a slow and expensive process and should never be undertaken for issues that have been extensively written about or where the opposite is true: lack of convincing evidence. In any case, RRs may offer a suitable alternative to more systematic methods. One of the first steps is to find out what has been written and what is already known. Rigorous systematic review searching is needed for a range of academic and scientific disciplines. Health librarians and biomedical researchers should consider REA-type reviews to address the need to apply the evidence more quickly without the need to conduct a full systematic review.
Rapid 'cumulation' is critical but presents challenges
If the review is to be delivered in a shorter time frame or a smaller budget it may seem inevitable that it will no longer be able to remain transparent, rigorous, exhaustive and comprehensive. What are the implications of any shortcuts taken, and can we measure the their impact? Which methods might be adopted when undertaking a rapid review? What do funders such as CIHR want in a good rapid review? What is the balance between working smarter and short changing the process? How do you create a team that can work together more efficiently within a shorter timescale? These are a few of the questions that need to be answered in an era of expedited research reviews.
In a broader sense, rapid reviews are a result of the vast knowledge economy that has developed exponentially in recent decades. The number of publishing outlets and ease of publishing in the digital era is responsible for the information explosion in medicine. The sheer amount of evidence available, coupled with rapid growth of scholarly publishing and communication tools, make it difficult and time-consuming to cumulate all of the evidence on a topic. The problem of locating many separate and similar clinical studies has led to the creation of newer forms of knowledge management such as the rapid review. Despite the concerns expressed about its methodological shortcomings, the REA is widely-used in public policy and health technology assessment.
- Does your question seem to be of the type where qualitative methods and synthesis would work just as well? where several people are not required to work closely and iteratively with the sort of timescale only available to full systematic reviews?
- Is there a theoretical framework for structuring your evidence assessment? Any theory must be explicit and standardized (especially about interventions) to make predictions for specific implementations of interventions
- What is required are detailed descriptions of the context of any intervention (in a downloadable format, amenable to further processing), so that reviewers/end-users can make informed decisions as to relevance
- In an ideal world, end-users would be sufficiently literate that they could do the RRs themselves - or at least find their way around the literature. Some are, and workshops can 'build capacity.' But who knows if your 'evidence culture' is sufficient enought? Many organizations do not have the resources to do more than simple evaluations.
Health librarians' role in RRs
Reviewing evidence takes time and health librarians can use various techniques to help their clients. One of the key questions for health librarians is how to assist researchers in the process of planning and carrying out research, and whether rapid assessments meet their needs. This requires a range of skills, knowledge and abilities on the part of the attending health librarian, and includes topics as diverse as understanding the challenges of information retrieval in a fragmented literature and the trends associated with finding the grey literature.
See CADTH's suggested timelines for rapid reviews
To enhance an RR's transparency, documents can be designed and used to guide the process, such as:
- explicit and documented search strategies
- assessment protocols (design statements outlining key criteria for review)
- regular, periodic assessments during and after the fact
Search strategies must be documented and used to guide searching in order to:
- access research using web-based search tools and databases, informed by a range and combination of search terms
- pursue particular sources suggested by librarians and colleagues
- respond to requests to locate grey literature, unpublished or less widely-circulated papers and reports
Search strategies identify the range of search approaches, terms and resources that were used. Searching generates a list of potentially relevant sources, from which researchers are able to focus on their own ideas and questions.
Elements of RRs
Usually a review of the academic, grey and practitioner literature includes the following five steps:
- Design and conceptual clarification of rapid review
- Purposeful evidence-based searching, and gathering of evidence
- Assessment of what is known about policy
- A critical appraisal of existing research which is "time-limited" (for relevance; then full assessment)
- Validation and discussion among experts
- Preparation of interim assessment, and final report
In addition, search the online and print literature as comprehensively as possible and do the following;
- Collate descriptive outlines of the available evidence
- Critically appraise evidence (including an economic appraisal)
- Sift out studies of poor quality
- Provide overview of what the evidence is saying
- Quantities of literature and overall quality/direction of literature (Davies, 2003, p.18-19)
Major review types
See CADTH's suggested timelines for rapid reviews
- Narrative, selective review (not systematic); collates relevant studies and draw conclusions from them
- Time required to complete: 1 week to 2 months
Quick scoping review
- Quick overview of research undertaken on a (constrained) topic (not systematic)
- Time required to complete: 1-2 weeks to 2 months
- Systematic search but a quick overview of existing research on a topic
- Synthesis of evidence provided by these studies to answer the REA question
- Time required to complete: 2 to 6 months (quicker than systematic review)
- Systematic. A broad review of existing research on a topic and synthesis of the evidence provided by these studies to answer the review question.
- Time required to complete: 8 to 12 months minimum
Multi-arm systematic review
- Systematic. Full map and synthesis of different types of evidence to answer the review question
- Time required to complete: 12 months minimum
Review of reviews
- Systematic. Same as any of the above methods but only includes reviews of other reviews
- Time required to complete: Often quicker than other types of full systematic review
- Arksey H, O'Malley L. Scoping studies: towards a methodological framework. Int J Social Research Methodology. 2005;8(1):19-32.
- Bambra C, Joyce KE, Bellis MA, et al. Reducing health inequalities in priority public health conditions: using rapid review to develop proposals for evidence-based policy. Journal of public health (Oxford, England). Dec 2010;32(4):496-505.
- Cameron A. Rapid versus full systematic reviews: an inventory of current methods and practice in health technology assessment. ASERNIP-S Report No. 60; 2007.
- Chalmers I. Trying to do more good than harm in policy and practice: the role of rigorous, transparent, up-to-date evaluations. Ann Am Acad Politic Social Sci. 2003;589:22-40.
- Davies P. Rapid evidence assessment: a tool for policy making. Government Social Research: London, 2004. http://www.gsr.gov.uk/new_research/archive/rae.asp
- Ganann R, Ciliska D, Thomas H. Expediting systematic reviews: methods and implications of rapid reviews. Implement Sci. 2010;5:56.
- Goodall DL, Marples G. Approaches to producing credible and useful literature reviews. Cancer Nurs Pract. 2013;12(3).
- Grant MJ, Booth A. A typology of reviews: an analysis of 14 review types and associated methodologies. Health Info Libr J. 2009 Jun;26(2):91-108.
- Grindrod K, Forgione A, Tsuyuki RT, Gavura S, Giustini D. Pharmacy 2.0: a scoping review of social media use in pharmacy. Res Social Adm Pharm. 2013 Jun 27.
- Harker J, Kleijnen J. What is a rapid review? A methodological exploration of rapid reviews in Health Technology Assessments. Int J Evid Based Healthc. 2012 Dec;10(4):397-410.
- Haynes RB, Wilczynski N, McKibbon KA et al. Developing optimal search strategies for detecting clinically sound studies in Medline. JAMIA. 1994;1:447-59.
- Higgins JPT, Green S. Cochrane Handbook for Systematic Reviews of Interventions. Cochrane Library, 2006. Chichester, UK: John Wiley & Sons, Ltd.
- Hunt DL, McKibbon KA. Locating and appraising systematic reviews. Ann Intern Med. 1997;126:532–8.
- Jahangirian M, Eldabi T, Garg L, et al. A rapid review method for extremely large corpora of literature: Applications to the domains of modelling, simulation, and management. International Journal of Information Management. 2011;31(3):234-243.
- Institute of Medicine (IOM). Clinical Practice Guidelines We Can Trust. 2011.
- Khangura S et al. Rapid review: an emerging approach to evidence synthesis in health technology assessment. Int J Tech Assess Health Care. 2014: 1-8.
- Khangura et al. Evidence summaries: the evolution of a rapid review approach. Systematic Reviews. 2012;1:10.
- Pawson R et al. Realist review: a new method of systematic review designed for complex policy interventions. J Health Serv Res Policy. 2005;10(S1):21–34.
- Relevo R, Paynter R. Peer review of search strategies. Methods Research Report. Prepared by the Oregon Evidence-based Practice Center under contract 290-2007-100572. AHRQ Publication 12-EHC068-EF. Rockville, MD: Agency for Healthcare Research and Quality. June 2012.
- Rotstein D. Differences between systematic reviews and health technology assessments: a trade-off between the ideals of scientific rigor and the realities of policy making. Int J Technol Assess Health Care. 2004;20(2):177-83.
- Schünemann H, Hill S, Kakad M, et al. WHO Rapid Advice Guidelines: quick and transparent. PLoS Med. 2007;4:e119.
- Shojania KG, Sampson M. How quickly do systematic reviews go out of date? A survival analysis. Ann Intern Med. 2007;147(4):224-33.
- Thomas J, et al. Rapid evidence assessments of research to inform social policy: taking stock and moving forward. Evidence & Policy: A Journal of Research, Debate and Practice. 2013;9(1):5-27.
- United Kingdom. Civil Service. Rapid Evidence Assessment Toolkit - How to do an REA. London, England. 2010
- Uman LS. Systematic reviews and meta-analyses. J Can Acad Child Adolesc Psychiatry. 2011;20(1):57-9.
- United Kingdom. Rapid Evidence Assessment Toolkit index (Civil Service).
- Warren V. Health technology appraisal of interventional procedures: comparison of rapid and slow methods. J Health Serv Res Policy. 2007;12:142-46.
- Watt et al. Rapid versus full systematic reviews: validity in clinical practice? Anz J Surg. 2008;78:1037–40.