Rapid reviews

From HLWIKI Canada
Jump to: navigation, search
Reviews of increasing complexity, from narrative reviews to systematic reviews... with complexity comes an increase in time & resources needed
Are you interested in contributing to HLWIKI International? contact: dean.giustini@ubc.ca

To browse other articles on a range of HSL topics, see the A-Z index.

Contents

Last Update

  • Updated.jpg 5 December 2014

Introduction

See also Evidence-based health care | Question scans | Horizon scans | Scoping reviews | Snowballing | Systematic narrative review methods

"...Rapid reviews are increasingly undertaken in health care to meet the demands of decision-makers and clinicians, who ultimately need timely evidence to inform their decisions. Under time and resource constraints, scoping reviews may be a suitable alternative to the traditional systematic review (though it depends on the research question)...limited budgets to fund systematic reviews, may also increase pressure to fund a rapid review...."
"...Rapid evidence reviews are a resource-efficient way to identify and summarise the general characteristics, issues, data and knowledge gaps surrounding a problem. They aim to be rigorous, transparent and explicit in method, but make concessions for the timeliness and utility of the output, and thus are not full systematic reviews of the literature or wider evidence..."Rand Corporation Paper, 2014

Rapid reviews (also rapid evidence reviews or rapid evidence assessments) are a type of accelerated systematic review that can be viewed, according to Khangura S et al, 2014, as part of a continuum of methodologies in assessing the evidence. In rapid reviews, you find common elements such as expert searching and the use of extended search techniques such as locating the grey literature. Rapid reviews are generally undertaken as evidence producers look at urgent (or emerging) needs (i.e., clinical urgency), new medical technologies and public policy. The RR is also critical in decision-making processes for politicians, public health policy experts and medical officials, who must use inclusive summaries of the evidence before they make their decisions.

The rapid review is a research methodology that uses shorter timeframes than for other evidence-based summaries. It provides a timely and valid view of evidence but sacrifices rigour. As such, RRs are both review and assessment, and respond to urgent clinical and public health-related questions. They aim to provide robust analyses of easily-retrievable evidence in less than six weeks (sometimes four weeks), typically requiring fewer resources and funding. Due to their rapid nature, the grey literature might not always be sought and preference may be given to the more readily available research published and written in English (introducing bias). In terms of methodology, rapid reviews follow most of the same principles of the systematic review but within a shorter time frame and in less detail. Some concessions are made in terms of methodological rigour in the rapid review. That said, RRs have their place in the field, and have gained favour in Canada, the United States and UK within the educational, government and policy sectors.

What is their value ?

According to the research, RRs are (re)appraisals of evidence that fall between health technology assessments (HTAs) and fully-developed systematic reviews. They are, in that sense, similar to scoping studies and question scans in the educational sector. RRs order the research similar to systematic reviews but meet shorter and urgent timelines, usually in two months or less. The prominence of evidence-based medicine and its principles have led some health organizations to develop more rapid methods for accessing, appraising and synthesizing evidence in health care. Typically this can be a slow and expensive process and should never be undertaken for issues that have been extensively written about or where the opposite is true: lack of convincing evidence. In any case, RRs may offer a suitable alternative to more systematic methods. One of the first steps is to find out what has been written and what is already known. Rigorous systematic review searching is needed for a range of academic and scientific disciplines. Health librarians and biomedical researchers should consider REA-type reviews to address the need to apply the evidence more quickly without the need to conduct a full systematic review.

Rapid 'cumulation' is critical but presents challenges

If the review is to be delivered in a shorter time frame or a smaller budget it may seem inevitable that it will no longer be able to remain transparent, rigorous, exhaustive and comprehensive. What are the implications of any shortcuts taken, and can we measure the their impact? Which methods might be adopted when undertaking a rapid review? What do funders such as CIHR want in a good rapid review? What is the balance between working smarter and short changing the process? How do you create a team that can work together more efficiently within a shorter timescale? These are a few of the questions that need to be answered in an era of expedited research reviews.

In a broader sense, rapid reviews are a result of the vast knowledge economy that has developed exponentially in recent decades. The number of publishing outlets and ease of publishing in the digital era is responsible for the information explosion in medicine. The sheer amount of evidence available, coupled with rapid growth of scholarly publishing and communication tools, make it difficult and time-consuming to cumulate all of the evidence on a topic. The problem of locating many separate and similar clinical studies has led to the creation of newer forms of knowledge management such as the rapid review. Despite the concerns expressed about its methodological shortcomings, the REA is widely-used in public policy and health technology assessment.

Considerations

  1. Does your question seem to be of the type where qualitative methods and synthesis would work just as well? where several people are not required to work closely and iteratively with the sort of timescale only available to full systematic reviews?
  2. Is there a theoretical framework for structuring your evidence assessment? Any theory must be explicit and standardized (especially about interventions) to make predictions for specific implementations of interventions
  3. What is required are detailed descriptions of the context of any intervention (in a downloadable format, amenable to further processing), so that reviewers/end-users can make informed decisions as to relevance
  4. In an ideal world, end-users would be sufficiently literate that they could do the RRs themselves - or at least find their way around the literature. Some are, and workshops can 'build capacity.' But who knows if your 'evidence culture' is sufficient enought? Many organizations do not have the resources to do more than simple evaluations.

Health librarians' role in RRs

Reviewing evidence takes time and health librarians can use various techniques to help their clients. One of the key questions for health librarians is how to assist researchers in the process of planning and carrying out research, and whether rapid assessments meet their needs. This requires a range of skills, knowledge and abilities on the part of the attending health librarian, and includes topics as diverse as understanding the challenges of information retrieval in a fragmented literature and the trends associated with finding the grey literature.

See CADTH's suggested timelines for rapid reviews

RR components

To enhance an RR's transparency, documents can be designed and used to guide the process, such as:

  • explicit and documented search strategies
  • assessment protocols (design statements outlining key criteria for review)
  • regular, periodic assessments during and after the fact

Search strategies must be documented and used to guide searching in order to:

  • access research using web-based search tools and databases, informed by a range and combination of search terms
  • pursue particular sources suggested by librarians and colleagues
  • respond to requests to locate grey literature, unpublished or less widely-circulated papers and reports

Search strategies identify the range of search approaches, terms and resources that were used. Searching generates a list of potentially relevant sources, from which researchers are able to focus on their own ideas and questions.

Elements of RRs

Usually a review of the academic, grey and practitioner literature includes the following five steps:

  1. Design and conceptual clarification of rapid review
  2. Purposeful evidence-based searching, and gathering of evidence
  3. Assessment of what is known about policy
  4. A critical appraisal of existing research which is "time-limited" (for relevance; then full assessment)
  5. Validation and discussion among experts
  6. Preparation of interim assessment, and final report

In addition, search the online and print literature as comprehensively as possible and do the following;

  1. Collate descriptive outlines of the available evidence
  2. Critically appraise evidence (including an economic appraisal)
  3. Sift out studies of poor quality
  4. Provide overview of what the evidence is saying
  5. Quantities of literature and overall quality/direction of literature (Davies, 2003, p.18-19)

Key websites

Major review types

See CADTH's suggested timelines for rapid reviews

Literature review

  • Narrative, selective review (not systematic); collates relevant studies and draw conclusions from them
  • Time required to complete: 1 week to 2 months

Quick scoping review

  • Quick overview of research undertaken on a (constrained) topic (not systematic)
  • Time required to complete: 1-2 weeks to 2 months

Rapid review

  • Systematic search but a quick overview of existing research on a topic
  • Synthesis of evidence provided by these studies to answer the REA question
  • Time required to complete: 2 to 6 months (quicker than systematic review)

Full systematic review

  • Systematic. A broad review of existing research on a topic and synthesis of the evidence provided by these studies to answer the review question.
  • Time required to complete: 8 to 12 months minimum

Multi-arm systematic review

  • Systematic. Full map and synthesis of different types of evidence to answer the review question
  • Time required to complete: 12 months minimum

Review of reviews

  • Systematic. Same as any of the above methods but only includes reviews of other reviews
  • Time required to complete: Often quicker than other types of full systematic review

References

Personal tools
Namespaces

Variants
Actions
Navigation
Toolbox