- University Libraries
- Research Guides
- Reviewing Research: Literature Reviews, Scoping Reviews, Systematic Reviews
- Differentiating the Three Review Types
Reviewing Research: Literature Reviews, Scoping Reviews, Systematic Reviews: Differentiating the Three Review Types
- Framework, Protocol, and Writing Steps
- Working with Keywords/Subject Headings
- Citing Research
The Differences in the Review Types
Grant, M.J. and Booth, A. (2009), A typology of reviews: an analysis of 14 review types and associated methodologies. H ealth Information & Libraries Journal , 26: 91-108. https://doi.org/10.1111/j.1471-1842.2009.00848.x The objective of this study is to provide descriptive insight into the most common types of reviews, with illustrative examples from health and health information domains.
- What Type of Review is Right for you (Cornell University)
Literature Reviews
Literature Review: it is a product and a process.
As a product , it is a carefully written examination, interpretation, evaluation, and synthesis of the published literature related to your topic. It focuses on what is known about your topic and what methodologies, models, theories, and concepts have been applied to it by others.
The process is what is involved in conducting a review of the literature.
- It is ongoing
- It is iterative (repetitive)
- It involves searching for and finding relevant literature.
- It includes keeping track of your references and preparing and formatting them for the bibliography of your thesis
- Literature Reviews (University of North Carolina at Chapel Hill) This handout will explain what literature reviews are and offer insights into the form and construction of literature reviews in the humanities, social sciences, and sciences.
Scoping Reviews
Scoping reviews are a " preliminary assessment of potential size and scope of available research literature . Aims to identify nature and extent of research evidence (usually including ongoing research)." Grant and Booth (2009).
Scoping reviews are not mapping reviews: Scoping reviews are more topic based and mapping reviews are more question based.
- examining emerging evidence when specific questions are unclear - clarify definitions and conceptual boundaries
- identify and map the available evidence
- a scoping review is done prior to a systematic review
- to summarize and disseminate research findings in the research literature
- identify gaps with the intention of resolution by future publications
- Scoping review timeframe and limitations (Touro College of Pharmacy
Systematic Reviews
Many evidence-based disciplines use ‘systematic reviews," this type of review is a specific methodology that aims to comprehensively identify all relevant studies on a specific topic, and to select appropriate studies based on explicit criteria . ( https://cebma.org/faq/what-is-a-systematic-review/ )
- clearly defined search criteria
- an explicit reproducible methodology
- a systematic search of the literature with the defined criteria met
- assesses validity of the findings - no risk of bias
- a comprehensive report on the findings, apparent transparency in the results
- Better evidence for a better world Browsable collection of systematic reviews
- Systematic Reviews in the Health Sciences by Molly Maloney Last Updated Jul 26, 2024 870 views this year
- Next: Framework, Protocol, and Writing Steps >>
- Duke NetID Login
- 919.660.1100
- Duke Health Badge: 24-hour access
- Accounts & Access
- Databases, Journals & Books
- Request & Reserve
- Training & Consulting
- Request Articles & Books
- Renew Online
- Reserve Spaces
- Reserve a Locker
- Study & Meeting Rooms
- Course Reserves
- Pay Fines/Fees
- Recommend a Purchase
- Access From Off Campus
- Building Access
- Computers & Equipment
- Wifi Access
- My Accounts
- Mobile Apps
- Known Access Issues
- Report an Access Issue
- All Databases
- Article Databases
- Basic Sciences
- Clinical Sciences
- Dissertations & Theses
- Drugs, Chemicals & Toxicology
- Grants & Funding
- Interprofessional Education
- Non-Medical Databases
- Search for E-Journals
- Search for Print & E-Journals
- Search for E-Books
- Search for Print & E-Books
- E-Book Collections
- Biostatistics
- Global Health
- MBS Program
- Medical Students
- MMCi Program
- Occupational Therapy
- Path Asst Program
- Physical Therapy
- Population Health
- Researchers
- Community Partners
Conducting Research
- Archival & Historical Research
- Black History at Duke Health
- Data Analytics & Viz Software
- Data: Find and Share
- Evidence-Based Practice
- NIH Public Access Policy Compliance
- Publication Metrics
- Qualitative Research
- Searching Animal Alternatives
Systematic Reviews
- Test Instruments
Using Databases
- JCR Impact Factors
- Web of Science
Finding & Accessing
- COVID-19: Core Clinical Resources
- Health Literacy
- Health Statistics & Data
- Library Orientation
Writing & Citing
- Creating Links
- Getting Published
- Reference Mgmt
- Scientific Writing
Meet a Librarian
- Request a Consultation
- Find Your Liaisons
- Register for a Class
- Request a Class
- Self-Paced Learning
Search Services
- Literature Search
- Systematic Review
- Animal Alternatives (IACUC)
- Research Impact
Citation Mgmt
- Other Software
Scholarly Communications
- About Scholarly Communications
- Publish Your Work
- Measure Your Research Impact
- Engage in Open Science
- Libraries and Publishers
- Directions & Maps
- Floor Plans
Library Updates
- Annual Snapshot
- Conference Presentations
- Contact Information
- Gifts & Donations
- What is a Systematic Review?
Types of Reviews
- Manuals and Reporting Guidelines
- Our Service
- 1. Assemble Your Team
- 2. Develop a Research Question
- 3. Write and Register a Protocol
- 4. Search the Evidence
- 5. Screen Results
- 6. Assess for Quality and Bias
- 7. Extract the Data
- 8. Write the Review
- Additional Resources
- Finding Full-Text Articles
Review Typologies
There are many types of evidence synthesis projects, including systematic reviews as well as others. The selection of review type is wholly dependent on the research question. Not all research questions are well-suited for systematic reviews.
- Review Typologies (from LITR-EX) This site explores different review methodologies such as, systematic, scoping, realist, narrative, state of the art, meta-ethnography, critical, and integrative reviews. The LITR-EX site has a health professions education focus, but the advice and information is widely applicable.
Review the table to peruse review types and associated methodologies. Librarians can also help your team determine which review type might be appropriate for your project.
Reproduced from Grant, M. J. and Booth, A. (2009), A typology of reviews: an analysis of 14 review types and associated methodologies. Health Information & Libraries Journal, 26: 91-108. doi:10.1111/j.1471-1842.2009.00848.x
|
|
|
|
|
|
| Aims to demonstrate writer has extensively researched literature and critically evaluated its quality. Goes beyond mere description to include degree of analysis and conceptual innovation. Typically results in hypothesis or mode | Seeks to identify most significant items in the field | No formal quality assessment. Attempts to evaluate according to contribution | Typically narrative, perhaps conceptual or chronological | Significant component: seeks to identify conceptual contribution to embody existing or derive new theory |
| Generic term: published materials that provide examination of recent or current literature. Can cover wide range of subjects at various levels of completeness and comprehensiveness. May include research findings | May or may not include comprehensive searching | May or may not include quality assessment | Typically narrative | Analysis may be chronological, conceptual, thematic, etc. |
| Map out and categorize existing literature from which to commission further reviews and/or primary research by identifying gaps in research literature | Completeness of searching determined by time/scope constraints | No formal quality assessment | May be graphical and tabular | Characterizes quantity and quality of literature, perhaps by study design and other key features. May identify need for primary or secondary research |
| Technique that statistically combines the results of quantitative studies to provide a more precise effect of the results | Aims for exhaustive, comprehensive searching. May use funnel plot to assess completeness | Quality assessment may determine inclusion/ exclusion and/or sensitivity analyses | Graphical and tabular with narrative commentary | Numerical analysis of measures of effect assuming absence of heterogeneity |
| Refers to any combination of methods where one significant component is a literature review (usually systematic). Within a review context it refers to a combination of review approaches for example combining quantitative with qualitative research or outcome with process studies | Requires either very sensitive search to retrieve all studies or separately conceived quantitative and qualitative strategies | Requires either a generic appraisal instrument or separate appraisal processes with corresponding checklists | Typically both components will be presented as narrative and in tables. May also employ graphical means of integrating quantitative and qualitative studies | Analysis may characterise both literatures and look for correlations between characteristics or use gap analysis to identify aspects absent in one literature but missing in the other |
| Generic term: summary of the [medical] literature that attempts to survey the literature and describe its characteristics | May or may not include comprehensive searching (depends whether systematic overview or not) | May or may not include quality assessment (depends whether systematic overview or not) | Synthesis depends on whether systematic or not. Typically narrative but may include tabular features | Analysis may be chronological, conceptual, thematic, etc. |
| Method for integrating or comparing the findings from qualitative studies. It looks for ‘themes’ or ‘constructs’ that lie in or across individual qualitative studies | May employ selective or purposive sampling | Quality assessment typically used to mediate messages not for inclusion/exclusion | Qualitative, narrative synthesis | Thematic analysis, may include conceptual models |
| Assessment of what is already known about a policy or practice issue, by using systematic review methods to search and critically appraise existing research | Completeness of searching determined by time constraints | Time-limited formal quality assessment | Typically narrative and tabular | Quantities of literature and overall quality/direction of effect of literature |
| Preliminary assessment of potential size and scope of available research literature. Aims to identify nature and extent of research evidence (usually including ongoing research) | Completeness of searching determined by time/scope constraints. May include research in progress | No formal quality assessment | Typically tabular with some narrative commentary | Characterizes quantity and quality of literature, perhaps by study design and other key features. Attempts to specify a viable review |
| Tend to address more current matters in contrast to other combined retrospective and current approaches. May offer new perspectives | Aims for comprehensive searching of current literature | No formal quality assessment | Typically narrative, may have tabular accompaniment | Current state of knowledge and priorities for future investigation and research |
| Seeks to systematically search for, appraise and synthesis research evidence, often adhering to guidelines on the conduct of a review | Aims for exhaustive, comprehensive searching | Quality assessment may determine inclusion/exclusion | Typically narrative with tabular accompaniment | What is known; recommendations for practice. What remains unknown; uncertainty around findings, recommendations for future research |
| Combines strengths of critical review with a comprehensive search process. Typically addresses broad questions to produce ‘best evidence synthesis’ | Aims for exhaustive, comprehensive searching | May or may not include quality assessment | Minimal narrative, tabular summary of studies | What is known; recommendations for practice. Limitations |
| Attempt to include elements of systematic review process while stopping short of systematic review. Typically conducted as postgraduate student assignment | May or may not include comprehensive searching | May or may not include quality assessment | Typically narrative with tabular accompaniment | What is known; uncertainty around findings; limitations of methodology |
| Specifically refers to review compiling evidence from multiple reviews into one accessible and usable document. Focuses on broad condition or problem for which there are competing interventions and highlights reviews that address these interventions and their results | Identification of component reviews, but no search for primary studies | Quality assessment of studies within component reviews and/or of reviews themselves | Graphical and tabular with narrative commentary | What is known; recommendations for practice. What remains unknown; recommendations for future research |
- << Previous: What is a Systematic Review?
- Next: Manuals and Reporting Guidelines >>
- Last Updated: Jun 18, 2024 9:41 AM
- URL: https://guides.mclibrary.duke.edu/sysreview
- Duke Health
- Duke University
- Duke Libraries
- Medical Center Archives
- Duke Directory
- Seeley G. Mudd Building
- 10 Searle Drive
- [email protected]
- Locations and Hours
- UCLA Library
- Research Guides
- Biomedical Library Guides
Systematic Reviews
- Types of Literature Reviews
What Makes a Systematic Review Different from Other Types of Reviews?
- Planning Your Systematic Review
- Database Searching
- Creating the Search
- Search Filters and Hedges
- Grey Literature
- Managing and Appraising Results
- Further Resources
Reproduced from Grant, M. J. and Booth, A. (2009), A typology of reviews: an analysis of 14 review types and associated methodologies. Health Information & Libraries Journal, 26: 91–108. doi:10.1111/j.1471-1842.2009.00848.x
Aims to demonstrate writer has extensively researched literature and critically evaluated its quality. Goes beyond mere description to include degree of analysis and conceptual innovation. Typically results in hypothesis or mode | Seeks to identify most significant items in the field | No formal quality assessment. Attempts to evaluate according to contribution | Typically narrative, perhaps conceptual or chronological | Significant component: seeks to identify conceptual contribution to embody existing or derive new theory | |
Generic term: published materials that provide examination of recent or current literature. Can cover wide range of subjects at various levels of completeness and comprehensiveness. May include research findings | May or may not include comprehensive searching | May or may not include quality assessment | Typically narrative | Analysis may be chronological, conceptual, thematic, etc. | |
Mapping review/ systematic map | Map out and categorize existing literature from which to commission further reviews and/or primary research by identifying gaps in research literature | Completeness of searching determined by time/scope constraints | No formal quality assessment | May be graphical and tabular | Characterizes quantity and quality of literature, perhaps by study design and other key features. May identify need for primary or secondary research |
Technique that statistically combines the results of quantitative studies to provide a more precise effect of the results | Aims for exhaustive, comprehensive searching. May use funnel plot to assess completeness | Quality assessment may determine inclusion/ exclusion and/or sensitivity analyses | Graphical and tabular with narrative commentary | Numerical analysis of measures of effect assuming absence of heterogeneity | |
Refers to any combination of methods where one significant component is a literature review (usually systematic). Within a review context it refers to a combination of review approaches for example combining quantitative with qualitative research or outcome with process studies | Requires either very sensitive search to retrieve all studies or separately conceived quantitative and qualitative strategies | Requires either a generic appraisal instrument or separate appraisal processes with corresponding checklists | Typically both components will be presented as narrative and in tables. May also employ graphical means of integrating quantitative and qualitative studies | Analysis may characterise both literatures and look for correlations between characteristics or use gap analysis to identify aspects absent in one literature but missing in the other | |
Generic term: summary of the [medical] literature that attempts to survey the literature and describe its characteristics | May or may not include comprehensive searching (depends whether systematic overview or not) | May or may not include quality assessment (depends whether systematic overview or not) | Synthesis depends on whether systematic or not. Typically narrative but may include tabular features | Analysis may be chronological, conceptual, thematic, etc. | |
Method for integrating or comparing the findings from qualitative studies. It looks for ‘themes’ or ‘constructs’ that lie in or across individual qualitative studies | May employ selective or purposive sampling | Quality assessment typically used to mediate messages not for inclusion/exclusion | Qualitative, narrative synthesis | Thematic analysis, may include conceptual models | |
Assessment of what is already known about a policy or practice issue, by using systematic review methods to search and critically appraise existing research | Completeness of searching determined by time constraints | Time-limited formal quality assessment | Typically narrative and tabular | Quantities of literature and overall quality/direction of effect of literature | |
Preliminary assessment of potential size and scope of available research literature. Aims to identify nature and extent of research evidence (usually including ongoing research) | Completeness of searching determined by time/scope constraints. May include research in progress | No formal quality assessment | Typically tabular with some narrative commentary | Characterizes quantity and quality of literature, perhaps by study design and other key features. Attempts to specify a viable review | |
Tend to address more current matters in contrast to other combined retrospective and current approaches. May offer new perspectives | Aims for comprehensive searching of current literature | No formal quality assessment | Typically narrative, may have tabular accompaniment | Current state of knowledge and priorities for future investigation and research | |
Seeks to systematically search for, appraise and synthesis research evidence, often adhering to guidelines on the conduct of a review | Aims for exhaustive, comprehensive searching | Quality assessment may determine inclusion/exclusion | Typically narrative with tabular accompaniment | What is known; recommendations for practice. What remains unknown; uncertainty around findings, recommendations for future research | |
Combines strengths of critical review with a comprehensive search process. Typically addresses broad questions to produce ‘best evidence synthesis’ | Aims for exhaustive, comprehensive searching | May or may not include quality assessment | Minimal narrative, tabular summary of studies | What is known; recommendations for practice. Limitations | |
Attempt to include elements of systematic review process while stopping short of systematic review. Typically conducted as postgraduate student assignment | May or may not include comprehensive searching | May or may not include quality assessment | Typically narrative with tabular accompaniment | What is known; uncertainty around findings; limitations of methodology | |
Specifically refers to review compiling evidence from multiple reviews into one accessible and usable document. Focuses on broad condition or problem for which there are competing interventions and highlights reviews that address these interventions and their results | Identification of component reviews, but no search for primary studies | Quality assessment of studies within component reviews and/or of reviews themselves | Graphical and tabular with narrative commentary | What is known; recommendations for practice. What remains unknown; recommendations for future research |
- << Previous: Home
- Next: Planning Your Systematic Review >>
- Last Updated: Jul 23, 2024 3:40 PM
- URL: https://guides.library.ucla.edu/systematicreviews
- University of Texas Libraries
Literature Reviews
- What is a literature review?
- Steps in the Literature Review Process
- Define your research question
- Determine inclusion and exclusion criteria
- Choose databases and search
- Review Results
- Synthesize Results
- Analyze Results
- Librarian Support
- Artificial Intelligence (AI) Tools
What is a Literature Review?
A literature or narrative review is a comprehensive review and analysis of the published literature on a specific topic or research question. The literature that is reviewed contains: books, articles, academic articles, conference proceedings, association papers, and dissertations. It contains the most pertinent studies and points to important past and current research and practices. It provides background and context, and shows how your research will contribute to the field.
A literature review should:
- Provide a comprehensive and updated review of the literature;
- Explain why this review has taken place;
- Articulate a position or hypothesis;
- Acknowledge and account for conflicting and corroborating points of view
From S age Research Methods
Purpose of a Literature Review
A literature review can be written as an introduction to a study to:
- Demonstrate how a study fills a gap in research
- Compare a study with other research that's been done
Or it can be a separate work (a research article on its own) which:
- Organizes or describes a topic
- Describes variables within a particular issue/problem
Limitations of a Literature Review
Some of the limitations of a literature review are:
- It's a snapshot in time. Unlike other reviews, this one has beginning, a middle and an end. There may be future developments that could make your work less relevant.
- It may be too focused. Some niche studies may miss the bigger picture.
- It can be difficult to be comprehensive. There is no way to make sure all the literature on a topic was considered.
- It is easy to be biased if you stick to top tier journals. There may be other places where people are publishing exemplary research. Look to open access publications and conferences to reflect a more inclusive collection. Also, make sure to include opposing views (and not just supporting evidence).
Source: Grant, Maria J., and Andrew Booth. “A Typology of Reviews: An Analysis of 14 Review Types and Associated Methodologies.” Health Information & Libraries Journal, vol. 26, no. 2, June 2009, pp. 91–108. Wiley Online Library, doi:10.1111/j.1471-1842.2009.00848.x.
Librarian Assistance
For help, please contact the librarian for your subject area. We have a guide to library specialists by subject .
- Last Updated: Aug 26, 2024 5:59 AM
- URL: https://guides.lib.utexas.edu/literaturereviews
- UConn Library
- Literature Review: The What, Why and How-to Guide
- Introduction
Literature Review: The What, Why and How-to Guide — Introduction
- Getting Started
- How to Pick a Topic
- Strategies to Find Sources
- Evaluating Sources & Lit. Reviews
- Tips for Writing Literature Reviews
- Writing Literature Review: Useful Sites
- Citation Resources
- Other Academic Writings
What are Literature Reviews?
So, what is a literature review? "A literature review is an account of what has been published on a topic by accredited scholars and researchers. In writing the literature review, your purpose is to convey to your reader what knowledge and ideas have been established on a topic, and what their strengths and weaknesses are. As a piece of writing, the literature review must be defined by a guiding concept (e.g., your research objective, the problem or issue you are discussing, or your argumentative thesis). It is not just a descriptive list of the material available, or a set of summaries." Taylor, D. The literature review: A few tips on conducting it . University of Toronto Health Sciences Writing Centre.
Goals of Literature Reviews
What are the goals of creating a Literature Review? A literature could be written to accomplish different aims:
- To develop a theory or evaluate an existing theory
- To summarize the historical or existing state of a research topic
- Identify a problem in a field of research
Baumeister, R. F., & Leary, M. R. (1997). Writing narrative literature reviews . Review of General Psychology , 1 (3), 311-320.
What kinds of sources require a Literature Review?
- A research paper assigned in a course
- A thesis or dissertation
- A grant proposal
- An article intended for publication in a journal
All these instances require you to collect what has been written about your research topic so that you can demonstrate how your own research sheds new light on the topic.
Types of Literature Reviews
What kinds of literature reviews are written?
Narrative review: The purpose of this type of review is to describe the current state of the research on a specific topic/research and to offer a critical analysis of the literature reviewed. Studies are grouped by research/theoretical categories, and themes and trends, strengths and weakness, and gaps are identified. The review ends with a conclusion section which summarizes the findings regarding the state of the research of the specific study, the gaps identify and if applicable, explains how the author's research will address gaps identify in the review and expand the knowledge on the topic reviewed.
- Example : Predictors and Outcomes of U.S. Quality Maternity Leave: A Review and Conceptual Framework: 10.1177/08948453211037398
Systematic review : "The authors of a systematic review use a specific procedure to search the research literature, select the studies to include in their review, and critically evaluate the studies they find." (p. 139). Nelson, L. K. (2013). Research in Communication Sciences and Disorders . Plural Publishing.
- Example : The effect of leave policies on increasing fertility: a systematic review: 10.1057/s41599-022-01270-w
Meta-analysis : "Meta-analysis is a method of reviewing research findings in a quantitative fashion by transforming the data from individual studies into what is called an effect size and then pooling and analyzing this information. The basic goal in meta-analysis is to explain why different outcomes have occurred in different studies." (p. 197). Roberts, M. C., & Ilardi, S. S. (2003). Handbook of Research Methods in Clinical Psychology . Blackwell Publishing.
- Example : Employment Instability and Fertility in Europe: A Meta-Analysis: 10.1215/00703370-9164737
Meta-synthesis : "Qualitative meta-synthesis is a type of qualitative study that uses as data the findings from other qualitative studies linked by the same or related topic." (p.312). Zimmer, L. (2006). Qualitative meta-synthesis: A question of dialoguing with texts . Journal of Advanced Nursing , 53 (3), 311-318.
- Example : Women’s perspectives on career successes and barriers: A qualitative meta-synthesis: 10.1177/05390184221113735
Literature Reviews in the Health Sciences
- UConn Health subject guide on systematic reviews Explanation of the different review types used in health sciences literature as well as tools to help you find the right review type
- << Previous: Getting Started
- Next: How to Pick a Topic >>
- Last Updated: Sep 21, 2022 2:16 PM
- URL: https://guides.lib.uconn.edu/literaturereview
- University of Wisconsin–Madison
- University of Wisconsin-Madison
- Research Guides
- Evidence Synthesis, Systematic Review Services
- Literature Review Types, Taxonomies
Evidence Synthesis, Systematic Review Services : Literature Review Types, Taxonomies
- Develop a Protocol
- Develop Your Research Question
- Select Databases
- Select Gray Literature Sources
- Write a Search Strategy
- Manage Your Search Process
- Register Your Protocol
- Citation Management
- Article Screening
- Risk of Bias Assessment
- Synthesize, Map, or Describe the Results
- Find Guidance by Discipline
- Manage Your Research Data
- Browse Evidence Portals by Discipline
- Automate the Process, Tools & Technologies
- Adapting Systematic Review Methods
- Additional Resources
Choosing a Literature Review Methodology
Growing interest in evidence-based practice has driven an increase in review methodologies. Your choice of review methodology (or literature review type) will be informed by the intent (purpose, function) of your research project and the time and resources of your team.
- Decision Tree (What Type of Review is Right for You?) Developed by Cornell University Library staff, this "decision-tree" guides the user to a handful of review guides given time and intent.
Types of Evidence Synthesis*
Critical Review - Aims to demonstrate writer has extensively researched literature and critically evaluated its quality. Goes beyond mere description to include degree of analysis and conceptual innovation. Typically results in hypothesis or model.
Mapping Review (Systematic Map) - Map out and categorize existing literature from which to commission further reviews and/or primary research by identifying gaps in research literature.
Meta-Analysis - Technique that statistically combines the results of quantitative studies to provide a more precise effect of the results.
Mixed Studies Review (Mixed Methods Review) - Refers to any combination of methods where one significant component is a literature review (usually systematic). Within a review context it refers to a combination of review approaches for example combining quantitative with qualitative research or outcome with process studies.
Narrative (Literature) Review - Broad, generic term - Refers to an examination and general synthesis of the research literature, often with a wide scope; completeness and comprehensiveness may vary. Does not follow an established protocol.
Overview - Generic term: summary of the [medical] literature that attempts to survey the literature and describe its characteristics.
Qualitative Systematic Review or Qualitative Evidence Synthesis - Method for integrating or comparing the findings from qualitative studies. It looks for ‘themes’ or ‘constructs’ that lie in or across individual qualitative studies.
Rapid Review - Assessment of what is already known about a policy or practice issue, by using systematic review methods to search and critically appraise existing research.
Scoping Review or Evidence Map - Preliminary assessment of potential size and scope of available research literature. Aims to identify nature and extent of research.
State-of-the-art Review - Tend to address more current matters in contrast to other combined retrospective and current approaches. May offer new perspectives on issue or point out area for further research.
Systematic Review - Seeks to systematically search for, appraise and synthesize research evidence, often adhering to guidelines on the conduct of a review. (An emerging subset includes Living Reviews or Living Systematic Reviews - A [review or] systematic review which is continually updated, incorporating relevant new evidence as it becomes available.)
Systematic Search and Review - Combines strengths of critical review with a comprehensive search process. Typically addresses broad questions to produce ‘best evidence synthesis.’
Umbrella Review - Specifically refers to review compiling evidence from multiple reviews into one accessible and usable document. Focuses on broad condition or problem for which there are competing interventions and highlights reviews that address these interventions and their results.
*Apart from some qualifying description for "Narrative (Literature) Review", these definitions are provided in Grant & Booth's "A Typology of Reviews: An Analysis of 14 Review Types and Associated Methodologies."
Literature Review Types/Typologies, Taxonomies
Grant, M. J., and A. Booth. "A Typology of Reviews: An Analysis of 14 Review Types and Associated Methodologies." Health Information and Libraries Journal 26.2 (2009): 91-108. DOI: 10.1111/j.1471-1842.2009.00848.x Link
Munn, Zachary, et al. “Systematic Review or Scoping Review? Guidance for Authors When Choosing between a Systematic or Scoping Review Approach.” BMC Medical Research Methodology , vol. 18, no. 1, Nov. 2018, p. 143. DOI: 10.1186/s12874-018-0611-x. Link
Sutton, A., et al. "Meeting the Review Family: Exploring Review Types and Associated Information Retrieval Requirements." Health Information and Libraries Journal 36.3 (2019): 202-22. DOI: 10.1111/hir.12276 Link
- << Previous: Home
- Next: The Systematic Review Process >>
- Last Updated: Aug 23, 2024 11:01 AM
- URL: https://researchguides.library.wisc.edu/literature_review
Research Methods
- Getting Started
- Literature Review Research
- Research Design
- Research Design By Discipline
- SAGE Research Methods
- Teaching with SAGE Research Methods
Literature Review
- What is a Literature Review?
- What is NOT a Literature Review?
- Purposes of a Literature Review
- Types of Literature Reviews
- Literature Reviews vs. Systematic Reviews
- Systematic vs. Meta-Analysis
Literature Review is a comprehensive survey of the works published in a particular field of study or line of research, usually over a specific period of time, in the form of an in-depth, critical bibliographic essay or annotated list in which attention is drawn to the most significant works.
Also, we can define a literature review as the collected body of scholarly works related to a topic:
- Summarizes and analyzes previous research relevant to a topic
- Includes scholarly books and articles published in academic journals
- Can be an specific scholarly paper or a section in a research paper
The objective of a Literature Review is to find previous published scholarly works relevant to an specific topic
- Help gather ideas or information
- Keep up to date in current trends and findings
- Help develop new questions
A literature review is important because it:
- Explains the background of research on a topic.
- Demonstrates why a topic is significant to a subject area.
- Helps focus your own research questions or problems
- Discovers relationships between research studies/ideas.
- Suggests unexplored ideas or populations
- Identifies major themes, concepts, and researchers on a topic.
- Tests assumptions; may help counter preconceived ideas and remove unconscious bias.
- Identifies critical gaps, points of disagreement, or potentially flawed methodology or theoretical approaches.
- Indicates potential directions for future research.
All content in this section is from Literature Review Research from Old Dominion University
Keep in mind the following, a literature review is NOT:
Not an essay
Not an annotated bibliography in which you summarize each article that you have reviewed. A literature review goes beyond basic summarizing to focus on the critical analysis of the reviewed works and their relationship to your research question.
Not a research paper where you select resources to support one side of an issue versus another. A lit review should explain and consider all sides of an argument in order to avoid bias, and areas of agreement and disagreement should be highlighted.
A literature review serves several purposes. For example, it
- provides thorough knowledge of previous studies; introduces seminal works.
- helps focus one’s own research topic.
- identifies a conceptual framework for one’s own research questions or problems; indicates potential directions for future research.
- suggests previously unused or underused methodologies, designs, quantitative and qualitative strategies.
- identifies gaps in previous studies; identifies flawed methodologies and/or theoretical approaches; avoids replication of mistakes.
- helps the researcher avoid repetition of earlier research.
- suggests unexplored populations.
- determines whether past studies agree or disagree; identifies controversy in the literature.
- tests assumptions; may help counter preconceived ideas and remove unconscious bias.
As Kennedy (2007) notes*, it is important to think of knowledge in a given field as consisting of three layers. First, there are the primary studies that researchers conduct and publish. Second are the reviews of those studies that summarize and offer new interpretations built from and often extending beyond the original studies. Third, there are the perceptions, conclusions, opinion, and interpretations that are shared informally that become part of the lore of field. In composing a literature review, it is important to note that it is often this third layer of knowledge that is cited as "true" even though it often has only a loose relationship to the primary studies and secondary literature reviews.
Given this, while literature reviews are designed to provide an overview and synthesis of pertinent sources you have explored, there are several approaches to how they can be done, depending upon the type of analysis underpinning your study. Listed below are definitions of types of literature reviews:
Argumentative Review This form examines literature selectively in order to support or refute an argument, deeply imbedded assumption, or philosophical problem already established in the literature. The purpose is to develop a body of literature that establishes a contrarian viewpoint. Given the value-laden nature of some social science research [e.g., educational reform; immigration control], argumentative approaches to analyzing the literature can be a legitimate and important form of discourse. However, note that they can also introduce problems of bias when they are used to to make summary claims of the sort found in systematic reviews.
Integrative Review Considered a form of research that reviews, critiques, and synthesizes representative literature on a topic in an integrated way such that new frameworks and perspectives on the topic are generated. The body of literature includes all studies that address related or identical hypotheses. A well-done integrative review meets the same standards as primary research in regard to clarity, rigor, and replication.
Historical Review Few things rest in isolation from historical precedent. Historical reviews are focused on examining research throughout a period of time, often starting with the first time an issue, concept, theory, phenomena emerged in the literature, then tracing its evolution within the scholarship of a discipline. The purpose is to place research in a historical context to show familiarity with state-of-the-art developments and to identify the likely directions for future research.
Methodological Review A review does not always focus on what someone said [content], but how they said it [method of analysis]. This approach provides a framework of understanding at different levels (i.e. those of theory, substantive fields, research approaches and data collection and analysis techniques), enables researchers to draw on a wide variety of knowledge ranging from the conceptual level to practical documents for use in fieldwork in the areas of ontological and epistemological consideration, quantitative and qualitative integration, sampling, interviewing, data collection and data analysis, and helps highlight many ethical issues which we should be aware of and consider as we go through our study.
Systematic Review This form consists of an overview of existing evidence pertinent to a clearly formulated research question, which uses pre-specified and standardized methods to identify and critically appraise relevant research, and to collect, report, and analyse data from the studies that are included in the review. Typically it focuses on a very specific empirical question, often posed in a cause-and-effect form, such as "To what extent does A contribute to B?"
Theoretical Review The purpose of this form is to concretely examine the corpus of theory that has accumulated in regard to an issue, concept, theory, phenomena. The theoretical literature review help establish what theories already exist, the relationships between them, to what degree the existing theories have been investigated, and to develop new hypotheses to be tested. Often this form is used to help establish a lack of appropriate theories or reveal that current theories are inadequate for explaining new or emerging research problems. The unit of analysis can focus on a theoretical concept or a whole theory or framework.
* Kennedy, Mary M. "Defining a Literature." Educational Researcher 36 (April 2007): 139-147.
All content in this section is from The Literature Review created by Dr. Robert Larabee USC
Robinson, P. and Lowe, J. (2015), Literature reviews vs systematic reviews. Australian and New Zealand Journal of Public Health, 39: 103-103. doi: 10.1111/1753-6405.12393
What's in the name? The difference between a Systematic Review and a Literature Review, and why it matters . By Lynn Kysh from University of Southern California
Systematic review or meta-analysis?
A systematic review answers a defined research question by collecting and summarizing all empirical evidence that fits pre-specified eligibility criteria.
A meta-analysis is the use of statistical methods to summarize the results of these studies.
Systematic reviews, just like other research articles, can be of varying quality. They are a significant piece of work (the Centre for Reviews and Dissemination at York estimates that a team will take 9-24 months), and to be useful to other researchers and practitioners they should have:
- clearly stated objectives with pre-defined eligibility criteria for studies
- explicit, reproducible methodology
- a systematic search that attempts to identify all studies
- assessment of the validity of the findings of the included studies (e.g. risk of bias)
- systematic presentation, and synthesis, of the characteristics and findings of the included studies
Not all systematic reviews contain meta-analysis.
Meta-analysis is the use of statistical methods to summarize the results of independent studies. By combining information from all relevant studies, meta-analysis can provide more precise estimates of the effects of health care than those derived from the individual studies included within a review. More information on meta-analyses can be found in Cochrane Handbook, Chapter 9 .
A meta-analysis goes beyond critique and integration and conducts secondary statistical analysis on the outcomes of similar studies. It is a systematic review that uses quantitative methods to synthesize and summarize the results.
An advantage of a meta-analysis is the ability to be completely objective in evaluating research findings. Not all topics, however, have sufficient research evidence to allow a meta-analysis to be conducted. In that case, an integrative review is an appropriate strategy.
Some of the content in this section is from Systematic reviews and meta-analyses: step by step guide created by Kate McAllister.
- << Previous: Getting Started
- Next: Research Design >>
- Last Updated: Jul 15, 2024 10:34 AM
- URL: https://guides.lib.udel.edu/researchmethods
Literature Review: Types of literature reviews
- Traditional or narrative literature reviews
- Scoping Reviews
- Systematic literature reviews
- Annotated bibliography
- Keeping up to date with literature
- Finding a thesis
- Evaluating sources and critical appraisal of literature
- Managing and analysing your literature
- Further reading and resources
Types of literature reviews
The type of literature review you write will depend on your discipline and whether you are a researcher writing your PhD, publishing a study in a journal or completing an assessment task in your undergraduate study.
A literature review for a subject in an undergraduate degree will not be as comprehensive as the literature review required for a PhD thesis.
An undergraduate literature review may be in the form of an annotated bibliography or a narrative review of a small selection of literature, for example ten relevant articles. If you are asked to write a literature review, and you are an undergraduate student, be guided by your subject coordinator or lecturer.
The common types of literature reviews will be explained in the pages of this section.
- Narrative or traditional literature reviews
- Critically Appraised Topic (CAT)
- Scoping reviews
- Annotated bibliographies
These are not the only types of reviews of literature that can be conducted. Often the term "review" and "literature" can be confusing and used in the wrong context. Grant and Booth (2009) attempt to clear up this confusion by discussing 14 review types and the associated methodology, and advantages and disadvantages associated with each review.
Grant, M. J. and Booth, A. (2009), A typology of reviews: an analysis of 14 review types and associated methodologies . Health Information & Libraries Journal, 26 , 91–108. doi:10.1111/j.1471-1842.2009.00848.x
What's the difference between reviews?
Researchers, academics, and librarians all use various terms to describe different types of literature reviews, and there is often inconsistency in the ways the types are discussed. Here are a couple of simple explanations.
- The image below describes common review types in terms of speed, detail, risk of bias, and comprehensiveness:
"Schematic of the main differences between the types of literature review" by Brennan, M. L., Arlt, S. P., Belshaw, Z., Buckley, L., Corah, L., Doit, H., Fajt, V. R., Grindlay, D., Moberly, H. K., Morrow, L. D., Stavisky, J., & White, C. (2020). Critically Appraised Topics (CATs) in veterinary medicine: Applying evidence in clinical practice. Frontiers in Veterinary Science, 7 , 314. https://doi.org/10.3389/fvets.2020.00314 is licensed under CC BY 3.0
- The table below lists four of the most common types of review , as adapted from a widely used typology of fourteen types of reviews (Grant & Booth, 2009).
Identifies and reviews published literature on a topic, which may be broad. Typically employs a narrative approach to reporting the review findings. Can include a wide range of related subjects. | 1 - 4 weeks | 1 | |
Assesses what is known about an issue by using a systematic review method to search and appraise research and determine best practice. | 2 - 6 months | 2 | |
Assesses the potential scope of the research literature on a particular topic. Helps determine gaps in the research. (See the page in this guide on .) | 1 - 4 weeks | 1 - 2 | |
Seeks to systematically search for, appraise, and synthesise research evidence so as to aid decision-making and determine best practice. Can vary in approach, and is often specific to the type of study, which include studies of effectiveness, qualitative research, economic evaluation, prevalence, aetiology, or diagnostic test accuracy. | 8 months to 2 years | 2 or more |
Grant, M.J. & Booth, A. (2009). A typology of reviews: An analysis of 14 review types and associated methodologies. Health Information & Libraries Journal, 26 (2), 91-108. https://doi.org/10.1111/j.1471-1842.2009.00848.x
See also the Library's Literature Review guide.
Critical Appraised Topic (CAT)
For information on conducting a Critically Appraised Topic or CAT
Callander, J., Anstey, A. V., Ingram, J. R., Limpens, J., Flohr, C., & Spuls, P. I. (2017). How to write a Critically Appraised Topic: evidence to underpin routine clinical practice. British Journal of Dermatology (1951), 177(4), 1007-1013. https://doi.org/10.1111/bjd.15873
Books on Literature Reviews
- << Previous: Home
- Next: Traditional or narrative literature reviews >>
- Last Updated: Aug 11, 2024 4:07 PM
- URL: https://libguides.csu.edu.au/review
Charles Sturt University is an Australian University, TEQSA Provider Identification: PRV12018. CRICOS Provider: 00005F.
Literature Reviews
- Getting Started
Selecting a Review Type
Defining the scope of your review, four common types of reviews.
- Developing a Research Question
- Searching the Literature
- Searching Tips
- ChatGPT [beta]
- Documenting your Search
- Using Citation Managers
- Concept Mapping
- Writing the Review
- Further Resources
More Review Types
This article by Sutton & Booth (2019) explores 48 distinct types of Literature Reviews:
Which Review is Right for You?
The Right Review tool has questions about your lit review process and plans. It offers a qualitative and quantitative option. At completion, you are given a lit review type recommendation.
You'll want to think about the kind of review you are doing. Is it a selective or comprehensive review? Is the review part of a larger work or a stand-alone work ?
For example, if you're writing the Literature Review section of a journal article, that's a selective review which is part of a larger work. Alternatively, if you're writing a review article, that's a comprehensive review which is a stand-alone work. Thinking about this will help you develop the scope of the review.
This exercise will help define the scope of your Literature Review, setting the boundaries for which literature to include and which to exclude.
A FEW GENERAL CONSIDERATIONS WHEN DEFINING SCOPE
- Which populations to investigate — this can include gender, age, socio-economic status, race, geographic location, etc., if the research area includes humans.
- What years to include — if researching the legalization of medicinal cannabis, you might only look at the previous 20 years; but if researching dolphin mating practices, you might extend many more decades.
- Which subject areas — if researching artificial intelligence, subject areas could be computer science, robotics, or health sciences
- How many sources — a selective review for a class assignment might only need ten, while a comprehensive review for a dissertation might include hundreds. There is no one right answer.
- There will be many other considerations that are more specific to your topic.
Most databases will allow you to limit years and subject areas, so look for those tools while searching. See the Searching Tips tab for information on how use these tools.
LITERATURE REVIEW
- Often used as a generic term to describe any type of review
- More precise definition: Published materials that provide an examination of published literature . Can cover wide range of subjects at various levels of comprehensiveness.
- Identifies gaps in research, explains importance of topic, hypothesizes future work, etc.
- Usually written as part of a larger work like a journal article or dissertation
SCOPING REVIEW
- Conducted to address broad research questions with the goal of understanding the extent of research that has been conducted.
- Provides a preliminary assessment of the potential size and scope of available research literature. It aims to identify the nature and extent of research evidence (usually including ongoing research)
- Doesn't assess the quality of the literature gathered (i.e. presence of literature on a topic shouldn’t be conflated w/ the quality of that literature)
- " Preparing scoping reviews for publication using methodological guides and reporting standards " is a great article to read on Scoping Reviews
SYSTEMATIC REVIEW
- Common in the health sciences ( Taubman Health Sciences Library guide to Systematic Reviews )
- Goal: collect all literature that meets specific criteria (methodology, population, treatment, etc.) and then appraise its quality and synthesize it
- Follows strict protocol for literature collection, appraisal and synthesis
- Typically performed by research teams
- Takes 12-18 months to complete
- Often written as a stand alone work
META-ANALYSIS
- Goes one step further than a systematic review by statistically combining the results of quantitative studies to provide a more precise effect of the results.
- << Previous: Getting Started
- Next: Developing a Research Question >>
- Last Updated: May 9, 2024 11:44 AM
- URL: https://guides.lib.umich.edu/litreview
Literature Reviews
- Tools & Visualizations
- Literature Review Examples
- Videos, Books & Links
Business & Econ Librarian
Click to Chat with a Librarian
Text: (571) 248-7542
What is a literature review?
A literature review discusses published information in a particular subject area. Often part of the introduction to an essay, research report or thesis, the literature review is literally a "re" view or "look again" at what has already been written about the topic, wherein the author analyzes a segment of a published body of knowledge through summary, classification, and comparison of prior research studies, reviews of literature, and theoretical articles. Literature reviews provide the reader with a bibliographic history of the scholarly research in any given field of study. As such, as new information becomes available, literature reviews grow in length or become focused on one specific aspect of the topic.
A literature review can be just a simple summary of the sources, but usually contains an organizational pattern and combines both summary and synthesis. A summary is a recap of the important information of the source, whereas a synthesis is a re-organization, or a reshuffling, of that information. The literature review might give a new interpretation of old material or combine new with old interpretations. Or it might trace the intellectual progression of the field, including major debates. Depending on the situation, the literature review may evaluate the sources and advise the reader on the most pertinent or relevant.
A literature review is NOT:
- An annotated bibliography – a list of citations to books, articles and documents that includes a brief description and evaluation for each citation. The annotations inform the reader of the relevance, accuracy and quality of the sources cited.
- A literary review – a critical discussion of the merits and weaknesses of a literary work.
- A book review – a critical discussion of the merits and weaknesses of a particular book.
- Teaching Information Literacy Reframed: 50+ Framework-Based Exercises for Creating Information-Literate Learners
- The UNC Writing Center – Literature Reviews
- The UW-Madison Writing Center: The Writer’s Handbook – Academic and Professional Writing – Learn How to Write a Literature Review
What is the difference between a literature review and a research paper?
The focus of a literature review is to summarize and synthesize the arguments and ideas of others without adding new contributions, whereas academic research papers present and develop new arguments that build upon the previously available body of literature.
How do I write a literature review?
There are many resources that offer step-by-step guidance for writing a literature review, and you can find some of them under Other Resources in the menu to the left. Writing the Literature Review: A Practical Guide suggests these steps:
- Chose a review topic and develop a research question
- Locate and organize research sources
- Select, analyze and annotate sources
- Evaluate research articles and other documents
- Structure and organize the literature review
- Develop arguments and supporting claims
- Synthesize and interpret the literature
- Put it all together
What is the purpose of writing a literature review?
Literature reviews serve as a guide to a particular topic: professionals can use literature reviews to keep current on their field; scholars can determine credibility of the writer in his or her field by analyzing the literature review.
As a writer, you will use the literature review to:
- See what has, and what has not, been investigated about your topic
- Identify data sources that other researches have used
- Learn how others in the field have defined and measured key concepts
- Establish context, or background, for the argument explored in the rest of a paper
- Explain what the strengths and weaknesses of that knowledge and ideas might be
- Contribute to the field by moving research forward
- To keep the writer/reader up to date with current developments in a particular field of study
- Develop alternative research projects
- Put your work in perspective
- Demonstrate your understanding and your ability to critically evaluate research in the field
- Provide evidence that may support your own findings
- Next: Tools & Visualizations >>
- Last Updated: Jul 30, 2024 3:43 PM
- URL: https://subjectguides.library.american.edu/literaturereview
- Research Process
- Manuscript Preparation
- Manuscript Review
- Publication Process
- Publication Recognition
- Language Editing Services
- Translation Services
Systematic Literature Review or Literature Review?
- 3 minute read
- 57.9K views
Table of Contents
As a researcher, you may be required to conduct a literature review. But what kind of review do you need to complete? Is it a systematic literature review or a standard literature review? In this article, we’ll outline the purpose of a systematic literature review, the difference between literature review and systematic review, and other important aspects of systematic literature reviews.
What is a Systematic Literature Review?
The purpose of systematic literature reviews is simple. Essentially, it is to provide a high-level of a particular research question. This question, in and of itself, is highly focused to match the review of the literature related to the topic at hand. For example, a focused question related to medical or clinical outcomes.
The components of a systematic literature review are quite different from the standard literature review research theses that most of us are used to (more on this below). And because of the specificity of the research question, typically a systematic literature review involves more than one primary author. There’s more work related to a systematic literature review, so it makes sense to divide the work among two or three (or even more) researchers.
Your systematic literature review will follow very clear and defined protocols that are decided on prior to any review. This involves extensive planning, and a deliberately designed search strategy that is in tune with the specific research question. Every aspect of a systematic literature review, including the research protocols, which databases are used, and dates of each search, must be transparent so that other researchers can be assured that the systematic literature review is comprehensive and focused.
Most systematic literature reviews originated in the world of medicine science. Now, they also include any evidence-based research questions. In addition to the focus and transparency of these types of reviews, additional aspects of a quality systematic literature review includes:
- Clear and concise review and summary
- Comprehensive coverage of the topic
- Accessibility and equality of the research reviewed
Systematic Review vs Literature Review
The difference between literature review and systematic review comes back to the initial research question. Whereas the systematic review is very specific and focused, the standard literature review is much more general. The components of a literature review, for example, are similar to any other research paper. That is, it includes an introduction, description of the methods used, a discussion and conclusion, as well as a reference list or bibliography.
A systematic review, however, includes entirely different components that reflect the specificity of its research question, and the requirement for transparency and inclusion. For instance, the systematic review will include:
- Eligibility criteria for included research
- A description of the systematic research search strategy
- An assessment of the validity of reviewed research
- Interpretations of the results of research included in the review
As you can see, contrary to the general overview or summary of a topic, the systematic literature review includes much more detail and work to compile than a standard literature review. Indeed, it can take years to conduct and write a systematic literature review. But the information that practitioners and other researchers can glean from a systematic literature review is, by its very nature, exceptionally valuable.
This is not to diminish the value of the standard literature review. The importance of literature reviews in research writing is discussed in this article . It’s just that the two types of research reviews answer different questions, and, therefore, have different purposes and roles in the world of research and evidence-based writing.
Systematic Literature Review vs Meta Analysis
It would be understandable to think that a systematic literature review is similar to a meta analysis. But, whereas a systematic review can include several research studies to answer a specific question, typically a meta analysis includes a comparison of different studies to suss out any inconsistencies or discrepancies. For more about this topic, check out Systematic Review VS Meta-Analysis article.
Language Editing Plus
With Elsevier’s Language Editing Plus services , you can relax with our complete language review of your systematic literature review or literature review, or any other type of manuscript or scientific presentation. Our editors are PhD or PhD candidates, who are native-English speakers. Language Editing Plus includes checking the logic and flow of your manuscript, reference checks, formatting in accordance to your chosen journal and even a custom cover letter. Our most comprehensive editing package, Language Editing Plus also includes any English-editing needs for up to 180 days.
How to Make a PowerPoint Presentation of Your Research Paper
Step-by-Step Guide: How to Craft a Strong Research Hypothesis
You may also like.
Descriptive Research Design and Its Myriad Uses
Five Common Mistakes to Avoid When Writing a Biomedical Research Paper
Making Technical Writing in Environmental Engineering Accessible
To Err is Not Human: The Dangers of AI-assisted Academic Writing
When Data Speak, Listen: Importance of Data Collection and Analysis Methods
Choosing the Right Research Methodology: A Guide for Researchers
Why is data validation important in research?
Writing a good review article
Input your search keywords and press Enter.
About Systematic Reviews
Understanding the Differences Between a Systematic Review vs Literature Review
Automate every stage of your literature review to produce evidence-based research faster and more accurately.
Let’s look at these differences in further detail.
Goal of the Review
The objective of a literature review is to provide context or background information about a topic of interest. Hence the methodology is less comprehensive and not exhaustive. The aim is to provide an overview of a subject as an introduction to a paper or report. This overview is obtained firstly through evaluation of existing research, theories, and evidence, and secondly through individual critical evaluation and discussion of this content.
A systematic review attempts to answer specific clinical questions (for example, the effectiveness of a drug in treating an illness). Answering such questions comes with a responsibility to be comprehensive and accurate. Failure to do so could have life-threatening consequences. The need to be precise then calls for a systematic approach. The aim of a systematic review is to establish authoritative findings from an account of existing evidence using objective, thorough, reliable, and reproducible research approaches, and frameworks.
Level of Planning Required
The methodology involved in a literature review is less complicated and requires a lower degree of planning. For a systematic review, the planning is extensive and requires defining robust pre-specified protocols. It first starts with formulating the research question and scope of the research. The PICO’s approach (population, intervention, comparison, and outcomes) is used in designing the research question. Planning also involves establishing strict eligibility criteria for inclusion and exclusion of the primary resources to be included in the study. Every stage of the systematic review methodology is pre-specified to the last detail, even before starting the review process. It is recommended to register the protocol of your systematic review to avoid duplication. Journal publishers now look for registration in order to ensure the reviews meet predefined criteria for conducting a systematic review [1].
Search Strategy for Sourcing Primary Resources
Learn more about distillersr.
(Article continues below)
Quality Assessment of the Collected Resources
A rigorous appraisal of collected resources for the quality and relevance of the data they provide is a crucial part of the systematic review methodology. A systematic review usually employs a dual independent review process, which involves two reviewers evaluating the collected resources based on pre-defined inclusion and exclusion criteria. The idea is to limit bias in selecting the primary studies. Such a strict review system is generally not a part of a literature review.
Presentation of Results
Most literature reviews present their findings in narrative or discussion form. These are textual summaries of the results used to critique or analyze a body of literature about a topic serving as an introduction. Due to this reason, literature reviews are sometimes also called narrative reviews. To know more about the differences between narrative reviews and systematic reviews , click here.
A systematic review requires a higher level of rigor, transparency, and often peer-review. The results of a systematic review can be interpreted as numeric effect estimates using statistical methods or as a textual summary of all the evidence collected. Meta-analysis is employed to provide the necessary statistical support to evidence outcomes. They are usually conducted to examine the evidence present on a condition and treatment. The aims of a meta-analysis are to determine whether an effect exists, whether the effect is positive or negative, and establish a conclusive estimate of the effect [2].
Using statistical methods in generating the review results increases confidence in the review. Results of a systematic review are then used by clinicians to prescribe treatment or for pharmacovigilance purposes. The results of the review can also be presented as a qualitative assessment when the end goal is issuing recommendations or guidelines.
Risk of Bias
Literature reviews are mostly used by authors to provide background information with the intended purpose of introducing their own research later. Since the search for included primary resources is also less exhaustive, it is more prone to bias.
One of the main objectives for conducting a systematic review is to reduce bias in the evidence outcome. Extensive planning, strict eligibility criteria for inclusion and exclusion, and a statistical approach for computing the result reduce the risk of bias.
Intervention studies consider risk of bias as the “likelihood of inaccuracy in the estimate of causal effect in that study.” In systematic reviews, assessing the risk of bias is critical in providing accurate assessments of overall intervention effect [3].
With numerous review methods available for analyzing, synthesizing, and presenting existing scientific evidence, it is important for researchers to understand the differences between the review methods. Choosing the right method for a review is crucial in achieving the objectives of the research.
[1] “Systematic Review Protocols and Protocol Registries | NIH Library,” www.nihlibrary.nih.gov . https://www.nihlibrary.nih.gov/services/systematic-review-service/systematic-review-protocols-and-protocol-registries
[2] A. B. Haidich, “Meta-analysis in medical research,” Hippokratia , vol. 14, no. Suppl 1, pp. 29–37, Dec. 2010, [Online]. Available: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3049418/#:~:text=Meta%2Danalyses%20are%20conducted%20to
3 Reasons to Connect
- Chester Fritz Library
- Library of the Health Sciences
- Thormodsgard Law Library
Literature Reviews
- Get started
Literature Reviews within a Scholarly Work
Literature reviews as a scholarly work.
- Finding Literature Reviews
- Your Literature Search
- Library Books
- How to Videos
- Communicating & Citing Research
- Bibliography
Literature reviews summarize and analyze what has been written on a particular topic and identify gaps or disagreements in the scholarly work on that topic.
Within a scholarly work, the literature review situates the current work within the larger scholarly conversation and emphasizes how that particular scholarly work contributes to the conversation on the topic. The literature review portion may be as brief as a few paragraphs focusing on a narrow topic area.
When writing this type of literature review, it's helpful to start by identifying sources most relevant to your research question. A citation tracking database such as Web of Science can also help you locate seminal articles on a topic and find out who has more recently cited them. See "Your Literature Search" for more details.
A literature review may itself be a scholarly publication and provide an analysis of what has been written on a particular topic without contributing original research. These types of literature reviews can serve to help keep people updated on a field as well as helping scholars choose a research topic to fill gaps in the knowledge on that topic. Common types include:
Systematic Review
Systematic literature reviews follow specific procedures in some ways similar to setting up an experiment to ensure that future scholars can replicate the same steps. They are also helpful for evaluating data published over multiple studies. Thus, these are common in the medical field and may be used by healthcare providers to help guide diagnosis and treatment decisions. Cochrane Reviews are one example of this type of literature review.
Semi-Systematic Review
When a systematic review is not feasible, a semi-systematic review can help synthesize research on a topic or how a topic has been studied in different fields (Snyder 2019). Rather than focusing on quantitative data, this review type identifies themes, theoretical perspectives, and other qualitative information related to the topic. These types of reviews can be particularly helpful for a historical topic overview, for developing a theoretical model, and for creating a research agenda for a field (Snyder 2019). As with systematic reviews, a search strategy must be developed before conducting the review.
Integrative Review
An integrative review is less systematic and can be helpful for developing a theoretical model or to reconceptualize a topic. As Synder (2019) notes, " This type of review often re quires a more creative collection of data, as the purpose is usually not to cover all articles ever published on the topic but rather to combine perspectives and insights from di ff erent fi elds or research traditions" (p. 336).
Sythesize and compare evidence | Quantitative, comprehensive for specific area, systematic search strategy, informs policy/practice | Health sciences, social sciences, STEM | |
Overview research area & changes over time | Quantitative or qualitative, less detailed/thorough search strategy, identifies themes or research gaps or develops a theoretical model or provides a history of the field | All | |
Synthesize literature to develop new perspectives or theories | Qualitative, non-systematic search strategy, combines ideas from different fields, focus on creating new frameworks or theories by critiquing previous ideas | Social sciences, humanities |
Source: Snyder, H. (2019). Literature review as a research methodology: An overview and guidelines. Journal of Business Research. 104. 333-339. doi: 10.1016/j.jbusres.2019.07.039
- << Previous: Get started
- Next: Finding Literature Reviews >>
- Last Updated: Aug 8, 2024 11:27 AM
- URL: https://libguides.und.edu/literature-reviews
How to Write a Literature Review
- What is a literature review
How is a literature review different from a research paper?
- What should I do before starting my literature review?
- What type of literature review should I write and how should I organize it?
- What should I be aware of while writing the literature review?
- For more information on Literature Reviews
- More Research Help
The purpose of an academic research paper is to develop a new argument. The literature review is one part of a research paper. In a research paper, you use the literature review as a foundation and as support for the new insight that you contribute. The focus of a literature review, however, is to summarize and analyze the arguments and ideas of others without adding new contributions.
- << Previous: What is a literature review
- Next: What should I do before starting my literature review? >>
- Last Updated: Feb 26, 2021 11:35 AM
- URL: https://midway.libguides.com/LiteratureReview
RESEARCH HELP
- Research Guides
- Databases A-Z
- Journal Search
- Citation Help
LIBRARY SERVICES
- Accessibility
- Interlibrary Loan
- Study Rooms
INSTRUCTION SUPPORT
- Course Reserves
- Library Instruction
- Little Memorial Library
- 512 East Stephens Street
- 859.846.5316
- [email protected]
- About Covidence and systematic reviews
What are the different types of review?
Systematic literature reviews (slrs).
SLR’s attempt to collate all empirical evidence that fit pre-specified eligibility criteria in order to answer a specific clearly-formulated research question. A SLR uses explicit and reproducible systematic methods that are selected with a view to minimizing bias, thus providing more reliable findings from which conclusions can be drawn and decisions made.
The process starts with a research question and a protocol or research plan. A review team searches for studies to answer the question using a highly sensitive search strategy. The retrieved studies are then screened for eligibility using pre-specified inclusion and exclusion criteria (this is done by at least two people working independently). Next, the reviewers extract the relevant data and assess the quality of the included studies. Finally, the review team synthesizes the extracted study data and presents the results.
A SLR may contain meta-analyses (statistical analysis). A SLR which is continually updated, incorporating relevant new evidence as it becomes available is often known as a living SLR.
Rapid reviews
Rapid reviews aim to produce a rigorous synthesis quickly (due to time constraints/urgency), based on a pre-defined research question. The review process for rapid reviews is the same as for a more traditional systematic review: the emphasis is on a replicable pre-specified search, and screening methods that minimize the risk of bias, although potentially isn’t as stringent as a formal systematic review.
The process operates within pre-specified limits (for example, by restricting searches to articles published during a specific timeframe) and is usually run by a multidisciplinary team with expertise in systematic review methods.
Umbrella reviews or Overview of reviews
An umbrella review is a review of multiple systematic reviews. The process uses explicit and systematic methods to search for, and identify, systematic reviews on related research questions in the same topic area. The purpose of an umbrella review is to synthesize the results of the systematic reviews across important outcomes.
Scoping reviews
Scoping reviews are exploratory and they typically address a broad question, compared to a systematic review that typically has a more targeted question.
Researchers conduct scoping reviews to assess the extent of the available evidence, to organize it into groups and to highlight gaps. If a scoping review finds no studies, this might help researchers to decide that a systematic review is likely to be of limited value and that resources could be better directed elsewhere.
Literature reviews or narrative reviews
Literature, or narrative, reviews provide an overview of what is known about a particular topic. They evaluate the material, rather than simply restating it, but the methods used to do this are not usually prespecified and they are not described in detail in the review. The search might be comprehensive but it does not aim to be exhaustive. Literature reviews are often topic based and can take the form of a discussion. Literature reviews lack precision and replicability and can present their findings in the context of what has come before. Often, this sort of synthesis does not attempt to control for the author’s own bias. The results or conclusion of a literature review is likely to be presented in a narrative format rather than statistical methods.
Take a look at the articles about the different types of review on the Covidence blog:
- Systematic review types: meet the family
- The difference between a systematic review and a literature review
- The difference between a systematic review and a meta-analysis
An official website of the United States government
The .gov means it’s official. Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.
The site is secure. The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.
- Publications
- Account settings
Preview improvements coming to the PMC website in October 2024. Learn More or Try it out now .
- Advanced Search
- Journal List
- v.8(11); 2016 Nov
How to Conduct a Systematic Review: A Narrative Literature Review
Nusrat jahan.
1 Psychiatry, Mount Sinai Chicago
Sadiq Naveed
2 Psychiatry, KVC Prairie Ridge Hospital
Muhammad Zeshan
3 Department of Psychiatry, Bronx Lebanon Hospital Icahn School of Medicine at Mount Sinai, Bronx, NY
Muhammad A Tahir
4 Psychiatry, Suny Upstate Medical University, Syracuse, NY
Systematic reviews are ranked very high in research and are considered the most valid form of medical evidence. They provide a complete summary of the current literature relevant to a research question and can be of immense use to medical professionals. Our goal with this paper is to conduct a narrative review of the literature about systematic reviews and outline the essential elements of a systematic review along with the limitations of such a review.
Introduction and background
A literature review provides an important insight into a particular scholarly topic. It compiles published research on a topic, surveys different sources of research, and critically examines these sources [ 1 ]. A literature review may be argumentative, integrative, historical, methodological, systematic, or theoretical, and these approaches may be adopted depending upon the types of analysis in a particular study [ 2 ].
Our topic of interest in this article is to understand the different steps of conducting a systematic review. Systematic reviews, according to Wright, et al., are defined as a “review of the evidence on a clearly formulated question that uses systematic and explicit methods to identify, select and critically appraise relevant primary research, and to extract and analyze data from the studies that are included in the review” [ 3 ]. A systematic review provides an unbiased assessment of these studies [ 4 ]. Such reviews emerged in the 1970s in the field of social sciences. Systematic reviews, as well as the meta-analyses of the appropriate studies, can be the best form of evidence available to clinicians [ 3 ]. The unsystematic narrative review is more likely to include only research selected by the authors, which introduces bias and, therefore, frequently lags behind and contradicts the available evidence [ 5 ].
Epidemiologist Archie Cochrane played a vital role in formulating the methodology of the systematic review [ 6 ]. Dr. Cochrane loved to study patterns of disease and how these related to the environment. In the early 1970s, he found that many decisions in health care were made without reliable, up-to-date evidence about the treatments used [ 6 ].
A systematic review may or may not include meta-analysis, depending on whether results from different studies can be combined to provide a meaningful conclusion. David Sackett defined meta-analysis as a “specific statistical strategy for assembling the results of several studies into a single estimate” [ 7 - 8 ].
While the systematic review has several advantages, it has several limitations which can affect the conclusion. Inadequate literature searches and heterogeneous studies can lead to false conclusions. Similarly, the quality of assessment is an important step in systematic reviews, and it can lead to adverse consequences if not done properly.
The purpose of this article is to understand the important steps involved in conducting a systematic review of all kinds of clinical studies. We conducted a narrative review of the literature about systematic reviews with a special focus on articles that discuss conducting reviews of randomized controlled trials. We discuss key guidelines and important terminologies and present the advantages and limitations of systematic reviews.
Narrative reviews are a discussion of important topics on a theoretical point of view, and they are considered an important educational tool in continuing medical education [ 9 ]. Narrative reviews take a less formal approach than systematic reviews in that narrative reviews do not require the presentation of the more rigorous aspects characteristic of a systematic review such as reporting methodology, search terms, databases used, and inclusion and exclusion criteria [ 9 ]. With this in mind, our narrative review will give a detailed explanation of the important steps of a systematic review.
Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) checklist
Systematic reviews are conducted based on predefined criteria and protocol. The PRISMA-P checklist, developed by Moher, et al., contains 17 items (26 including sub-items) comprising the important steps of a systematic review, including information about authors, co-authors, their mailing and email addresses, affiliations, and any new or updated version of a previous systematic review [ 9 ]. It also identifies a plan for documenting important protocol amendments, registry names, registration numbers, financial disclosures, and other support services [ 10 ]. Moher, et al. also state that methods of systematic reviews involve developing eligibility criteria and describing information sources, search strategies, study selection processes, outcomes, assessment of bias in individual studies, and data synthesis [ 10 ].
Research question
Writing a research question is the first step in conducting a systematic review and is of paramount importance as it outlines both the need and validity of systematic reviews (Nguyen, et al., unpublished data). It also increases the efficiency of the review by limiting the time and cost of identifying and obtaining relevant literature [ 11 ]. The research question should summarize the main objective of a systematic review.
An example research question might read, “How does attention-deficit/hyperactivity disorder (ADHD) affect the academic performance of middle school children in North America?” The question focuses on the type of data, analysis, and topic to be discussed (i.e., ADHD among North American middle school students). Try to avoid research questions that are too narrow or broad—they can lead to the selection of only a few studies and the ability to generalize results to any other populations may be limited. An example of a research question that is too narrow would be, “What is the prevalence of ADHD in children and adolescents in Chicago, IL?” Alternately, if the research question is too broad, it can be difficult to reach a conclusion due to poor methodology. An example of a research question that is too broad in scope would be, “What are the effects of ADHD on the functioning of children and adolescents in North America?”
Different tools that can be used to help devise a research question, depending on the type of question, are: population, intervention, comparator, and outcomes (PICO); sample, phenomenon of interest, design, evaluation, and research type (SPIDER); setting, perspective, intervention, comparison, and evaluation (SPICE); and expectation, client group, location, impact, professionals, and service (ECLIPSE).
The PICO approach is mostly used to compare different interventions with each other. It helps to formulate a research question related to prognosis, diagnosis, and therapies [ 12 ].
Scenario: A 50-year-old white woman visited her psychiatrist with a diagnosis of major depressive disorder. She was prescribed fluoxetine, which she feels has been helpful. However, she experienced some unpleasant side effects of nausea and abdominal discomfort. She has recently been told by a friend about the use of St. John’s wort in treating depression and would like to try this in treating her current depression. (Formulating research questions, unpublished data).
In the above-mentioned scenario, the sample population is a 50-year-old female with major depressive disorder; the intervention is St. John’s wort; the comparison is fluoxetine; and the outcome would be efficacy and safety. In order to see the outcome of both efficacy and safety, we will compare the efficacy and safety of both St. John’s wort and fluoxetine in a sample population for treating depression. This scenario represents an example where we can apply the PICO approach to compare two interventions.
In contrast, the SPIDER approach is focused more on study design and samples rather than populations [ 13 ]. The SPIDER approach can be used in this research question: “What is the experience of psychiatry residents attending a transgender education?” The sample is psychiatry residents; the phenomenon of interest is transgender education; the design is a survey; the evaluation looks at the experience; and the research type is qualitative.
The SPICE approach can be used to evaluate the outcome of a service, intervention, or project [ 14 ]. The SPICE approach applies to the following research question: “In psychiatry clinics, does the combined use of selective serotonin reuptake inhibitor (SSRI) and psychotherapy reduce depression in an outpatient clinic versus SSRI therapy alone?” The setting is the psychiatry clinic; the perspective/population is the outpatient; the intervention is combined psychotherapy and SSRI; the comparison is SSRI alone; and the evaluation is reduced depression.
The ECLIPSE approach is useful for evaluating the outcome of a policy or service (Nguyen, et al., unpublished data). ECLIPSE can apply in the following research question: “How can a resident get access to medical records of patients admitted to inpatient from other hospitals?” The expectation is: “What are you looking to improve/change to increase access to medical records for patients admitted to inpatient?” The client group is the residents; the location is the inpatient setting; the impact would be the residents having easy access to medical records from other hospitals; and the professionals in this scenario would be those involved in improving the service experiences such as hospital administrators and IT staff.
Inclusion and exclusion criteria
Establishing inclusion and exclusion criteria come after formulating research questions. The concept of inclusion and exclusion of data in a systematic review provides a basis on which the reviewer draws valid and reliable conclusions regarding the effect of the intervention for the disorder under consideration [ 11 ]. Inclusions and exclusion are based on preset criteria for specific systematic review. It should be done before starting the literature search in order to minimize the possibility of bias.
Eligibility criteria provide the boundaries of the systematic review [ 15 ]. Participants, interventions, and comparison of a research question provide the basis for eligibility criteria [ 15 ]. The inclusion criteria should be able to identify the studies of interest and, if the inclusion criteria are too broad or too narrow, it can lead to an ineffective screening process.
Protocol registration
Developing and registering research protocol is another important step of conducting a systematic review. The research protocol ensures that a systematic review is carefully planned and explicitly documented before the review starts, thus promoting consistency in conduct for the review team and supporting the accountability, research integrity, and transparency of the eventually completed review [ 10 ]. PROSPERO and the Cochrane Database of Systematic Reviews are utilized for registering research protocols and research questions, and they check for prior existing duplicate protocols or research questions. PROSPERO is an international database of prospectively registered systematic reviews related to health care and social sciences (PRISMA, 2016). It is funded by the National Institute for Health Research. The Cochrane Collaboration concentrates on producing systematic reviews of interventions and diagnostic test accuracy but does not currently produce reviews on questions of prognosis or etiology [ 16 ].
A detailed and extensive search strategy is important for the systematic review since it minimizes bias in the review process [ 17 ].
Selecting and searching appropriate electronic databases is determined by the topic of interest. Important databases are: MEDLARS Online (MEDLINE), which is the online counterpart to the Medical Literature Analysis and Retrieval System (MEDLARS); Excerpta Medica Database (EMBASE); and Google Scholar. There are multiple electronic databases available based on the area of interest. Other important databases include: PsycINFO for psychology and psychiatry; Allied and Complementary Medicine Database (AMED) for complementary medicine; Manual, Alternative, and Natural Therapy Index System (MANTIS) for alternative medical literature; and Cumulative Index to Nursing and Allied Health Literature (CINAHL) for nursing and allied health [ 15 ].
Additional studies relevant for the review may be found by looking at the references of studies identified by different databases [ 15 ]. Non-indexed articles may be found by searching the content of journals, conferences proceedings, and abstracts. It will also help with letters and commentaries which may not get indexed [ 15 ]. Reviewing clinical trial registries can provide information about any ongoing trials or unpublished research [ 15 ]. A gray literature search can access unpublished papers, reports, and conference reports, and it generally covers studies that are published in an informal fashion, rather than in an indexed journal [ 15 ]. Further search can be performed by selecting important key articles and going through in-text citations [ 15 ].
Using Boolean operators, truncation, and wildcards
Boolean operators use the relationship between different search words to help with the search strategy. These are simple words (i.e., AND, OR, and NOT) which can help with more focused and productive results (poster, Jahan, et al.: How to conduct a systematic review. APPNA 39th Summer Convention. Washington, DC. 2016). The Boolean operator AND finds articles with all the search words. The use of OR broadens the focus of the search, and it will include articles with at least one search term. The researchers can also ignore certain results from the records by using NOT in the search strategy.
An example of AND would be using “depression” AND “children” in the search strategy with the goal of studying depression in children. This search strategy will include all the articles about both depression and children. The researchers may use OR if the emphasis of the study is mood disorders or affective disorders in adolescents. In that case, the search strategy will be “mood disorders” OR “affective disorders” AND “adolescents.” This search will find all the articles about mood disorders or affective disorders in adolescents. The researchers can use NOT if they only want to study depression in children and want to ignore bipolar disorder from the search. An example search in this scenario would be “depression” NOT “bipolar disorder” AND “children.” This will help ignore studies related to bipolar disorder in children.
Truncation and wildcards are other tools to make search strategy more comprehensive and focused. While the researchers search a database for certain articles, they frequently face terminologies that have the same initial root of a word but different endings. An example would be "autism," "autistic," and "autism spectrum disorder." These words have a similar initial root derived from “autis” but they end differently in each case. The truncation symbol (*) retrieves articles that contain words beginning with “autis” plus any additional characters. Wildcards are used for words with the same meanings but different spellings due to various reasons. For the words with spelling variations of a single letter, wildcard symbols can be used. When the researcher inputs “M+N” in the search bar, this returns results containing both “man” or “men” as the wildcard accounts for the spelling variations between the letters M and N.
Study selection
Study selection should be performed in a systematic manner, so reviewers deal with fewer errors and a lower risk of bias (online course, Li T, Dickersin K: Introduction to systematic review and meta-analysis. 2016. https://www.coursera.org/learn/systematic-review #). Study selection should involve two independent reviewers who select studies using inclusion and exclusion criteria. Any disagreements during this process should be resolved by discussion or by a third reviewer [ 10 ]. Specific study types can be selected depending on the research question. For example, questions on incidence and prevalence can be answered by surveys and cohort studies. Clinical trials can provide answers to questions related to therapy and screening. Queries regarding diagnostic accuracy can be answered by clinical trials and cross-sectional studies (online course, Li T, Dickersin K: Introduction to systematic review and meta-analysis. 2016. https://www.coursera.org/learn/systematic-review #). Prognosis and harm-related questions should use cohort studies and clinical trials, and etiology questions should use case-control and cohort studies (online course, Li T, Dickersin K: Introduction to systematic review and meta-analysis. 2016. https://www.coursera.org/learn/systematic-review #).
Data screening and data extractions are two of the major steps in conducting a systematic review [ 18 ]. Data screening involves searching for relevant articles in different databases using keywords. The next step of data screening is manuscript selection by reviewing each manuscript in the search results to compare that manuscript against the inclusion criteria [ 18 ]. The researchers should also review the references of the papers selected before selecting the final paper, which is the last step of data screening [ 18 ].
The next stage is extracting and appraising the data of the included articles [ 18 ]. A data extraction form should be used to help reduce the number of errors, and more than one person should record the data [ 17 ]. Data should be collected on specific points like population type, study authors, agency, study design, humanitarian crisis, target age groups, research strengths from the literature, setting, study country, type(s) of public health intervention, and health outcome(s) addressed by the public health intervention. All this information should then be put into an electronic database [ 18 ].
Assessing bias
Bias is a systematic error (or deviation from the truth) in results or inferences. Biases can change the results of any study and lead to an underestimation or overestimation of the true intervention effect [ 19 ]. Biases can impact any aspect of a review, including selecting studies, collecting and extracting data, and making a conclusion. Biases can vary in magnitude; some are small, with negligible effect, but some are substantial to a degree where an apparent finding may be entirely due to bias [ 19 ]. There are different types of bias, including, but not limited to, selection, detection, attrition, reporting, and performance.
Selection bias occurs when a sample selected is not representative of the whole general population. If randomization of the sample is done correctly, then chances of selection bias can be minimized [ 20 ].
Detection bias refers to systematic differences between groups in how outcomes are determined. This type of bias is based on knowledge of the intervention provided and its outcome [ 19 ].
Attrition bias refers to systematic differences between groups in withdrawals from a study [ 19 ]. The data will be considered incomplete if some subjects are withdrawn or have irregular visits during data collection.
Reporting bias refers to systematic differences between reported and unreported findings, and it is commonly seen during article reviews. Reporting bias is based on reviewer judgment about the outcome of selected articles [ 20 ].
Performance bias develops due to the knowledge of the allocated interventions by participants and personnel during the study [ 20 ]. Using a double-blind study design helps prevent performance bias, where neither the experimenter nor the subjects know which group contains controls and which group contains the test article [ 14 ].
Last step of systematic review: discussion
The discussion of a systematic review is where a summary of the available evidence for different outcomes is written and discussed [ 10 ]. The limitations of a systematic review are also discussed in detail. Finally, a conclusion is drawn after evaluating the results and considering limitations [ 10 ].
Discussion of the current article
Systematic reviews with or without a meta-analysis are currently ranked to be the best available evidence in the hierarchy of evidence-based practice [ 21 ]. We have discussed the methodology of a systematic review. A systematic review is classified in the category of filtered information because it appraises the quality of the study and its application in the field of medicine [ 21 ]. However, there are some limitations of the systematic review, as we mentioned earlier in our article. A large randomized controlled trial may provide a better conclusion than a systematic review of many smaller trials due to their larger sample sizes [ 22 ], which help the researchers generalize their conclusions for a bigger population. Other important factors to consider include higher dropout rates in large studies, co-interventions, and heterogeneity among studies included in the review.
As we discussed the limitations of the systematic review and its effect on quality of evidence, there are several tools to rate the evidence, such as the Grading of Recommendations Assessment, Development and Evaluation (GRADE) system [ 22 ]. GRADE provides a structured approach to evaluating the risk of bias, serious inconsistency between studies, indirectness, imprecision of the results, and publication bias [ 22 ]. Another approach used to rate the quality of evidence is a measurement tool to assess systematic reviews (AMSTAR) [ 23 ]. It is also available in several languages [ 23 ].
Conclusions
Despite its limitations, a systematic review can add to the knowledge of the scientific community especially when there are gaps in the existing knowledge. However, conducting a systematic review requires different steps that involve different tools and strategies. It can be difficult at times to access and utilize these resources. A researcher can understand and strategize a systematic review following the different steps outlined in this literature review. However, conducting a systematic review requires a thorough understanding of all the concepts and tools involved, which is an extensive endeavor to be summed up in one article.
The Cochrane Handbook for Systematic Reviews of Interventions and the Center for Reviews and Dissemination (CRD) provide excellent guidance through their insightful and detailed guidelines. We recommend consulting these resources for further guidance.
Given that our article is a narrative review of the scholarly literature, it contains the same limitations as noted for any narrative review. We hope that our review of the means and methods for conducting a systematic review will be helpful in providing basic knowledge to utilize the resources available to the scientific community.
The content published in Cureus is the result of clinical experience and/or research by independent individuals or organizations. Cureus is not responsible for the scientific accuracy or reliability of data or conclusions published herein. All content published within Cureus is intended only for educational, research and reference purposes. Additionally, articles published within Cureus should not be deemed a suitable substitute for the advice of a qualified health care professional. Do not disregard or avoid professional medical advice due to content published within Cureus.
The authors have declared that no competing interests exist.
How do I Write a Literature Review?: #5 Writing the Review
- Step #1: Choosing a Topic
- Step #2: Finding Information
- Step #3: Evaluating Content
- Step #4: Synthesizing Content
- #5 Writing the Review
- Citing Your Sources
WRITING THE REVIEW
You've done the research and now you're ready to put your findings down on paper. When preparing to write your review, first consider how will you organize your review.
The actual review generally has 5 components:
Abstract - An abstract is a summary of your literature review. It is made up of the following parts:
- A contextual sentence about your motivation behind your research topic
- Your thesis statement
- A descriptive statement about the types of literature used in the review
- Summarize your findings
- Conclusion(s) based upon your findings
Introduction : Like a typical research paper introduction, provide the reader with a quick idea of the topic of the literature review:
- Define or identify the general topic, issue, or area of concern. This provides the reader with context for reviewing the literature.
- Identify related trends in what has already been published about the topic; or conflicts in theory, methodology, evidence, and conclusions; or gaps in research and scholarship; or a single problem or new perspective of immediate interest.
- Establish your reason (point of view) for reviewing the literature; explain the criteria to be used in analyzing and comparing literature and the organization of the review (sequence); and, when necessary, state why certain literature is or is not included (scope) -
Body : The body of a literature review contains your discussion of sources and can be organized in 3 ways-
- Chronological - by publication or by trend
- Thematic - organized around a topic or issue, rather than the progression of time
- Methodical - the focusing factor usually does not have to do with the content of the material. Instead, it focuses on the "methods" of the literature's researcher or writer that you are reviewing
You may also want to include a section on "questions for further research" and discuss what questions the review has sparked about the topic/field or offer suggestions for future studies/examinations that build on your current findings.
Conclusion : In the conclusion, you should:
Conclude your paper by providing your reader with some perspective on the relationship between your literature review's specific topic and how it's related to it's parent discipline, scientific endeavor, or profession.
Bibliography : Since a literature review is composed of pieces of research, it is very important that your correctly cite the literature you are reviewing, both in the reviews body as well as in a bibliography/works cited. To learn more about different citation styles, visit the " Citing Your Sources " tab.
- Writing a Literature Review: Wesleyan University
- Literature Review: Edith Cowan University
- << Previous: Step #4: Synthesizing Content
- Next: Citing Your Sources >>
- Last Updated: Aug 22, 2023 1:35 PM
- URL: https://libguides.eastern.edu/literature_reviews
About the Library
- Collection Development
- Circulation Policies
- Mission Statement
- Staff Directory
Using the Library
- A to Z Journal List
- Library Catalog
- Research Guides
Interlibrary Services
- Research Help
Warner Memorial Library
- Open access
- Published: 19 November 2018
Systematic review or scoping review? Guidance for authors when choosing between a systematic or scoping review approach
- Zachary Munn ORCID: orcid.org/0000-0002-7091-5842 1 ,
- Micah D. J. Peters 1 ,
- Cindy Stern 1 ,
- Catalin Tufanaru 1 ,
- Alexa McArthur 1 &
- Edoardo Aromataris 1
BMC Medical Research Methodology volume 18 , Article number: 143 ( 2018 ) Cite this article
920k Accesses
2708 Citations
859 Altmetric
Metrics details
Scoping reviews are a relatively new approach to evidence synthesis and currently there exists little guidance regarding the decision to choose between a systematic review or scoping review approach when synthesising evidence. The purpose of this article is to clearly describe the differences in indications between scoping reviews and systematic reviews and to provide guidance for when a scoping review is (and is not) appropriate.
Researchers may conduct scoping reviews instead of systematic reviews where the purpose of the review is to identify knowledge gaps, scope a body of literature, clarify concepts or to investigate research conduct. While useful in their own right, scoping reviews may also be helpful precursors to systematic reviews and can be used to confirm the relevance of inclusion criteria and potential questions.
Conclusions
Scoping reviews are a useful tool in the ever increasing arsenal of evidence synthesis approaches. Although conducted for different purposes compared to systematic reviews, scoping reviews still require rigorous and transparent methods in their conduct to ensure that the results are trustworthy. Our hope is that with clear guidance available regarding whether to conduct a scoping review or a systematic review, there will be less scoping reviews being performed for inappropriate indications better served by a systematic review, and vice-versa.
Peer Review reports
Systematic reviews in healthcare began to appear in publication in the 1970s and 1980s [ 1 , 2 ]. With the emergence of groups such as Cochrane and the Joanna Briggs Institute (JBI) in the 1990s [ 3 ], reviews have exploded in popularity both in terms of the number conducted [ 1 ], and their uptake to inform policy and practice. Today, systematic reviews are conducted for a wide range of purposes across diverse fields of inquiry, different evidence types and for different questions [ 4 ]. More recently, the field of evidence synthesis has seen the emergence of scoping reviews, which are similar to systematic reviews in that they follow a structured process, however they are performed for different reasons and have some key methodological differences [ 5 , 6 , 7 , 8 ]. Scoping reviews are now seen as a valid approach in those circumstances where systematic reviews are unable to meet the necessary objectives or requirements of knowledge users. There now exists clear guidance regarding the definition of scoping reviews, how to conduct scoping reviews and the steps involved in the scoping review process [ 6 , 8 ]. However, the guidance regarding the key indications or reasons why reviewers may choose to follow a scoping review approach is not as straightforward, with scoping reviews often conducted for purposes that do not align with the original indications as proposed by Arksey and O’Malley [ 5 , 6 , 7 , 8 , 9 , 10 ]. As editors and peer reviewers for various journals we have noticed that there is inconsistency and confusion regarding the indications for scoping reviews and a lack of clarity for authors regarding when a scoping review should be performed as opposed to a systematic review. The purpose of this article is to provide practical guidance for reviewers on when to perform a systematic review or a scoping review, supported with some key examples.
Indications for systematic reviews
Systematic reviews can be broadly defined as a type of research synthesis that are conducted by review groups with specialized skills, who set out to identify and retrieve international evidence that is relevant to a particular question or questions and to appraise and synthesize the results of this search to inform practice, policy and in some cases, further research [ 11 , 12 , 13 ]. According to the Cochrane handbook, a systematic review ‘uses explicit, systematic methods that are selected with a view to minimizing bias, thus providing more reliable findings from which conclusions can be drawn and decisions made.’ [ 14 ] Systematic reviews follow a structured and pre-defined process that requires rigorous methods to ensure that the results are both reliable and meaningful to end users. These reviews may be considered the pillar of evidence-based healthcare [ 15 ] and are widely used to inform the development of trustworthy clinical guidelines [ 11 , 16 , 17 ].
A systematic review may be undertaken to confirm or refute whether or not current practice is based on relevant evidence, to establish the quality of that evidence, and to address any uncertainty or variation in practice that may be occurring. Such variations in practice may be due to conflicting evidence and undertaking a systematic review should (hopefully) resolve such conflicts. Conducting a systematic review may also identify gaps, deficiencies, and trends in the current evidence and can help underpin and inform future research in the area. Systematic reviews can be used to produce statements to guide clinical decision-making, the delivery of care, as well as policy development [ 12 ]. Broadly, indications for systematic reviews are as follows [ 4 ]:
Uncover the international evidence
Confirm current practice/ address any variation/ identify new practices
Identify and inform areas for future research
Identify and investigate conflicting results
Produce statements to guide decision-making
Despite the utility of systematic reviews to address the above indications, there are cases where systematic reviews are unable to meet the necessary objectives or requirements of knowledge users or where a methodologically robust and structured preliminary searching and scoping activity may be useful to inform the conduct of the systematic reviews. As such, scoping reviews (which are also sometimes called scoping exercises/scoping studies) [ 8 ] have emerged as a valid approach with rather different indications to those for systematic reviews. It is important to note here that other approaches to evidence synthesis have also emerged, including realist reviews, mixed methods reviews, concept analyses and others [ 4 , 18 , 19 , 20 ]. This article focuses specifically on the choice between a systematic review or scoping review approach.
Indications for scoping reviews
True to their name, scoping reviews are an ideal tool to determine the scope or coverage of a body of literature on a given topic and give clear indication of the volume of literature and studies available as well as an overview (broad or detailed) of its focus. Scoping reviews are useful for examining emerging evidence when it is still unclear what other, more specific questions can be posed and valuably addressed by a more precise systematic review [ 21 ]. They can report on the types of evidence that address and inform practice in the field and the way the research has been conducted.
The general purpose for conducting scoping reviews is to identify and map the available evidence [ 5 , 22 ]. Arskey and O’Malley, authors of the seminal paper describing a framework for scoping reviews, provided four specific reasons why a scoping review may be conducted [ 5 , 6 , 7 , 22 ]. Soon after, Levac, Colquhoun and O’Brien further clarified and extended this original framework [ 7 ]. These authors acknowledged that at the time, there was no universally recognized definition of scoping reviews nor a commonly acknowledged purpose or indication for conducting them. In 2015, a methodological working group of the JBI produced formal guidance for conducting scoping reviews [ 6 ]. However, we have not previously addressed and expanded upon the indications for scoping reviews. Below, we build upon previously described indications and suggest the following purposes for conducting a scoping review:
To identify the types of available evidence in a given field
To clarify key concepts/ definitions in the literature
To examine how research is conducted on a certain topic or field
To identify key characteristics or factors related to a concept
As a precursor to a systematic review.
To identify and analyse knowledge gaps
Deciding between a systematic review and a scoping review approach
Authors deciding between the systematic review or scoping review approach should carefully consider the indications discussed above for each synthesis type and determine exactly what question they are asking and what purpose they are trying to achieve with their review. We propose that the most important consideration is whether or not the authors wish to use the results of their review to answer a clinically meaningful question or provide evidence to inform practice. If the authors have a question addressing the feasibility, appropriateness, meaningfulness or effectiveness of a certain treatment or practice, then a systematic review is likely the most valid approach [ 11 , 23 ]. However, authors do not always wish to ask such single or precise questions, and may be more interested in the identification of certain characteristics/concepts in papers or studies, and in the mapping, reporting or discussion of these characteristics/concepts. In these cases, a scoping review is the better choice.
As scoping reviews do not aim to produce a critically appraised and synthesised result/answer to a particular question, and rather aim to provide an overview or map of the evidence. Due to this, an assessment of methodological limitations or risk of bias of the evidence included within a scoping review is generally not performed (unless there is a specific requirement due to the nature of the scoping review aim) [ 6 ]. Given this assessment of bias is not conducted, the implications for practice (from a clinical or policy making point of view) that arise from a scoping review are quite different compared to those of a systematic review. In some cases, there may be no need or impetus to make implications for practice and if there is a need to do so, these implications may be significantly limited in terms of providing concrete guidance from a clinical or policy making point of view. Conversely, when we compare this to systematic reviews, the provision of implications for practice is a key feature of systematic reviews and is recommended in reporting guidelines for systematic reviews [ 13 ].
Exemplars for different scoping review indications
In the following section, we elaborate on each of the indications listed for scoping reviews and provide a number of examples for authors considering a scoping review approach.
Scoping reviews that seek to identify the types of evidence in a given field share similarities with evidence mapping activities as explained by Bragge and colleagues in a paper on conducting scoping research in broad topic areas [ 24 ]. Chambers and colleagues [ 25 ] conducted a scoping review in order to identify current knowledge translation resources (and any evaluations of them) that use, adapt and present findings from systematic reviews to suit the needs of policy makers. Following a comprehensive search across a range of databases, organizational websites and conference abstract repositories based upon predetermined inclusion criteria, the authors identified 20 knowledge translation resources which they classified into three different types (overviews, summaries and policy briefs) as well as seven published and unpublished evaluations. The authors concluded that evidence synthesists produce a range of resources to assist policy makers to transfer and utilize the findings of systematic reviews and that focussed summaries are the most common. Similarly, a scoping review was conducted by Challen and colleagues [ 26 ] in order to determine the types of available evidence identifying the source and quality of publications and grey literature for emergency planning. A comprehensive set of databases and websites were investigated and 1603 relevant sources of evidence were identified mainly addressing emergency planning and response with fewer sources concerned with hazard analysis, mitigation and capability assessment. Based on the results of the review, the authors concluded that while there is a large body of evidence in the field, issues with its generalizability and validity are as yet largely unknown and that the exact type and form of evidence that would be valuable to knowledge users in the field is not yet understood.
To clarify key concepts/definitions in the literature
Scoping reviews are often performed to examine and clarify definitions that are used in the literature. A scoping review by Schaink and colleagues 27 was performed to investigate how the notion of “patient complexity” had been defined, classified, and understood in the existing literature. A systematic search of healthcare databases was conducted. Articles were assessed to determine whether they met the inclusion criteria and the findings of included articles were grouped into five health dimensions. An overview of how complexity has been described was presented, including the varying definitions and interpretations of the term. The results of the scoping review enabled the authors to then develop a complexity framework or model to assist in defining and understanding patient complexity [ 27 ].
Hines et al. [ 28 ] provide a further example where a scoping review has been conducted to define a concept, in this case the condition bronchopulmonary dysplasia. The authors revealed significant variation in how the condition was defined across the literature, prompting the authors to call for a ‘comprehensive and evidence-based definition’. [ 28 ]
To examine how research is conducted on a certain topic
Scoping reviews can be useful tools to investigate the design and conduct of research on a particular topic. A scoping review by Callary and colleagues 29 investigated the methodological design of studies assessing wear of a certain type of hip replacement (highly crosslinked polyethylene acetabular components) [ 29 ]. The aim of the scoping review was to survey the literature to determine how data pertinent to the measurement of hip replacement wear had been reported in primary studies and whether the methods were similar enough to allow for comparison across studies. The scoping review revealed that the methods to assess wear (radiostereometric analysis) varied significantly with many different approaches being employed amongst the investigators. The results of the scoping review led to the authors recommending enhanced standardization in measurements and methods for future research in this field [ 29 ].
There are other examples of scoping reviews investigating research methodology, with perhaps the most pertinent examples being two recent scoping reviews of scoping review methods [ 9 , 10 ]. Both of these scoping reviews investigated how scoping reviews had been reported and conducted, with both advocating for a need for clear guidance to improve standardization of methods [ 9 , 10 ]. Similarly, a scoping review investigating methodology was conducted by Tricco and colleagues 30 on rapid review methods that have been evaluated, compared, used or described in the literature. A variety of rapid review approaches were identified with many instances of poor reporting identified. The authors called for prospective studies to compare results presented by rapid reviews versus systematic reviews.
Scoping reviews can be conducted to identify and examine characteristics or factors related to a particular concept. Harfield and colleagues (2015) conducted a scoping review to identify the characteristics of indigenous primary healthcare service delivery models [ 30 , 31 , 32 ]. A systematic search was conducted, followed by screening and study selection. Once relevant studies had been identified, a process of data extraction commenced to extract characteristics referred to in the included papers. Over 1000 findings were eventually grouped into eight key factors (accessible health services, community participation, culturally appropriate and skilled workforce, culture, continuous quality improvement, flexible approaches to care, holistic health care, self-determination and empowerment). The results of this scoping review have been able to inform a best practice model for indigenous primary healthcare services.
Scoping reviews conducted as precursors to systematic reviews may enable authors to identify the nature of a broad field of evidence so that ensuing reviews can be assured of locating adequate numbers of relevant studies for inclusion. They also enable the relevant outcomes and target group or population for example for a particular intervention to be identified. This can have particular practical benefits for review teams undertaking reviews on less familiar topics and can assist the team to avoid undertaking an “empty” review [ 33 ]. Scoping reviews of this kind may help reviewers to develop and confirm their a priori inclusion criteria and ensure that the questions to be posed by their subsequent systematic review are able to be answered by available, relevant evidence. In this way, systematic reviews are able to be underpinned by a preliminary and evidence-based scoping stage.
A scoping review commissioned by the United Kingdom Department for International Development was undertaken to determine the scope and nature of literature on people’s experiences of microfinance. The results of this scoping review were used to inform the development of targeted systematic review questions that focussed upon areas of particular interest [ 34 ].
In their recent scoping review on the conduct and reporting of scoping reviews, Tricco and colleagues 10 reveal only 12% of scoping reviews contained recommendations for the development of ensuing systematic reviews, suggesting that the majority of scoping review authors do not conduct scoping reviews as a precursor to future systematic reviews.
To identify and analyze gaps in the knowledge base
Scoping reviews are rarely solely conducted to simply identify and analyze gaps present in a given knowledge base, as examination and presentation of what hasn’t been investigated or reported generally requires exhaustive examination of all of what is available. In any case, because scoping reviews tend to be a useful approach for reviewing evidence rapidly in emerging fields or topics, identification and analysis of knowledge gaps is a common and valuable indication for conducting a scoping review. A scoping review was recently conducted to review current research and identify knowledge gaps on the topic of “occupational balance”, or the balance of work, rest, sleep, and play [ 35 ]. Following a systematic search across a range of relevant databases, included studies were selected and in line with predetermined inclusion criteria, were described and mapped to provide both an overall picture of the current state of the evidence in the field and to identify and highlight knowledge gaps in the area. The results of the scoping review allowed the authors to illustrate several research ‘gaps’, including the absence of studies conducted outside of western societies, the lack of knowledge around peoples’ levels of occupational balance, as well as a dearth of evidence regarding how occupational balance may be enhanced. As with other scoping reviews focussed upon identifying and analyzing knowledge gaps, results such as these allow for the identification of future research initiatives.
Scoping reviews are now seen as a valid review approach for certain indications. A key difference between scoping reviews and systematic reviews is that in terms of a review question, a scoping review will have a broader “scope” than traditional systematic reviews with correspondingly more expansive inclusion criteria. In addition, scoping reviews differ from systematic reviews in their overriding purpose. We have previously recommended the use of the PCC mnemonic (Population, Concept and Context) to guide question development [ 36 ]. The importance of clearly defining the key questions and objectives of a scoping review has been discussed previously by one of the authors, as a lack of clarity can result in difficulties encountered later on in the review process [ 36 ].
Considering their differences from systematic reviews, scoping reviews should still not be confused with traditional literature reviews. Traditional literature reviews have been used as a means to summarise various publications or research on a particular topic for many years. In these traditional reviews, authors examine research reports in addition to conceptual or theoretical literature that focuses on the history, importance, and collective thinking around a topic, issue or concept. These types of reviews can be considered subjective, due to their substantial reliance on the author’s pre-exiting knowledge and experience and as they do not normally present an unbiased, exhaustive and systematic summary of a topic [ 12 ]. Regardless of some of these limitations, traditional literature reviews may still have some use in terms of providing an overview of a topic or issue. Scoping reviews provide a useful alternative to literature reviews when clarification around a concept or theory is required. If traditional literature reviews are contrasted with scoping reviews, the latter [ 6 ]:
Are informed by an a priori protocol
Are systematic and often include exhaustive searching for information
Aim to be transparent and reproducible
Include steps to reduce error and increase reliability (such as the inclusion of multiple reviewers)
Ensure data is extracted and presented in a structured way
Another approach to evidence synthesis that has emerged recently is the production of evidence maps [ 37 ]. The purpose of these evidence maps is similar to scoping reviews to identify and analyse gaps in the knowledge base [ 37 , 38 ]. In fact, most evidence mapping articles cite seminal scoping review guidance for their methods [ 38 ]. The two approaches therefore have many similarities, with perhaps the most prominent difference being the production of a visual database or schematic (i.e. map) which assists the user in interpreting where evidence exists and where there are gaps [ 38 ]. As Miake-Lye states, at this stage ‘it is difficult to determine where one method ends and the other begins.’ [ 38 ] Both approaches may be valid when the indication is for determining the extent of evidence on a particular topic, particularly when highlighting gaps in the research.
A further popular method to define and scope concepts, particularly in nursing, is through the conduct of a concept analysis [ 39 , 40 , 41 , 42 ]. Formal concept analysis is ‘a process whereby concepts are logically and systematically investigated to form clear and rigorously constructed conceptual definitions,’ [ 42 ] which is similar to scoping reviews where the indication is to clarify concepts in the literature. There is limited methodological guidance on how to conduct a concept analysis and recently they have been critiqued for having no impact on practice [ 39 ]. In our opinion, scoping reviews (where the purpose is to systematically investigate a concept in the literature) offer a methodologically rigorous alternative to concept analysis with their results perhaps being more useful to inform practice.
Comparing and contrasting the characteristics of traditional literature reviews, scoping reviews and systematic reviews may help clarify the true essence of these different types of reviews (see Table 1 ).
Rapid reviews are another emerging type of evidence synthesis and a substantial amount of literature have addressed these types of reviews [ 43 , 44 , 45 , 46 , 47 ]. There are various definitions for rapid reviews, and for simplification purposes, we define these review types as ‘systematic reviews with shortcuts.’ In this paper, we have not discussed the choice between a rapid or systematic review approach as we are of the opinion that perhaps the major consideration for conducting a rapid review (as compared to a systematic or scoping review) is not the purpose/question itself, but the feasibility of conducting a full review given financial/resource limitations and time pressures. As such, a rapid review could potentially be conducted for any of the indications listed above for the scoping or systematic review, whilst shortening or skipping entirely some steps in the standard systematic or scoping review process.
There is some overlap across the six listed purposes for conducting a scoping review described in this paper. For example, it is logical to presume that if a review group were aiming to identify the types of available evidence in a field they would also be interested in identifying and analysing gaps in the knowledge base. Other combinations of purposes for scoping reviews would also make sense for certain questions/aims. However, we have chosen to list them as discrete reasons in this paper in an effort to provide some much needed clarity on the appropriate purposes for conducting scoping reviews. As such, scoping review authors should not interpret our list of indications as a discrete list where only one purpose can be identified.
It is important to mention some potential abuses of scoping reviews. Reviewers may conduct a scoping review as an alternative to a systematic review in order to avoid the critical appraisal stage of the review and expedite the process, thinking that a scoping review may be easier than a systematic review to conduct. Other reviewers may conduct a scoping review in order to ‘map’ the literature when there is no obvious need for ‘mapping’ in this particular subject area. Others may conduct a scoping review with very broad questions as an alternative to investing the time and effort required to craft the necessary specific questions required for undertaking a systematic review. In these cases, scoping reviews are not appropriate and authors should refer to our guidance regarding whether they should be conducting a systematic review instead.
This article provides some clarification on when to conduct a scoping review as compared to a systematic review and clear guidance on the purposes for conducting a scoping review. We hope that this paper will provide a useful addition to this evolving methodology and encourage others to review, modify and build upon these indications as the approach matures. Further work in scoping review methods is required, with perhaps the most important advancement being the recent development of an extension to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) for scoping reviews [ 48 ] and the development of software and training programs to support these reviews [ 49 , 50 ]. As the methodology advances, guidance for scoping reviews (such as that included in the Joanna Briggs Institute Reviewer’s Manual) will require revision, refining and updating.
Scoping reviews are a useful tool in the ever increasing arsenal of evidence synthesis approaches. Researchers may preference the conduct of a scoping review over a systematic review where the purpose of the review is to identify knowledge gaps, scope a body of literature, clarify concepts, investigate research conduct, or to inform a systematic review. Although conducted for different purposes compared to systematic reviews, scoping reviews still require rigorous and transparent methods in their conduct to ensure that the results are trustworthy. Our hope is that with clear guidance available regarding whether to conduct a scoping review or a systematic review, there will be less scoping reviews being performed for inappropriate indications better served by a systematic review, and vice-versa.
Bastian H, Glasziou P, Chalmers I. Seventy-five trials and eleven systematic reviews a day: how will we ever keep up? PLoS Med. 2010;7(9):e1000326.
Article Google Scholar
Chalmers I, Hedges LV, Cooper H. A brief history of research synthesis. Eval Health Prof. 2002;25(1):12–37.
Jordan Z, Munn Z, Aromataris E, Lockwood C. Now that we're here, where are we? The JBI approach to evidence-based healthcare 20 years on. Int J Evid Based Healthc. 2015;13(3):117–20.
Munn Z, Stern C, Aromataris E, Lockwood C, Jordan Z. What kind of systematic review should I conduct? A proposed typology and guidance for systematic reviewers in the medical and health sciences. BMC Med Res Methodol. 2018;18(1):5.
Arksey H, O'Malley L. Scoping studies: towards a methodological framework. Int J Soc Res Methodol. 2005;8(1):19–32.
Peters MD, Godfrey CM, Khalil H, McInerney P, Parker D, Soares CB. Guidance for conducting systematic scoping reviews. Int J Evid Based Healthc. 2015;13(3):141–6.
Levac D, Colquhoun H, O'Brien KK. Scoping studies: advancing the methodology. Implement Sci. 2010;5(1):1.
Colquhoun HL, Levac D, O'Brien KK, et al. Scoping reviews: time for clarity in definition, methods, and reporting. J Clin Epidemiol. 2014;67(12):1291–4.
Pham MT, Rajić A, Greig JD, Sargeant JM, Papadopoulos A, McEwen SA. A scoping review of scoping reviews: advancing the approach and enhancing the consistency. Res Synth Methods. 2014;5(4):371–85.
Tricco AC, Lillie E, Zarin W, et al. A scoping review on the conduct and reporting of scoping reviews. BMC Med Res Methodol. 2016;16:15.
Pearson A. Balancing the evidence: incorporating the synthesis of qualitative data into systematic reviews. JBI Reports. 2004;2:45–64.
Aromataris E, Pearson A. The systematic review: an overview. AJN The American Journal of Nursing. 2014;114(3):53–8.
Liberati A, Altman DG, Tetzlaff J, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate healthcare interventions: explanation and elaboration. BMJ (Clinical research ed). 2009;339:b2700.
Higgins J, Green S, eds. Cochrane handbook for systematic reviews of interventions. Version 5.1.0 [updated March 2011]. ed: The Cochrane Collaboration 2011.
Munn Z, Porritt K, Lockwood C, Aromataris E, Pearson A. Establishing confidence in the output of qualitative research synthesis: the ConQual approach. BMC Med Res Methodol. 2014;14:108.
Pearson A, Jordan Z, Munn Z. Translational science and evidence-based healthcare: a clarification and reconceptualization of how knowledge is generated and used in healthcare. Nursing research and practice. 2012;2012:792519.
Steinberg E, Greenfield S, Mancher M, Wolman DM, Graham R. Clinical practice guidelines we can trust. Institute of Medicine. Washington, DC: National Academies Press; 2011.
Gough D, Thomas J, Oliver S. Clarifying differences between review designs and methods. Systematic Reviews. 2012;1:28.
Grant MJ, Booth A. A typology of reviews: an analysis of 14 review types and associated methodologies. Health Inf Libr J. 2009;26(2):91–108.
Tricco AC, Tetzlaff J, Moher D. The art and science of knowledge synthesis. J Clin Epidemiol. 2011;64(1):11–20.
Armstrong R, Hall BJ, Doyle J, Waters E. ‘Scoping the scope’ of a cochrane review. J Public Health. 2011;33(1):147–50.
Anderson S, Allen P, Peckham S, Goodwin N. Asking the right questions: scoping studies in the commissioning of research on the organisation and delivery of health services. Health Research Policy and Systems. 2008;6(1):1.
Pearson A, Wiechula R, Court A, Lockwood C. The JBI model of evidence-based healthcare. International Journal of Evidence-Based Healthcare. 2005;3(8):207–15.
PubMed Google Scholar
Bragge P, Clavisi O, Turner T, Tavender E, Collie A, Gruen RL. The global evidence mapping initiative: scoping research in broad topic areas. BMC Med Res Methodol. 2011;11:92.
Chambers D, Wilson PM, Thompson CA, Hanbury A, Farley K, Light K. Maximizing the impact of systematic reviews in health care decision making: a systematic scoping review of knowledge-translation resources. Milbank Q. 2011;89(1):131–56.
Challen K, Lee AC, Booth A, Gardois P, Woods HB, Goodacre SW. Where is the evidence for emergency planning: a scoping review. BMC Public Health. 2012;12:542.
Schaink AK, Kuluski K, Lyons RF, et al. A scoping review and thematic classification of patient complexity: offering a unifying framework. Journal of comorbidity. 2012;2(1):1–9.
Hines D, Modi N, Lee SK, Isayama T, Sjörs G, Gagliardi L, Lehtonen L, Vento M, Kusuda S, Bassler D, Mori R. Scoping review shows wide variation in the definitions of bronchopulmonary dysplasia in preterm infants and calls for a consensus. Acta Paediatr. 2017;106(3):366–74.
Callary SA, Solomon LB, Holubowycz OT, Campbell DG, Munn Z, Howie DW. Wear of highly crosslinked polyethylene acetabular components. Acta Orthop. 2015;86(2):159–68.
Davy C, Harfield S, McArthur A, Munn Z, Brown A. Access to primary health care services for indigenous peoples: a framework synthesis. Int J Equity Health. 2016;15(1):163.
Harfield S, Davy C, Kite E, et al. Characteristics of indigenous primary health care models of service delivery: a scoping review protocol. JBI Database System Rev Implement Rep. 2015;13(11):43–51.
Harfield SG, Davy C, McArthur A, Munn Z, Brown A, Brown N. Characteristics of indigenous primary health care service delivery models: a systematic scoping review. Glob Health. 2018;14(1):12.
Peters MDJ LC, Munn Z, Moola S, Mishra RK (2015) , Protocol. Adelaide: the Joanna Briggs Institute UoA. What are people’s views and experiences of delivering and participating in microfinance interventions? A systematic review of qualitative evidence from South Asia.
Peters MDJ LC, Munn Z, Moola S, Mishra RK People’s views and experiences of participating in microfinance interventions: A systematic review of qualitative evidence. London: EPPI-Centre: social science research unit, UCL Institute of education, University College London; 2016.
Wagman P, Håkansson C, Jonsson H. Occupational balance: a scoping review of current research and identified knowledge gaps. J Occup Sci. 2015;22(2):160–9.
Peters MD. In no uncertain terms: the importance of a defined objective in scoping reviews. JBI Database System Rev Implement Rep. 2016;14(2):1–4.
Hetrick SE, Parker AG, Callahan P, Purcell R. Evidence mapping: illustrating an emerging methodology to improve evidence-based practice in youth mental health. J Eval Clin Pract. 2010;16(6):1025–30.
Miake-Lye IM, Hempel S, Shanman R, Shekelle PG. What is an evidence map? A systematic review of published evidence maps and their definitions, methods, and products. Systematic reviews. 2016;5(1):1.
Draper P. A critique of concept analysis. J Adv Nurs. 2014;70(6):1207–8.
Gibson CH. A concept analysis of empowerment. J Adv Nurs. 1991;16(3):354–61.
Article CAS Google Scholar
Meeberg GA. Quality of life: a concept analysis. J Adv Nurs. 1993;18(1):32–8.
Ream E, Richardson A. Fatigue: a concept analysis. Int J Nurs Stud. 1996;33(5):519–29.
Tricco AC, Antony J, Zarin W, et al. A scoping review of rapid review methods. BMC Med. 2015;13:224.
Ganann R, Ciliska D, Thomas H. Expediting systematic reviews: methods and implications of rapid reviews. Implement Sci. 2010;5:56.
Harker J, Kleijnen J. What is a rapid review? A methodological exploration of rapid reviews in health technology assessments. Int J Evid Based Healthc. 2012;10(4):397–410.
Khangura S, Konnyu K, Cushman R, Grimshaw J, Moher D. Evidence summaries: the evolution of a rapid review approach. Syst Rev. 2012;1:10.
Munn Z, Lockwood C, Moola S. The development and use of evidence summaries for point of care information systems: a streamlined rapid review approach. Worldviews Evid-Based Nurs. 2015;12(3):131–8.
Tricco AC, Lillie E, Zarin W, et al. PRISMA extension for scoping reviews (PRISMA-ScR): checklist and explanation. Ann Intern Med. 2018;169(7):467–73.
Munn Z, Aromataris E, Tufanaru C, Stern C, Porritt K, Farrow J, Lockwood C, Stephenson M, Moola S, Lizarondo L, McArthur A. The development of software to support multiple systematic review types: the Joanna Briggs institute system for the unified management, assessment and review of information (JBI SUMARI). Int J Evid Based Healthc. 2018. (in press)
Stern C, Munn Z, Porritt K, et al. An international educational training course for conducting systematic reviews in health care: the Joanna Briggs Institute's comprehensive systematic review training program. Worldviews Evid-Based Nurs. 2018;15(5):401–8.
Download references
Acknowledgements
No funding was provided for this paper.
Availability of data and materials
Not applicable.
Author information
Authors and affiliations.
The Joanna Briggs Institute, The University of Adelaide, 55 King William Road, North Adelaide, 5005, South Australia
Zachary Munn, Micah D. J. Peters, Cindy Stern, Catalin Tufanaru, Alexa McArthur & Edoardo Aromataris
You can also search for this author in PubMed Google Scholar
Contributions
ZM: Led the development of this paper and conceptualised the idea for a paper on indications for scoping reviews. Provided final approval for submission. MP: Contributed conceptually to the paper and wrote sections of the paper. Provided final approval for submission. CS: Contributed conceptually to the paper and wrote sections of the paper. Provided final approval for submission. CT: Contributed conceptually to the paper and wrote sections of the paper. Provided final approval for submission. AM: Contributed conceptually to the paper and reviewed and provided feedback on all drafts. Provided final approval for submission. EA: Contributed conceptually to the paper and reviewed and provided feedback on all drafts. Provided approval and encouragement for the work to proceed. Provided final approval for submission.
Corresponding author
Correspondence to Zachary Munn .
Ethics declarations
Ethics approval and consent to participate, consent for publication, competing interests.
All the authors are members of the Joanna Briggs Institute, an evidence-based healthcare research institute which provides formal guidance regarding evidence synthesis, transfer and implementation. Zachary Munn is a member of the editorial board of this journal. The authors have no other competing interests to declare.
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License ( http://creativecommons.org/licenses/by/4.0/ ), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver ( http://creativecommons.org/publicdomain/zero/1.0/ ) applies to the data made available in this article, unless otherwise stated.
Reprints and permissions
About this article
Cite this article.
Munn, Z., Peters, M.D.J., Stern, C. et al. Systematic review or scoping review? Guidance for authors when choosing between a systematic or scoping review approach. BMC Med Res Methodol 18 , 143 (2018). https://doi.org/10.1186/s12874-018-0611-x
Download citation
Received : 21 February 2018
Accepted : 06 November 2018
Published : 19 November 2018
DOI : https://doi.org/10.1186/s12874-018-0611-x
Share this article
Anyone you share the following link with will be able to read this content:
Sorry, a shareable link is not currently available for this article.
Provided by the Springer Nature SharedIt content-sharing initiative
- Systematic review
- Scoping review
- Evidence-based healthcare
BMC Medical Research Methodology
ISSN: 1471-2288
- General enquiries: [email protected]
IMAGES
COMMENTS
Literature Review: it is a product and a process. As a product, it is a carefully written examination, interpretation, evaluation, and synthesis of the published literature related to your topic.It focuses on what is known about your topic and what methodologies, models, theories, and concepts have been applied to it by others.. The process is what is involved in conducting a review of the ...
Literature reviews may have differences that include: Purpose: The reason or objective of the review. One review may be to see how much has been published on a topic (a scoping review) while another may to draw new conclusions by combining data from multiple yet similar studies (a meta-analysis). A student may do a review for an assignment ...
This site explores different review methodologies such as, systematic, scoping, realist, narrative, state of the art, meta-ethnography, critical, and integrative reviews. The LITR-EX site has a health professions education focus, but the advice and information is widely applicable. Types of Reviews. Review the table to peruse review types and ...
Characterizes quantity and quality of literature, perhaps by study design and other key features. Attempts to specify a viable review: State-of-the-art review: Tend to address more current matters in contrast to other combined retrospective and current approaches. May offer new perspectives: Aims for comprehensive searching of current literature
A literature or narrative review is a comprehensive review and analysis of the published literature on a specific topic or research question. The literature that is reviewed contains: books, articles, academic articles, conference proceedings, association papers, and dissertations. It contains the most pertinent studies and points to important ...
Narrative review: The purpose of this type of review is to describe the current state of the research on a specific topic/research and to offer a critical analysis of the literature reviewed. Studies are grouped by research/theoretical categories, and themes and trends, strengths and weakness, and gaps are identified.
Within a review context it refers to a combination of review approaches for example combining quantitative with qualitative research or outcome with process studies. Narrative (Literature) Review - Broad, generic term - Refers to an examination and general synthesis of the research literature, often with a wide scope; completeness and ...
what a literature review is and, equally, what it is not. It explores its purpose and relevance and the differences between the literature review and other forms of academic writing. The fundamental steps involved in undertaking a literature review will also be considered. Whether or not you have previously embarked on
The objective of a Literature Review is to find previous published scholarly works relevant to an specific topic. A literature review is important because it: Explains the background of research on a topic. Demonstrates why a topic is significant to a subject area. Discovers relationships between research studies/ideas.
Narrative or traditional literature reviews. Critically Appraised Topic (CAT) Scoping reviews. Systematic literature reviews. Annotated bibliographies. These are not the only types of reviews of literature that can be conducted. Often the term "review" and "literature" can be confusing and used in the wrong context.
LITERATURE REVIEW. Often used as a generic term to describe any type of review. More precise definition: Published materials that provide an examination of published literature. Can cover wide range of subjects at various levels of comprehensiveness. Identifies gaps in research, explains importance of topic, hypothesizes future work, etc.
A literature review discusses published information in a particular subject area. Often part of the introduction to an essay, research report or thesis, the literature review is literally a "re" view or "look again" at what has already been written about the topic, wherein the author analyzes a segment of a published body of knowledge through summary, classification, and comparison of prior ...
The difference between literature review and systematic review comes back to the initial research question. Whereas the systematic review is very specific and focused, the standard literature review is much more general. The components of a literature review, for example, are similar to any other research paper.
A systematic review usually employs a dual independent review process, which involves two reviewers evaluating the collected resources based on pre-defined inclusion and exclusion criteria. The idea is to limit bias in selecting the primary studies. Such a strict review system is generally not a part of a literature review. Presentation of Results
Literature Reviews within a Scholarly Work. Literature reviews summarize and analyze what has been written on a particular topic and identify gaps or disagreements in the scholarly work on that topic. Within a scholarly work, the literature review situates the current work within the larger scholarly conversation and emphasizes how that ...
Introduction. A systematic review collects secondary data, and is a synthesis of all available, relevant evidence which brings together all existing primary studies for review (Cochrane 2016).A systematic review differs from other types of literature review in several major ways.
There are many different types of literature reviews from traditional literature reviews to rigorous systematic reviews. Each has its own methodology. Please review resources on this page and familiarize yourself with the task, commitment, and purpose of each before trying to decide on the type of review best fitting your research question.
As mentioned previously, there are a number of existing guidelines for literature reviews. Depending on the methodology needed to achieve the purpose of the review, all types can be helpful and appropriate to reach a specific goal (for examples, please see Table 1).These approaches can be qualitative, quantitative, or have a mixed design depending on the phase of the review.
The literature review is one part of a research paper. In a research paper, you use the literature review as a foundation and as support for the new insight that you contribute. The focus of a literature review, however, is to summarize and analyze the arguments and ideas of others without adding new contributions.
A meta-analysis is a type of systematic review that summarises and compares data using statistical techniques. Aim/Definition. A scholarly literature review summarises evidence on a topic using a formal writing style and adopting qualitative data collection methods to select and interpret studies. Can involve some quantitative analysis.
An umbrella review is a review of multiple systematic reviews. The process uses explicit and systematic methods to search for, and identify, systematic reviews on related research questions in the same topic area. The purpose of an umbrella review is to synthesize the results of the systematic reviews across important outcomes.
Our goal with this paper is to conduct a narrative review of the literature about systematic reviews and outline the essential elements of a systematic review along with the limitations of such a review. Keywords: systematic reviews, meta-analysis, narrative literature review, prisma checklist. Go to: A literature review provides an important ...
The actual review generally has 5 components: Abstract - An abstract is a summary of your literature review. It is made up of the following parts: A contextual sentence about your motivation behind your research topic. Your thesis statement. A descriptive statement about the types of literature used in the review. Summarize your findings.
Scoping reviews are a relatively new approach to evidence synthesis and currently there exists little guidance regarding the decision to choose between a systematic review or scoping review approach when synthesising evidence. The purpose of this article is to clearly describe the differences in indications between scoping reviews and systematic reviews and to provide guidance for when a ...