Home - Systematic Reviews - LibGuides at University of North Carolina at Chapel Hill
Having trouble accessing government information? See the Library’s guide to
Alternative Sources for Federal Information and Data
Systematic Reviews: Home
Created by Health Science Librarians
This guide was created by librarians at the
Health Sciences Library
Ask HSL
Systematic review resources
What is a Systematic Review?
A simplified process map
How can the library help?
How can AI and machine learning help?
Publications by HSL Librarians
Systematic reviews in non-health disciplines
Resources for performing systematic reviews
Step 1: Complete Pre-Review Tasks
Step 2: Develop a Protocol
Step 3: Conduct Literature Searches
Step 4: Manage Citations
Step 5: Screen Citations
Step 6: Assess Quality of Included Studies
Step 7: Extract Data from Included Studies
Step 8: Write the Review
FAQs
Need help?
Check our FAQ's
Email us
Call (919) 962-0800
Make an appointment with a librarian
Request a systematic or scoping review consultation
What is a Systematic Review?
What is a Systematic Review?
A systematic review is a literature review that gathers
all of the available evidence
matching
pre-specified
eligibility criteria
to answer a specific research question. It uses explicit, systematic methods, documented in a protocol, to
minimize bias
, provide
reliable findings
, and inform decision-making.
There are many types of literature reviews.
Before beginning a systematic review, consider whether it is the best type of review for your question, goals, and resources. The table below compares a few different types of reviews to help you decide which is best for you.
Comparing Systematic, Scoping, and Systematized Reviews
Systematic Review
Scoping Review
Systematized Review
Conducted for Publication
Conducted for Publication
Conducted for Assignment, Thesis, or (Possibly) Publication
Protocol Required
Protocol Required
No Protocol Required
Focused Research Question
Broad Research Question
Either
Focused Inclusion & Exclusion Criteria
Broad Inclusion & Exclusion Criteria
Either
Requires Large Team
Requires Small Team
Usually 1-2 People
For more information, see Covidence Academy's blog post comparing
Systematic and Scoping Reviews
Scoping Review Guide
For more information about scoping reviews, refer to the UNC HSL Scoping Review Guide.
A simplified process map
UNC HSL's Simplified, Step-by-Step Process Map
A PDF file of the HSL's Systematic Review Process Map.
Text-Only: UNC HSL's Systematic Reviews - A Simplified, Step-by-Step Process
A text-only PDF file of HSL's Systematic Review Process Map.
Systematic Reviews: a Simplified, Step-by-Step Process
© 2021 by Emily P. Jones & Michelle Cawley is licensed under
CC BY-NC 4.0
How can the library help?
The average systematic review takes 1,168 hours to complete.
A librarian can help you speed up the process.
Systematic reviews follow established guidelines and best practices to produce high-quality research. Librarian involvement in systematic reviews is based on two levels. In Tier 1, your research team can consult with the librarian as needed. The librarian will answer questions and give you recommendations for tools to use. In Tier 2, the librarian will be an active member of your research team and co-author on your review. Roles and expectations of librarians vary based on the level of involvement desired. Examples of these differences are outlined in the table below.
Roles and expectations of librarians based on level of involvement desired.
Tasks
Tier 1: Consultative
Tier 2: Research Partner / Co-author
Topic Development
Guidance on process and steps
Yes
Yes
Background searching for past and upcoming reviews
Yes
Yes
Development of Eligibility Criteria
Development and/or refinement of review topic
Yes
Yes
Assistance with refinement of PICO (population, intervention(s), comparator(s), and key questions
Yes
Yes
Guidance on study types to include
Yes
Yes
Protocol Creation and Registration
Guidance on protocol registration
Yes
Yes
Searching
Identification of databases for searches
Yes
Yes
Instruction in search techniques and methods
Yes
Yes
Training in citation management software use for managing and sharing results
Yes
Yes
Development and execution of searches
No
Yes
Downloading search results to citation management software and removing duplicates
No
Yes
Documentation of search strategies
No
Yes
Management of search results
No
Yes
Study Selection and Extraction
Guidance on methods
Yes
Yes
Guidance on data extraction, and management techniques and software
Yes
Yes
Writing and Publishing
Suggestions of journals to target for publication
Yes
Yes
Drafting of literature search description in "Methods" section
No
Yes
Creation of PRISMA diagram
No
Yes
Drafting of literature search appendix
No
Yes
Review other manuscript sections and final draft
No
Yes
Librarian contributions warrant co-authorship
No
Yes
Request a systematic or scoping review consultation
How can AI and machine learning help?
Cochrane Webinar Series: Artificial Intelligence (AI) methods in evidence synthesis
Advancements in AI, automation, and language processing are increasingly influencing the creation and use of evidence syntheses. AI language models (e.g., ChatGPT, Claude) and automation tools (e.g., ASReview, Laser AI, DistillerSR) offer new possibilities for tasks like search strategy development, screening and data extraction, risk of bias assessment, and writing evidence syntheses. These tools can significantly speed up the process of producing or updating evidence syntheses, benefiting researchers and users alike. However, understanding the strengths and limitations of these technologies is critical to maintaining quality.
In this webinar series, Cochrane explores the role of AI in evidence synthesis, examines how it can complement traditional methods and provides a platform for experts to discuss the opportunities, challenges, and risks involved. This series targets those with foundational knowledge of systematic reviews who want to stay updated on AI developments in evidence synthesis.
This webinar series was developed in collaboration with Waldemar Siemens and Joerg Meerpohl, who are affiliated with Cochrane Germany and the Institute of Evidence in Medicine, Medical Center – University of Freiburg, Germany. The series is based on the Methods Forum 2024 by Cochrane Germany (
cochrane.de/methodenforum-2024
), organised by Waldemar Siemens and Joerg Meerpohl.
Webinar recordings and slides are available on the Cochrane
Artificial Intelligence (AI) methods in evidence synthesis
website.
(How) can AI-based automation tools assist with systematic searching?
[January 2025] Presented by Dr. Maria-Inti Metzendorf & Irma Klerings
View the recording.
Could large language models and/or AI-based automation tools assist the screening process?
[February 2025] Presented by Dr. Siw Waffenschmidt
View the recording.
Opportunities and challenges for data extraction with a large language model
[March 2025] Presented by Prof. Gerald Gartlehner
View the recording.
(How well) can large language models and AI-based automation tools assist in Risk of Bias Assessment?
[April 2025] Presented by Dr. Angelika Eisele-Metzger
View the recording.
How effectively do large language models and AI-based automation tools assist in writing and summarizing evidence syntheses?
[Upcoming: May 7 2025] Presented by Dr. Riaz Qureshi
Sign Up.
View the recording.
Recommendations and guidance on responsible AI in evidence synthesis
[Upcoming: June 3 2025]
Presented by Ella Flemyng, Dr. Anna Noel-Storr, Prof. James Thomas, Prof. Gerald Gartlehner, Prof. Joerg Meerpohl, & Biljana Macura.
Sign Up.
View the recording.
How you can partner with the HSL
UNC Health Sciences Librarians partner on systematic reviews and can apply three different types of predictive AI based on the project's needs. You can find more information on each type on our
How Does Predictive AI/ML Work?
page.
Library guide
AI and Machine Learning for Evidence Syntheses
by
Emily Jones, MLIS, AHIP
596 views this year
Publications by HSL Librarians
The following are systematic and scoping reviews co-authored by HSL librarians.
Only the most recent 15 results are listed. Click the website link at the bottom of the list to see all reviews co-authored by HSL librarians in PubMed
Loading ...
Systematic reviews in non-health disciplines
Researchers conduct systematic reviews in a variety of disciplines.  If your focus is on a topic outside of the health sciences, you may want to also consult the resources below to learn how systematic reviews may vary in your field.  You can also
contact a librarian for your discipline
with questions.
Additionally, please refer to UNC's Evidence Synthesis Guide which is focused on non-health disciplines.
Evidence Synthesis
by
Shannon Delaney
1998 views this year
Education
EPPI-Centre methods for conducting systematic reviews
The EPPI-Centre develops methods and tools for conducting systematic reviews, including reviews for education, public and social policy.
Systematic Reviews in Educational Research
by
Olaf Zawacki-Richter (Editor); Michael Kerres (Editor); Svenja Bedenlier (Editor); Melissa Bond (Editor); Katja Buntins (Editor)
In this open access edited volume, international researchers of the field describe and discuss the systematic review method in its application to research in education. Alongside fundamental methodical considerations, reflections and practice examples are included and provide an introduction and overview on systematic reviews in education research.
ISBN: 9783658276010
Publication Date: 2019-12-02
Environmental Topics
Collaboration for Environmental Evidence (CEE)
CEE seeks to promote and deliver evidence syntheses on issues of greatest concern to environmental policy and practice as a public service
Social Sciences
Systematic Reviews in the Social Sciences
by
Helen Roberts; Mark Petticrew
(The links in this book tend to be out of date, but the explanations of the systematic review process are clear and well-laid out). Written by two highly-respected social scientists, provides an overview of systematic literature review methods: outlines the rationale and methods of systematic reviews; gives worked examples from social science and other fields; Takes the reader through the process stage by stage; Including detailed sections on assessing the quality of both quantitative, and qualitative research; searching for evidence in the social sciences; meta-analytic and other methods of evidence synthesis; publication bias; heterogeneity; and approaches to dissemination.
ISBN: 9781405121101
Publication Date: 2005-12-16
Finding and Evaluating Evidence
by
Denise E. Bronson; Tamara S. Davis
Evidence-based practice (EBP) promises to have a profound impact on social work practice, education, and scholarship, but adopting EBP depends on the availability and accessibility of evidence and on strategies to synthesize this information. Systematic reviews provide a comprehensive,unbiased method for retrieving and synthesizing relevant research. This pocket guide is a concise introduction that describes the steps required to complete a systematic review and the criteria that can be used to assess the quality of existing reviews.The authors provide straightforward information on how to define a search question that captures the problem's parameters, develop a search strategy that is transparent and comprehensive, assess the quality and credibility of existing research, and summarize the available research to support EBP insocial work. Providing coverage for both quantitative and qualitative synthesis methods, examples illustrate the steps and decisions associated with each approach to research synthesis. Key points and suggested readings and websites provide avenues for further study. This pocket guide is anexcellent introduction to EBP and systematic reviews that will be valued by social work students, practitioners, and scholars.
ISBN: 9780195337365
Publication Date: 2011-09-22
Systematic reviews and meta-analysis
by
Julia H. Littell, Jacqueline Corcoran, Vijayan Pillai
This pocket guide to Systematic Reviews and Meta-Analysis illuminates precisely that practical groundwork.In clear, step-by-step terms, the authors explain how to format topics, locate and screen studies, extract and assess data, pool effect sizes, determine bias, and interpret the results, showing readers how to combine reviewing and meta-analysis correctly and effectively.
ISBN: 978019532654
Publication Date: 2008
Siddaway AP, Wood AM, Hedges LV. How to Do a Systematic Review: A Best Practice Guide for Conducting and Reporting Narrative Reviews, Meta-Analyses, and Meta-Syntheses. Annu Rev Psychol. 2019 Jan 4;70:747-770. doi: 10.1146/annurev-psych-010418-102803.
A resource for psychology systematic reviews, which also covers qualitative meta-syntheses or meta-ethnographies
The Campbell Collaboration
Social Work
Systematic Reviews and Meta-Analysis
by
Julia H. Littell; Jacqueline Corcoran; Vijayan Pillai
When used in tandem, systematic reviews and meta-analysis-- two distinct but highly compatible approaches to research synthesis-- form a powerful, scientific approach to analyzing previous studies. But to see their full potential, a social work researcher must be versed in the foundationalprocesses underlying them. This pocket guide to Systematic Reviews and Meta-Analysis illuminates precisely that practical groundwork.In clear, step-by-step terms, the authors explain how to format topics, locate and screen studies, extract and assess data, pool effect sizes, determine bias, and interpret the results, showing readers how to combine reviewing and meta-analysis correctly and effectively. Each chapter containsvivid social work examples and concludes with a concise summary and notes on further reading, while the book's glossary and handy checklists and sample search and data extraction forms maximize the boo'ks usefulness.Highlighting the concepts necessary to understand, critique, and conduct research synthesis, this brief and highly readable introduction is a terrific resource for students and researchers alike.
Call Number: H62 .L497 2008 (Davis 5th floor)
ISBN: 9780195326543
Publication Date: 2008-02-13
Finding and Evaluating Evidence
by
Denise E. Bronson; Tamara S. Davis
Evidence-based practice (EBP) promises to have a profound impact on social work practice, education, and scholarship, but adopting EBP depends on the availability and accessibility of evidence and on strategies to synthesize this information. Systematic reviews provide a comprehensive,unbiased method for retrieving and synthesizing relevant research. This pocket guide is a concise introduction that describes the steps required to complete a systematic review and the criteria that can be used to assess the quality of existing reviews.The authors provide straightforward information on how to define a search question that captures the problem's parameters, develop a search strategy that is transparent and comprehensive, assess the quality and credibility of existing research, and summarize the available research to support EBP insocial work. Providing coverage for both quantitative and qualitative synthesis methods, examples illustrate the steps and decisions associated with each approach to research synthesis. Key points and suggested readings and websites provide avenues for further study. This pocket guide is anexcellent introduction to EBP and systematic reviews that will be valued by social work students, practitioners, and scholars.
ISBN: 9780195337365
Publication Date: 2011-09-22
Software engineering
Guidelines for Performing Systematic Literature Reviews in Software Engineering
Downloadable PDF report of comprehensive guidelines for systematic literature reviews appropriate for software engineering researchers, including PhD students.
Evidence-Based Software Engineering and Systematic Reviews
by
David Budgen; Barbara Ann Kitchenham; Pearl Brereton
In the decade since the idea of adapting the evidence-based paradigm for software engineering was first proposed, it has become a major tool of empirical software engineering. Evidence-Based Software Engineering and Systematic Reviews provides a clear introduction to the use of an evidence-based model for software engineering research and practice. The book explains the roles of primary studies (experiments, surveys, case studies) as elements of an over-arching evidence model, rather than as disjointed elements in the empirical spectrum. Supplying readers with a clear understanding of empirical software engineering best practices, it provides up-to-date guidance on how to conduct secondary studies in software engineering--replacing the existing 2004 and 2007 technical reports. The book is divided into three parts. The first part discusses the nature of evidence and the evidence-based practices centered on a systematic review, both in general and as applying to software engineering. The second part examines the different elements that provide inputs to a systematic review (usually considered as forming a secondary study), especially the main forms of primary empirical study currently used in software engineering. The final part provides practical guidance on how to conduct systematic reviews (the guidelines), drawing together accumulated experiences to guide researchers and students in planning and conducting their own studies. The book includes an extensive glossary and an appendix that provides a catalogue of reviews that may be useful for practice and teaching.
Call Number: QA76.758 .K58 2016 (Science Annex)
ISBN: 9781482228656
Publication Date: 2015-11-05
Sport, Exercise, & Nutrition
Conducting Systematic Reviews in Sport, Exercise, and Physical Activity
by
David Tod
This book offers a conceptual and practical guide to the systematic review process and its application to sport, exercise, and physical activity research. It begins by describing what systematic reviews are and why they assist scientists and practitioners. Providing step-by-step instructions the author leads readers through the process, including generation of suitable review questions; development and implementation of search strategies; data extraction and analysis; theoretical interpretation; and result dissemination. Conducting Systematic Reviews in Sport, Exercise, and Physical Activity clarifies several common misunderstandings including the difference between qualitative systematic reviews and meta-analyses . Each chapter begins with a set of learning objectives focused on practical application, illustrated with examples from reviews published within the sport, exercise, and physical activity fields. Once a reader has completed all the learning activities along the way, they will have designed a systematic review and have written a protocol ready for registration. The book ends with a collection of advice from internationally regarded scientists with substantial experience in systematic reviews.
ISBN: 9783030122621
Publication Date: 2019-09-11
Application of systematic review methodology to the field of nutrition
by
Tufts Evidence-based Practice Center
Publication Date: 2009
Resources for performing systematic reviews
Piecing Together Systematic Reviews and Other Evidence Syntheses
by
Margaret J. Foster (Editor); Sarah T. Jewell (Editor)
ISBN: 9781538150177
Publication Date: 2022-11-02
Systematic Reviews and Meta-Analysis — Open & Free (Open Learning Initiative)
The course follows guidelines and standards developed by the Campbell Collaboration, based on empirical evidence about how to produce the most comprehensive and accurate reviews of research
An Introduction to Systematic Reviews
by
David Gough (Editor); Sandy Oliver (Editor); James Thomas (Editor)
Focused on actively using systematic review as method, this book provides clear, step-by-step advice on the logic and processes of systematic reviewing. Stressing the importance of precision and accuracy, this new edition carefully balances a need for insightful theory with real-world pragmatism; it introduces a wide range of cutting-edge approaches to research synthesis including text mining, living reviews and new ideas in mixed methods reviews such as qualitative comparative analysis. The book also includes: A new chapter on statistical synthesis Coverage of computer-assisted methods and relevant software Expanded sections on data extraction and management A guide to working with many different types of data including longitudinal and panel. Packed with examples from across the social sciences, this book helps students and researchers alike in turning systematic reviews into recommendations for policy and practice.
Call Number: H62 .I658 2017 (Davis 5th floor)
ISBN: 9781473929425
Publication Date: 2017-05-05
Doing a Systematic Review
by
Angela Boland (Editor); Gemma Cherry (Editor); Rumona Dickson (Editor)
Written in a friendly, accessible style by an expert team of authors with years of experience in both conducting and supervising systematic reviews, this is the perfect guide to using systematic review methodology in a research project. It provides clear answers to all review-related questions, including: How do I formulate an appropriate review question? What's the best way to manage my review? How do I develop my search strategy? How do I get started with data extraction? How do I assess the quality of a study? How can I analyse and synthesize my data? How should I write up the discussion and conclusion sections of my dissertation or thesis?
Call Number: R853.S94 D65 2017 (Davis 8th floor)
ISBN: 9781473967007
Publication Date: 2017-11-23
Systematic Approaches to a Successful Literature Review
by
Andrew Booth; Diana Papaioannou; Anthea Sutton
Reviewing the literature is an essential part of every research project. This book takes you step-by-step through the process of approaching your literature review systematically, applying systematic principles to a wide range of literature review types. Through numerous examples, case studies and exercises, the book covers often neglected areas of literature review such as concept analysis, scoping and mapping. The book includes practical tools for supporting the various stages of the review process, including; - managing your literature review - searching the literature - assessing the quality of the literature - synthesising qualitative and/or quantitative data - writing up and presenting data Systematic Approaches to a Successful Literature Review is essential reading for any student or researcher looking to approach their literature review in a systematic way.
Call Number: Q180.55.M4 B66 2012 (Davis 8th floor)
ISBN: 9780857021342
Publication Date: 2012-01-24
Systematic Reviews
by
David Gough, Sandy Oliver & James Thomas
Publication Date: 2020
Systematic Reviews
by
Carole Torgerson
Any piece of primary research ought to be preceded by a systematic review. The key advantage of a systematic review over the traditional narrative review is its ability to identify all the available eveidence in a systematic and replicable manner. This book will describe a) the key steps to undertaking a systematic review and b) the process of undertaking a meta-analysis. The book will include step-by-step examples of how to design data extraction forms, search strategies and combine in a meta-analysis.
Call Number: H 62 T682s 2003 (HSL 3rd floor) H62 .T682 2003 (Davis 5th floor)
ISBN: 9780826465801
Publication Date: 2003-12-01
Doing Your Literature Review
by
Jill Jesson; Lydia Matheson; Fiona M. Lacey
The literature review is a compulsory part of research and, increasingly, may form the whole of a student research project. This highly accessible book guides students through the production of either a traditional or a systematic literature review, clearly explaining the difference between the two types of review, the advantages and disadvantages of both, and the skills needed. It gives practical advice on reading and organising relevant literature and critically assessing the reviewed field. Contents include:  using libraries and the internet  note making  presentation  critical analysis  referencing, plagiarism and copyright. This book will be relevant to students from any discipline. It includes contributions from two lecturers who have many years experience of teaching research methods and the supervision of postgraduate research dissertations and a librarian, each offering expert advice on either the creation and assessment of literature reviews or the process of searching for information. The book also highlights the increasing importance for many disciplines of the systematic review methodology and discusses some of the specific challenges which it brings.   Jill K. Jesson has worked with multi-disciplinary research teams within the Aston School of Pharmacy, Aston Business School and with M-E-L Research, an independent public services research consultancy. She has now left Aston University and is working as a Consultant.   Lydia Matheson is an Information Specialist working for Library & Information Services at Aston University.   Fiona M. Lacey is an academic pharmacist, a member of the pharmacy practice teaching group in the School of Pharmacy, and Associate Dean in the School of Life and Health Sciences at Aston.
Call Number: H62 .J44 2011 (Davis 5th floor)
ISBN: 9781848601536
Publication Date: 2011-03-14
An Introduction to Systematic Reviews
by
David Gough (Editor); Sandy Oliver (Editor); James Thomas (Editor)
    This timely, engaging book provides an overview of the nature, logic, diversity and process of undertaking systematic reviews as part of evidence informed decision making.   A focused, accessible and technically up-to-date book, it covers the full breadth of approaches to reviews from statistical meta analysis to meta ethnography. It is ideal for anyone undertaking their own systematic review - providing all the necessary conceptual and technical background needed to make a good start on the process.   The content is divided into five clear sections:   * Approaches to reviewing * Getting started * Gathering and describing research * Appraising and synthesising data * Making use of reviews/models of research use.   Easy to read and logically structured, this book is essential reading for anyone doing systematic reviews.   David Gough is Professor of Evidence Informed Policy and Practice and Director of SSRU and its EPPI-Centre and Co-Editor of the journal Evidence & Policy. Sandy Oliver is Professor of Public Policy and Deputy Director of SSRU and its EPPI-Centre. James Thomas is Reader in Social Policy, Assistant Director of SSRU and Associate Direcctor of the EPPI-Centre.
Call Number: H62 .G68 2012 (Davis 5th floor)
ISBN: 9781849201803
Publication Date: 2012-04-04
Doing a Systematic Review
by
Angela Boland (Editor); Gemma Cherry (Editor); Rumona Dickson (Editor)
If you are a Masters or a PhD student conducting a systematic review for your dissertation or thesis, then this is the book for you! Written by an expert team of authors with years of experience in conducting systematic reviews and supervising students doing systematic reviews, the book provides a roadmap to guide you through the process. The book addresses the following questions: - What′s the best way to manage my review? - How do I formulate an appropriate review question? - How do I develop my search strategy? - How do I get started on data extraction? - How do I assess the quality of the studies I′m using? - How can I analyse and synthesise my data? - How should I write up the discussion and conclusion sections of my dissertation or thesis? - Where should I publish my data? Throughout the book, the authors make extensive use of questions posed by real students when carrying out reviews to help you through some of the challenges you may face. Like a team of supervisors in your pocket, this book will provide you with the tips and tools for a successful dissertation.
Call Number: W 20.5 D657 2014 (HSL 3rd floor)
ISBN: 9781446269688
Publication Date: 2013-12-20
Updating reviews
Updating systematic reviews
by
University of Ottawa Evidence-based Practice Center
Publication Date: 2007
Next:
Step 1: Complete Pre-Review Tasks >>