Evidence Synthesis: Evidence Synthesis Services (ESS)
The Evidence Synthesis Services (ESS) Team at the University Libraries is here to help!
Scroll down for workshops, recordings, and evidence synthesis training opportunities!
The ESS Team is available for three levels of support:
Level 1: Consultation
- about 3 consultations per project
- basic methodological advice (help you find options)
- suggest resources and tools
- connect to available training and workshops
Level 2: Mentorship (with Acknowledgement)
- ongoing guidance
- provide support for protocol development
- methodological guidance (help you follow guidelines selected)
- provide support for resources and tools (one-on-one training)
- detailed feedback, troubleshooting, and suggestions for enhancements on search strategy
Level 2 support requires that library employee is acknowledged in final manuscript; Level 2 is not available for class assignments; Level 2 is available based on staffing capacity
Level 3: Partnership (with Authorship)
- in-depth collaboration
- contribute to protocol development
- set up Covidence project
- responsible for developing the comprehensive search strategy with input from the team
- running searches
- download and deduplicate results
- contribute to methods and other portions of the manuscript as appropriate
- provide support for file and data management
Level 3 support requires that library employee is included as an author on final manuscript and other related outputs; Level 3 is not available for student projects (e.g., dissertation, thesis, class assignment); Level 3 is available based on staffing capacity - email email@example.com for more details
To request support email firstname.lastname@example.org
In your email, please include:
- Your scope (research question and eligibility criteria) and at least two seminal articles.
- Whether you have searched for in-progress and/or existing reviews, and if so describe what you found.
- The review methodology (or methodologies) that you think fit your scope.
- Two to three meeting times that would work well for you during the next 2 weeks.
Literature Review and Synthesis Basics Series (Fall)
These 1.5 - 2 hour introductory sessions are for those who want to learn more about evidence synthesis approaches. Lessons can be applied generally. These sessions are held every fall semester and the recordings are posted on this page (below).
Search the Library Events Calendar for upcoming "Evidence Synthesis" workshops!
Systematic Review and Meta-Analysis Deep Dive (This event will be held again in January)
This 4-day workshop is great for those who want to learn more about and practice the skills required for conducting systematic reviews and/or meta-analyses. Intended audience has some familiarity of the systematic review and meta-analysis process and aim to start their own review in the near future. Recordings are only distributed to participants (not registrants).
Additional Offerings (by request)
By request, the ESS team provides in-class instruction (e.g., one-off, embedded), instruction tailored to a specific audience, and other educational opportunities. Reach out!
Recordings & On-Demand Support
Literature Reviews & Evidence Synthesis Methods (Fall 2022)
Evidence synthesis (ES) reviews are comprehensive, rigorous reviews of available information and often serve as the foundation of evidence-based decision making. During this session, we will illustrate the characteristics and history of ES, and describe some of the methods commonly used today. By the end of this 1.5 hour session, you’ll be able to (1) differentiate narrative/traditional literature review and a systematic, evidence synthesis approaches, (2) recognize commonly used reviews methods and how to select methods based on your goals, and (3) consider how to apply some best practices from evidence synthesis to your literature review, regardless of the method you choose.
Developing Scope & Search Strategies (Fall 2022)
Defining the scope and designing a systematic search strategy can be overwhelming and tedious. Join us for this 1.5 hour workshop where we’ll (1) consider approaches to developing a clearly defined research scope, (2) translate your research question/s to a search strategy, (3) recognize features of a systematic search approach, and (4) know how to report your search strategy transparently and replicability. This session is part of the Evidence Synthesis Basics Series (link), but is applicable to any literature review approach.
Literature Review Tricks & Tools (Fall 2022)
How do you decide where to search? How can you access something the library doesn’t have in its collections? How can you be alerted to new studies that have just come out? How can you stay organized throughout while finding and selecting literature for your review? In this 1.5 hour session, we’ll introduce you to tricks and helpful tools that address these questions and can help you save time and enhance your searches for and review of literature.
Evaluating Literature & Critically Appraising Literature (Fall 2022)
Critical appraisal is a universally useful skill for any literature review method. In this 2 hour session, we’ll discuss the importance and value of evaluating literature and critical appraising research. Participants will be introduced to several critical appraisal tools that can help researchers to evaluate the risk of bias in studies and reviews. We’ll also discuss how you may consider approaching critical appraisal in your own review.
To view past recordings, go to the Older Workshops tab.
The Basics of Covidence
Developed by the Evidence Synthesis Services team at the University Libraries at Virginia Tech. Updated October 2022.
Watch this video at your own pace to learn about the systematic review software, “Covidence”. Whether you’re conducting a full systematic review, or just have a large number of references to review, this software will help streamline and keep track of the process. You’ll receive PDN credit for watching the videos and completing the quiz.
Introduction to Covidence 101
The Covidence Team presents 2021 updates to ESS Library Team
Information about specific aspects of Covidence
Bulk Uploading of Full-Text and Full-Text Retrieval
The Covidence Team presents updates regarding the full-text retrieval and uploading process in a public forum, October 2022.
An Update on Machine Learning (AI) in Systematic Reviews
The Covidence Team and external collaborators discuss AI in Systematic Reviews
Open Access & Evidence Synthesis (Fall 2021)
This session will begin with a discussion on how open access supports several aspects of the evidence synthesis process. We’ll explore the value of having open access sources to include in the synthesis itself and some challenges that must be overcome when searching and accessing sources that require institutional access or are fee-based. We will also address ways to utilize open access repositories (such as VTechWorks and Open Science Framework) to make your synthesis more transparent so that others can properly evaluate, replicate, or use your synthesis. Additionally, we will hear cases from folks who have used open access resources or repositories as a means to support their evidence synthesis projects. Panelist include:
- Dr. Sofia Rincon Gallardo Patino, Regional consultant on Nutrition and Physical Activity at the Pan American Health Organization
- Dr. Linbing Wang, Professor, Civil and Environmental Engineering, Virginia Tech [unfortunately Dr. Wang was unable to attend this session]
- Dr. Anne Brown, Assistant Professor, Science Informatics Consultant at the University Libraries at Virginia Tech
- Dr. Ryan Stewart, Associate Professor, School of Plant and Environmental Sciences, Virginia Tech
Grey Literature 101 (Spring 2021)
Systematic Review & Meta-Analysis Deep Dive (2023)
The Evidence Synthesis Services (ESS) team at the University Libraries in collaboration with the Statistical Applications and Innovations Group (SAIG) will host the third Systematic Review and Meta-Analysis Deep Dive, January 9-12, 2023. We also will host a summer version of the Systematic Review and Meta-Analysis Deep Dive, June 26 - 29, 2023. During this 4-day workshop participants will become familiar with the major required steps of this methodology, practice relevant skills, and consider the many decisions necessary for a successful synthesis.
Audience: This session is open to anyone interested in gaining hands-on experience with the steps and skills required by the systematic review (and meta-analysis) method - affiliation with Virginia Tech is not required. Participants are expected to have a basic understanding of the systematic review process as outlined by the sections on our library guide (guides.lib.vt.edu/SRMA/). Before the session, participants will be asked to become familiar with a commonly used reporting guideline, PRISMA (prisma-statement.org). Participants are welcome to bring a systematic review that they are pursuing (or plan to pursue) to work on throughout the session. However, it is not required that you have a project (existing, or in mind) to participate.
Time: This hands-on workshop will take place on January 9 - 12, 2023; 10am - 3pm with a 1 hour lunch break from 12 - 1pm. You must be able to attend the first three days (January 10, 11, and 12) to participate. The fourth day (January 13) is optional for those interested in learning about meta-analysis methods.
Access: The event will be held online. Prior to the event, those who register will receive the zoom link via email.
Pre-workshop assignment: Prior to the workshop, you will be asked to review a brief (~6 minute) video, the current (2020) PRISMA checklist, and 1 - 2 systematic review(s) articles.
Optional credit: Upon completion of the workshop, participants will have the opportunity to apply these 12-16 hours toward PDN credit.
If this event is of interest to you, but you are not familiar with the basics of systematic reviews or evidence synthesis, we encourage you to check out recordings from our Evidence Synthesis Basics Series on our Library Guide (guides.lib.vt.edu/SRMA/Help). If you are interested in other kinds of support, such as classroom instruction or group / individual consultation, please reach out to us directly at email@example.com.
Below are recordings from the 2023 SRMA Deep Dive that focus highly on systematic review and meta-analysis research through a series of live video workshops with multiple lecturers and topic experts.
Day 1 | Getting Started & Systematic Searching
In the SRMA Day 1 Deep Dive video, the learning objectives are:
- Differentiate between a systematic review and a review done systematically.
- Become familiar with major steps required for systematic reviews.
- Practice the relevant skills for systematic reviews.
- Consider the many decisions that are necessary for effective evidence synthesis.
- Know how to find ongoing support Virginia Tech with ESS and SAIG.
June 2023 Edition
January 2023 Edition
Day 2 | Title & Abstract Screening and Critical Appraisal
In the SRMA Day 2 Deep Dive video, the learning objectives are:
- Gain an understanding of the title and abstract (TIAB) screening process.
- Become familiar with piloting the stages of a systematic review.
- Understand critical appraisal and why it is important to the systematic review process.
- Become knowledgeable about common research biases.
June 2023 Edition
January 2023 Edition
Day 3 | Data Extraction (Qualitative Synthesis)
In the SRMA Day 3 Deep Dive video, the learning objectives are:
- Learn how to create a data extraction form.
- Lean how to present the results.
- Learn about qualitative synthesis and how it can be an effective research tool.
- Understand qualitative coding as a possible method of research application.
- Learn about some of the different types of qualitative synthesis and the benefits.
June 2023 Edition
January 2023 Edition
Day 4 | Meta-Analysis (Quantitative Synthesis)
In the SRMA Day 4 Deep Dive video, the learning objectives are:
- Define meta-analysis (MA).
- Learn why and when you would want to do a meta-analysis.
- Learn the basics of effect size measures.
- Learn the basics of different meta-analysis methods including: fixed and random effects models, forest plots, heterogeneity, sub-group analysis, meta-regression, and small-study effect (publication bias).
- Understand the practical things that are important to MA's. Like software used and data extraction.
June 2023 Edition
January 2023 Edition
Training outside VT
Agency for Healthcare Research and Quality (AHRQ) | Training Modules for the Systematic Reviews Methods Guide
American Institutes for Research (AIR) | meta-analysis, systematic reviews, and other evidence synthesis approaches (MOSAIC)
Campbell Collaboration | recorded workshops, training, presentations
Covidence | Covidence Academy
Carrie Price's | 5-minute Friday Videos; short videos covering various ES-related topics
Collaborations in Evidence Synthesis
On the next tabs, we've curated links for several collaborations relevant to evidence synthesis in different fields.
What are they?
Collaborations in Evidence Synthesis are groups of researchers, librarians, information professionals, statisticians, etc. who conduct or support the conduct of evidence synthesis reviews. These groups tend to focus on a specific discipline - for example, the Cochrane Collaboration only produces and supports reviews related to health and medicine. Use the tabs in this box to explore some collaborations by discipline.
Why are they important?
These collaborations cross national boarders and have the power to connect you to a wider community of synthesis and knowledge translation professionals in your field. Often, evidence synthesis collaborations will also manage the production, review, and updating of discipline-specific guidelines and expectations. Although the basic procedures for evidence synthesis methods are respectively similar across disciplines, there are some nuances that discipline-specific collaborations are best suited to address.
How to get involved
In most cases, it not necessary to be involved with one of these collaborations in order to publish your own review in the field. To publish with a specific collaboration, you will need to adhere to a specific set of standards unique to that collaboration. For example, if you plan to publish with the Campbell Collaboration, they have author requirements such as following MECCIR Conduct and Reporting Standards.
If you are interested in becoming more involved, some collaborations have a standing invitation for volunteer to act as peer reviewers, editors, or serve on sub-committees.
Systematic reviews help food manufacturers, veterinarians and other animal health professionals understand the vast volume of scientific research. Originally used in human health, sociology, and education, our group has extensive and unique expertise in conducting systematic reviews in any area related to food, food production and animal. We have worked extensively in food safety, animal health and animal welfare. We have also numerous publications and video tutorials on how to conduct reviews.
An open community of stakeholders working towards a sustainable global environment and the conservation of biodiversity. CEE seeks to promote and deliver evidence syntheses on issues of greatest concern to environmental policy and practice as a public service.
Effective Health Care (EHC) Program
The Effective Health Care (EHC) Program improves the quality of health care by providing the best available evidence on the outcomes, benefits and harms, and appropriateness of drugs, devices, and health care services and by helping health care professionals, patients, policymakers, and health care systems make informed health care decisions. The EHC Program achieves this goal by partnering with research centers, academic institutions, health professional societies, consumer organizations, and other stakeholders to conduct research, evidence synthesis, evidence translation, dissemination, and implementation of research findings.
We are an independent, diverse, global organization that collaborates to produce trusted synthesized evidence, make it accessible to all, and advocate for its use. Our work is internationally recognized as the benchmark for high-quality information about the effectiveness of health care.
JBI is an international research organisation based in the Faculty of Health and Medical Sciences at the University of Adelaide, South Australia. JBI develops and delivers unique evidence-based information, software, education and training designed to improve healthcare practice and health outcomes.
The Campbell Collaboration is an international social science research network that produces high quality, open and policy-relevant evidence syntheses, plain language summaries and policy briefs.
The EPPI-Centre is committed to informing policy and professional practice with sound evidence. As such, it is involved in two main areas of work:
- Systematic reviews: This includes developing methods for systematic reviews and research syntheses, conducting reviews, supporting others to undertake reviews, and providing guidance and training in this area.
- Research use: This includes studying the use/non-use of research evidence in personal, practice and political decision-making, supporting those who wish to find and use research to help solve problems, and providing guidance and training in this area.
The ESS Team
Associate Director, Health Sciences Libraries
Liaison to Veterinary Medicine, Animal & Poultry Sciences, Dairy Sciences, Population Health Sciences
Virginia (Ginny) Pannabecker
Assistant Dean and Director, Research Collaboration and Engagement
Liaison to Biochemistry, Systems Biology, Biomedical Engineering and Mechanics (BEAM)