Universal Access
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License unless otherwise noted on a specific visual or other content item.
Once you have an initial research question, you can develop and refine your research question and eligibility criteria through exploratory searching. Exploratory searching is also called preliminary, initial, and naive or novice searching. Regardless of what you call it, it is simply a series of searches conducted prior to starting the review with the goal of producing a well-defined scope with clear demonstration of contribution to the field. This is an iterative process as illustrated in the image to the right.
Throughout the exploratory search you should collect A. existing and in-progress reviews and B. seminal articles related to your scope. Ultimately, this phase should help your team produce:
At the bottom of this page, we also suggest C. where to start exploratory searching.
Before starting, make sure a systematic review hasn't already addressed, or is in the process of addressing your research question(s).
You should look for published systematic reviews, but also check out review registries and general purpose repositories (e.g., Open Science Framework) where you're more likely to find unpublished or in-progress reviews and/or review protocols. Searching registries will give you a glimpse into the work that is being done currently, but isn't yet complete. Remember, this kind of review is a serious time-commitment, and you don't want to unknowingly duplicate efforts.
Existing and in-progress reviews on similar, non-identical topics can be helpful when identifying where to search and developing the search strategy and data extraction forms!
In academic journal databases, you can sometimes find a filter for Systematic Reviews, Meta-Analyses, and/or simply Reviews. If a built-in filter doesn't exist, you can add the term "review" to your search.
|
Initial Research Question: Does drinking coffee reduce the likelihood of falling asleep while driving? (coffee) AND (sleep) AND (driving) AND (review)
If you get too many results, you can specify the kind of review: (coffee) AND (sleep) AND (driving) AND ("systematic review" OR "meta analysis") |
We pursue systematic reviews and/or meta-analyses to answer a research question. If a review already answers your question, this existing review can be the foundation of your next research project!
Sometimes it is still important to pursue a review, even if your original research question(s) have been answered. What is considered "the same" review is not always clear. Generally speaking, you need to justify that and illustrate how your new review contributes something unique to the field.
If a review already answers your question, and your team would still like to pursue a review, your team can:
According to Garner, et al., (2016), "The decision [of whether or not to update] needs to take into account whether the review addresses a current question, uses valid methods, and is well conducted; and whether there are new relevant methods, new studies, or new information on existing included studies. Given this information, the agency, editors, or authors need to judge whether the update will influence the review findings or credibility sufficiently to justify the effort in updating it."
Bashir, R., et al. Time-to-update of systematic reviews relative to the availability of new evidence. Syst Rev 7, 195 (2018). https://doi.org/10.1186/s13643-018-0856-9
Garner, P., et al. Panel for updating guidance for systematic reviews (PUGs). (2016). When and how to update systematic reviews: Consensus and checklist. BMJ, i3507. https://doi.org/10.1136/bmj.i3507
Review replication is not often pursued due to the amount of time and labor required. However, Pieper, Heß, & Faggion (2021) have developed a framework for replicating, and the replication process is a great learning tool.
You may find other reviews (e.g., scoping review, restricted (or rapid) review) on your topic exist - that's great, as these might provide further insight to the appropriateness of the systematic review method for your research question(s) and how to frame your own review approach.
What is 'Seminal Work'?In general, seminal work also called pivotal, landmark, or seed studies, are articles that are central to the research topic and have great importance and influence within the discipline. Seminal articles are likely to be cited frequently in different journal articles, books, dissertations etc.
In systematic reviews and/or meta-analyses, seminal work are the "seed articles" for your specific review - the articles (or other material) you know need to be included in your final synthesis. These articles may have sparked the teams interest in pursuing a review or may be identified through the exploratory search.
Seminal articles can be helpful when identifying where to search and developing the search strategy!
In short, where you exploratory search will depend on your research question. In other words, you should consider searching wherever you are likely to find material that answers your research question.
In addition to repositories, you'll want to search academic journal databases that may be relevant to your topic. Consider your topic from perspectives other than your own discipline - it's likely your topic overlaps with several disciplines. For example, if you are examining a public health topic, it may be useful to search databases related to health / medicine and social sciences.
You can also use this exploratory phase to determine whether a database is relevant and should be searched as part of your final comprehensive systematic review search strategy, or not.
Hint: Sort "By Subject" to find relevant guides
Web browsing in Google or Google Scholar is a great place to start finding seminal works and existing reviews, as well as journals and databases in which you should conduct more robust exploratory searches.
Never rely only on web browsing. While Google Scholar (and Google) are great places to start searching, results are tailored to individual users, are not replicable, and algorithms are not transparent. More guidance for web browsing is located in the "Where to Search" sub-tab of the "Comprehensive Search" section of this guide.
The possibilities of where to exploratory search are endless! Consider searching anywhere that seminal articles or existing/in-progress reviews relevant to your scope may exist. Here are a few more places to get you started.
Researchers use these sites to share unpublished or in-progress research and reviews, procedural documentation, and other grey literature. For example:
Researchers uses these sites to openly share research, some of which is not yet published (or peer-reviewed), also called 'preprints'. For example:
There are several systematic review repositories that exist - some contain only published reviews, while others include review registrations and protocols. In the following table, we present and link out to some repositories that specifically house systematic reviews and similar evidence synthesis publications.
Campbell Collaboration Registry
"...all registered titles for systematic reviews or evidence and gap maps that have been accepted by the Editor of a Campbell Coordinating Group. When titles progress to protocol stage, the protocol is published in the Campbell Systematic Reviews journal."
Campbell Systematic Review Journal
Both registry and journal include topics related to Business and Management, Climate Solutions, Crime and Justice, Disability, Education, International Development, Knowledge Translation and Implementation, and Social Welfare
Cochrane Database of Systematic Reviews (CDSR)
"...the leading journal and database for systematic reviews in health care. CDSR includes Cochrane Reviews (systematic reviews) and protocols for Cochrane Reviews as well as editorials and supplements."
"Cochrane Collaboration produces high-quality systematic reviews in health disciplines. For more detail and specific fields of research, check out the Cochrane Review Groups and Networks."
Database of promoting health effectiveness reviews (DoPHER)
"...focussed coverage of systematic and non-systematic reviews of effectiveness in health promotion and public health worldwide. This register currently contains details of over 6,000 reviews of health promotion and public health effectiveness."
"...a collaborative, multilingual database of health evidence. It is the largest source of systematic reviews relevant for health-decision making, and a large source of other types of scientific evidence."
"...quality-rated systematic reviews evaluating the effectiveness and cost-effectiveness of public health interventions, including cost data."
Joanna Briggs Systematic Review
"...a collection of world-class resources driven by the needs of health professionals and consumers worldwide"
"International database of prospectively registered systematic reviews in health and social care, welfare, public health, education, crime, justice, and international development, where there is a health related outcome."
