Systematic Reviews and Meta-Analyses

Data Extraction Templates

Data extraction is often performed using a single form to extract data from all included (relevant) studies in a uniform manner. Because the data extraction stage is driven by the scope and goals of a systematic review, there is not a gold standard or one-size-fits all approach to developing a data extraction form.

However, there are templates and guidance available to help in the creation of your forms.

Because it is standard to include the data extraction form in the supplemental material of a systematic review and/or meta-analysis, you may also consider the forms developed and/or used during similar, already published and/or in-progress reviews 

As is the case with the critical appraisal, the type of data you are able to extract will also depend on the study design. Therefore, it is likely that the exact data you extract from each individual article will vary somewhat. 

Data Extraction Form Templates

Cochrane | One form for randomized controlled trials (RCTs) only; one form for RCTs and non-RCTs

Joanna Briggs Institute (JBI) | Several forms located in each relevant chapter:

• Qualitative data (appendix 2.3)
• Text and opinion data (appendix 4.3)
• Prevalence studies (prevalence data; appendix 5.2)
• Mixed method (convergent integrated approach; appendix 8.1)
• Diagnostic test accuracy (appendix 9.3)
• Measurement properties (appendix 12.1) with table of results template (appendix 12.2)

Present Data Extracted

Data extracted from each reference is presented as a summary table or summary of findings table and described in the narrative.

Summary Tables

A summary table, like the examples seen below, provides readers with quick glance summary of study details that are important to the systematic review and/or meta-analysis. Similarly to the other stages of a review, what you collect and report will depend on the scope of the review and the type of synthesis you plan to conduct.

It may be appropriate to include more than one summary table. For example, one table may present basic information about the study such as author names, year of publication, year(s) the study was conducted, study design, funding agency, etc.; Another table may present details more specific to the qualitative synthesis; A third table may present information specifically relevant to the meta-analysis, with effect sizes, confidence intervals, etc. Additionally, it is best practice to have one summary table for each outcome.

SYREAF Protocols 

Step 4: Data extraction

Conducting systematic reviews of intervention questions II: Relevance screening, data extraction, assessing risk of bias, presenting the results and interpreting the findings. Sargeant JM, O’Connor AM. Zoonoses Public Health. 2014 Jun;61 Suppl 1:39-51. doi: 10.1111/zph.12124. PMID: 24905995

Study designs and systematic reviews of interventions: building evidence across study designs. Sargeant JM, Kelton DF, O’Connor AM. Zoonoses Public Health. 2014 Jun;61 Suppl 1:10-7. doi: 10.1111/zph.12127. PMID: 24905992

Randomized controlled trials and challenge trials: Design and criterion for validity. Sargeant JM, Kelton DF, O’Connor AM,Zoon. Public Health. 2014. 61 (S1); 18 – 27. PMID: 24905993

Campbell - MECCIR

The Campbell Collaboration has combined their reporting and conduct (methodological) guidelines.

Section 5 - Coding (also referred to as data extraction) and critical appraisal (p.4)

• Code data for descriptive and statistical data in replicable manner
• Specify and justify each effect size index (Item 5b)
• Establish protocol for difficult decisions and resolving conflicts
• Pilot, check for consistency
• Describe coding process (Item 5a)
• Use all available manuscripts (Item 5c)
• Seek missing information; document (Item 5d)

CEE - Guidelines and Standards for Evidence synthesis in Environmental Management

Section 6. Data Coding and Data Extraction

CEE Standards for conduct and reporting

6.3 Assessing agreement between data coders/extractors

6.4 Data coding

6.5 Data extraction

In the Final Manuscript | PRISMA

Data Collection Process (Item 9; report in methods)

Essential Items

• Report how many reviewers collected data from each report, whether multiple reviewers worked independently or not (for example, data collected by one reviewer and checked by another), and any processes used to resolve disagreements between data collectors.
• Report any processes used to obtain or confirm relevant data from study investigators (such as how they were contacted, what data were sought, and success in obtaining the necessary information).
• If any automation tools were used to collect data, report how the tool was used (such as machine learning models to extract sentences from articles relevant to the PICO characteristics), how the tool was trained, and what internal or external validation was done to understand the risk of incorrect extractions.
• If articles required translation into another language to enable data collection, report how these articles were translated (for example, by asking a native speaker or by using software programs).
• If any software was used to extract data from figures, specify the software used.
• If any decision rules were used to select data from multiple reports corresponding to a study, and any steps were taken to resolve inconsistencies across reports, report the rules and steps used.

Data Items (Item 10; report in methods)

Essential Items

• List and define the outcome domains and time frame of measurement for which data were sought (Item 10a)
• Specify whether all results that were compatible with each outcome domain in each study were sought, and, if not, what process was used to select results within eligible domains (Item 10a)
• If any changes were made to the inclusion or definition of the outcome domains or to the importance given to them in the review, specify the changes, along with a rationale (Item 10a)
• If any changes were made to the processes used to select results within eligible outcome domains, specify the changes, along with a rationale (Item 10a)
• List and define all other variables for which data were sought. It may be sufficient to report a brief summary of information collected if the data collection and dictionary forms are made available (for example, as additional files or deposited in a publicly available repository) (Item 10b)
• Describe any assumptions made about any missing or unclear information from the studies. For example, in a study that includes “children and adolescents,” for which the investigators did not specify the age range, authors might assume that the oldest participants would be 18 years, based on what was observed in similar studies included in the review, and should report that assumption (Item 10b)
• If a tool was used to inform which data items to collect (such as the Tool for Addressing Conflicts of Interest in Trials (TACIT) or a tool for recording intervention details), cite the tool used (Item 10b)

Additional Items

Consider specifying which outcome domains were considered the most important for interpreting the review’s conclusions (such as “critical” versus “important” outcomes) and provide rationale for the labelling (such as “a recent core outcome set identified the outcomes labelled ‘critical’ as being the most important to patients”) (Item 10a)

Effect Measures (Item 12; report in methods)

Essential Items

• Specify for each outcome or type of outcome (such as binary, continuous) the effect measure(s) (such as risk ratio, mean difference) used in the synthesis or presentation of results.
• State any thresholds or ranges used to interpret the size of effect (such as minimally important difference; ranges for no/trivial, small, moderate, and large effects) and the rationale for these thresholds.
• If synthesised results were re-expressed to a different effect measure, report the methods used to re-express results (such as meta-analysing risk ratios and computing an absolute risk reduction based on an assumed comparator risk)

Study Characteristics (Item 17; report in results)

Essential Items

• Cite each included study
• Present the key characteristics of each study in a table or figure (considering a format that will facilitate comparison of characteristics across the studies)

Additional Items

If the review examines the effects of interventions, consider presenting an additional table that summarises the intervention details for each study

Results of Individual Studies (Item 19; report in results)

Essential Items

• For all outcomes, irrespective of whether statistical synthesis was undertaken, present for each study summary statistics for each group (where appropriate). For dichotomous outcomes, report the number of participants with and without the events for each group; or the number with the event and the total for each group (such as 12/45). For continuous outcomes, report the mean, standard deviation, and sample size of each group.
• For all outcomes, irrespective of whether statistical synthesis was undertaken, present for each study an effect estimate and its precision (such as standard error or 95% confidence/credible interval). For example, for time-to-event outcomes, present a hazard ratio and its confidence interval.
• If study-level data are presented visually or reported in the text (or both), also present a tabular display of the results.
• If results were obtained from multiple sources (such as journal article, study register entry, clinical study report, correspondence with authors), report the source of the data. This need not be overly burdensome. For example, a statement indicating that, unless otherwise specified, all data came from the primary reference for each included study would suffice. Alternatively, this could be achieved by, for example, presenting the origin of each data point in footnotes, in a column of the data table, or as a hyperlink to relevant text highlighted in reports (such as using SRDR Data Abstraction Assistant139).
• If applicable, indicate which results were not reported directly and had to be computed or estimated from other information (see item #13b)