Research Impact & Intelligence: Research Impact
Contact: researchintel@vt.edu
Related Guides
Citation Impact Metrics & Tools
Citation impact, or bibliometrics, can be as simple as citation counts to papers and as complex as tracking and mapping citation collaboration networks between authors and organizations.
- Citations & BibliometricsThis page reviews citation counts to articles, books, book chapters, data sets, software, and the field-normalized citation impact metric.
Citation Data Sources
Several databases and sources can be used to access citation data. Therefore, you will likely find different citation data, depending on where you access it. Citation counts will only be as high as can be counted for the particular source from which they are accessed.
Below is a depiction of the overlap of the four major bibliographic data sources and their overlap in the millions of records (with an estimate for Google Scholar. It was estimated at 389 million records in a 2018 study, so we have listed it at over 500 million records, but it is likely now much larger than that.)
±The size of Google Scholar was estimated at 389 million records in 2018 and is likely at least 500 million records today.
*The Web of Science (WoS) Core Collection is one database of 12 on the WoS platform. The Core Collection consists of 89 million records and is used primarily by researchers and administrators to analyze research impact. It is also the database used for Journal Citation Reports (JCR), which is where the Journal Impact Factor and other journal metrics are published.
Citation Databases & Search Engines
- Google ScholarGoogle's search engine for scholarly research: the ease of Google searching combined with the quality resources you find in library databases.
- Web of Science from Clarivate AnalyticsThe three Web of Science databases index citations from journal articles and conference proceedings in the sciences, social sciences, and arts and humanities. You can perform cited reference searches, analyze trends and patterns, and create visual representations of citation relationships. 1900-present
- ScopusScopus indexes citations of journal articles, conference papers, and books in the sciences, medicine, social sciences, arts, and humanities. You can perform cited reference searches. You can compare authors, institutions, and journals using various metrics. 1800s-present
- Dimensions PlusDimensions Plus indexes more than 100 million publications, ranging from articles published in scholarly journals, books and book chapters, to preprints and conference proceedings. Dimensions Plus is an extensive and fully interlinked database with publications, grants, patents, clinical trials, datasets and policy documents. 1600s to present.
- Lens.orgA free source of bibliographic data. This links to the scholarly works data, but Lens also has databases for patents and biological sequences.
- OpenAlexOpenAlex is a fully open catalog of the global research system. It's named after the ancient Library of Alexandria and made by the nonprofit OurResearch.
- Publish or PerishPublish or Perish is a software program that retrieves and analyzes academic citations.
- Publish or Perish (PoP) Author Metrics TemplateAfter you export data from Publish or Perish, you can use this template to showcase your citation metrics, compare to similar authors / scholars in your field, and make your case for an upcoming review or interview.
- JYUcite & Co-Citation Percentile Rank (CPR)CPR compares the citation rate (citations / day since work became citable) of an article to the actual citation rates of articles that are co-cited along with that article.
Individual Co-Authorship Network Analysis Example
In the example above, only one author's publications were analyzed (Barbara Lockee). The size of the nodes represents the number of publications while the color of the nodes represents the number of citations. The lighter the node (e.g., yellow), the more citations while the darker the node, the fewer citations to the works that were published when the authors collaborated together. Since Lockee is the core author, she is the 'average' for this network, and so her node is green or 'average' for all the citations. We can see that her publications with Burton, Bond, and Hodges have the highest citation counts.
- JCR: Journal Citation Reports from Web of ScienceJournal Citation Reports provides citation data for journals, and includes virtually all areas of science, technology, and social sciences. Journal Citation Reports can show you the most frequently cited journals in a field, highest impact journals in a field based on a calculated impact factor and Eigenfactor score, immediancy indexes, and largest journals in a field. 2000-2018.
- SCImago Journal Rank (SJR)The SCImago Journal & Country Rank is a publicly available portal that includes the journals and country scientific indicators developed from the information contained in the Scopus® database.
- SNIP IndicatorSNIP stands for Source Normalized Impact per Paper. This indicator measures the average citation impact of the publications of a journal. Unlike the well-known Journal Impact Factor, SNIP corrects for differences in citation practices between scientific fields, thereby allowing for more accurate between-field comparisons of citation impact.
- A guide on journal metricsA guide for those wanting to use journal metrics for evaluation, analytics, and reviews, e.g., promotion & tenure.
Altmetrics
Alternative impact, alternative metrics (or altmetrics), include alternative means of measuring scholarship beyond citations and bibliometrics (i.e., academic engagement and impact). Examples include: mentions and citations of scholarship in news media, social media, public policy documents, patents, Wikipedia, multimedia videos, open peer review platforms, blogs, and other online sources.
Databases & Resources
- Altmetric Explorer for InstitutionsAltmetric Explorer for Institutions is an intuitive, web-based platform that enables users to search, monitor, and measure altmetrics: mentions and conversations surrounding the research outputs of specific authors, research groups, departments, and institutions.
- Altmetric BookmarkletWant to find out the Altmetric details for a research article or other output? Install the free bookmarklet for Chrome, Firefox and Safari to view the online shares and mentions of an article with a single click.
- Using Altmetric Data Responsibly: A Guide to Interpretation and Good PracticeThis guide focuses specifically on data from the data provider and company, Altmetric, but other types of altmetrics are mentioned and occasionally used as a comparison in this guide, such as the Open Syllabus database to find the educational engagement with scholarly outputs.
Visualization & Analytic Tools
- The rise of new citation indexes and the impact on Science mapping toolsAn in-depth blog post reviewing new citation visualization tools, including Citespace, VOSviewer, Citation Gecko, and more.
- CitNetExplorerCitNetExplorer is a free software tool for visualizing and analyzing citation networks of scientific publications.
Literature Mapping & Discovery Tools
- [Blog post] 3 new tools to try for Literature mapping — Connected Papers, Inciteful and LitmapsAs we see a rise in innovative literature review mapping tools, built on the backs of increasingly open metadata and citations as well as machine learning techniques, blogger Aaron Tay reviews three of the latest and slickest tools out there.
- [Blog post] ResearchRabbit is out of beta- my review of this new literature mapping toolAaron Tay reviews ResearchRabbit, one of the newest and slickest literature mapping and discovery tools.
- Connected PapersConnected Papers is an online visual tool to help researchers and applied scientists find and explore papers relevant to their field of work.
- Citation GeckoCitation Gecko allows you to search or import "seed papers" as a way to find other relevant literature based on co-citation and bibliographic coupling concepts.
- LitmapsFrom Litmaps: Litmaps finds the articles that are most relevant to your search criteria. It does this by analysing the citation patterns of the articles you select as your input. Litmaps traverses millions of papers for you in seconds and selects the most connected articles for you to review.
- ResearchRabbitResearchRabbit is designed to help support and enhance workflows as you stumble down the rabbit hole of constantly switching between different modes of searching and browsing for literature. It is also one of the first lit map tools to support co-authorship graphs
VOSviewer Visual Example
This is a visualization that represents the terms mentioned in titles and abstracts published by faculty in the VTCSOM Psychiatry Department. The larger the term or node, the more often that word occurs across publications. The connections or links between nodes/terms represents the number of times terms occur together in the same publication. The color represents the average number of citations received by publications that mention those terms. Overall, the number of publications represented here is 1,433 from a year range of 2010-2019.
Please also note that the terms in the top part of the visual, which indicate lower citation impact on average, likely need to be analyzed on their own, since the publications with those terms likely represent a different field or sub-field in psychiatry, whereas the terms in the bottom part with seemingly more citation impact represent research that focuses more on neurology and the brain, an area of research that tends to receive more citations on average.
- Interactive VOSviewer Map (from above)This interactive map of the term map above will allow you to highlight the terms and networks, zoom in, change the colors based on term clusters, publication year, citation counts, or normalized citation counts.