We believe it is the role of Digital Science to help the scientometrics community access information it needs to develop open, transparent research indicators. In Barcelona: A beautiful horizon, our CEO Daniel Hook describes the history and vision of this commitment. Researchers can use Altmetric and Dimensions data to study how research is funded, communicated, commercialized, and how it makes an impact in the world.

For years, research has shown that inclusive datasets like Dimensions are essential for understanding the global research landscape, whether the interest is open access measurement or publishing diversity. We are proud to make these data available for the study of science.

Through the Scientometric Researcher Access to Data (SRAD) program, we offer no-cost access to Altmetric and Dimensions for non-commercial scientometric research projects, through which you will get access to the Altmetric Explorer, Dimensions Analytics, our APIs (Altmetric Explorer API, Altmetric Details Page API, and the Dimensions Analytics API) and we are now expanding research to Dimensions data by offering access to the Dimensions on Google BigQuery (GBQ) dataset through Google’s Analytics Hub.

By expanding access to Dimensions on GBQ, we are excited to facilitate researchers in answering complex questions with big data, exploring and linking more datapoints, and connecting Dimensions data to other open datasets!”

Kathryn Weber-Boer

Director Scientometrics

Expanding access

Access supports university-affiliated scientometrics researchers with clearly defined research projects, aiming for published results.  Scientometric research involves the quantitative study of science, technology, and innovation. It aims to measure and evaluate the impact, patterns and trends in scientific research and its influence across disciplines and institutions. We also welcome projects that support the development, testing, or comparison of bibliometric or scientometric indicators. Innovative research is particularly encouraged; duplicative research questions are not (with the exception of replication studies, which are encouraged). Access is not intended for use in commercial products, for self assessment, or non-scientometric research. 

Special consideration is given for International Society for Scientometrics and Informetrics members and associates of the Research on Research Institute.

Monthly meetings

In addition to access, scientometric researchers meet monthly to share information about Digital Science datasets (Altmetric & Dimensions), access methods (APIs, BigQuery, Google Analytics Hub), and using these data to study science:

Learn more

For information on how we process personal information, please refer to the Dimensions privacy policy. Email addresses are used to monitor usage and ensure compliance with terms of use. See our Terms and Conditions to learn more.

Results

We are proud of the results achieved by using our data, which include the following output:

Articles

• Scientific elite revisited: patterns of productivity, collaboration, authorship and impact

• Scale-free growth in regional scientific capacity building explains long-term scientific dominance

• Journal editors’ views on altmetrics in tourism and hospitality research

• A multiple linear regression analysis to measure the journal contribution to the social attention of research

Preprints

• Unveiling tortured phrases in humanities and social sciences

• Sneaked references: Cooked reference metadata inflate citation counts

• Sneaked references: Cooked reference metadata inflate citation counts (resulting publication)

Conference presentations

• Exploratory analysis of policy document sources in Altmetric.com and Overton

• Do popular research topics attract the most social attention? A first proposal based on OpenAlex and Wikipedia

Datasets

• Care to share: Dataset and resources for Dutch National Open Science Festival hackathon

dataset

• Data journals and data papers in the humanities

Problematic Paper Screener

We are also particularly proud that our support powers the Problematic Paper Screener, a community-supported and driven effort to monitor publications with a range of problems from artificially generated content to feet of clay, first introduced here.

Related

Dimensions

Scientometric research page

Altmetric

Research page

The post Introducing SRAD appeared first on Digital Science.

Introduction

The Altmetric 500 is a new initiative that digs into the context of research output and the detailed measures of attention per source. We know Altmetric delivers insight into the wider impact and influence of academic articles, but how does this new initiative work behind the scenes?

New in 2024

This year, we decided to use Altmetric to investigate more closely global attention to research; we looked at articles and books with the most attention by geographic region and by a number of categories from news media, blogs, social media, policy documents, Wikipedia, and patents, as well as research that had broad attention across multiple mention source categories (the calculation is described below).

And, thanks to the recent release of Altmetric on Google’s BigQuery (GBQ), where this deep-dive report was put together, it can be rebuilt, tweaked or customized by anyone with a licence to the data. By introducing additional filters, a whole new set of insights has been created:

• publishers can use the data to understand how, where, and by whom their published content is being shared;
• funders can learn where their funds made the biggest splash;
• research institutions can focus on the research produced by themselves and similar institutions.

Because we believe strongly in data availability, we have shared the code we used on Figshare to be accessed, copied, and reused by others (for non-commercial purposes, of course).

It is our belief that there are no choices in the study of science that come without exclusion; the purpose here is not to provide a definitive list of the “best” papers published in 2023 (December 2022-November 2023). The list (like this post) shows that “attention” can mean many things, and what really matters is the question one is asking. We’d like to open the conversation, and look forward to seeing what the research community does with the data.

How we put this report together

Initially we broke publications down by field of research, using the ANZSRC 2020 Fields of Research (FoRs); the United Nations Sustainable Development Goals (SDGs); and exclusively regional collaboration. The results show in brilliant colour what we already knew to be true: the deeper you dig, the more remarkable science turns out to be!

Through the magic of machine learning, Dimensions categorizes research output, assigning Sustainable Development Goals (SDGs) and fields of research (FoRs) to the appropriate publications. (More information about how that magic works can be found here for SDGs, FoR identification, and the Dimensions Data Approach in general.)

Global regions (listed in Table 1) were assigned with the aim of democratising our attention to the research landscape: for the regional highlights, we limited our results to those papers produced in collaboration within these regions (excluding those where there was collaboration outside the region). This approach to geographic distribution is deliberate but open to discussion. It was important for us to display a more equitable distribution of publications and not have data from some regions be overshadowed by countries that have an extremely high number of research publication outputs. Therefore, for example, Mexico is grouped with Latin America and the Caribbean instead of North America, and Oceania excludes Australia and New Zealand.

Methods

We defined our criteria for inclusion: publications that have been published between December 2022 and November 2023, with the type of chapter, article, or book. In calculating mentions and citations, we excluded any which occurred after December 1, 2023 (or were identified by Altmetric after June 25, 2024).

Attention

We counted the number of social media profiles (from Reddit, Facebook, X/Twitter) which had mentioned the publication (‘social_media_attention_sources’ in the breadth of attention calculation), the number of mentions in news or blog sources, and the number of citations in policy documents, patents, or Wikipedia pages.

Categories

For each publication, we used the Dimensions-assigned fields of research, any related UN Sustainable Development Goals, and the countries of the research organizations affiliated with each publication (a total of 555 categories, including the overall tops). Some publications were the top mentioned in more than one category or attention type (there are 362 unique articles in the Altmetric 500 of 2023).

Breadth of attention

Figure 1 represents the calculation used to highlight breadth of attention. This calculation begins by identifying the highest number of social media attention sources, news/blog mentions, policy mentions, and scientific citations within each category (geographic region, research field, and SDG). The mentions received by each research output are then divided by the maximum number of mentions per category. These adjusted values are summed and averaged by four, to determine a “breadth of attention indicator” for each paper within each category. Each paper receives multiple breadth of attention indicators as it is evaluated across three different parameters: geographic region, research field, and SDGs.

Some initial observations

An interesting feature of the attention to research is that specific research output often gains attention in one attention source category while barely acknowledged in another. This holds true for the Altmetric 500 in general, and was notable especially in comparing the most-mentioned research output by Wikipedia pages versus news mentions (Figure 3). It was also interesting to note that the publications with the most attention in these venues were not necessarily those with relatively high scientific citation.

However, despite the tendency to excel in one category of attention rather than many, we would like to highlight the publications which garnered the most attention from multiple sources: in policy documents and scientific citation (Figure 2); in policy documents and news articles (Figure 3); on Wikipedia and in the news (Figure 4); or in the mainstream and social media (Figure 5). Hover over the scatter points on these images to see the titles which were most mentioned in these attention categories.

Policy vs. scientific citations

^{Figures 2 and 3.}

Some examples we would like to highlight include:

1) One book in a series of three (Climate Change 2021 – The Physical Science Basis, Climate Change 2022 – Mitigation of Climate Change, and Climate Change 2022 – Impacts, Adaptation and Vulnerability), each of which made the Altmetric 500 for 2023, in multiple categories (with the most mentions in policy documents, on Wikipedia, and in scientific citations, in both the fields of Environmental Sciences and Economics, and the UN SDG Climate Action.

2) Introducing ACLED: An Armed Conflict Location and Event Dataset was the top of scientific citations and policy attention for publications produced within a single geographic region (in this case, the University of Oslo, in non-EU Europe), SDG 16 – Peace, Justice and Strong Institutions, and the field of Human Society.

3) Finally, COVID-19 pandemic and mitigation strategies: implications for maternal and child health and nutrition was the top for both scientific and policy citations in the UN SDG 1 – No Poverty and 6 – Clean Water and Sanitation, as well as top in scientific citations for the SDG 2 – Zero Hunger.

There are also articles which have had a relatively high level of attention from the scientific community (indicated by citations) and also received attention in policy documents (one of which has been mentioned in a patent application), but were not picked up by news media, blogs, or in social media. An example of this phenomenon is Atoms in molecules : a quantum theory.

The scatter plot of news and blog mentions relative to policy document mentions shows that most attention to the tops are either highly cited by news/blogs or policy, but the few papers which were the most highly cited in both highlight some of the major issues of 2023: GPT/LLMs and long Covid, as well as areas of perennial attention (climate change and autism). The publication Introducing ACLED had the highest number of policy mentions (in 60 policy documents from policy organizations including the World Bank, the Food and Agriculture Organization of the United Nations, Africa Portal, and the National Bureau of Economic Research), but did not have any news attention at all.

News vs. Wikipedia and News vs. X attention

^{Figures 4 and 5.}

Finally, the European Commission (EC) had the greatest number of titles and top categories among funders; these numbers rise substantially when European Research Council (ERC) grants are also included. The titles associated with these grants are listed in Table 4. These titles are often in the top of one or more SDGs and one or more fields; they top news and blog mentions, have exceptionally broad attention and include tops of Wikipedia, X profiles, and Facebook walls.

We cannot explain here why publications gather more attention in one source than another, but Altmetric exists to provide the kind of data about attention that could be used to investigate that question.

Next steps

Over the next few months, we’ll be exploring many facets of this dataset. The wide range of sources of attention make this an interesting dataset, no matter what kind of attention is interesting to you. Connecting the results to Altmetric on GBQ makes the results sortable and aggregatable by publisher, journal, funder, and affiliated university (see them listed below).

Tables 4-8.

We’ll also be comparing this method to the approach of the previous Top 100 lists. To set the stage for that analysis, keep your eyes peeled for Ten Years of the Top 100, coming soon.

A note of caution

Among the Altmetric 500 are a few articles which may have attracted attention for unexpected reasons. At Digital Science, we think all research should be visible and that includes research published in non-indexed and emerging journals, or on preprint repositories. It also means that we don’t remove retracted papers from our dataset. We highlight them, include retraction notices in our publications dataset, and follow the publisher’s title edits to indicate retractions. It should come as no surprise to followers of recent news that retracted articles also garner a lot of attention. We track that, too. We think this information is worth having, and worth studying (see our own Leslie McIntosh’s posts on the misuse of research in law and identifying plagiarism. Which retracted articles get attention tells us a lot about what matters in public discourse, and the fact of article retraction tells us a lot about the challenges that confront science in our digital publishing world and in a culture of “publish or perish”.

For example, Nature’s RETRACTED ARTICLE: Evidence of near-ambient superconductivity in a N-doped lutetium hydride is in this year’s Tops, having been discussed by the most news/blogs, the most YouTube videos, and having the greatest breadth of attention in the field of chemical sciences. There was a big buzz about the results of the paper when it was published, because the world is waiting for better solutions for conductivity. The Dimensions Research Assistant tells us that, “Near-ambient superconductivity matters because it brings the prospect of superconducting technologies operating at practical temperatures and pressures closer to reality, potentially transforming energy transmission, storage, and magnetic applications with unprecedented efficiency and reduced environmental impact (Mourachkine, 2006).” There was a second burst of attention following the retraction note published in November 2023 (which also gained substantial attention).

Data sources

The Altmetric 500 can be found in Figshare: https://doi.org/10.6084/m9.figshare.25047692

More about Altmetric on GBQ can be found here: https://www.altmetric.com/solutions/altmetric-on-gbq/

The post Altmetric 500: Methodology appeared first on Digital Science.