Additional support for RCR: A validated article-level measure of scientific influence.
Ontology highlight
ABSTRACT:
SUBMITTER: Hutchins BI
PROVIDER: S-EPMC5624567 | biostudies-literature | 2017 Oct
REPOSITORIES: biostudies-literature
Publications
Additional support for RCR: A validated article-level measure of scientific influence.
Hutchins B Ian BI Hoppe Travis A TA Meseroll Rebecca A RA Anderson James M JM Santangelo George M GM
PLoS biology 20171002 10
Similar Datasets
Project description:Despite their recognized limitations, bibliometric assessments of scientific productivity have been widely adopted. We describe here an improved method to quantify the influence of a research article by making novel use of its co-citation network to field-normalize the number of citations it has received. Article citation rates are divided by an expected citation rate that is derived from performance of articles in the same field and benchmarked to a peer comparison group. The resulting Relative Citation Ratio is article level and field independent and provides an alternative to the invalid practice of using journal impact factors to identify influential papers. To illustrate one application of our method, we analyzed 88,835 articles published between 2003 and 2010 and found that the National Institutes of Health awardees who authored those papers occupy relatively stable positions of influence across all disciplines. We demonstrate that the values generated by this method strongly correlate with the opinions of subject matter experts in biomedical research and suggest that the same approach should be generally applicable to articles published in all areas of science. A beta version of iCite, our web tool for calculating Relative Citation Ratios of articles listed in PubMed, is available at https://icite.od.nih.gov.
| S-EPMC5012559 | biostudies-literature
Project description:Given the vast scale of the modern scientific enterprise, it can be difficult for scientists to make judgments about the work of others through careful analysis of the entirety of the relevant literature. This has led to a reliance on metrics that are mathematically flawed and insufficiently diverse to account for the variety of ways in which investigators contribute to scientific progress. An urgent, critical first step in solving this problem is replacing the Journal Impact Factor with an article-level alternative. The Relative Citation Ratio (RCR), a metric that was designed to serve in that capacity, measures the influence of each publication on its respective area of research. RCR can serve as one component of a multifaceted metric that provides an effective data-driven supplement to expert opinion. Developing validated methods that quantify scientific progress can help to optimize the management of research investments and accelerate the acquisition of knowledge that improves human health.
| S-EPMC5449139 | biostudies-other
Project description:The presence of web-based communities is a distinctive signature of Web 2.0. The web-based feature means that information propagation within each community is highly facilitated, promoting complex collective dynamics in view of information exchange. In this work, we focus on a community of scientists and study, in particular, how the awareness of a scientific paper is spread. Our work is based on the web usage statistics obtained from the PLoS Article Level Metrics dataset compiled by PLoS. The cumulative number of HTML views was found to follow a long tail distribution which is reasonably well-fitted by a lognormal one. We modeled the diffusion of information by a random multiplicative process, and thus extracted the rates of information spread at different stages after the publication of a paper. We found that the spread of information displays two distinct decay regimes: a rapid downfall in the first month after publication, and a gradual power law decay afterwards. We identified these two regimes with two distinct driving processes: a short-term behavior driven by the fame of a paper, and a long-term behavior consistent with citation statistics. The patterns of information spread were found to be remarkably similar in data from different journals, but there are intrinsic differences for different types of web usage (HTML views and PDF downloads versus XML). These similarities and differences shed light on the theoretical understanding of different complex systems, as well as a better design of the corresponding web applications that is of high potential marketing impact.
| S-EPMC3095621 | biostudies-literature
Project description:Classification schemes for scientific activity and publications underpin a large swath of research evaluation practices at the organizational, governmental, and national levels. Several research classifications are currently in use, and they require continuous work as new classification techniques becomes available and as new research topics emerge. Convolutional neural networks, a subset of "deep learning" approaches, have recently offered novel and highly performant methods for classifying voluminous corpora of text. This article benchmarks a deep learning classification technique on more than 40 million scientific articles and on tens of thousands of scholarly journals. The comparison is performed against bibliographic coupling-, direct citation-, and manual-based classifications-the established and most widely used approaches in the field of bibliometrics, and by extension, in many science and innovation policy activities such as grant competition management. The results reveal that the performance of this first iteration of a deep learning approach is equivalent to the graph-based bibliometric approaches. All methods presented are also on par with manual classification. Somewhat surprisingly, no machine learning approaches were found to clearly outperform the simple label propagation approach that is direct citation. In conclusion, deep learning is promising because it performed just as well as the other approaches but has more flexibility to be further improved. For example, a deep neural network incorporating information from the citation network is likely to hold the key to an even better classification algorithm.
| S-EPMC8112690 | biostudies-literature
Project description:To assess household food waste in large-scale studies with the aim to understand differences in food waste levels between households, surveys are often employed. Yet, survey measures rely on people's awareness of their own food waste levels, draw upon their memory of instances of food waste, and can be subject to social desirability. Therefore, existing survey measures may not be optimal in measuring household food waste. The Household Food Waste Questionnaire has been developed to ameliorate these issues. It uses a pre-announcement to increase awareness of food waste, focuses on a short and specific time period (i.e. the past week), and specifies detailed product categories, whereas previous surveys mostly used general questions without reference to time period or product category. The amount of household food waste estimated using the Household Food Waste Questionnaire is likely to considerably underestimate the actual amount, so the method should not be used to obtain accurate waste amounts, but rather to distinguish differences between households and/or across time. Advantages compared to existing survey methods are that it: •Distinguishes better between households with low versus high levels of food waste•Correlates more highly with other measurements of household food waste (diary, kitchen caddy, photograph coding).
| S-EPMC6889683 | biostudies-literature
Project description:Surveys are widely used to assess hospital management with the aim of understanding differences in management practices. However, survey measures with prior notice can make hospitals change their routine practices and are unable to reflect the actual hospital management level. The World Management Survey (WMS) methodology has been developed to ameliorate these issues. It uses a double-blinded method and open-ended question design. The Chinese Hospital Management Survey (CHMS) project is the first to adapt the WMS methodology in China, which it uses to measure hospital management level in 510 hospitals. This paper provides an instrument to better measure actual management practices, which makes it possible to compare the management level of hospitals in China and other countries.
| S-EPMC9975700 | biostudies-literature
Project description:Article-level metrics (ALMs) provide a wide range of metrics about the uptake of an individual journal article by the scientific community after publication. They include citations, usage statistics, discussions in online comments and social media, social bookmarking, and recommendations. In this essay, we describe why article-level metrics are an important extension of traditional citation-based journal metrics and provide a number of example from ALM data collected for PLOS Biology.
| S-EPMC3805468 | biostudies-literature
Project description:Biomedical literature is an essential source of biomedical evidence. To translate the evidence for biomedicine study, researchers often need to carefully read multiple articles about specific biomedical issues. These articles thus need to be highly related to each other. They should share similar core contents, including research goals, methods, and findings. However, given an article r, it is challenging for search engines to retrieve highly related articles for r. In this paper, we present a technique PBC (Passage-based Bibliographic Coupling) that estimates inter-article similarity by seamlessly integrating bibliographic coupling with the information collected from context passages around important out-link citations (references) in each article. Empirical evaluation shows that PBC can significantly improve the retrieval of those articles that biomedical experts believe to be highly related to specific articles about gene-disease associations. PBC can thus be used to improve search engines in retrieving the highly related articles for any given article r, even when r is cited by very few (or even no) articles. The contribution is essential for those researchers and text mining systems that aim at cross-validating the evidence about specific gene-disease associations.
| S-EPMC4595445 | biostudies-literature
Project description:Interest in and use of article-level metrics (ALMs) has grown rapidly amongst the research community, by researchers, publishers, funders, and research institutions. As this happens, it is critical to ensure secure and reliable data that is trustworthy and can be used by all. Two case studies are presented, which illustrate different approaches to establishing ALM data integrity.
| S-EPMC4546647 | biostudies-other
Project description: Not available
| S-EPMC4626085 | biostudies-literature