In search of innovative potential : The challenge of measuring disruptiveness of research using bibliometric data.
Ontology highlight
ABSTRACT:
SUBMITTER: Bornmann L
PROVIDER: S-EPMC11239872 | biostudies-literature | 2024 Jul
REPOSITORIES: biostudies-literature
Publications
In search of innovative potential : The challenge of measuring disruptiveness of research using bibliometric data.
Bornmann Lutz L Ettl Christoph C Leibel Christian C
EMBO reports 20240612 7
Similar Datasets
Project description:Bibliometric indicators are increasingly used to evaluate individual scientists-as is exemplified by the popularity of the many other publication and citation-based indicators used in evaluation. These indicators, however, cover at best some of the quality dimensions relevant for assessing a researcher: productivity and impact. At the same time, research quality has more dimensions than productivity and impact alone. As current bibliometric indicators are not covering various important quality dimensions, we here contribute to developing better indicators for those quality dimensions not yet addressed. One of the quality dimensions lacking valid indicators is an individual researcher's independence. We propose indicators to measure different aspects of independence: two assessing whether a researcher has developed an own collaboration network and two others assessing the level of thematic independence. Taken together they form an independence indicator. We illustrate how these indicators distinguish between researchers that are equally productive and have a considerable impact. The independence indicator is a step forward in evaluating individual scholarly quality.
| S-EPMC6436739 | biostudies-literature
Project description:This study addresses the critical need for regional tourism integration and sustainable development by identifying cooperation opportunities among tourist attractions within a region. We introduce a novel methodology that combines association rule mining with complex network analysis and utilizes search index data as a dynamic and contemporary data source to reveal cooperative patterns among tourist attractions. Our approach delineates a potential cooperative network within the destination ecosystem, categorizing tourist attractions into three distinct communities: core, intermediary, and periphery. These communities correspond to high, medium, and low tourist demand scales, respectively. The study uncovers a self-organizing network structure, driven by congruences in internal tourist demand and variances in external tourist experiences. Functionally, there is a directed continuum of cooperation prospects among these communities. The core community, characterized by significant tourist demand, acts as a catalyst, boosting demand for other attractions. The intermediary community, central in the network, links the core and periphery, enhancing cooperative ties and influence. Peripheral attractions, representing latent growth areas within the destination matrix, benefit from associations with the core and intermediary communities. Our findings provide vital insights into the dynamics, systemic characteristics, and fundamental mechanisms of potential cooperation networks among tourist attractions. They enable tourism management organizations to employ our analytical framework for real-time monitoring of tourism demand and flow trends. Additionally, the study guides the macro-control of tourism flows based on the tourism network, thereby improving the tourist experience and promoting coordinated development among inter-regional tourist attractions.
| S-EPMC10849253 | biostudies-literature
Project description:BackgroundRare diseases have become a major public health concern worldwide. However, detailed epidemiological data are lacking. With the development of the Internet, search queries have played an important role in disease surveillance. In this study, we explored a new method for the epidemiological research on rare diseases, using large-scale online search queries and reported case data. We distilled search logs related to rare diseases nationwide from 2016 to 2019. The case data were obtained from China's national database of rare diseases during the same period.ResultsA total of 120 rare diseases were included in this study. From 2016 to 2019, the number of patients with rare diseases estimated using search data and those obtained from the case database showed an increasing trend. Rare diseases can be ranked by the number of search estimated patients and reported patients, and the rankings of each disease in both search and reported case data were generally stable. Furthermore, the disease rankings in the search data were relatively consistent with the reported case data in each year, with more than 50% of rare diseases having a ranking difference of -20 to 20 between the two systems. In addition, the relationship between the disease rankings in the two systems was generally stable over time. Based on the relationship between the disease rankings in the search and reported case data, rare diseases can be classified into two categories.ConclusionOnline search queries may provide an important new resource for detecting rare diseases. Rare diseases can be classified into two categories to guide different epidemiological research strategies.
| S-EPMC10411025 | biostudies-literature
Project description:BackgroundThe recent surge in clinical and nonclinical health-related data has been accompanied by a concomitant increase in personal health data (PHD) research across multiple disciplines such as medicine, computer science, and management. There is now a need to synthesize the dynamic knowledge of PHD in various disciplines to spot potential research hotspots.ObjectiveThe aim of this study was to reveal the knowledge evolutionary trends in PHD and detect potential research hotspots using bibliometric analysis.MethodsWe collected 8281 articles published between 2009 and 2018 from the Web of Science database. The knowledge evolution analysis (KEA) framework was used to analyze the evolution of PHD research. The KEA framework is a bibliometric approach that is based on 3 knowledge networks: reference co-citation, keyword co-occurrence, and discipline co-occurrence.ResultsThe findings show that the focus of PHD research has evolved from medicine centric to technology centric to human centric since 2009. The most active PHD knowledge cluster is developing knowledge resources and allocating scarce resources. The field of computer science, especially the topic of artificial intelligence (AI), has been the focal point of recent empirical studies on PHD. Topics related to psychology and human factors (eg, attitude, satisfaction, education) are also receiving more attention.ConclusionsOur analysis shows that PHD research has the potential to provide value-based health care in the future. All stakeholders should be educated about AI technology to promote value generation through PHD. Moreover, technology developers and health care institutions should consider human factors to facilitate the effective adoption of PHD-related technology. These findings indicate opportunities for interdisciplinary cooperation in several PHD research areas: (1) AI applications for PHD; (2) regulatory issues and governance of PHD; (3) education of all stakeholders about AI technology; and (4) value-based health care including "allocative value," "technology value," and "personalized value."
| S-EPMC8593818 | biostudies-literature
Project description:BackgroundThe ubiquitous use of mobile phones in sending and receiving text messages has become a norm for young people. Undeniably, text messaging has become a new and important communication medium not only in the social realm but in education as well. The aim of this study is to evaluate the effectiveness of using text messaging as a means to collect data for a medical research project.A cross sectional study was carried out during a double blind, randomized controlled trial to assess the efficacy and safety of a probiotic in the management of Irritable Bowel Syndrome (IBS). The study aim was to assess the response rate of weekly symptom reports via Short Message Service (SMS). The subjects were undergraduates in a private medical university in Malaysia. They were identified through a previous university wide study as suffering from IBS based on Rome III criteria. The subjects were randomly assigned to either the treatment arm receiving a daily probiotic, or the placebo arm. They were required to score their symptoms using eight-item-questionnaires at baseline, and thereafter weekly, for a total of 8 weeks. All subjects were given the choice to communicate their symptom scores by text messaging via mobile phones or by email. SMS text messages were sent to remind trial subjects to attend face-to-face visits and to complete a paper based 34-item-questionnaires on IBS quality of life assessment at baseline and at end of 8 weeks.FindingsThe response rate of weekly symptom scores via Short Message Service (SMS) from a total of 38 subjects was 100%. Through the study, 342 reports were submitted: 33.3% of these were received on the due date without reminder, 60.0% one day after the deadline, after a single reminder, 6.1% 2-3 days after the deadline, after 2-3 reminders and 0.6% 5 days after the deadline, after SMS, phone reminder and face-to-face encounter. All SMS symptom reports, whether on time or late, were complete. With the help of SMS reminder, all trial subjects completed the paper based IBS quality of life assessment at baseline and at end of study.ConclusionsThis study found using text messaging via mobile phone an excellent instrument for collecting weekly symptom reports in response to trial medication, reminding trial subjects to attend face to face visits and completing more complex paper based evaluation. The 100% response rate of weekly symptom reports was facilitated by using simple number codes for SMS submission.Trial registrationNot appropriate.
| S-EPMC3022815 | biostudies-literature
Project description:BackgroundStudies using Taiwan's National Health Insurance (NHI) claims data have expanded rapidly both in quantity and quality during the first decade following the first study published in 2000. However, some of these studies were criticized for being merely data-dredging studies rather than hypothesis-driven. In addition, the use of claims data without the explicit authorization from individual patients has incurred litigation.ObjectiveThis study aimed to investigate whether the research output during the second decade after the release of the NHI claims database continues growing, to explore how the emergence of open access mega journals (OAMJs) and lawsuit against the use of this database affect the research topics and publication volume and to discuss the underlying reasons.MethodsPubMed was used to locate publications based on NHI claims data between 1996 and 2017. Concept extraction using MetaMap was employed to mine research topics from article titles. Research trends were analyzed from various aspects, including publication amount, journals, research topics and types, and cooperation between authors.ResultsA total of 4473 articles were identified. A rapid growth in publications was witnessed from 2000 to 2015, followed by a plateau. Diabetes, stroke, and dementia were the top 3 most popular research topics whereas statin therapy, metformin, and Chinese herbal medicine were the most investigated interventions. Approximately one-third of the articles were published in open access journals. Studies with two or more medical conditions, but without any intervention, were the most common study type. Studies of this type tended to be contributed by prolific authors and published in OAMJs.ConclusionsThe growth in publication volume during the second decade after the release of the NHI claims database was different from that during the first decade. OAMJs appeared to provide fertile soil for the rapid growth of research based on NHI claims data, in particular for those studies with two or medical conditions in the article title. A halt in the growth of publication volume was observed after the use of NHI claims data for research purposes had been restricted in response to legal controversy. More efforts are needed to improve the impact of knowledge gained from NHI claims data on medical decisions and policy making.
| S-EPMC7327589 | biostudies-literature
Project description:Questions such as how democratic a country is, how free are its media, or how independent is its judiciary are highly important to researchers and decision makers. We describe a research infrastructure that produces the world's largest dataset on democracy, governance, human rights, and related topics. The dataset is far more resolved and accurate than previous efforts, currently covers 202 political units from 1789 until the present, and is regularly updated each spring. The infrastructure involves an online survey of over 3,000 experts from 180 countries. Survey design and advanced statistical techniques are crucial for assuring data validity. The infrastructure also provides reports and analyses based on the data and easy-to-use tools for exploring and graphing the data.
| S-EPMC7660434 | biostudies-literature
Project description:Evaluation of scientific research is becoming increasingly reliant on publication-based bibliometric indicators, which may result in the devaluation of other scientific activities--such as data curation--that do not necessarily result in the production of scientific publications. This issue may undermine the movement to openly share and cite data sets in scientific publications because researchers are unlikely to devote the effort necessary to curate their research data if they are unlikely to receive credit for doing so. This analysis attempts to demonstrate the bibliometric impact of properly curated and openly accessible data sets by attempting to generate citation counts for three data sets archived at the National Oceanographic Data Center. My findings suggest that all three data sets are highly cited, with estimated citation counts in most cases higher than 99% of all the journal articles published in Oceanography during the same years. I also find that methods of citing and referring to these data sets in scientific publications are highly inconsistent, despite the fact that a formal citation format is suggested for each data set. These findings have important implications for developing a data citation format, encouraging researchers to properly curate their research data, and evaluating the bibliometric impact of individuals and institutions.
| S-EPMC3966791 | biostudies-other
Project description:Human capital-that is, resources associated with the knowledge and skills of individuals-is a critical component of economic development1,2. Learning metrics that are comparable for countries globally are necessary to understand and track the formation of human capital. The increasing use of international achievement tests is an important step in this direction3. However, such tests are administered primarily in developed countries4, limiting our ability to analyse learning patterns in developing countries that may have the most to gain from the formation of human capital. Here we bridge this gap by constructing a globally comparable database of 164 countries from 2000 to 2017. The data represent 98% of the global population and developing economies comprise two-thirds of the included countries. Using this dataset, we show that global progress in learning-a priority Sustainable Development Goal-has been limited, despite increasing enrolment in primary and secondary education. Using an accounting exercise that includes a direct measure of schooling quality, we estimate that the role of human capital in explaining income differences across countries ranges from a fifth to half; this result has an intermediate position in the wide range of estimates provided in earlier papers in the literature5-13. Moreover, we show that average estimates mask considerable heterogeneity associated with income grouping across countries and regions. This heterogeneity highlights the importance of including countries at various stages of economic development when analysing the role of human capital in economic development. Finally, we show that our database provides a measure of human capital that is more closely associated with economic growth than current measures that are included in the Penn world tables version 9.014 and the human development index of the United Nations15.
| S-EPMC8046667 | biostudies-literature
Project description:BackgroundHuman trafficking is a crime against humanity. It is also a serious threat to global health and security. Globalization has made human trafficking an easier task for the criminal organizations. No data are available on the volume, research trends, and key players in this field. Therefore, the aim of this study was to assess the research activity and research trends on human trafficking.MethodsA bibliometric method was adopted. Literature published in academic journals indexed in Scopus database was retrieved. The study period was set from 2000 to 2017.ResultsTwo thousand forty-four documents were retrieved. The average number of authors per document was 1.9. Over one third (n = 771; 37.7%) of the retrieved documents were about sex trafficking, 616 (30.1%) were about labor trafficking/forced labor, 199 (9.7%) were about child trafficking, and 138 (6.8%) were about organ trafficking. One third (n = 707; 34.6%) of the documents were in health-related fields while 1526 (74.7%) were in social sciences and humanities. The USA ranked first (n = 735; 36.0%) regarding the number of published documents. Geographic distribution of the retrieved document showed that world regions with a high prevalence of human trafficking had the least research contribution. International research collaboration has a limited contribution to the retrieved literature. The Harvard University (USA) was the most active institution (n = 39; 1.9%). International Migration (n = 35; 1.7%) was the most active journal in publishing documents on HT. Documents published in Transplantation journal received the highest number of citations per document (25.5) and two of the most cited documents were about organ trafficking.ConclusionThere was an under-representation of health-related literature on human trafficking. Literature on sex trafficking dominated the field of human trafficking. Research networks and research collaboration between the source and destination countries is important. Future research plans need to focus on health issues and on exploited/trafficked laborers.
| S-EPMC6225706 | biostudies-literature