Application of computer-based testing in the Korean Medical Licensing Examination, the emergence of the metaverse in medical education, journal metrics and statistics, and appreciation to reviewers and volunteers.
Application of computer-based testing in the Korean Medical Licensing Examination, the emergence of the metaverse in medical education, journal metrics and statistics, and appreciation to reviewers and volunteers.
Project description:BackgroundPeer review is widely used in academic fields to assess a manuscript's significance and to improve its quality for publication. This scoping review will assess existing peer review guidelines and/or checklists intended for reviewers of biomedical journals and provide an overview on the review guidelines.MethodsPubMed, Embase, and Allied and Complementary Medicine (AMED) databases were searched for review guidelines from the date of inception until February 19, 2021. There was no date restriction nor article type restriction. In addition to the database search, websites of journal publishers and non-publishers were additionally hand-searched.ResultsOf 14,633 database publication records and 24 website records, 65 publications and 14 websites met inclusion criteria for the review (78 records in total). From the included records, a total of 1,811 checklist items were identified. The items related to Methods, Results, and Discussion were found to be the highly discussed in reviewer guidelines.ConclusionThis review identified existing literature on peer review guidelines and provided an overview of the current state of peer review guides. Review guidelines were varying by journals and publishers. This calls for more research to determine the need to use uniform review standards for transparent and standardized peer review.Protocol registrationThe protocol for this study has been registered at Research Registry (www.researchregistry.com): reviewregistry881.
Project description:The Journal of the Medical Library Association (JMLA) recently issued a call for submissions that recognize and address social injustices; speak to diversity, equity, and inclusion in our workforce and among our user populations; and share critical perspectives on health sciences librarianship as well as those on any topic within JMLA's scope written by authors who are Black, Indigenous, or People of Color. We also committed to creating more equitable opportunities for authors, reviewers, and editorial board members from marginalized groups. As part of this effort, we conducted a demographic survey of all individuals who served as a member of the JMLA editorial board or reviewer or had submitted a manuscript to JMLA between 2018 and 2020. We found that most survey respondents are white, heterosexual, women and do not identify with a disability, meaning that JMLA is missing out on a diversity of perspectives and life experiences that could improve the journal's processes and policies, enrich its content, and accelerate the research and practice of health sciences librarianship. Therefore, to avoid perpetuating or aggravating systemic biases and power structures in scholarly publishing or health sciences librarianship, we pledge to take concrete steps toward making JMLA a more diverse and inclusive journal.
Project description:ObjectivesTo investigate whether there is an association between women's representation as peer reviewers and editors of medical journals.MethodsIn this cross-sectional study, the gender of editors and peer reviewers of journals of the British Medical Journal Publishing Group (BMJ-PG) in 2020 was determined based on given names. Trends over time were analysed for the BMJ between 2009 and 2017.ResultsOverall, this study included 47 of the 74 journals in the BMJ-PG. Women accounted for 30.2% of the 42 539 peer reviewers, with marked variation from 8% to 50%. Women represented 33.4% of the 555 editors, including 19.2% of the 52 editors-in-chief. There was a moderate positive correlation between the percentage of women as editors and as reviewers (Spearman correlation coefficient 0.590; p<0.0001). The percentage of women as editors, excluding editors-in-chief, was higher when the editor-in-chief was a woman than a man (53.3% vs 29.2%, respectively; p<0.0001). Likewise, the percentage of women as peer reviewers was higher in journals that had a woman as editor-in-chief in comparison with a man (32.0% vs 26.4%, respectively; p<0.0001). There was a slight increase in the percentage of women as peer reviewers from 27.3% in 2009 to 29.7% in 2017 in the BMJ.ConclusionsWomen account for less than one in three peer reviewers of medical journals. Women's representation as peer reviewers is higher in journals with higher percentage of women as editors or with a woman as editor-in-chief. It is, thus, imperative to address the persisting gender gap at all levels of the publishing system.
Project description:ObjectiveMany journals permit authors to submit supplementary material for publication alongside the article. We explore the value, use and role of this material in biomedical journal articles from the perspectives of authors, peer reviewers and readers.Design and settingWe conducted online surveys (November-December 2016) of corresponding authors and peer reviewers at 17 BMJ Publishing Group journals in a range of specialities.ParticipantsParticipants were asked to respond to one of three surveys: as authors, peer reviewers or readers.ResultsWe received 2872/20340 (14%) responses: authors 819/6892 (12%), peer reviewers 1142/6682 (17%) and readers 911/6766 (14%). Most authors submitted (711/819, 87%) and 80% (724/911) of readers reported reading supplementary material with their last article, while 95% (1086/1142) of reviewers reported seeing these materials sometimes. Additional data tables were the most common supplementary material reported (authors: 74%; reviewers: 89%; readers: 67%). A majority in each group indicated additional tables were most useful to readers (61%-77%); 20%-36% and 3%-4% indicated they were most useful to peer reviewers and journal editors, respectively. Checklists and reporting guidelines showed the opposite: higher proportions of each group regarded these as most useful to journal editors. All three groups favoured the publication of additional tables and figures on the journal's website (80%-83%), with <4% of each group responding that these do not need to be available. Approximately one-fifth (16%-23%) responded that raw study data should be available on the journal's website, while 24%-33% said that these materials should not be made available anywhere.ConclusionsAuthors, peer reviewers and readers agree that supplementary materials are useful. Supplementary tables and figures were favoured over reporting checklists or raw data for reading but not for study replication. Journals should consider the roles, resource costs and strategic placement of supplementary materials to ensure optimal usage and minimise waste.Trial registration numberNCT02961036.
Project description:Measuring the impact of public health science or research is important especially when it comes to health outcomes. Achieving the desired health outcomes take time and may be influenced by several contributors, making attribution of credit to any one entity or effort problematic. Here we offer a science impact framework (SIF) for tracing and linking public health science to events and/or actions with recognized impact beyond journal metrics. The SIF was modeled on the Institute of Medicine's (IOM) Degrees of Impact Thermometer, but differs in that SIF is not incremental, not chronological, and has expanded scope. The SIF recognizes five domains of influence: disseminating science, creating awareness, catalyzing action, effecting change and shaping the future (scope differs from IOM). For public health, the goal is to achieve one or more specific health outcomes. What is unique about this framework is that the focus is not just on the projected impact or outcome but rather the effects that are occurring in real time with the recognition that the measurement field is complex, and it takes time for the ultimate outcome to occur. The SIF is flexible and can be tailored to measure the impact of any scientific effort: from complex initiatives to individual publications. The SIF may be used to measure impact prospectively of an ongoing or new body of work (e.g., research, guidelines and recommendations, or technology) and retrospectively of completed and disseminated work, through linking of events using indicators that are known and have been used for measuring impact. Additionally, linking events offers an approach to both tell our story and also acknowledge other players in the chain of events. The value added by science can easily be relayed to the scientific community, policy makers and the public.