Browse
Submit Data
Databases
API
Help

Dataset Information

0 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

The multiplicity of analysis strategies jeopardizes replicability: lessons learned across disciplines.

ABSTRACT: For a given research question, there are usually a large variety of possible analysis strategies acceptable according to the scientific standards of the field, and there are concerns that this multiplicity of analysis strategies plays an important role in the non-replicability of research findings. Here, we define a general framework on common sources of uncertainty arising in computational analyses that lead to this multiplicity, and apply this framework within an overview of approaches proposed across disciplines to address the issue. Armed with this framework, and a set of recommendations derived therefrom, researchers will be able to recognize strategies applicable to their field and use them to generate findings more likely to be replicated in future studies, ultimately improving the credibility of the scientific process.

SUBMITTER: Hoffmann S

PROVIDER: S-EPMC8059606 | biostudies-literature | 2021 Apr

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Publications

The multiplicity of analysis strategies jeopardizes replicability: lessons learned across disciplines.

Hoffmann Sabine S Schönbrodt Felix F Elsas Ralf R Wilson Rory R Strasser Ulrich U Boulesteix Anne-Laure AL

Royal Society open science 20210421 4

For a given research question, there are usually a large variety of possible analysis strategies acceptable according to the scientific standards of the field, and there are concerns that this multiplicity of analysis strategies plays an important role in the non-replicability of research findings. Here, we define a general framework on common sources of uncertainty arising in computational analyses that lead to this multiplicity, and apply this framework within an overview of approaches propose ...[more]

PMID: 33996122

Similar Datasets

Battling the opioid epidemic: lessons learned and management strategies.

Project description: Not available

| S-EPMC6470326 | biostudies-literature

Therapeutic strategies for COVID-19: progress and lessons learned.

Project description:The coronavirus disease 2019 (COVID-19) pandemic has stimulated tremendous efforts to develop therapeutic strategies that target severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) and/or human proteins to control viral infection, encompassing hundreds of potential drugs and thousands of patients in clinical trials. So far, a few small-molecule antiviral drugs (nirmatrelvir-ritonavir, remdesivir and molnupiravir) and 11 monoclonal antibodies have been marketed for the treatment of COVID-19, mostly requiring administration within 10 days of symptom onset. In addition, hospitalized patients with severe or critical COVID-19 may benefit from treatment with previously approved immunomodulatory drugs, including glucocorticoids such as dexamethasone, cytokine antagonists such as tocilizumab and Janus kinase inhibitors such as baricitinib. Here, we summarize progress with COVID-19 drug discovery, based on accumulated findings since the pandemic began and a comprehensive list of clinical and preclinical inhibitors with anti-coronavirus activities. We also discuss the lessons learned from COVID-19 and other infectious diseases with regard to drug repurposing strategies, pan-coronavirus drug targets, in vitro assays and animal models, and platform trial design for the development of therapeutics to tackle COVID-19, long COVID and pathogenic coronaviruses in future outbreaks.

| S-EPMC10113999 | biostudies-literature

Strategies and Lessons Learned for Supporting and Supervising Peer Specialists.

Project description:As peer-delivered services are increasingly embedded within behavioral health organizations, a need has arisen to identify practices that facilitate supervision and support of peer providers. The authors present supervision strategies and lessons learned that emerged during a large pragmatic trial in three supportive housing agencies that examined a peer-delivered healthy lifestyle intervention for people with serious mental illness. Strategies included access to multiple supervisors, formal and informal support, acknowledgment of lack of role clarity, ongoing role negotiation, a collaborative approach to troubleshooting challenges, explicit emphasis on peer specialists' value, and linking peer specialists to opportunities for mutual support and professional development.

| S-EPMC8656242 | biostudies-literature

Replicability and Prediction: Lessons and Challenges from GWAS.

Project description:Since the publication of the Wellcome Trust Case Control Consortium (WTCCC) landmark study a decade ago, genome-wide association studies (GWAS) have led to the discovery of thousands of risk variants involved in disease etiology. This success story has two angles that are often overlooked. First, GWAS findings are highly replicable. This is an unprecedented phenomenon in complex trait genetics, and indeed in many areas of science, which in past decades have been plagued by false positives. At a time of increasing concerns about the lack of reproducibility, we examine the biological and methodological reasons that account for the replicability of GWAS and identify the challenges ahead. In contrast to the exemplary success of disease gene discovery, at present GWAS findings are not useful for predicting phenotypes. We close with an overview of the prospects for individualized prediction of disease risk and its foreseeable impact in clinical practice.

| S-EPMC6003860 | biostudies-literature

Recruitment strategies and lessons learned from a large genetic study of African Americans.

Project description:Genetic studies must enroll large numbers of participants to obtain adequate statistical power. Data are needed on how researchers can best use limited financial and practical resources to achieve these targets, especially in under-represented populations. This paper provides a retrospective analysis of the recruitment strategies for a large glaucoma genetics study in African Americans. The Primary Open-Angle African American Glaucoma Genetics study enrolled 10,192 African American subjects from the Philadelphia region. Major recruitment approaches included clinic enrollment from University of Pennsylvania (UPenn) sites, clinic enrollment from external sites, sampling of Penn Medicine Biobank (PMBB), and community outreach. We calculated the enrollment yield, cost per subject, and seasonal trends of these approaches. The majority (65%) of subject were enrolled from UPenn sites with an average cost of $133/subject. Over time, monthly case enrollment declined as the pool of eligible subjects was depleted. Expanding to external sites boosted case numbers ($129/subject) and the biobank provided additional controls at low cost ($5/subject), in large part due to the generosity of PMBB providing samples free of cost. Community outreach was costly with low return on enrollment ($978/subject for 220 subjects). Summer months (Jun-Aug) produced the highest recruitment yields (p<0.001). Genetic studies will benefit from a multi-pronged and culturally sensitive recruitment approach. In our experience, the biobank was most cost-effective for control enrollment, while recruitment from clinics (including expansion to new sites) was necessary to recruit fully phenotyped cases.

| S-EPMC9897316 | biostudies-literature

Recruitment Strategies and Lessons Learned from the Children's Healthy Living Program Prevalence Survey.

Project description:The US Affiliated Pacific region's childhood obesity prevalence has reached epidemic proportions. To guide program and policy development, a multi-site study was initiated, in collaboration with partners from across the region, to gather comprehensive information on the regional childhood obesity prevalence. The environmental and cultural diversity of the region presented challenges to recruiting for and implementing a shared community-based, public health research program. This paper presents the strategies used to recruit families with young children (n = 5775 for children 2 - 8 years old) for obesity-related measurement across eleven jurisdictions in the US Affiliated Pacific Region. Data were generated by site teams that provided summaries of their recruitment strategies and lessons learned. Conducting this large multi-site prevalence study required considerable coordination, time and flexibility. In every location, local staff knowledgeable of the community was hired to lead recruitment, and participant compensation reflected jurisdictional appropriateness (e.g., gift cards, vouchers, or cash). Although recruitment approaches were site-specific, they were predominantly school-based or a combination of school- and community-based. Lessons learned included the importance of organization buy-in; communication, and advance planning; local travel and site peculiarities; and flexibility. Future monitoring of childhood obesity prevalence in the region should consider ways to integrate measurement activities into existing organizational infrastructures for sustainability and cost-effectiveness, while meeting programmatic (e.g. study) goals.

| S-EPMC5690270 | biostudies-literature

Lessons Learned from CNV Analysis of Major Birth Defects.

Project description:The treatment of major birth defects are key concerns for child health. Hitherto, for the majority of birth defects, the underlying cause remains unknown, likely to be heterogeneous. The implicated mortality and/or reduced fecundity in major birth defects suggest a significant fraction of mutational de novo events among the affected individuals. With the advent of systematic array-based molecular karyotyping, larger cohorts of affected individuals have been screened over the past decade. This review discusses the identification of disease-causing copy-number variations (CNVs) among individuals with different congenital malformations. It highlights the differences in findings depending on the respective congenital malformation. It looks at the differences in findings of CNV analysis in non-isolated complex congenital malformations, associated with central nervous system malformations or intellectual disabilities, compared to isolated single organ-system malformations. We propose that the more complex an organ system is, and the more genes involved during embryonic development, the more likely it is that mutational de novo events, comprising CNVs, will confer to the expression of birth defects of this organ system.

| S-EPMC7663563 | biostudies-literature

Genomic Variation: Lessons Learned from Whole-Genome CNV Analysis.

Project description:One of the most fundamental goals of the study of human genetics was to determine the relationship between genomic variation and human disease. The effects of large-scale structural variation, such as aneuploidy and other cytogenetically visible imbalances, as well as sequence-level variation, have been studied for several decades. However, compared to these, the impact of submicroscopic copy number variants (CNV) has only recently been appreciated. Despite this, lessons learned from the study of CNVs have already proven significant and broadly applicable. From expanding the concept of normal human variation to providing concrete examples of the utility of genomics in clinical care and challenging notions of the genetic architecture of complex disease, CNVs have provided valuable insights into the genomics of human health and development.

| S-EPMC4129219 | biostudies-literature

Software Carpentry: lessons learned.

Project description:Since its start in 1998, Software Carpentry has evolved from a week-long training course at the US national laboratories into a worldwide volunteer effort to improve researchers' computing skills. This paper explains what we have learned along the way, the challenges we now face, and our plans for the future.

| S-EPMC3976103 | biostudies-literature

Lessons Learned from the COVID-19 Pandemic: Interpreting Vaccination Strategies in a Nationwide Demographic Study.

Project description:ObjectiveBrazil was strongly affected by the COVID-19 pandemic. Its continental dimension and socio-demographic characteristics pose challenges to distribution and accessibility, making vaccination programs challenging. The objectives of the study were to describe the clinical and demographic characteristics of the general population vaccinated against COVID-19 by October 2021 and analyze the strategies implemented during the vaccination program.Study design and settingA retrospective nationwide study that analyzed data from the OpenDataSUS platform of the Informatics Department of the Brazilian Ministry of Health (DataSUS), which contains information from all individuals in Brazil who have received at least one dose of any vaccine against COVID-19 approved by the National Health Agency (ANVISA) from 17 January to 3 October 2021.ResultsUntil 3 October, a total of 146,254,578 persons (68.6 per 100 inhabitants) received at least one dose of a vaccine in Brazil. The north and northeast regions had the lowest vaccination rates compared with the remaining regions (North: 56.8, Northeast: 62.0, South: 74.4, and Southeast: 73.2 per 100 inhabitants). Elderly individuals had the highest vaccination rates, particularly those above 70 years old. Heterologous dosing regimens were administered to 1,063,079 individuals (0.7% of those receiving the first dose).ConclusionsThe COVID-19 vaccination program reached more than two-thirds of the population in Brazil by 9 months after its start, but the vaccination coverage was heterogeneous, reflecting the country's geographic and socio-demographic characteristics. Establishing priority groups for vaccination was a main characteristic of the vaccination strategy. In addition, technology transfer agreements have played an important role in increasing vaccine accessibility.

| S-EPMC11209574 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data