New relevance and significance measures to replace p-values.
Ontology highlight
ABSTRACT:
SUBMITTER: Stahel WA
PROVIDER: S-EPMC8208587 | biostudies-literature | 2021
REPOSITORIES: biostudies-literature
Publications
The p-value has been debated exorbitantly in the last decades, experiencing fierce critique, but also finding some advocates. The fundamental issue with its misleading interpretation stems from its common use for testing the unrealistic null hypothesis of an effect that is precisely zero. A meaningful question asks instead whether the effect is relevant. It is then unavoidable that a threshold for relevance is chosen. Considerations that can lead to agreeable conventions for this choice are pres ...[more]
Similar Datasets
Project description:Importance of the fieldDisrupted l-methionine (Met) metabolism can lead to hepatic, neurological and cardiovascular dysfunction in humans. Aberrant methyl group flux likely contributes to the development of these pathologies, but when patients also become hypermethionemic, additional toxicological mechanisms may be relevant.Areas covered in this reviewFollowing a discussion of the causes of hypermethionemia in humans, evidence for the toxicological roles and clinical significance of the Met transmethylation (TM), transamination (TA) and sulfoxidation (SO) pathways will be presented.What the reader will gainRecent data from freshly isolated mouse hepatocytes (FIMHs) confirmed previous in vivo results in rodents that Met TM is a detoxification pathway while Met TA leads to toxicity. Gender-related differences in Met accumulation and metabolism in FIMHs correlated with gender differences in toxicity. Data obtained from FIMHs also implicated Met SO in Met metabolism and toxicity. Currently, little is known about the mechanisms and biological significance of Met sulfoxidation in humans.Take home messageIn hypermethionemic patients, clinical and dietary interventions should focus on increasing Met TM and decreasing Met TA and SO. Novel biomarkers of hypermethionemia in humans that correlate with pathological end points are needed to better understand the impact of the condition.
| S-EPMC2957509 | biostudies-literature
Project description:The arrival of modern brain imaging technologies has provided new opportunities for examining the biological essence of human intelligence as well as the relationship between brain size and cognition. Thanks to these advances, we can now state that the relationship between brain size and intelligence has never been well understood. This view is supported by findings showing that cognition is correlated more with brain tissues than sheer brain size. The complexity of cellular and molecular organization of neural connections actually determines the computational capacity of the brain. In this review article, we determine that while genotypes are responsible for defining the theoretical limits of intelligence, what is primarily responsible for determining whether those limits are reached or exceeded is experience (environmental influence). Therefore, we contend that the gene-environment interplay defines the intelligent quotient of an individual.
| S-EPMC5319308 | biostudies-literature
Project description:BackgroundAppropriately defining and using the minimal important change (MIC) and the minimal clinically important difference (MCID) are crucial for determining whether the results are clinically significant. The aim of this study is to survey the status of randomized controlled trials (RCTs) for insomnia interventions to assess the inclusion and interpretation of MIC/MCID values.MethodsWe conducted a cross-sectional study to survey the status of RCTs for insomnia interventions to assess the inclusion and appropriate interpretation of MIC/MCID values. A literature search was conducted by searching the main sleep medicine journals indexed in PubMed, the Excerpta Medica Database (EMBASE), and the Cochrane Central Register of Controlled Trials (CENTRAL) to identify a broad range of search terms. We included RCTs with no restriction on the intervention. The included studies used the Insomnia Severity Index (ISI) or the Pittsburgh Sleep Quality Index (PSQI) questionnaire as the outcome measures.Results81 eligible studies were identified, and more than one-third of the included studies used MIC/MCID (n = 31, 38.3%). Among them, 21 studies with ISI as the outcome used MIC defined as a relative decrease ranging from 3 to 8 points. The most frequently used MIC value was a 6-point decrease (n = 7), followed by 8-point (n = 6) and 7-point decrease (n = 4), a 4 to 5-points decrease (n = 3), and a 30% reduction from baseline; 6 studies used MCID values, ranging from 2.8 to 4 points. The most frequently used MCID value was a 4-point decrease in the ISI (n = 4). 4 studies with PSQI as the outcome used a 3-point change as the MIC (n = 2) and a 2.5 to 2.7-point difference as MCID (n = 2). 4 non-inferiority design studies considered interval estimation when drawing clinically significant conclusions in their MCID usage.ConclusionsThe lack of consistent MIC/MCID interpretation and usage in outcome measures for insomnia highlights the urgent need for further efforts to address this issue and improve reporting practices.
| S-EPMC11308508 | biostudies-literature
Project description:It has been suggested that clinician-rated scales and self-report questionnaires may be interchangeable in the measurement of depression severity, but it has not been tested whether clinically significant information is lost when assessment is restricted to either clinician-rated or self-report instruments. The aim of this study is to test whether self-report provides information relevant to short-term treatment outcomes that is not captured by clinician-rating and vice versa.In genome-based drugs for depression (GENDEP), 811 patients with major depressive disorder treated with escitalopram or nortriptyline were assessed with the clinician-rated Montgomery-Åsberg Depression Rating Scale (MADRS), Hamilton Rating Scale for Depression (HRSD), and the self-report Beck Depression Inventory (BDI). In sequenced treatment alternatives to relieve depression (STAR*D), 4,041 patients treated with citalopram were assessed with the clinician-rated and self-report versions of the Quick Inventory of Depressive Symptomatology (QIDS-C and QIDS-SR) in addition to HRSD.In GENDEP, baseline BDI significantly predicted outcome on MADRS/HRSD after adjusting for baseline MADRS/HRSD, explaining additional 3 to 4% of variation in the clinician-rated outcomes (both P < .001). Likewise, each clinician-rated scale significantly predicted outcome on BDI after adjusting for baseline BDI and explained additional 1% of variance in the self-reported outcome (both P < .001). The results were confirmed in STAR*D, where self-report and clinician-rated versions of the same instrument each uniquely contributed to the prediction of treatment outcome.Complete assessment of depression should include both clinician-rated scales and self-reported measures.
| S-EPMC3750710 | biostudies-literature
Project description:PurposeIt is essential that clinicians have evidence-based benchmarks to support accurate diagnosis and clinical decision making. Recent studies report poor reliability for diagnostic judgments and identifying mechanisms of impairment from videofluoroscopy (VFSS). Establishing VFSS reference values for healthy swallowing would help resolve such discrepancies. Steele et al. (2019) released preliminary reference data for quantitative VFSS measures in healthy adults aged < 60 years. Here, we extend that work to provide reference percentiles for VFSS measures across a larger age span.MethodData for 16 VFSS parameters were collected from 78 healthy adults aged 21-82 years (39 male). Participants swallowed three comfortable sips each of thin, slightly, mildly, moderately, and extremely thick barium (20% w/v). VFSS recordings were analyzed in duplicate by trained raters, blind to participant and task, using the Analysis of Swallowing Physiology: Events, Kinematics and Timing (ASPEKT) Method. Reference percentiles (p2.5, 5, 25, 50, 75, 95, and 97.5) were determined as per Clinical and Laboratory Standards Institute EP28-A3c guidelines.ResultsWe present VFSS reference percentile tables, by consistency, for (a) timing parameters (swallow reaction time; the hyoid burst-to-upper esophageal sphincter (UES)-opening interval; UES opening duration; time-to-laryngeal vestibule closure (LVC); and LVC duration) and (b) anatomically scaled pixel-based measures of maximum UES diameter, pharyngeal area at maximum pharyngeal constriction and rest, residue (vallecular, pyriform, other pharyngeal locations, total), and hyoid kinematics (X, Y, XY coordinates of peak position; speed). Clinical decision limits are proposed to demarcate atypical values of potential clinical concern.ConclusionThese updated reference percentiles and proposed clinical decision limits are intended to support interpretation and reliability for VFSS assessment data.Supplemental materialhttps://doi.org/10.23641/asha.24043041.
| S-EPMC10713020 | biostudies-literature
Project description:BackgroundResearchers often misinterpret and misrepresent statistical outputs. This abuse has led to a large literature on modification or replacement of testing thresholds and P-values with confidence intervals, Bayes factors, and other devices. Because the core problems appear cognitive rather than statistical, we review some simple methods to aid researchers in interpreting statistical outputs. These methods emphasize logical and information concepts over probability, and thus may be more robust to common misinterpretations than are traditional descriptions.MethodsWe use the Shannon transform of the P-value p, also known as the binary surprisal or S-value s = -log2(p), to provide a measure of the information supplied by the testing procedure, and to help calibrate intuitions against simple physical experiments like coin tossing. We also use tables or graphs of test statistics for alternative hypotheses, and interval estimates for different percentile levels, to thwart fallacies arising from arbitrary dichotomies. Finally, we reinterpret P-values and interval estimates in unconditional terms, which describe compatibility of data with the entire set of analysis assumptions. We illustrate these methods with a reanalysis of data from an existing record-based cohort study.ConclusionsIn line with other recent recommendations, we advise that teaching materials and research reports discuss P-values as measures of compatibility rather than significance, compute P-values for alternative hypotheses whenever they are computed for null hypotheses, and interpret interval estimates as showing values of high compatibility with data, rather than regions of confidence. Our recommendations emphasize cognitive devices for displaying the compatibility of the observed data with various hypotheses of interest, rather than focusing on single hypothesis tests or interval estimates. We believe these simple reforms are well worth the minor effort they require.
| S-EPMC7528258 | biostudies-literature
Project description:An exciting recent development is the uptake of deep neural networks in many scientific fields, where the main objective is outcome prediction with a black-box nature. Significance testing is promising to address the black-box issue and explore novel scientific insights and interpretations of the decision-making process based on a deep learning model. However, testing for a neural network poses a challenge because of its black-box nature and unknown limiting distributions of parameter estimates while existing methods require strong assumptions or excessive computation. In this article, we derive one-split and two-split tests relaxing the assumptions and computational complexity of existing black-box tests and extending to examine the significance of a collection of features of interest in a dataset of possibly a complex type, such as an image. The one-split test estimates and evaluates a black-box model based on estimation and inference subsets through sample splitting and data perturbation. The two-split test further splits the inference subset into two but requires no perturbation. Also, we develop their combined versions by aggregating the p -values based on repeated sample splitting. By deflating the bias-sd-ratio, we establish asymptotic null distributions of the test statistics and the consistency in terms of Type 2 error. Numerically, we demonstrate the utility of the proposed tests on seven simulated examples and six real datasets. Accompanying this article is our python library dnn-inference (https://dnn-inference.readthedocs.io/en/latest/) that implements the proposed tests.
| S-EPMC10915654 | biostudies-literature
Project description:Improving the survival of patients with cholangiocarcinoma (CCA) has long proved challenging, although the treatment of this disease nowadays is on advancement. The historical invariability of survival outcomes and the limited number of agents known to be effective in the treatment of this disease has increased the number of studies designed to identify genetic targetable hits that can be efficacious for novel therapies. In this respect, the increasing feasibility of molecular profiling starting either from tumor tissue or circulating cell-free DNA (cfDNA) has led to an increased understanding of CCA biology. Intrahepatic CCA (iCCA) and extrahepatic CCA (eCCA) display different and typical patterns of actionable genomic alterations, which offer opportunity for therapeutic intervention. This review article will summarize the current knowledge on the genomic alterations of iCCA and eCCA, provide information on the main technologies for genomic profiling using either tumor tissue or cfDNA, and briefly discuss the main clinical trials with targeted agents in this disease.
| S-EPMC9400790 | biostudies-literature
Project description:BackgroundAssessing the outcome of motif mining algorithms is an essential task, as the number of reported motifs can be very large. Significance measures play a central role in automatically ranking those motifs, and therefore alleviating the analysis work. Spotting the most interesting and relevant motifs is then dependent on the choice of the right measures. The combined use of several measures may provide more robust results. However caution has to be taken in order to avoid spurious evaluations.ResultsFrom the set of conducted experiments, it was verified that several of the selected significance measures show a very similar behavior in a wide range of situations therefore providing redundant information. Some measures have proved to be more appropriate to rank highly conserved motifs, while others are more appropriate for weakly conserved ones. Support appears as a very important feature to be considered for correct motif ranking. We observed that not all the measures are suitable for situations with poorly balanced class information, like for instance, when positive data is significantly less than negative data. Finally, a visualization scheme was proposed that, when several measures are applied, enables an easy identification of high scoring motifs.ConclusionIn this work we have surveyed and categorized 14 significance measures for pattern evaluation. Their ability to rank three types of deterministic motifs was evaluated. Measures were applied in different testing conditions, where relations were identified. This study provides some pertinent insights on the choice of the right set of significance measures for the evaluation of deterministic motifs extracted from protein databases.
| S-EPMC2254621 | biostudies-literature
Project description:BackgroundIn recent decades, novel echocardiographic measures have constantly emerged. It is still unclear which echocardiographic measures have the most significant prognostic value in the general population. Accordingly, the aim of this study was to compare the prognostic value of a large panel of echocardiographic measures to identify the most promising measures.MethodsA total of 1,497 Framingham study participants (mean age, 65 years; 55.4% women) who underwent echocardiographic measurements of left ventricular ejection fraction, left ventricular mass index, global longitudinal strain, global circumferential strain, mitral annular plane systolic excursion, mitral E/e' ratio, maximum and minimum left atrial (LA) volume index, LA emptying fraction, and left ventricular longitudinal synchrony were evaluated. These measures were related to the incidence of two composite outcomes: cardiovascular disease (CVD) or death and atrial fibrillation (AF) or congestive heart failure (CHF).ResultsOn follow-up (mean, 8.3 years), there were 241 CVD events or deaths and 139 AF or CHF events. In multivariate-adjusted Cox models, higher LA emptying fraction was associated with a lower risk (hazard ratios per SD, 0.80 and 0.70 for CVD or death and AF or CHF, respectively; P ≤ .001 for both) while higher minimum LA volume index (hazard ratios per SD, 1.32 and 1.70 for CVD or death and AF or CHF, respectively; P ≤ .001 for both) and maximum LA volume index (hazard ratios per SD, 1.26 and 1.54 for CVD or death and AF or CHF, respectively; P ≤ .002 for both) were associated with a higher risk for both composite outcomes.ConclusionsIn this community-based sample, LA volumes and function were the best echocardiographic predictors of clinical outcomes. Therefore, these values should be considered for inclusion in standard echocardiographic assessments for the purpose of risk stratification.
| S-EPMC6986561 | biostudies-literature