Lineup fairness: propitious heterogeneity and the diagnostic feature-detection hypothesis.
Ontology highlight
ABSTRACT:
SUBMITTER: Carlson CA
PROVIDER: S-EPMC6565783 | biostudies-literature | 2019 Jun
REPOSITORIES: biostudies-literature
Publications
Lineup fairness: propitious heterogeneity and the diagnostic feature-detection hypothesis.
Carlson Curt A CA Jones Alyssa R AR Whittington Jane E JE Lockamyeir Robert F RF Carlson Maria A MA Wooten Alex R AR
Cognitive research: principles and implications 20190613 1
Researchers have argued that simultaneous lineups should follow the principle of propitious heterogeneity, based on the idea that if the fillers are too similar to the perpetrator even an eyewitness with a good memory could fail to correctly identify him. A similar prediction can be derived from the diagnostic feature-detection (DFD) hypothesis, such that discriminability will decrease if too few features are present that can distinguish between innocent and guilty suspects. Our first experiment ...[more]
Similar Datasets
Project description:Prediction models are commonly used to estimate risk for cardiovascular diseases, to inform diagnosis and management. However, performance may vary substantially across relevant subgroups of the population. Here we investigated heterogeneity of accuracy and fairness metrics across a variety of subgroups for risk prediction of two common diseases: atrial fibrillation (AF) and atherosclerotic cardiovascular disease (ASCVD). We calculated the Cohorts for Heart and Aging in Genomic Epidemiology Atrial Fibrillation (CHARGE-AF) score for AF and the Pooled Cohort Equations (PCE) score for ASCVD in three large datasets: Explorys Life Sciences Dataset (Explorys, n = 21,809,334), Mass General Brigham (MGB, n = 520,868), and the UK Biobank (UKBB, n = 502,521). Our results demonstrate important performance heterogeneity across subpopulations defined by age, sex, and presence of preexisting disease, with fairly consistent patterns across both scores. For example, using CHARGE-AF, discrimination declined with increasing age, with a concordance index of 0.72 [95% CI 0.72-0.73] for the youngest (45-54 years) subgroup to 0.57 [0.56-0.58] for the oldest (85-90 years) subgroup in Explorys. Even though sex is not included in CHARGE-AF, the statistical parity difference (i.e., likelihood of being classified as high risk) was considerable between males and females within the 65-74 years subgroup with a value of - 0.33 [95% CI - 0.33 to - 0.33]. We also observed weak discrimination (i.e., < 0.7) and suboptimal calibration (i.e., calibration slope outside of 0.7-1.3) in large subsets of the population; for example, all individuals aged 75 years or older in Explorys (17.4%). Our findings highlight the need to characterize and quantify the behavior of clinical risk models within specific subpopulations so they can be used appropriately to facilitate more accurate, consistent, and equitable assessment of disease risk.
| S-EPMC9307639 | biostudies-literature
Project description:ᅟ: We report on research on individual-difference measures that could be used to assess the validity of eyewitness identification decisions.BackgroundThe predictive utility of face recognition tasks for eyewitness identification has received some attention from psychologists, but the previous research focused primarily on witnesses' likelihood of correctly choosing the culprit when present in a lineup. Far less discussed has been individual differences in witnesses' proclivity to choose from a lineup that does not contain the culprit. We designed a two-alternative non-forced-choice face recognition task (consisting of mini-lineup test pairs, half old/new and half new/new) to predict witnesses' proclivity to choose for a set of culprit-absent lineups associated with earlier-viewed crime videos.ResultsIn two studies involving a total of 402 participants, proclivity to choose on new/new pairs predicted mistaken identifications on culprit-absent lineups, with r values averaging .43. The likelihood of choosing correctly on old/new pairs (a measure of face recognition skill) was only weakly predictive of correct identifications in culprit-present lineups (mean r of .22).ConclusionsOur findings could be the basis for further research aimed at developing a standardized measure of proclivity to choose that could be used, along with other measures, to weigh eyewitnesses' lineup identification decisions.
| S-EPMC6352739 | biostudies-literature
Project description:Missed identifications of peptides in data-dependent acquisition (DDA) proteomics experiments is an obstacle n the precise determination of which proteins are present in a sample and their relative abundance. Efforts pular analysis workfl raw data to transfer a pehtiraw identifiher. Another approach ipeptide identifictatioimpute peptide idich they were missing.Wen which they were missing.We propoted xtractio called targeted extractio called targeted extractio called targeted extxactio c called targeted eractio called targeted extractio called targeted extraugh which prees t t in a run. The modeeiseetween obdentifieference library o pep from muliseetween obdentifieference library o pep from mulise the risk of drawing nimise the risk of drawing nimise the risk of dra drg nim nimihe the risk of drawing niminimise the risk of drawiies, oate of false discs Verechgtperforms the poe (FDR)tios of decoys as targtperforms the poe (FDR)tios of decoys as targtperforms the poe (FDR)tios of decoys as targtperforms the poe (FDR)tios of decoys as targtperforms the popular anand MSFraggt will be a vaprabeomics ribution to the proteomics ribution to the proteomics ribution to the proteomics ribution to the proteomics ribution to the proteomics ribution to the proteomics ribution to the proteomics toolbox for protein quantification.
2022-03-07 | PXD030706 | Pride
Project description:MotivationEpigenetic assays using next-generation sequencing have furthered our understanding of the functional genomic regions and the mechanisms of gene regulation. However, a single assay produces billions of data points, with limited information about the biological process due to numerous sources of technical and biological noise. To draw biological conclusions, numerous specialized algorithms have been proposed to summarize the data into higher-order patterns, such as peak calling and the discovery of differentially methylated regions. The key principle underlying these approaches is the search for locally consistent patterns.ResultsWe propose L0 segmentation as a universal framework for extracting locally coherent signals for diverse epigenetic sources. L0 serves to compress the input signal by approximating it as a piecewise constant. We implement a highly scalable L0 segmentation with additional loss functions designed for sequencing epigenetic data types including Poisson loss for single tracks and binomial loss for methylation/coverage data. We show that the L0 segmentation approach retains the salient features of the data yet can identify subtle features, such as transcription end sites, missed by other analytic approaches.Availability and implementationOur approach is implemented as an R package "l01segmentation" with a C++ backend. Available at https://github.com/boooooogey/l01segmentation.
| S-EPMC11897706 | biostudies-literature
Project description:Cannabis has been used for various medicinal applications including, but not limited to, cancer: most commonly to treat chemotherapy-associated side effects. Cannabis is often used for its palliative effects in the form of purified cannabinoids, or as extracts. This study was conducted using two breast cancer cell lines and aimed to evaluate potential anti-proliferative "intra-entourage effects" between purified phytocannabinoids resembling the THC and CBD ratios of medicinal and recreational cannabis strains, as well as to investigate potential "inter-entourage effects" between the different ratios and the phytochemicals found in a Cannabis sativa extract. This study also aimed to evaluate the potential interaction between cannabinoids and chemotherapeutic agents. The data identified an intra-entourage effect present in the MCF-7 cells when treated with a recreational, but not a medicinal, cannabis formulation. This effect may be due to THC partially exerting its anti-proliferative effects through the estrogen receptor (ER), present in the MCF-7 cell line. Little to no intra-entourage effects were observed in the MDA-MB-231 cell line and no inter-entourage effects were observed in either cell line. The simultaneous treatment of the MCF-7 cell line with various cannabinoid formulations and the common breast cancer treatment, tamoxifen, resulted in the diminished anti-proliferative activity of tamoxifen, an effect that was more evident when combined with recreational cannabis formulations. Since cannabis is commonly used in palliative care to treat chemotherapy-associated side effects, further research is required to investigate the potential interference of various cannabis formulations to ensure that the efficacy of chemotherapeutic agents is not compromised.Supplementary informationThe online version contains supplementary material available at 10.1007/s13205-021-03102-1.
| S-EPMC8807790 | biostudies-literature
Project description:Rankings are a popular and universal approach to structuring otherwise unorganized collections of items by computing a rank for each item based on the value of one or more of its attributes. This allows us, for example, to prioritize tasks or to evaluate the performance of products relative to each other. While the visualization of a ranking itself is straightforward, its interpretation is not, because the rank of an item represents only a summary of a potentially complicated relationship between its attributes and those of the other items. It is also common that alternative rankings exist which need to be compared and analyzed to gain insight into how multiple heterogeneous attributes affect the rankings. Advanced visual exploration tools are needed to make this process efficient. In this paper we present a comprehensive analysis of requirements for the visualization of multi-attribute rankings. Based on these considerations, we propose LineUp--a novel and scalable visualization technique that uses bar charts. This interactive technique supports the ranking of items based on multiple heterogeneous attributes with different scales and semantics. It enables users to interactively combine attributes and flexibly refine parameters to explore the effect of changes in the attribute combination. This process can be employed to derive actionable insights as to which attributes of an item need to be modified in order for its rank to change. Additionally, through integration of slope graphs, LineUp can also be used to compare multiple alternative rankings on the same set of items, for example, over time or across different attribute combinations. We evaluate the effectiveness of the proposed multi-attribute visualization technique in a qualitative study. The study shows that users are able to successfully solve complex ranking tasks in a short period of time.
| S-EPMC4198697 | biostudies-literature
Project description:Filler siphoning theory posits that the presence of fillers (known innocents) in a lineup protects an innocent suspect from being chosen by siphoning choices away from that innocent suspect. This mechanism has been proposed as an explanation for why simultaneous lineups (viewing all lineup members at once) induces better performance than showups (one-person identification procedures). We implemented filler siphoning in a computational model (WITNESS, Clark, Applied Cognitive Psychology 17:629-654, 2003), and explored the impact of the number of fillers (lineup size) and filler quality on simultaneous and sequential lineups (viewing lineups members in sequence), and compared both to showups. In limited situations, we found that filler siphoning can produce a simultaneous lineup performance advantage, but one that is insufficient in magnitude to explain empirical data. However, the magnitude of the empirical simultaneous lineup advantage can be approximated once criterial variability is added to the model. But this modification works by negatively impacting showups rather than promoting more filler siphoning. In sequential lineups, fillers were found to harm performance. Filler siphoning fails to clarify the relationship between simultaneous lineups and sequential lineups or showups. By incorporating constructs like filler siphoning and criterial variability into a computational model, and trying to approximate empirical data, we can sort through explanations of eyewitness decision-making, a prerequisite for policy recommendations.
| S-EPMC5698388 | biostudies-literature
Project description:The discovery of subtypes is pivotal for disease diagnosis and targeted therapy, considering the diverse responses of different cells or patients to specific treatments. Exploring the heterogeneity within disease or cell states provides insights into disease progression mechanisms and cell differentiation. The advent of high-throughput technologies has enabled the generation and analysis of various molecular data types, such as single-cell RNA-seq, proteomic, and imaging datasets, at large scales. While presenting opportunities for subtype discovery, these datasets pose challenges in finding relevant signatures due to their high dimensionality. Feature selection, a crucial step in the analysis pipeline, involves choosing signatures that reduce the feature size for more efficient downstream computational analysis. Numerous existing methods focus on selecting signatures that differentiate known diseases or cell states, yet they often fall short in identifying features that preserve heterogeneity and reveal subtypes. To identify features that can capture the diversity within each class while also maintaining the discrimination of known disease states, we employed deep metric learning-based feature embedding to conduct a detailed exploration of the statistical properties of features essential in preserving heterogeneity. Our analysis revealed that features with a significant difference in interquartile range (IQR) between classes possess crucial subtype information. Guided by this insight, we developed a robust statistical method, termed PHet (Preserving Heterogeneity) that performs iterative subsampling differential analysis of IQR and Fisher's method between classes, identifying a minimal set of heterogeneity-preserving discriminative features to optimize subtype clustering quality. Validation using public single-cell RNA-seq and microarray datasets showcased PHet's effectiveness in preserving sample heterogeneity while maintaining discrimination of known disease/cell states, surpassing the performance of previous outlier-based methods. Furthermore, analysis of a single-cell RNA-seq dataset from mouse tracheal epithelial cells revealed, through PHet-based features, the presence of two distinct basal cell subtypes undergoing differentiation toward a luminal secretory phenotype. Notably, one of these subtypes exhibited high expression of BPIFA1. Interestingly, previous studies have linked BPIFA1 secretion to the emergence of secretory cells during mucociliary differentiation of airway epithelial cells. PHet successfully pinpointed the basal cell subtype associated with this phenomenon, a distinction that pre-annotated markers and dispersion-based features failed to make due to their admixed feature expression profiles. These findings underscore the potential of our method to deepen our understanding of the mechanisms underlying diseases and cell differentiation and contribute significantly to personalized medicine.
| S-EPMC10769187 | biostudies-literature
Project description:BackgroundEvaluate the predictive value of myocardial stress measured by magnetic resonance imaging (MRI) on the severity of coronary artery stenosis and acute myocardial infarction (AMI). In the early stage of acute myocardial infarction, many imaging findings are negative, and MRI myocardial stress detection is controversial in the diagnosis of this aspect. Therefore, it is necessary to determine whether MRI myocardial stress can diagnose acute myocardial infarction.MethodsA total of 120 patients were divided into an AMI group and non-AMI group. The AMI group was further divided into a mild group, moderate group, and severe group. The myocardial stress was measured by MRI, compared in each group, the correlation between myocardial stress and coronary artery stenosis rate was analyzed, and coronary artery disease (CAD) compared between patients with AMI, and the relationship between myocardial stress and AMI was observed.ResultsAmong the 120 patients, there were 77 cases in the AMI group, including 21 cases in the mild group, 40 cases in the moderate group, and 16 cases in the severe group. There were a total of 43 cases in the non-AMI group. Myocardial stress in the AMI group was significantly higher than that in the non-AMI group (P<0.05). The myocardial stress increased gradually in the mild, moderate, and severe AMI groups (P<0.001). Myocardial stress was positively correlated with coronary artery stenosis rate (P<0.001) and CAD (P<0.05). Logistic regression analysis showed that myocardial stress was an independent risk factor for AMI (P<0.05). The sensitivity and specificity of myocardial stress >5.15 mm in the diagnosis of AMI were 83.5%, 68.6% (AUC =0.834), respectively. Acute myocardial infarction is often caused by risk factors such as hyperlipidemia, hypertension and hyperglycemia, as well as vascular stenosis caused by arterial wall malformation, vascular wall inflammation or vasospasm.ConclusionsThe MRI measurement of myocardial stress is simple, reliable, and practical to evaluate the degree of coronary artery lesions. Myocardial stress is closely related to AMI and can assist in the diagnosis of AMI.
| S-EPMC9562525 | biostudies-literature
Project description:One of the most important drivers for the coexistence of plant species is the resource heterogeneity of a certain environment, and several studies in different ecosystems have supported this resource heterogeneity-diversity hypothesis. However, to date, only a few studies have measured heterogeneity of light and soil resources below forest canopies to investigate their influence on understory plant species richness. Here, we aim to determine (1) the influence of forest stand structural complexity on the heterogeneity of light and soil resources below the forest canopy and (2) whether heterogeneity of resources increases understory plant species richness. Measures of stand structural complexity were obtained through inventories and remote sensing techniques in 135 1-ha study plots of temperate forests, established along a gradient of forest structural complexity. We measured light intensity and soil chemical properties on six 25 m² subplots on each of these 135 plots and surveyed understory vegetation. We calculated the coefficient of variation of light and soil parameters to obtain measures of resource heterogeneity and determined understory plant species richness at plot level. Spatial heterogeneity of light and of soil pH increased with higher stand structural complexity, although heterogeneity of soil pH did not increase in conditions of generally high levels of light availability. Increasing light heterogeneity was also associated with increasing understory plant species richness. However, light heterogeneity had no such effects in conditions where soil resource heterogeneity (variation in soil C:N ratios) was low. Our results support the resource heterogeneity-diversity hypothesis for temperate forest understory at the stand scale. Our results also highlight the importance of interaction effects between the heterogeneity of both light and soil resources in determining plant species richness.
| S-EPMC8858222 | biostudies-literature