Visualizing 3D imagery by mouth using candy-like models.
Ontology highlight
ABSTRACT:
SUBMITTER: Baumer KM
PROVIDER: S-EPMC8163080 | biostudies-literature | 2021 May
REPOSITORIES: biostudies-literature
Publications
Visualizing 3D imagery by mouth using candy-like models.
Baumer Katelyn M KM Lopez Juan J JJ Naidu Surabi V SV Rajendran Sanjana S Iglesias Miguel A MA Carleton Kathleen M KM Eisenmann Cheyanne J CJ Carter Lillian R LR Shaw Bryan F BF
Science advances 20210528 22
Handheld models help students visualize three-dimensional (3D) objects, especially students with blindness who use large 3D models to visualize imagery by hand. The mouth has finer tactile sensors than hand, which could improve visualization using microscopic models that are portable, inexpensive, and disposable. The mouth remains unused in tactile learning. Here, we created bite-size 3D models of protein molecules from "gummy bear" gelatin or nontoxic resin. Models were made as small as rice gr ...[more]
Similar Datasets
Project description:Our knowledge about respiratory virus spreading is mostly based on monolayer cultures that hardly reflect the complex organization of the airway epithelium. Thus, there is a strong demand for biologically relevant models. One possibility to study virus spreading at the cellular level is real-time imaging. In an attempt to visualize virus spreading under somewhat more physiological conditions, Calu-3 cells and human primary fibroblasts were co-cultured submerged or as air-liquid interface (ALI). An influenza A virus (IAV) replicating well in cell culture, and carrying a red fluorescent protein (RFP) reporter gene was used for real-time imaging. Our three-dimensional (3D) models exhibited important characteristics of native airway epithelium including a basement membrane, tight junctions and, in ALI models, strong mucus production. In submerged models, first fluorescence signals appeared between 9 and 12 h post infection (hpi) with a low multiplicity of infection of 0.01. Virus spreading further proceeded in the immediate vicinity of infected cells. In ALI models, RFP was found at 22 hpi and later. Consequently, the progression of infection was delayed, in contrast to the submerged model. With these features, we believe that our 3D airway models can deliver new insights in the spreading of IAV and other respiratory viruses.
| S-EPMC9688616 | biostudies-literature
Project description:BackgroundAI models have shown promise in performing many medical imaging tasks. However, our ability to explain what signals these models have learned is severely lacking. Explanations are needed in order to increase the trust of doctors in AI-based models, especially in domains where AI prediction capabilities surpass those of humans. Moreover, such explanations could enable novel scientific discovery by uncovering signals in the data that aren't yet known to experts.MethodsIn this paper, we present a workflow for generating hypotheses to understand which visual signals in images are correlated with a classification model's predictions for a given task. This approach leverages an automatic visual explanation algorithm followed by interdisciplinary expert review. We propose the following 4 steps: (i) Train a classifier to perform a given task to assess whether the imagery indeed contains signals relevant to the task; (ii) Train a StyleGAN-based image generator with an architecture that enables guidance by the classifier ("StylEx"); (iii) Automatically detect, extract, and visualize the top visual attributes that the classifier is sensitive towards. For visualization, we independently modify each of these attributes to generate counterfactual visualizations for a set of images (i.e., what the image would look like with the attribute increased or decreased); (iv) Formulate hypotheses for the underlying mechanisms, to stimulate future research. Specifically, present the discovered attributes and corresponding counterfactual visualizations to an interdisciplinary panel of experts so that hypotheses can account for social and structural determinants of health (e.g., whether the attributes correspond to known patho-physiological or socio-cultural phenomena, or could be novel discoveries).FindingsTo demonstrate the broad applicability of our approach, we present results on eight prediction tasks across three medical imaging modalities-retinal fundus photographs, external eye photographs, and chest radiographs. We showcase examples where many of the automatically-learned attributes clearly capture clinically known features (e.g., types of cataract, enlarged heart), and demonstrate automatically-learned confounders that arise from factors beyond physiological mechanisms (e.g., chest X-ray underexposure is correlated with the classifier predicting abnormality, and eye makeup is correlated with the classifier predicting low hemoglobin levels). We further show that our method reveals a number of physiologically plausible, previously-unknown attributes based on the literature (e.g., differences in the fundus associated with self-reported sex, which were previously unknown).InterpretationOur approach enables hypotheses generation via attribute visualizations and has the potential to enable researchers to better understand, improve their assessment, and extract new knowledge from AI-based models, as well as debug and design better datasets. Though not designed to infer causality, importantly, we highlight that attributes generated by our framework can capture phenomena beyond physiology or pathophysiology, reflecting the real world nature of healthcare delivery and socio-cultural factors, and hence interdisciplinary perspectives are critical in these investigations. Finally, we will release code to help researchers train their own StylEx models and analyze their predictive tasks of interest, and use the methodology presented in this paper for responsible interpretation of the revealed attributes.FundingGoogle.
| S-EPMC10993140 | biostudies-literature
Project description:ObjectiveRisk prediction models can assist clinicians in making decisions. To boost the uptake of these models in clinical practice, it is important that end-users understand how the model works and can efficiently communicate its results. We introduce novel methods for interpretable model visualization.MethodsThe proposed visualization techniques are applied to two prediction models from the Framingham Heart Study for the prediction of intermittent claudication and stroke after atrial fibrillation. We represent models using color bars, and visualize the risk estimation process for a specific patient using patient-specific contribution charts.ResultsThe color-based model representations provide users with an attractive tool to instantly gauge the relative importance of the predictors. The patient-specific representations allow users to understand the relative contribution of each predictor to the patient's estimated risk, potentially providing insightful information on which to base further patient management. Extensions towards non-linear models and interactions are illustrated on an artificial dataset.ConclusionThe proposed methods summarize risk prediction models and risk predictions for specific patients in an alternative way. These representations may facilitate communication between clinicians and patients.
| S-EPMC4503430 | biostudies-literature
Project description:Spatial ability is important for success in STEM fields but is typically measured using a small number of tests that were not developed in the STEM context, have not been normed with recent samples, or have not been subjected to modern psychometric analyses. Here, an approach to developing valid, reliable, and efficient computer-based tests of spatial skills is proposed and illustrated via the development of an efficient test of the ability to visualize cross-sections of three-dimensional (3D) objects. After pilot testing, three measures of this ability were administered online to 498 participants (256 females, aged 18-20). Two of the measures, the Santa Barbara Solids and Planes of Reference tests had good psychometric properties and measured a domain-general ability to visualize cross-sections, with sub-factors related to item difficulty. Item-level statistics informed the development of the refined versions of these tests and a combined measure composed of the most informative test items. Sex and ethnicity had no significant effects on the combined measure after controlling for mathematics education, verbal ability, and age. The measures ofcross-sectioning ability developed in the context of geology education were found to be too difficult, likely because they measured domain knowledge in addition to cross-sectioning ability. Recommendations are made for the use of cross-section tests in selection and training and for the more general development of spatial ability measures.
| S-EPMC10672093 | biostudies-literature
Project description:Recently, convolutional neural networks (CNNs) have been widely applied in brain-computer interface (BCI) based on electroencephalogram (EEG) signals. Due to the subject-specific nature of EEG signal patterns and the multi-dimensionality of EEG features, it is necessary to employ appropriate feature representation methods to enhance the decoding accuracy of EEG. In this study, we proposed a method for representing EEG temporal, frequency, and phase features, aiming to preserve the multi-domain information of EEG signals. Specifically, we generated EEG temporal segments using a sliding window strategy. Then, temporal, frequency, and phase features were extracted from different temporal segments and stacked into 3D feature maps, namely temporal-frequency-phase features (TFPF). Furthermore, we designed a compact 3D-CNN model to extract these multi-domain features efficiently. Considering the inter-individual variability in EEG data, we conducted individual testing for each subject. The proposed model achieved an average accuracy of 89.86, 78.85, and 63.55% for 2-class, 3-class, and 4-class motor imagery (MI) classification tasks, respectively, on the PhysioNet dataset. On the GigaDB dataset, the average accuracy for 2-class MI classification was 91.91%. For the comparison between MI and real movement (ME) tasks, the average accuracy for the 2-class were 87.66 and 80.13% on the PhysioNet and GigaDB datasets, respectively. Overall, the method presented in this paper have obtained good results in MI/ME tasks and have a good application prospect in the development of BCI systems based on MI/ME.
| S-EPMC10493321 | biostudies-literature
Project description:Grade of membership models, also known as "admixture models", "topic models" or "Latent Dirichlet Allocation", are a generalization of cluster models that allow each sample to have membership in multiple clusters. These models are widely used in population genetics to model admixed individuals who have ancestry from multiple "populations", and in natural language processing to model documents having words from multiple "topics". Here we illustrate the potential for these models to cluster samples of RNA-seq gene expression data, measured on either bulk samples or single cells. We also provide methods to help interpret the clusters, by identifying genes that are distinctively expressed in each cluster. By applying these methods to several example RNA-seq applications we demonstrate their utility in identifying and summarizing structure and heterogeneity. Applied to data from the GTEx project on 53 human tissues, the approach highlights similarities among biologically-related tissues and identifies distinctively-expressed genes that recapitulate known biology. Applied to single-cell expression data from mouse preimplantation embryos, the approach highlights both discrete and continuous variation through early embryonic development stages, and highlights genes involved in a variety of relevant processes-from germ cell development, through compaction and morula formation, to the formation of inner cell mass and trophoblast at the blastocyst stage. The methods are implemented in the Bioconductor package CountClust.
| S-EPMC5363805 | biostudies-literature
Project description:Incentive processing is a critical component of a host of cognitive processes, including attention, motivation, and learning. Neuroimaging studies have clarified the neural systems underlying processing of primary and secondary rewards in adults. However, current reward paradigms have hindered comparisons across these reward types as well as between age groups. To address methodological issues regarding the timing of incentive delivery (during scan vs. postscan) and the age-appropriateness of the incentive type, we utilized fMRI and a modified version of a card-guessing game (CGG), in which candy pieces delivered postscan served as the reinforcer, to investigate neural responses to incentives. Healthy young adults 22-26 years of age won and lost large and small amounts of candy on the basis of their ability to guess the number on a mystery card. BOLD activity was compared following candy gain (large/small), loss (large/small), and neutral feedback. During candy gains, adults recruited regions typically involved in response to monetary and other rewards, such as the caudate, putamen, and orbitofrontal cortex. During losses, they displayed greater deactivation in the hippocampus than in response to neutral and gain feedback. Additionally, individual-difference analyses suggested a negative relationship between reward sensitivity (assessed by the Behavioral Inhibition/Behavioral Activation Scales) and the difference between high- and low-magnitude losses in the caudate and lateral orbitofrontal cortex. Also within the striatum, greater punishment sensitivity was positively related to the difference in activity following high as compared to low gains. Overall, these results show strong overlap with those from previous monetary versions of the CGG and provide a baseline for future work with developmental populations.
| S-EPMC3915358 | biostudies-literature
Project description:Noncovalent interactions are essential in the formation and properties of a diverse range of hybrid materials. However, reliably identifying the noncovalent interactions in nanocrystalline materials remains challenging using conventional methods such as X-ray diffraction and spectroscopy. Here, we demonstrate that accurate atomic positions including hydrogen atoms can be determined using three-dimensional electron diffraction (3D ED), from which the entire range of noncovalent interactions in a nanocrystalline aluminophosphate hybrid material SCM-34 are directly visualized. The protonation states of both the inorganic and organic components in SCM-34 are determined from the hydrogen positions. All noncovalent interactions, including hydrogen-bonding, electrostatic, π-π stacking, and van der Waals interactions, are unambiguously identified, which provides detailed insights into the formation of the material. The 3D ED data also allow us to distinguish different types of covalent bonds based on their bond lengths and to identify an elongated terminal P═O π-bond caused by noncovalent interactions. Our results show that 3D ED can be a powerful tool for resolving detailed noncovalent interactions in nanocrystalline materials. This can improve our understanding of hybrid systems and guide the development of novel functional materials.
| S-EPMC9490833 | biostudies-literature
Project description:During recall of visual information people tend to move their eyes even though there is nothing to see. Previous studies indicated that such eye movements are related to the spatial location of previously seen items on 2D screens, but they also showed that eye movement behavior varies significantly across individuals. The reason for these differences remains unclear. In the present study we used immersive virtual reality to investigate how individual tendencies to process and represent visual information contribute to eye fixation patterns in visual imagery of previously inspected objects in three-dimensional (3D) space. We show that participants also look back to relevant locations when they are free to move in 3D space. Furthermore, we found that looking back to relevant locations depends on individual differences in visual object imagery abilities. We suggest that object visualizers rely less on spatial information because they tend to process and represent the visual information in terms of color and shape rather than in terms of spatial layout. This finding indicates that eye movements during imagery are subject to individual strategies, and the immersive setting in 3D space made individual differences more likely to unfold.
| S-EPMC9391428 | biostudies-literature
Project description:Motor imagery (MI) based brain-computer interface (BCI) is an important BCI paradigm which requires powerful classifiers. Recent development of deep learning technology has prompted considerable interest in using deep learning for classification and resulted in multiple models. Finding the best performing models among them would be beneficial for designing better BCI systems and classifiers going forward. However, it is difficult to directly compare performance of various models through the original publications, since the datasets used to test the models are different from each other, too small, or even not publicly available. In this work, we selected five MI-EEG deep classification models proposed recently: EEGNet, Shallow & Deep ConvNet, MB3D and ParaAtt, and tested them on two large, publicly available, databases with 42 and 62 human subjects. Our results show that the models performed similarly on one dataset while EEGNet performed the best on the second with a relatively small training cost using the parameters that we evaluated.
| S-EPMC9420068 | biostudies-literature