Browse
Submit Data
Databases
API
Help

Dataset Information

0 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

What's in a text-to-image prompt? The potential of stable diffusion in visual arts education.

ABSTRACT: Text-to-Image artificial intelligence (AI) recently saw a major breakthrough with the release of Dall-E and its open-source counterpart, Stable Diffusion. These programs allow anyone to create original visual art pieces by simply providing descriptions in natural language (prompts). Using a sample of 72,980 Stable Diffusion prompts, we propose a formalization of this new medium of art creation and assess its potential for teaching the history of art, aesthetics, and technique. Our findings indicate that text-to-Image AI has the potential to revolutionize the way art is taught, offering new, cost-effective possibilities for experimentation and expression. However, it also raises important questions about the ownership of artistic works. As more and more art is created using these programs, it will be crucial to establish new legal and economic models to protect the rights of artists.

SUBMITTER: Dehouche N

PROVIDER: S-EPMC10245047 | biostudies-literature | 2023 Jun

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Publications

What's in a text-to-image prompt? The potential of stable diffusion in visual arts education.

Dehouche Nassim N Dehouche Kullathida K

Heliyon 20230526 6

Text-to-Image artificial intelligence (AI) recently saw a major breakthrough with the release of Dall-E and its open-source counterpart, Stable Diffusion. These programs allow anyone to create original visual art pieces by simply providing descriptions in natural language (prompts). Using a sample of 72,980 Stable Diffusion prompts, we propose a formalization of this new medium of art creation and assess its potential for teaching the history of art, aesthetics, and technique. Our findings indic ...[more]

PMID: 37292268

Similar Datasets

Finetuning of GLIDE stable diffusion model for AI-based text-conditional image synthesis of dermoscopic images.

Project description:BackgroundThe development of artificial intelligence (AI)-based algorithms and advances in medical domains rely on large datasets. A recent advancement in text-to-image generative AI is GLIDE (Guided Language to Image Diffusion for Generation and Editing). There are a number of representations available in the GLIDE model, but it has not been refined for medical applications.MethodsFor text-conditional image synthesis with classifier-free guidance, we have fine-tuned GLIDE using 10,015 dermoscopic images of seven diagnostic entities, including melanoma and melanocytic nevi. Photorealistic synthetic samples of each diagnostic entity were created by the algorithm. Following this, an experienced dermatologist reviewed 140 images (20 of each entity), with 10 samples originating from artificial intelligence and 10 from original images from the dataset. The dermatologist classified the provided images according to the seven diagnostic entities. Additionally, the dermatologist was asked to indicate whether or not a particular image was created by AI. Further, we trained a deep learning model to compare the diagnostic results of dermatologist versus machine for entity classification.ResultsThe results indicate that the generated images possess varying degrees of quality and realism, with melanocytic nevi and melanoma having higher similarity to real images than other classes. The integration of synthetic images improved the classification performance of the model, resulting in higher accuracy and precision. The AI assessment showed superior classification performance compared to dermatologist.ConclusionOverall, the results highlight the potential of synthetic images for training and improving AI models in dermatology to overcome data scarcity.

| S-EPMC10623307 | biostudies-literature

CuTCP: Custom Text Generation-based Class-aware Prompt Tuning for visual-language models.

Project description:Visual-language models (VLMs) excel in cross-modal reasoning by synthesizing visual and linguistic features. Recent VLMs use prompt learning for fine-tuning, allowing adaptation to various downstream tasks. TCP applies class-aware prompt tuning to improve VLMs generalization, yet its reliance on fixed text templates as prior knowledge can limit adaptability to fine-grained category distinctions. To address this, we propose Custom Text Generation-based Class-aware Prompt Tuning (CuTCP). CuTCP leverages large language models to generate descriptive, category-specific prompts, embedding richer semantic information that enhances the model's ability to differentiate between known and unseen categories. Compared with TCP, CuTCP achieves an improvement of 0.74% on new classes and 0.44% on overall harmonic mean, averaged over 11 diverse image datasets. Experimental results demonstrate that CuTCP addresses the limitations of general prompt templates, significantly improving model adaptability and generalization capability, with particularly strong performance in fine-grained classification tasks.

| S-EPMC11751190 | biostudies-literature

Using Visual Arts Education in Dermatology to Benefit Resident Wellness and Clinical Communication.

Project description:IntroductionArt education interventions improve observation skills among dermatology residents, but there is limited data regarding their benefits to wellness and clinical communication.MethodsResidents in the Stanford dermatology residency program participated in an arts-based education session, repeated in the fall of 2018 and 2019, that included a rotation of observational exercises adapted from the Artful Thinking program through Harvard Project Zero. The 2018 session featured exercises on identification and understanding of visual observation, while the 2019 session featured exercises on perspectives and objectivity of visual observation. Participants completed preintervention, postintervention, and 3-month follow-up surveys in fall 2018 and a postintervention survey in fall 2019.ResultsTwenty-one residents participated in the 2018 education session and produced an adequate response rate (62%-90%) across surveys. At 3 months, five of 13 residents (39%) reported new use of art for mindfulness and stress reduction, 12 of 13 (92%) could recall an example of use of observation to improve patient communication, and four of 13 (31%) confirmed and described adjustments to their handoff technique. In 2019, 13 out of 18 participants (72%) completed the postintervention survey. Responses reinforced themes from the prior iteration but focused on perspective, objectivity, context, and uncertainty in observations. Respondents also identified additional arenas of communication to benefit from these observational techniques.DiscussionDermatology residents increased use of art for personal wellness and adjusted clinical communication strategies after a single arts-based education session. Annual repetition with novel exercises maintained engagement and yielded additional participant insights.

| S-EPMC8015639 | biostudies-literature

What's new and what's next in diffusion MRI preprocessing.

Project description:Diffusion MRI (dMRI) provides invaluable information for the study of tissue microstructure and brain connectivity, but suffers from a range of imaging artifacts that greatly challenge the analysis of results and their interpretability if not appropriately accounted for. This review will cover dMRI artifacts and preprocessing steps, some of which have not typically been considered in existing pipelines or reviews, or have only gained attention in recent years: brain/skull extraction, B-matrix incompatibilities w.r.t the imaging data, signal drift, Gibbs ringing, noise distribution bias, denoising, between- and within-volumes motion, eddy currents, outliers, susceptibility distortions, EPI Nyquist ghosts, gradient deviations, B1 bias fields, and spatial normalization. The focus will be on "what's new" since the notable advances prior to and brought by the Human Connectome Project (HCP), as presented in the predecessing issue on "Mapping the Connectome" in 2013. In addition to the development of novel strategies for dMRI preprocessing, exciting progress has been made in the availability of open source tools and reproducible pipelines, databases and simulation tools for the evaluation of preprocessing steps, and automated quality control frameworks, amongst others. Finally, this review will consider practical considerations and our view on "what's next" in dMRI preprocessing.

| S-EPMC9379864 | biostudies-literature

Using Visual Arts Education and Reflective Practice to Increase Empathy and Perspective Taking in Medical Students.

Project description:IntroductionEmpathy is a critical competency for health care providers. However, empathy levels in medical students and residents have been shown to paradoxically decrease during training. Arts and humanities education and reflective practice may reduce burnout and promote empathy during medical school.MethodsWe developed and implemented an art education elective for medical students focusing on observation and reflective practice and measured its impact on empathy. Between 2017 and 2022, first-year medical students were offered an annual, 4-week elective led by art educators that featured visualization exercises and discussions on the role of bias and perspective in art interpretation. Curriculum effectiveness and impact on empathy were measured using the validated Interpersonal Reactivity Index (IRI) and self-assessments.ResultsOne hundred twenty-eight students participated in the elective over a 5-year period; 89 (70%) completed assessments. Students reported improvements in empathic communication, recognition of bias, and observation skills. IRI data demonstrated a significant increase in perspective taking (19.0 vs. 20.2; p < .0125).DiscussionParticipation in the elective was associated with self-reported improvements in visual observation, awareness of bias, and empathetic communication. IRI results showed that participants also demonstrated improved perspective taking. Since perspective taking is a cognitive component of empathy, we have provided some empirical evidence that arts education in medical school can promote empathic attitudes and skills.

| S-EPMC10514245 | biostudies-literature

Developmentally stable representations of naturalistic image structure in macaque visual cortex.

Project description:To determine whether post-natal improvements in form vision result from changes in mid-level visual cortex, we studied neuronal and behavioral responses to texture stimuli that were matched in local spectral content but varied in "naturalistic" structure. We made longitudinal measurements of visual behavior from 16 to 95 weeks of age, and of neural responses from 20 to 56 weeks. We also measured behavioral and neural responses in near-adult animals more than 3 years old. Behavioral sensitivity reached half-maximum around 25 weeks of age, but neural sensitivities remained stable through all ages tested. Neural sensitivity to naturalistic structure was highest in V4, lower in V2 and inferotemporal cortex (IT), and barely discernible in V1. Our results show a dissociation between stable neural performance and improving behavioral performance, which may reflect improved processing capacity in circuits downstream of visual cortex.

| S-EPMC11491121 | biostudies-literature

DEVELOPMENTALLY STABLE REPRESENTATIONS OF NATURALISTIC IMAGE STRUCTURE IN MACAQUE VISUAL CORTEX.

Project description:We studied visual development in macaque monkeys using texture stimuli, matched in local spectral content but varying in "naturalistic" structure. In adult monkeys, naturalistic textures preferentially drive neurons in areas V2 and V4, but not V1. We paired behavioral measurements of naturalness sensitivity with separately-obtained population recordings from neurons in areas V1, V2, V4, and inferotemporal cortex (IT). We made behavioral measurements from 16 weeks of age and physiological measurements as early as 20 weeks, and continued through 56 weeks. We measured behavior with a reinforced looking paradigm based on oddity detection. Behavioral sensitivity reached half of maximum at roughly 25 weeks of age. Neural sensitivities remained stable from the earliest ages tested. As in adults, neural sensitivity to naturalistic structure increased from V1 to V2 to V4. While sensitivities in V2 and IT were similar, the dimensionality of the IT representation was more similar to V4's than to V2's.

| S-EPMC10925106 | biostudies-literature

Visual system repair: what's next?

Project description: Not available

| S-EPMC8530143 | biostudies-literature

Guided diffusion for molecular generation with interaction prompt.

Project description:Molecular generative models have exhibited promising capabilities in designing molecules from scratch with high binding affinities in a predetermined protein pocket, offering potential synergies with traditional structural-based drug design strategy. However, the generative processes of such models are random and the atomic interaction information between ligand and protein are ignored. On the other hand, the ligand has high propensity to bind with residues called hotspots. Hotspot residues contribute to the majority of the binding free energies and have been recognized as appealing targets for designed molecules. In this work, we develop an interaction prompt guided diffusion model, InterDiff to deal with the challenges. Four kinds of atomic interactions are involved in our model and represented as learnable vector embeddings. These embeddings serve as conditions for individual residue to guide the molecular generative process. Comprehensive in silico experiments evince that our model could generate molecules with desired ligand-protein interactions in a guidable way. Furthermore, we validate InterDiff on two realistic protein-based therapeutic agents. Results show that InterDiff could generate molecules with better or similar binding mode compared to known targeted drugs.

| S-EPMC11033848 | biostudies-literature

What's Behind Image? Toward a Better Understanding of Image-Driven Behavior.

Project description:Our experimental design systematically varies image concerns in a dictator/trust game. In comparison to the baseline, we either decrease the role of self-image concerns (by providing an excuse for selfish behavior) or increase the role of social-image concerns (by conveying the transfer choice to a third person). In this set up, we analyze the underlying processes that motivate subjects to give less/more. Controlling for distributional preferences and expectations, our results indicate that moral emotions (guilt and shame) are a significant determinant of pro-social behavior. The disposition to guilt explains giving in the baseline, while it does not when an excuse for selfish behavior exists. Subjects' disposition to shame is correlated to giving when their choice is public and they can be identified. JEL Classifications: C72, C91, D03, D80.

| S-EPMC8219908 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data