Probing Large Language Model Hidden States for Adverse Drug Reaction Knowledge.

ABSTRACT: Large language models (LLMs) integrate knowledge from diverse sources into a single set of internal weights. However, these representations are difficult to interpret, complicating our understanding of the models' learning capabilities. Sparse autoencoders (SAEs) linearize LLM embeddings, creating monosemantic features that both provide insight into the model's comprehension and simplify downstream machine learning tasks. These features are especially important in biomedical applications where explainability is critical. Here, we evaluate the use of Gemma Scope SAEs to identify how LLMs store known facts involving adverse drug reactions (ADRs). We transform hidden-state embeddings of drug names from Gemma2-9b-it into interpretable features and train a linear classifier on these features to

SUBMITTER: Berkowitz J 

PROVIDER: S-EPMC11844579 | biostudies-literature | 2025 Feb

REPOSITORIES: biostudies-literature