A compressed large language model embedding dataset of ICD 10 CM descriptions.

ABSTRACT: This paper presents novel datasets providing numerical representations of ICD-10-CM codes by generating description embeddings using a large language model followed by a dimension reduction via autoencoder. The embeddings serve as informative input features for machine learning models by capturing relationships among categories and preserving inherent context information. The model generating the data was validated in two ways. First, the dimension reduction was validated using an autoencoder, and secondly, a supervised model was created to estimate the ICD-10-CM hierarchical categories. Results show that the dimension of the data can be reduced to as few as 10 dimensions while maintaining the ability to reproduce the original embeddings, with the fidelity decreasing as the reduced-dimensi

SUBMITTER: Kane MJ 

PROVIDER: S-EPMC10726612 | biostudies-literature | 2023 Dec

REPOSITORIES: biostudies-literature