Geometry-based BERT: An experimentally validated deep learning model for molecular property prediction in drug discovery.

ABSTRACT: Various deep learning based methods have significantly impacted the realm of drug discovery. The development of deep learning methods for identifying novel structural types of active compounds has become an urgent challenge. In this paper, we introduce a self-supervised representation learning framework, i.e., Geometry-based Bidirectional Encoder Representations from Transformers (GEO-BERT). GEO-BERT considers the information of atoms and chemical bonds in chemical structures as the input, and integrates the positional information of the three-dimensional conformation of the molecule for training. Specifically, GEO-BERT enhances its ability to characterize molecular structures by introducing three different positional relationships: atom-atom, bond-bond, and atom-bond. By benchmarking stud

SUBMITTER: Zhang X 

PROVIDER: S-EPMC12723016 | biostudies-literature | 2025 Dec

REPOSITORIES: biostudies-literature