Large-scale multi-omic biosequence transformers for modeling protein-nucleic acid interactions.

ABSTRACT: The transformer architecture has revolutionized bioinformatics and driven progress in the understanding and prediction of the properties of biomolecules. To date, most biosequence transformers have been trained on single-omic data-either proteins or nucleic acids-and have seen incredible success in downstream tasks in each domain, with particularly noteworthy breakthroughs in protein structural modeling. However, single-omic pretraining limits the ability of these models to capture cross-modal interactions. Here we present OmniBioTE, the largest open-source multi-omic model trained on over 250 billion tokens of mixed protein and nucleic acid data. We show that despite only being trained on unlabeled sequence data, OmniBioTE learns joint representations mapping genes to their corresponding

SUBMITTER: Chen SF 

PROVIDER: S-EPMC12863687 | biostudies-literature | 2026

REPOSITORIES: biostudies-literature