BatteryBERT: A Pretrained Language Model for Battery Database Enhancement.

ABSTRACT: A great number of scientific papers are published every year in the field of battery research, which forms a huge textual data source. However, it is difficult to explore and retrieve useful information efficiently from these large unstructured sets of text. The Bidirectional Encoder Representations from Transformers (BERT) model, trained on a large data set in an unsupervised way, provides a route to process the scientific text automatically with minimal human effort. To this end, we realized six battery-related BERT models, namely, BatteryBERT, BatteryOnlyBERT, and BatterySciBERT, each of which consists of both cased and uncased models. They have been trained specifically on a corpus of battery research papers. The pretrained BatteryBERT models were then fine-tuned on downstream tasks, i

SUBMITTER: Huang S 

PROVIDER: S-EPMC9795558 | biostudies-literature | 2022 Dec

REPOSITORIES: biostudies-literature