Unknown

Dataset Information

0

Dynamic decoding and dual synthetic data for automatic correction of grammar in low-resource scenario.


ABSTRACT: Grammar error correction systems are pivotal in the field of natural language processing (NLP), with a primary focus on identifying and correcting the grammatical integrity of written text. This is crucial for both language learning and formal communication. Recently, neural machine translation (NMT) has emerged as a promising approach in high demand. However, this approach faces significant challenges, particularly the scarcity of training data and the complexity of grammar error correction (GEC), especially for low-resource languages such as Indonesian. To address these challenges, we propose InSpelPoS, a confusion method that combines two synthetic data generation methods: the Inverted Spellchecker and Patterns+POS. Furthermore, we introduce an adapted seq2seq framework equipped with a dynamic decoding method and state-of-the-art Transformer-based neural language models to enhance the accuracy and efficiency of GEC. The dynamic decoding method is capable of navigating the complexities of GEC and correcting a wide range of errors, including contextual and grammatical errors. The proposed model leverages the contextual information of words and sentences to generate a corrected output. To assess the effectiveness of our proposed framework, we conducted experiments using synthetic data and compared its performance with existing GEC systems. The results demonstrate a significant improvement in the accuracy of Indonesian GEC compared to existing methods.

SUBMITTER: Musyafa A 

PROVIDER: S-EPMC11232608 | biostudies-literature | 2024

REPOSITORIES: biostudies-literature

altmetric image

Publications

Dynamic decoding and dual synthetic data for automatic correction of grammar in low-resource scenario.

Musyafa Ahmad A   Gao Ying Y   Solyman Aiman A   Khan Siraj S   Cai Wentian W   Khan Muhammad Faizan MF  

PeerJ. Computer science 20240705


Grammar error correction systems are pivotal in the field of natural language processing (NLP), with a primary focus on identifying and correcting the grammatical integrity of written text. This is crucial for both language learning and formal communication. Recently, neural machine translation (NMT) has emerged as a promising approach in high demand. However, this approach faces significant challenges, particularly the scarcity of training data and the complexity of grammar error correction (GE  ...[more]

Similar Datasets

| S-EPMC8134505 | biostudies-literature
| S-EPMC8704929 | biostudies-literature
| S-EPMC6394911 | biostudies-literature
| S-EPMC8670362 | biostudies-literature
| S-EPMC8993016 | biostudies-literature
| S-EPMC4034269 | biostudies-literature
| S-EPMC5728493 | biostudies-literature
| S-EPMC7056760 | biostudies-literature
| S-EPMC3048778 | biostudies-literature