Correcting spelling mistakes in Persian texts with rules and deep learning methods.

ABSTRACT: This study aims to develop a system for automatically correcting spelling errors in Persian texts using two approaches: one that relies on rules and a common spelling mistake list and another that uses a deep neural network. The list of 700 common misspellings was compiled, and a database of 55,000 common Persian words was used to identify spelling errors in the rule-based approach. 112 rules were implemented for spelling correction, each providing suggested words for misspelled words. 2500 sentences were used for evaluation, with the word with the shortest Levenshtein distance selected for evaluation. In the deep learning approach, a deep encoder-decoder network that utilized long short-term memory (LSTM) with a word embedding layer was used as the base network, with FastText chosen as th

SUBMITTER: Kasmaiee S 

PROVIDER: S-EPMC10652024 | biostudies-literature | 2023 Nov

REPOSITORIES: biostudies-literature