EAD: effortless anomalies detection, a deep learning based approach for detecting outliers in English textual data.

ABSTRACT: Anomalies are the existential abnormalities in data, the identification of which is known as anomaly detection. The absence of timely detection of anomalies may affect the key processes of decision-making, fraud detection, and automated classification. Most of the existing models of anomaly detection utilize the traditional way of tokenizing and are computationally costlier, mainly if the outliers are to be extracted from a large script. This research work intends to propose an unsupervised, all-MiniLM-L6-v2-based system for the detection of outliers. The method makes use of centroid embeddings to extract outliers in high-variety, large-volume data. To avoid mistakenly treating novelty as an outlier, the Minimum Covariance Determinant (MCD) based approach is followed to count the novelty o

SUBMITTER: Wang X 

PROVIDER: S-EPMC11623099 | biostudies-literature | 2024

REPOSITORIES: biostudies-literature