AI enabled sign language recognition and VR space bidirectional communication using triboelectric smart glove.

ABSTRACT: Sign language recognition, especially the sentence recognition, is of great significance for lowering the communication barrier between the hearing/speech impaired and the non-signers. The general glove solutions, which are employed to detect motions of our dexterous hands, only achieve recognizing discrete single gestures (i.e., numbers, letters, or words) instead of sentences, far from satisfying the meet of the signers' daily communication. Here, we propose an artificial intelligence enabled sign language recognition and communication system comprising sensing gloves, deep learning block, and virtual reality interface. Non-segmentation and segmentation assisted deep learning model achieves the recognition of 50 words and 20 sentences. Significantly, the segmentation approach splits enti

SUBMITTER: Wen F 

PROVIDER: S-EPMC8433305 | biostudies-literature | 2021 Sep

REPOSITORIES: biostudies-literature