MULTIMEDIA REPRESENTATION OF SIGN LANGUAGE ELEMENTS BASED ON MACHINE LEARNING

Abstract

This paper describes implementation of a system for multimedia representation of sign language elements based on machine learning. This system represents a good basis for further development of a system for translation and mediation in communication with hearing impaired people. Recognizing hand movements and understanding what that movement means in real time is a major challenge in computer vision. A system was created that detects the movement of the hand and interprets the meaning of the movement, and then transfers the movement to a 3D digital model of a hand in real time.