When the sign language detection model is confident the user is signing, it plays a silent 20-kilohertz ultrasonic audio tone that the videoconferencing software can detect as sound, ...

Earlier this year, Google presented a research paper on real-time sign language detection using human pose estimation at the Sign Language Recognition, Translation and Production 2020 workshop.

This hand-tracking algorithm could lead to sign language recognition The system first runs the video through a model called PoseNet, which estimates the positions of the body and limbs in each frame.