SigNN - Real-time ASL Alphabet Translator play online

SigNN is the first app to offer real-time ASL, sign language alphabet translation. This app can differentiate between the static characters of the sign language alphabet [A-Y, minus J] and the dynamic characters [J, Z]. This allows it to translate the entire alphabet.

When using SigNN, please sign with your left hand. Right-hand support is not implemented in the app. Additionally, please make sure your hand is not at an extreme angle when signing the ASL alphabet.

This tool can help people learn sign language by validating if they are clearly signing their word. If the app can understand your ASL sign, then an ASL signer certainly could as well.

This tool may also get people interested in ASL and the facilitation of communication with those who have difficulty communicating through speech. There right now exists expensive sign language translation gloves, but we hope to see more affordable and scalable solutions in the future.

SigNN stands for Sign Neural Network and is a proof of concept built upon Mediapipe, a Machine-Learning Pipeline made by Google. It shows that real-time sign language translation is now possible on mobile devices. This app was developed by a group of students at the University of California, Santa Barbara.

A company or group with more resources can create a more accurate neural network and provide support for not only the ASL alphabet but the more common ASL phrases. While we may be the first on the app store, we hope that many improved versions will follow.