top of page
///////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////
The Project...
ASL to TEXT

 

Goal and Motivation:

 

The goal of this project is to create a mobile application that translates American Sign Language (ASL) into text allowing individuals with speech disabilities to communicate in a more fluid and natural manner. In this modern time, people with speech disabilities feel as if they are segregated from the community due to the inability to communicate in a manner similar to the majority of people. They have expressed interest in a device that would “give them their voice”. This project would allow individuals with speech disabilities to be more actively involved in conversations rather than constantly having to interrupt the flow of the conversation. Currently, there is no commercial tool to translate ASL to text and this project aims to solve that issue

The main difficulty in this project lies with the following: just as not everyone speaks exactly the same way, not everyone signs the same way.Generalizing the project to function out-of-the-box for a wide range of people is the ultimate goal.

 

///////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////

Hello!

 

Approach

  • Dictionary: a dictionary will need to be developed. This dictionary will correlate the arm and hand movement to a text word.

  • Calibration: to allow the application to work with everyone, a calibration test must be performed so that the program can adapt the dictionary to the person's movement.

  • Word Parsing: the data will come in the form of a constant stream. A parsing program will need to be developed so that individual words can be pulled from the stream of data.

     

     

     

     

     

     

     

     

Using the MYO armband!

bottom of page