Abstract

This paper presents the design of TranslatAble, a new Augmentative and Alternative Communication system. Taking advantage of the convenience and mobility of modern smartphones, TranslatAble allows individuals with complex communication needs-specifically individuals with severe dysarthria or individuals who primarily use non-sign language gestures-To build their own system of communication through speech or gesture input. This system uses a machine learning model-specifically dynamic time warping-To match the user's input to their unique dictionary to help them be understood by their communication partner. TranslatAble is highly flexible and person-centered, which allows it to adapt to fit the unique needs of each user's unique communication needs. We expect this novel device to enable individuals with complex communication needs to interact with a larger social circle. This may help decrease feelings of loneliness and increase self-confidence, self-esteem, and independence, as well as help maintain strong relationships outside of the user's support network.

Original languageEnglish (US)
Title of host publicationASSETS 2016 - Proceedings of the 18th International ACM SIGACCESS Conference on Computers and Accessibility
PublisherAssociation for Computing Machinery, Inc
Pages321-322
Number of pages2
ISBN (Electronic)9781450341240
DOIs
StatePublished - Oct 23 2016
Event18th International ACM SIGACCESS Conference on Computers and Accessibility, ASSETS 2016 - Reno, United States
Duration: Oct 24 2016Oct 26 2016

Publication series

NameASSETS 2016 - Proceedings of the 18th International ACM SIGACCESS Conference on Computers and Accessibility

Other

Other18th International ACM SIGACCESS Conference on Computers and Accessibility, ASSETS 2016
Country/TerritoryUnited States
CityReno
Period10/24/1610/26/16

Keywords

  • AAC device
  • Augmentative and alternative communication
  • Complex communication needs
  • Gesture recognition
  • Speech recognition

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Human-Computer Interaction
  • Hardware and Architecture
  • Software

Fingerprint

Dive into the research topics of 'TranslatAble: Giving individuals with complex communication needs a voice through speech and gesture recognition'. Together they form a unique fingerprint.

Cite this