Restricted Research - Award List, Note/Discussion Page
Fiscal Year: 2023
210 University of North Texas (142098)
Principal Investigator: Albert,Mark Vincent
Total Amount of Contract, Award, or Gift (Annual before 2011): $ 37,125
Exceeds $250,000 (Is it flagged?): No
Start and End Dates: 1/1/23 - 12/31/23
Restricted Research: YES
Academic Discipline: Computer Science & Engineering
Department, Center, School, or Institute: College of Engineering
Title of Contract, Award, or Gift: Pilot development and assessment of a precision gesture-to-speech system for speech-impaired individuals with limited mobility
Name of Granting or Contracting Agency/Entity:
Shirley Ryan AbilityLab
CFDA Link: HHS
93.865
Program Title:
none
CFDA Linked: Child Health and Human Development Extramural Research
Note:
The long-term research project effort will develop a fast and flexible wearable gesture recognition establishing a new paradigm for non-verbal communication technology. Complex gesture recognition systems exist for shared, standardized movements such as sign language, however, many individuals with Cerebral Palsy and other motor impairments lack both the ability to speak and perform fine motor movements consistently. Standard solutions include few-shot training of subject-specific gestures for individuals lacking fine motor skills due to motor or cognitive impairments, however, current domain adaptation strategies are not sufficient to establish a large repertoire of individual movements and lack immediate feedback on efficacy of novel movement patterns to iteratively improve through human-in-the-loop optimization. Architectures and embedding strategies are currently being field-tested with a smartphone application available on the Google Play store, with plans to compile a vast and varied data set of user-defined gestures. The goal of this C-STAR project effort will be iterative development and validation to improve communication for individuals with limited vocal and motor skills, including cerebral palsy.
Discussion: No discussion notes