3D Avatar Approach for Continuous Sign Movement Using Speech/Text
| Language | English |
|---|---|
| Type | Journal Articles |
| Authors | Debashis Das Chakladar, Pradeep Kumar, Shubham Mandal, Partha Pratim Roy, Masakazu Iwamura, Byung-Gyu Kim |
| Title | 3D Avatar Approach for Continuous Sign Movement Using Speech/Text |
| Journal | Applied Sciences (Special Issue on Artificial Intelligence for Multimedia Signal Processing) |
| Vol. | 11 |
| No. | 8 |
| Presentation number | 3439 |
| Number of pages | 13 |
| Publisher | MDPI |
| Reviewed | Reviewed |
| Date | April 2021 |
| Research fields | Pattern recognition |
| DOI | 10.3390/app11083439 |
| Key | Chakladar2021 (id=1836) |
Abstract
Sign language is a visual language for communication used by hearing-impaired people with the help of hand and finger movements. Indian Sign Language (ISL) is a well-developed and standard way of communication for hearing-impaired people living in India. However, other people who use spoken language always face difficulty while communicating with a hearing-impaired person due to lack of sign language knowledge. In this study, we have developed a 3D avatar-based sign language learning system that converts the input speech/text into corresponding sign movements for ISL. The system consists of three modules. Initially, the input speech is converted into an English sentence. Then, that English sentence is converted into the corresponding ISL sentence using the Natural Language Processing (NLP) technique. Finally, the motion of the 3D avatar is defined based on the ISL sentence. The translation module achieves a 10.50 SER (Sign Error Rate) score.
Files
- …
Export this publication
Format definition
How to write the definition
Insert a field with braces like {authors}. A part enclosed in [ ... ] is omitted entirely when any field inside it is empty. Available fields:
{authors}{authors_and}{authors_ja}{authors_ja_tight}{authors_en}{authors_en_and}{authors_tight}{first_author}{title}{title_ja}{title_en}{journal}{journal_ja}{journal_en}{book_title}{volume}{number}{series}{presen_id}{pages}{pp}{num_pages}{year}{month}{month_en}{month_short}{ym}{date}{date_ja}{date_en}{publisher}{address}{location}{review}{review_ja}{review_en}{reviewed_mark}{presen_type}{type}{type_label}{doi}{url}{key}{awards}