3D Avatar Approach for Continuous Sign Movement Using Speech/Text

言語英語
種類論文
著者Debashis Das Chakladar,Pradeep Kumar,Shubham Mandal,Partha Pratim Roy,Masakazu Iwamura,Byung-Gyu Kim
論文名3D Avatar Approach for Continuous Sign Movement Using Speech/Text
論文誌名Applied Sciences (Special Issue on Artificial Intelligence for Multimedia Signal Processing)
Vol.11
No.8
発表番号3439
ページ数13
出版社MDPI
査読の有無有
年月2021年4月
分野パターン認識
DOI10.3390/app11083439
キーChakladar2021 (id=1836)

要約

Sign language is a visual language for communication used by hearing-impaired people with the help of hand and finger movements. Indian Sign Language (ISL) is a well-developed and standard way of communication for hearing-impaired people living in India. However, other people who use spoken language always face difficulty while communicating with a hearing-impaired person due to lack of sign language knowledge. In this study, we have developed a 3D avatar-based sign language learning system that converts the input speech/text into corresponding sign movements for ISL. The system consists of three modules. Initially, the input speech is converted into an English sentence. Then, that English sentence is converted into the corresponding ISL sentence using the Natural Language Processing (NLP) technique. Finally, the motion of the 3D avatar is defined based on the ISL sentence. The translation module achieves a 10.50 SER (Sign Error Rate) score.

関連ファイル

この文献を出力

書式の定義
書き換えるとすぐ出力に反映されます(書式を選び直すか「既定に戻す」を押すまで有効).1 行目が既定,種類別に変えるには「book: …」のような行を追加
書式の定義の書き方

{authors} のように波括弧でフィールドを挿入します.[ ... ] で囲んだ部分は,その中のフィールドが空のとき丸ごと省略されます.使えるフィールド:

{authors}{authors_and}{authors_ja}{authors_ja_tight}{authors_en}{authors_en_and}{authors_tight}{first_author}{title}{title_ja}{title_en}{journal}{journal_ja}{journal_en}{book_title}{volume}{number}{series}{presen_id}{pages}{pp}{num_pages}{year}{month}{month_en}{month_short}{ym}{date}{date_ja}{date_en}{publisher}{address}{location}{review}{review_ja}{review_en}{reviewed_mark}{presen_type}{type}{type_label}{doi}{url}{key}{awards}

← 一覧に戻る