Self-supervised Learning for Reading Activity Classification

言語英語
種類論文
著者Md. Rabiul Islam,Shuji Sakamoto,Yoshihiro Yamada,Andrew W. Vargo,Motoi Iwata,Masakazu Iwamura,Koichi Kise
論文名Self-supervised Learning for Reading Activity Classification
論文誌名Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (ACM IMWUT journal)
Vol.5
No.3
発表番号105
ページpp.1-22
出版社ACM
査読の有無有
年月2021年9月
分野行動認識
DOI10.1145/3478088
キーIslam2021_IMWUT (id=1844)

要約

Reading analysis can relay information about user's confidence and habits and can be used to construct useful feedback. A lack of labeled data inhibits the effective application of fully-supervised Deep Learning (DL) for automatic reading analysis. We propose a Self-supervised Learning (SSL) method for reading analysis. Previously, SSL has been effective in physical human activity recognition (HAR) tasks, but it has not been applied to cognitive HAR tasks like reading. We first evaluate the proposed method on a four-class classification task on reading detection using electrooculography datasets, followed by an evaluation of a two-class classification task of confidence estimation on multiple-choice questions using eye-tracking datasets. Fully-supervised DL and support vector machines (SVMs) are used as comparisons for the proposed SSL method. The results show that the proposed SSL method is superior to the fully-supervised DL and SVM for both tasks, especially when training data is scarce. This result indicates the proposed method is the superior choice for reading analysis tasks. These results are important for informing the design of automatic reading analysis platforms.

関連ファイル

この文献を出力

書式の定義
書き換えるとすぐ出力に反映されます(書式を選び直すか「既定に戻す」を押すまで有効).1 行目が既定,種類別に変えるには「book: …」のような行を追加
書式の定義の書き方

{authors} のように波括弧でフィールドを挿入します.[ ... ] で囲んだ部分は,その中のフィールドが空のとき丸ごと省略されます.使えるフィールド:

{authors}{authors_and}{authors_ja}{authors_ja_tight}{authors_en}{authors_en_and}{authors_tight}{first_author}{title}{title_ja}{title_en}{journal}{journal_ja}{journal_en}{book_title}{volume}{number}{series}{presen_id}{pages}{pp}{num_pages}{year}{month}{month_en}{month_short}{ym}{date}{date_ja}{date_en}{publisher}{address}{location}{review}{review_ja}{review_en}{reviewed_mark}{presen_type}{type}{type_label}{doi}{url}{key}{awards}

← 一覧に戻る