Contrastive Learning for Fine-Grained Reading Detection

要約

Reading is a cognitive activity that we perform aiming at various purposes, such as gaining knowledge and entertaining ourselves, with different scripts and layouts. Therefore, automatic reading detection gives useful information about users’ reading activities. Deep learning enables automatic feature extraction and model creation but needs large-sized labeled data. The self-supervised learning devised to overcome this limitation work as noncontrastive self-supervised learning (SSL) and contrastive self-supervised learning (contrastive learning). Although SSL is well explored for reading analysis, contrastive learning is not still well explored. This paper explores contrastive learning that works in several ways. A Simple Framework for Contrastive Learning of Visual Representations (SimCLR) is one way that has attracted much attention in many research domains because of its superior performance. We explore SimCLR for the cognitive activity recognition task of finegrained reading detection employing electrooculography datasets. These datasets describe eye movements that have been recorded for in-the-wild condition. The obtained results are compared against SSL and supervised baselines. The results show that, for an equal number of training samples, the SimCLR method obtains a maximum performance gain of 3.02 and 3.96 percentage points compared to the two baselines, respectively. Besides, SimCLR shows the best performance for large-sized data with a data efficiency of about 80%, whereas SSL shows the best performance for small-sized data. The analysis conducted in this paper shows a direction for researchers and system designers to employ self-supervised learning for automatic reading detection.

関連ファイル

• …