Smart Eyewear for Interaction and Activity Recognition

要約

Smart glasses and, in general, eyewear are a fairly novel device class with a lot of possibilities for user interaction design and unobtrusive activity tracking. In this paper we show applications using an early prototype of J!NS MEME, smart glasses with integrated electrodes to detect eye movements (Electrooculography, EOG) and motion sensors (accelerometer and gyroscope) to monitor head motions. We present several demonstrations: We show a simple eye movement visualization, detecting left/right eye motion and blink. Additionally, users can play a game, ’Blinky Bird’. They need to help a bird avoid obstacles using eye movements. We implemented online detection of reading and talking behavior using a combination of blink, eye movement and head motion. We can give people a long term view of their reading, talking, and also walking activity over the day.