Smart Watch that Monitors Typing
Here’s a watch that monitors the movements of your hand and can guess what you’re typing.
Using the watch’s built-in motion sensors, more specifically data from the accelerometer and gyroscope, researchers were able to create a 3D map of the user’s hand movements while typing on a keyboard.
The researchers then created two algorithms, one for detecting what keys were being pressed, and one for guessing what word was typed.
The first algorithm recorded the places where the smartwatch’s sensors would detect a dip in movement, considering this spot as a keystroke, and then created a heatmap of common spots where the user would press down.
Based on known keyboard layouts, these spots were attributed to letters on the left side of the keyboard.
The second algorithm took this data, and analyzing the pauses between smartwatch (left hand) keystrokes, it was able to detect how many letters were pressed with the right hand, based on the user’s regular keystroke frequency.
Based on a simple dictionary lookup, the algorithm then managed to reliably reproduce what words were typed on the keyboard.