Feedback is... late: measuring multimodal delays in mobile device touchscreen interaction

Multimodal interaction is becoming common in many kinds of devices, particularly mobile phones. If care is not taken in design and implementation, there may be latencies in the timing of feedback in the different modalities may have unintended effects on users. This paper introduces an easy to implement multimodal latency measurement tool for touchscreen interaction. It uses offthe-shelf components and free software and is capable of measuring latencies accurately between different interaction events in different modalities. The tool uses a high-speed camera, a mirror, a microphone and an accelerometer to measure the touch, visual, audio and tactile feedback events that occur in touchscreen interaction. The microphone and the accelerometer are both interfaced with a standard PC soundcard that makes the measurement and analysis simple. The latencies are obtained by hand and eye using a slow-motion video player and an audio editor. To validate the tool, we measured four commercial mobil...

• Type: Journal
• Year: 2010
• Where: ICMI
• Authors: Topi Kaaresoja, Stephen A. Brewster
• Keywords: Biometrics, Feedback, ICMI 2010, Mobile Phones, Touchscreen Interaction