Gyro-based Camera-motion Detection in User-generated Videos

We propose a gyro-based camera-motion detection method for videos captured with smartphones. First, the delay between the acquisition of video and gyroscope data is estimated using similarities induced by camera motion in the two sensor modalities. Pan, tilt and shake are then detected using the dominant motions and high frequencies in the gyroscope data. Morphological operations are applied to remove outliers and to identify segments with continuous camera-motion. We compare the proposed method with existing methods that use visual or inertial sensor data. Categories and Subject Descriptors I.2.10 [Artificial Intelligence]: Vision and Scene Understanding—Video analysis, Motion Keywords Gyroscope sensor, Visual sensor, User-generated videos, Camera motion, Detection, Synchronization

• Type: Journal
• Year: 2015
• Where: MM
• Authors: Sophia Bano, Andrea Cavallaro, Xavier Parra
• Keywords: MM 2015, Multimedia