Dataset Information

Robust Global Motion Estimation for Video Stabilization Based on Improved K-Means Clustering and Superpixel.

ABSTRACT: Obtaining accurate global motion is a crucial step for video stabilization. This paper proposes a robust and simple method to implement global motion estimation. We don't extend the framework of 2D video stabilization but add a "plug and play" module to motion estimation based on feature points. Firstly, simple linear iterative clustering (SLIC) pre-segmentation is used to obtain superpixels of the video frame, clustering is performed according to the superpixel centroid motion vector and cluster center with large value is eliminated. Secondly, in order to obtain accurate global motion estimation, an improved K-means clustering is proposed. We match the feature points of the remaining superpixels between two adjacent frames, establish a feature points' motion vector space, and use improved K-means clustering for clustering. Finally, the richest cluster is being retained, and the global motion is obtained by homography transformation. Our proposed method has been verified on different types of videos and has efficient performance than traditional approaches. The stabilization video has an average improvement of 0.24 in the structural similarity index than the original video and 0.1 higher than the traditional method.

SUBMITTER: Wu R

PROVIDER: S-EPMC8038417 | biostudies-literature | 2021 Apr

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Robust Global Motion Estimation for Video Stabilization Based on Improved K-Means Clustering and Superpixel.

Wu Rouwan R Xu Zhiyong Z Zhang Jianlin J Zhang Lihong L

Sensors (Basel, Switzerland) 20210403 7

Obtaining accurate global motion is a crucial step for video stabilization. This paper proposes a robust and simple method to implement global motion estimation. We don't extend the framework of 2D video stabilization but add a "plug and play" module to motion estimation based on feature points. Firstly, simple linear iterative clustering (SLIC) pre-segmentation is used to obtain superpixels of the video frame, clustering is performed according to the superpixel centroid motion vector and cluste ...[more]

PMID: 33916773

Similar Datasets

Project description:Rotating machinery condition monitoring and fault diagnosis are important bases for maintenance decisions, as the vibrations generated during operation are usually imperceptible to the naked eye. Eulerian video motion magnification (EVMM) can reveal subtle changes and has been widely used in various fields such as medicine, structural analysis, and fault diagnosis, etc. However, the method has a bound relationship among three parameters: spatial wavelength, amplification factor, and displacement function, so it is necessary to adjust the parameters manually in practical applications. In this paper, on the basis of the original method, an automatic solution of spatial cutoff wavelength based on brightness is proposed. First, an input video is decomposed into image sequences, their RGB color spaces are transformed into HSV color spaces, and the Value channel image representing brightness is selected to automatically calculate the spatial cutoff frequency, and then the spatial cutoff wavelength is determined, and the motion magnification video in the specified frequency band is obtained by substituting it into the original method. Then, a publicly available video is taken as an example for simulation analysis. By comparing the time-brightness curves of the three videos (original video, motion magnification video obtained by the original method and the improved method), it is apparent that the proposed method exhibits the most significant brightness variation. Finally, taking an overhung rotor-bearing test device as the object, five conditions are set, respectively: normal, rotor unbalance, loosened anchor bolt of the bearing seat, compound fault, rotor misalignment. The proposed method is adopted to magnify the motion of the characteristic frequency bands including 1X frequency and 2X frequency. The results show that no obvious displacement is found in normal working conditions, and that the rotor unbalance fault has an overall axial shaking, the bearing seat at the loose place has an obvious vertical displacement, while the compound fault combines the both fault characteristics, and the rotor misalignment fault has an obvious axial displacement of the free-end bearing seat. The method proposed in this paper can automatically obtain the space cutoff wavelength, which solves the problem of defects arising from manually adjusting the parameters in the original method, and provides a new method for rotating machinery fault diagnosis and other fields of application.

Dataset Information

Robust Global Motion Estimation for Video Stabilization Based on Improved K-Means Clustering and Superpixel.

Publications

Robust Global Motion Estimation for Video Stabilization Based on Improved K-Means Clustering and Superpixel.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets