Can Micro-Expression be Recognized Based on Single Apex Frame?

Micro-expressions are rapid and subtle facial movements such that they are difficult to detect and recognize. Most of recent works have attempted to recognize micro-expression by using the spatial and dynamic information from the video clip. Physiological studies have demonstrated that the apex frame can convey the most emotion expressed in facial expression. It may be reasonable to use apex frame for improving micro-expression recognition. However, it is wonder how much apex frames contribute to micro-expression recognition. In this paper, we primarily focus on resolving the contribution-level by using apex frame for micro-expression recognition. Firstly, we propose a new method to detect the apex frame in frequency domain, as it is found that apex frame has very correlated relationship with the amplitude change in frequency domain. Secondly, we propose to use deep convolutional neural network (DCNN) on apex frame to recognize micro-expression. Intensive experimental results on CASME II database shows that our method has achieved considerably improvement compared with the state-of-the-art methods in micro-expression recognition. These results also demonstrate that apex frame can express the major emotion in micro-expression.

Authors:
Li Yante, Huang Xiaohua, Zhao Guoying

Publication type:
A4 Article in conference proceedings

Place of publication:
2018 25th IEEE International Conference on Image Processing (ICIP)

Keywords:
3D FFT, Apex frame spotting, Deep Convolutional Neural Network, micro-expression

Published:

Full citation:
Y. Li, X. Huang and G. Zhao, “Can Micro-Expression be Recognized Based on Single Apex Frame?,” 2018 25th IEEE International Conference on Image Processing (ICIP), Athens, 2018, pp. 3094-3098. doi: 10.1109/ICIP.2018.8451376

DOI:
https://doi.org/10.1109/ICIP.2018.8451376

Read the publication here:
http://urn.fi/urn:nbn:fi-fe201902226046