Abstract

This paper presents Local Log-Euclidean Covariance Matrix (L2ECM) to represent neighboring image properties by capturing cor- relation of various image cues. Our work is inspired by the structure tensor which computes the second-order moment of image gradients for representing local image properties, and the Diffusion Tensor Imaging which produces tensor-valued image characterizing the local tissue struc- ture. Our approach begins with extraction of raw features consisting of multiple image cues. For each pixel we compute a covariance matrix in its neighboring region, producing a tensor-valued image. The covariance matrices are symmetric and positive-definite (SPD) which forms a Rie- mannian manifold. In the Log-Euclidean framework, the SPD matrices form a Lie group equipped with Euclidean space structure, which en- ables common Euclidean operations in the logarithm domain. Hence, we compute the covariance matrix logarithm, obtaining the pixel-wise symmetric matrix. After half-vectorization we obtain the vector-valued L2ECM image, which can be flexibly handled with Euclidean operations while preserving the geometric structure of SPD matrices. The L2ECM features can be used in diverse image or vision tasks. We demonstrate some applications of its statistical modeling by simple second-order cen- tral moment and achieve promising performance.