Publications -> Journal Papers

Retrieval-Based Face Annotation by Weak Label Regularized Local Coordinate Coding


Authors: D. Wang, S. C. H. Hoi, Y. He, J. Zhu, T. Mei, and J. Luo
Title: Retrieval-Based Face Annotation by Weak Label Regularized Local Coordinate Coding
Abstract: This paper investigates a retrieval-based annotation paradigm of mining web facial images for automated face annotation. In general, there are two key challenges for such an annotation paradigm. The first challenge is how to efficiently retrieve a short list of most similar facial images from facial image databases, and the second challenge is how to effectively perform annotation by exploiting these similar facial images and their weak labels which are often noisy and incomplete. In this paper, we mainly focus on tackling the second challenge of the retrieval-based face annotation paradigm. In particular, we propose an effective Weak Label Regularized Local Coordinate Coding (WLRLCC) technique, which exploits the local coordinate coding principle in learning sparse features, and at the same time employs the graph-based weak label regularization principle to enhance the weak labels of the short list of similar facial images. We present an efficient optimization algorithm to solve the WLRLCC task, and develop an effective sparse reconstruction scheme to perform the final face name annotation. We conduct a set of extensive empirical studies on a large-scale facial image database with a total of 6,000 persons and over 600,000 web facial images, in which encouraging results show that the proposed WLRLCC algorithm significantly boosts the performance of the regular retrieval-based face annotation approaches.
Keywords: Face annotation; Content-based image retrieval; Machine learning; Label refinement; Web facial images; Weak label
Journal Name: IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 36, no. 3
Publisher: IEEE
Year: 2014
Accepted PDF File: Retrieval-based_Face_Annotation_by_Weak_Label_Regularized_Local_Coordinate_Coding_accepted.pdf
Permanent Link: http://dx.doi.org/10.1145/2072298.2072345
Reference: D. Wang, S. C. H. Hoi, Y. He, J. Zhu, T. Mei, and J. Luo, “Retrieval-based face annotation by weak label regularized local coordinate coding,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 36, no. 3, pp. 550–563, March 2014.
bibtex: 
@article {LILY-j10, 
   author	= {Wang, Dayong and Hoi, Steven C. H. and He, Ying and Zhu, Jianke and Mei, Tao and Luo, Jiebo},
   title	= {Retrieval-Based Face Annotation by Weak Label Regularized Local Coordinate Coding}, 
   journal	= {IEEE Transactions on Pattern Analysis and Machine Intelligence}, 
   year		= {2014}, 
   month	= {March}, 
   volume	= {36}, 
   number	= {3}, 
   pages	= {550-563}, 
   publisher 	= {IEEE},
}