Real-Time Computerized Annotation of Pictures

Jia Li and James Z. Wang
The Pennsylvania State University, University Park, PA 16802
Abstract:

Automated annotation of digital pictures has been a highly challenging problem for computer scientists since the invention of computers. The capability of annotating pictures by computers can lead to breakthroughs in a wide range of applications including Web image search, online picture-sharing communities, and scientific experiments. In our work, by advancing statistical modeling and optimization techniques, we can train computers about hundreds of semantic concepts using example pictures from each concept. The ALIPR (Automatic Linguistic Indexing of Pictures - Real Time) system of fully automatic and high speed annotation for online pictures has been constructed. Thousands of pictures from an Internet photo-sharing site, unrelated to the source of those pictures used in the training process, have been tested. The experimental results show that a single computer processor can suggest annotation terms in real-time and with good accuracy.


Full Paper in Color

(PDF, 1.3MB)

On-line Demo

On-line Info


Citation: Jia Li and James Z. Wang, ``Real-time Computerized Annotation of Pictures,'' Proceedings of the ACM Multimedia Conference, pp. 911-920, ACM, Santa Barbara, CA, October 2006.

Copyright 2006 ACM. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works, must be obtained from the ACM.

Last Modified: July 25, 2006
© 2006