Aesthetics and Emotions in Images: A Computational Perspective

Dhiraj Joshi (Kodak Research), Ritendra Datta (Google), Quang-Tuan Luong (Terragalleria.com),
Elena Fedorovskaya (Kodak Research), James Z. Wang (The Pennsylvania State University and National Science Foundation),
Jia Li (The Pennsylvania State University) and Jiebo Luo (Kodak Research) Abstract:

In this tutorial, we define and discuss key aspects of the problem of computational inference of aesthetics and emotion from images. We begin with a background discussion on philosophy, photography, paintings, visual arts, and psychology. This is followed by introduction of a set of key computational problems that the research community has been striving to solve and the computational framework required for solving them. We also describe data sets available for performing assessment and outline several real-world applications where research in this domain can be employed. A significant number of papers that have attempted to solve problems in aesthetics and emotion inference are surveyed in this tutorial. We also discuss future directions that researchers can pursue and make a strong case for seriously attempting to solve problems in this research domain.


Full Paper

(IEEE PDF, 3.6MB)

On-line Info


The copyrights of the images of ancient works belong to the museums or the owners of the images. Some images are used in the project under teaching, scholarship or research, which are considered as "Fair Use" because (1) the amount of copyrighted work used is reasonable, (2) the importance of that part of the work is not substantial to the whole work, and (3) the effect of the use upon the value or potential value of the copyrighted work is not significant. (See 17 U.S.C.A. § 107).

Citation: Dhiraj Joshi, Ritendra Datta, Quang-Tuan Luong, Elena Fedorovskaya, James Z. Wang, Jia Li and Jiebo Luo, ``Aesthetics and Emotions in Images: A Computational Perspective,'' IEEE Signal Processing Magazine, vol. 28, no. 5, pp. 94-115, September 2011.

Copyright 2011 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works, must be obtained from the IEEE.

Last Modified: September 1, 2011
© 2011