Title:
Towards Using Visual Attributes to Infer Image Sentiment Of Social Events
Towards Using Visual Attributes to Infer Image Sentiment Of Social Events
Author(s)
Ahsan, Unaiza
De Choudhury, Munmun
Essa, Irfan
De Choudhury, Munmun
Essa, Irfan
Advisor(s)
Editor(s)
Collections
Supplementary to
Permanent Link
Abstract
Widespread and pervasive adoption of smartphones has led to instant sharing of photographs that capture events ranging from mundane to life-altering happenings. We propose to capture sentiment information of such social event images leveraging their visual content. Our method extracts an intermediate visual representation of social event images based on the visual attributes that occur in the images going beyond sentiment-specific attributes. We map the top predicted attributes to sentiments and extract the dominant emotion associated with a picture of a social event. Unlike recent approaches, our method generalizes to a variety of social events and even to unseen events, which are not available at training time. We demonstrate the effectiveness of our approach on a challenging social event image
dataset and our method outperforms state-of-the-art approaches for classifying complex event images into sentiments.
Sponsor
Date Issued
2017
Extent
Resource Type
Text
Resource Subtype
Proceedings