Text-Image Sentiment Analysis
Conference Publication ResearchOnline@JCUAbstract
Expressiveness varies from one person to another. Most images posted on Twitter lack good labels and the accompanying tweets have a lot of noise. Hence, in this paper we identify the contents and sentiments in images through the fusion of both image and text features. We leverage on the fact that AlexNet is a pre-trained model with great performance in image classification and the corresponding set of images are extracted from the web. In particular, we present a novel method to extract features from Twitter images and the corresponding labels or tweets using deep convolutional neural networks trained on Twitter data. We consider fine tuning AlexNet pre-trained CNNs to initialize the model and AffectiveSpace of English concepts as text features. Lastly, to combine the image and text predictions we propose a novel sentiment score. Our model is evaluated on Twitter dataset of images and corresponding labels and tweets. We show that accuracy by merging scores from text and image models is higher than using any one system alone.
Journal
N/A
Publication Name
N/A
Volume
13397
ISBN/ISSN
1611-3349
Edition
N/A
Issue
N/A
Pages Count
12
Location
Hanoi, Vietnam
Publisher
Springer
Publisher Url
N/A
Publisher Location
Cham, Switzerland
Publish Date
N/A
Url
N/A
Date
N/A
EISSN
N/A
DOI
10.1007/978-3-031-23804-8_14