awesome-emotion-recognition-in-conversations

A comprehensive reading list for papers related to Emotion Recognition in Conversations (ERC), contextual Sentiment/Affect/Sarcasm Analysis, or joint classification of pragmatics such as Dialogue Acts in Conversations.

Please feel free to send a PR in case any new or existing paper is missing from the list.

What is ERC?

ERC is a task that aims at predicting emotion of each utterance in a conversation. The following is an excerpt of a conversation with each utterance tagged with corresponding emotion and sentiment label:

Overviews

• Deep Emotion Recognition in Textual Conversations: A Survey, ArXiv 2022
• Beneath the Tip of the Iceberg: Current Challenges and New Directions in Sentiment Analysis Research, IEEE Transactions on Affective Computing 2020
• Emotion Recognition in Conversation: Research Challenges, Datasets, and Recent Advances, IEEE Access 2019

Data Resources

• MEISD: A Multimodal Multi-Label Emotion, Intensity and Sentiment Dialogue Dataset for Emotion Recognition and Sentiment Analysis in Conversations , COLING 2020
• Storytelling with Dialogue: A Critical Role Dungeons and Dragons Dataset, ACL 2020
• ScenarioSA: A Dyadic Conversational Database for Interactive Sentiment Analysis, IEEE Access 2020
• K-EmoCon, a multimodal sensor dataset for continuous emotion recognition in naturalistic conversations, Arxiv 2020
• Emotional Dialogue Acts, LREC 2020
• MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversations, ACL 2019
• MUStARD: Towards Multimodal Sarcasm Detection (An Obviously Perfect Paper), ACL 2019
• Understanding emotions in text using deep learning and big data, Computers in Human Behavior 2019
• Emotionlines: An emotion corpus of multi-party conversations, LREC 2018
• DailyDialog: A Manually Labelled Multi-turn Dialogue Dataset, AFNLP 2017
• The semaine database: Annotated multimodal records of emotionally colored conversations between a person and a limited agent, IEEE Transactions on Affective Computing 2012
• IEMOCAP: Interactive emotional dyadic motion capture database, JLRE 2008

ERC

• Context-Dependent Embedding Utterance Representations for Emotion Recognition in Conversations, Workshop on Computational Approaches to Subjectivity, Sentiment, & Social Media Analysis, ACL 2023
• Fuzzy Fingerprinting Transformer Language-Models for Emotion Recognition in Conversations, FUZZ-IEEE 2023
• DialogueCRN: Contextual Reasoning Networks for Emotion Recognition in Conversations, ACL 2021
• MMGCN: Multimodal Fusion via Deep Graph Convolution Network for Emotion Recognition in Conversation, ACL 2021
• Directed Acyclic Graph Network for Conversational Emotion Recognition, ACL 2021
• COIN: Conversational Interactive Networks for Emotion Recognition in Conversation, Workshop on Multimodal Artificial Intelligence, NAACL 2021
• DialogXL: All-in-One XLNet for Multi-Party Conversation Emotion Recognition, AAAI 2021
• Quantum-inspired Neural Network for Conversational Emotion Recognition, AAAI 2021
• Modeling both Intra- and Inter-modal Influence for Real-Time Emotion Detection in Conversations, ACM MM 2020
• Contextual Augmentation of Pretrained Language Models for Emotion Recognition in Conversations, COLING 2020
• CAN-GRU: a Hierarchical Model for Emotion Recognition in Dialogue, COLING 2020
• DialogueTRM: Exploring the Intra- and Inter-Modal Emotional Behaviors in the Conversation, Arxiv 2020
• Knowledge Aware Emotion Recognition in Textual Conversations via Multi-Task Incremental Transformer, COLING 2020
• Summarize before Aggregate: A Global-to-local Heterogeneous Graph Inference Network for Conversational Emotion Recognition, COLING 2020
• An Iterative Emotion Interaction Network for Emotion Recognition in Conversations, COLING 2020
• HiTrans: A Transformer-Based Context- and Speaker-Sensitive Model for Emotion Detection in Conversations, COLING 2020
• [Relation-aware Graph Attention Networks with Relational Position Encodings for Emotion Recognition in Conversations], EMNLP 2020
• HAN-ReGRU: hierarchical attention network with residual gated recurrent unit for emotion recognition in conversation, Neural Computing Applications 2020
• Real-Time Emotion Recognition via Attention Gated Hierarchical Memory Network, AAAI 2020
• Adapted Dynamic Memory Network for Emotion Recognition in Conversation, IEEE Transactions on Affective Computing 2020
• Different Contextual Window Sizes Based RNNs for Multimodal Emotion Detection in Interactive Conversations, IEEE Access 2020
• Domain adversarial learning for emotion recognition, Arxiv 2020
• Towards Emotion-aided Multi-modal Dialogue Act Classification, ACL 2020
• A Self-Attentive Emotion Recognition Network, ICASSP 2020
• Hierarchical Transformer Network for Utterance-Level Emotion Recognition, Applied Sciences 2020
• Exploring Perception Uncertainty for Emotion Recognition in Dyadic Conversation and Music Listening, Springer 2020
• A Novel Semantic Approach for Intelligent Response Generation using Emotion Detection Incorporating NPMI Measure, Procedia Computer Science, 2020
• HGFM: A Hierarchical Grained and Feature Model for Acoustic Emotion Recognition, ICASSP 2020
• A Dialogical Emotion Decoder for Speech Motion Recognition in Spoken Dialog, ICASSP 2020
• Adapted Dynamic Memory Network for Emotion Recognition in Conversation, IEEE Transaction on Affective Computing 2020
• Contextualized Emotion Recognition in Conversation as Sequence Tagging, SIGDIAL 2020
• Different Contextual Window Sizes based RNNs for Multimodal Emotion Detection in Interactive Conversations, IEEE Access 2020
• Retrospective Loss: Looking Back to Improve Training of Deep Neural Networks, KDD 2020
• Attention-based modeling for emotion detection and classification in textual conversations, Arxiv 2020
• BiERU: Bidirectional Emotional Recurrent Unit for Conversational Sentiment Analysis, Arxiv 2020
• Multi-Task Learning with Auxiliary Speaker Identification for Conversational Emotion Recognition, Arxiv 2020
• Analysis of Utterance Combinations for Emotion Recognition in Conversation, Unpublished
• Interactive double states emotion cell model for textual dialogue emotion prediction, KBS 2020
• Contextualized Emotion Recognition in Conversation as Sequence Tagging, SIGDIAL 2020
• Non-acted multi-view audio-visual dyadic interactions. Project non-verbal emotion recognition in dyadic scenarios and speaker segmentation, Masters/Doctoral Thesis 2020
• Multilogue-Net: A Context Aware RNN for Multi-modal Emotion Detection and Sentiment Analysis in Conversation, HML Workshop, ACL 2020
• Conversational Transfer Learning for Emotion Recognition, INFFUS 2020
• An interaction-aware attention network for speech emotion recognition in spoken dialogs, ICASSP 2019
• Higru: Hierarchical gated recurrent units for utterance-level emotion recognition, NAACL 2019
• Detecting Topic-Oriented Speaker Stance in Conversational Speech, Interspeech 2019
• Mutual Correlation Attentive Factors in Dyadic Fusion Networks for Speech Emotion Recognition, ACM MM 2019
• An Effective Deep Learning Approach for Dialogue Emotion Recognition in Car-Hailing Platform, IEEE SmartWorld/SCALCOM/UIC/ATC/CBDCom/IOP/SCI 2019
• LIRMM-advanse at SemEval-2019 Task 3: Attentive conversation modeling for emotion detection and classification, Semeval 2019 Task 3
• ntuer at semeval-2019 task 3: Emotion classification with word and sentence representations in rcnn, Semeval 2019 Task 3
• Coastal at semeval-2019 task 3: Affect classification in dialogue using attentive bilstms, Semeval 2019 Task 3
• EPITA-ADAPT at SemEval-2019 Task 3: Detecting emotions in textual conversations using deep learning models combination, Semeval 2019 Task 3.
• Modeling both Context-and Speaker-Sensitive Dependence for Emotion Detection in Multi-speaker Conversations, IJCAI 2019
• What a Dialogue! A Deep Neural Framework for Contextual Affect Detection, ICNIP 2019
• Attentional Neural Network for Emotion Detection in Conversations with Speaker Influence Awareness, CCF International Conference on Natural Language Processing and Chinese Computing 2019
• Knowledge-Enriched Transformer for Emotion Detection in Textual Conversations, EMNLP 2019
• PT-CoDE: Pre-trained Context-Dependent Encoder for Utterance-level Emotion Recognition, Arxiv 2019
• EmotionX-IDEA: Emotion BERT – an Affectional Model for Conversation, Arxiv 2019
• DialogueGCN: A Graph Convolutional Neural Network for Emotion Recognition in Conversation, EMNLP 2019
• DialogueRNN: An Attentive RNN for Emotion Detection in Conversations, AAAI 2019
• ICON: Interactive Conversational Memory Network for Multimodal Emotion Detection, EMNLP 2018
• Conversational Memory Network for Emotion Recognition in Dyadic Dialogue Videos, NAACL 2018

Contextual Sentiment Analysis

• Sentiment Forecasting in Dialog, COLING 2020
• DCR-Net: A Deep Co-Interactive Relation Network for Joint Dialog Act Recognition and Sentiment Classification, AAAI 2020
• A Quantum-like Multimodal Network Framework for Modeling Interaction Dynamics in Multiparty Conversational Sentiment Analysis, Information Fusion 2020
• Quantum-Inspired Interactive Networks for Conversational Sentiment Analysis, IJCAI 2019
• Quantum-Inspired DMATT-BiGRU for Conversational Sentiment Analysis, ICTAI 2019

Contexutal Sarcasm Analysis

• Reactive Supervision: A New Method for Collecting Sarcasm Data, EMNLP 2020
• Sarcasm Detection Using an Ensemble Approach, FigLang, ACL 2020
• Sarcasm Detection using Context Separators in Online Discourse, FigLang, ACL 2020
• C-Net: Contextual Network for Sarcasm Detection, FigLang, ACL 2020
• Sarcasm Identification and Detection in Conversion Context using BERT, FigLang, ACL 2020
• Applying Transformers and Aspect-based Sentiment Analysis approaches on Sarcasm Detection, FigLang, ACL 2020
• Neural Sarcasm Detection using Conversation Context, FigLang, ACL 2020
• Context-Aware Sarcasm Detection Using BERT, FigLang, ACL 2020
• Transformers on Sarcasm Detection with Context, FigLang, ACL 2020
• A Novel Hierarchical BERT Architecture for Sarcasm Detection, FigLang, ACL 2020
• Detecting Sarcasm in Conversation Context Using Transformer-Based Models, FigLang, ACL 2020
• MUStARD: Towards Multimodal Sarcasm Detection (An Obviously Perfect Paper), ACL 2019

Others

• Smile Intensity Detection in Multiparty Interaction using Deep Learning, ACII 2019

Workshops and Shared Tasks

• Second Grand-Challenge and Workshop on Multimodal Language (Challenge-HML), ACL 2020
• The Second Workshop on Figurative Language Processing, ACL 2020
• EMOCONTEXT, Semeval 2019
• EmotionX Challenge, IJCAI 2019