├── ABSA.md ├── CAD.md ├── ECPE.md ├── ECSS.md ├── EICG.md ├── ERG.md ├── ERPS.md ├── ESC.md ├── FEG.md ├── FER.md ├── MLER.md ├── README.md ├── SA.md ├── SD.md └── SER.md /ABSA.md: -------------------------------------------------------------------------------- 1 | # Papers in Aspect-Based Sentiment Analysis 2 | 3 | - Fukun Ma, Xuming Hu, Aiwei Liu, Yawen Yang, Shuang Li, Philip S. Yu, Lijie Wen- AMR-based Network for Aspect-based Sentiment Analysis - Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2023 4 | 5 | - Jianfei Yu, Qiankun Zhao, and Rui Xia - Cross-Domain Data Augmentation with Domain-Adaptive Language Modeling for Aspect-Based Sentiment Analysis - The Annual Meeting of the Association for Computational Linguistics (ACL), 2023 6 | 7 | - Zengzhi Wang, Qiming Xie, and Rui Xia - A Simple yet Effective Framework for Few-Shot Aspect-Based Sentiment Analysis - The Annual Conference of the Association for Computing Machinery Special Interest Group in Information Retrieval (SIGIR), Short paper, 2023 8 | 9 | - Hao Fei, Tat-Seng Chua, Chenliang Li, Donghong Ji, Meishan Zhang, Yafeng Ren - On the Robustness of Aspect-based Sentiment Analysis: Rethinking Model, Data, and Training - ACM Transactions on Information Systems, 2022 10 | 11 | - Wenxuan Zhang, Xin Li, Yang Deng, Lidong Bing, Wai Lam - Towards Generative Aspect-Based Sentiment Analysis - Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 2: Short Papers), 2021 12 | 13 | - Ruifan Li, Hao Chen, Fangxiang Feng, Zhanyu Ma, Xiaojie Wang, Eduard Hovy - Dual Graph Convolutional Networks for Aspect-based Sentiment Analysis - Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), 2021 -------------------------------------------------------------------------------- /CAD.md: -------------------------------------------------------------------------------- 1 | # Papers in Conversational Affect Detection 2 | including emotion recognition in conversation (ERC) and sentiment analysis in conversation (SAC). 3 | 4 | - Zijian Yi, Ziming Zhao, Zhishu Shen, Tiehua Zhang - Multimodal Fusion via Hypergraph Autoencoder and Contrastive Learning for Emotion Recognition in Conversation - Proceedings of the 32nd ACM International Conference on Multimedia, 2024 5 | 6 | - Geng Tu, Tian Xie, Bin Liang, Hongpeng Wang, Ruifeng Xu - Adaptive Graph Learning for Multimodal Conversational Emotion Detection - Proceedings of the Thirty-Eighth AAAI Conference on Artificial Intelligence, 2024 7 | 8 | - Geng Tu, Jun Wang, Zhenyu Li, Shiwei Chen, Bin Liang, Xi Zeng, Min Yang, Ruifeng Xu - Multiple Knowledge-Enhanced Interactive Graph Network for Multimodal Conversational Emotion Recognition - Findings of the Association for Computational Linguistics: EMNLP 2024 9 | 10 | - Yuntao Shou, Huan Liu, Xiangyong Cao, Deyu Meng, Bo Dong - A Low-rank Matching Attention based Cross-modal Feature Fusion Method for Conversational Emotion Recognition - IEEE Transactions on Affective Computing, 2024 11 | 12 | - Geng Tu, Feng Xiong, Bin Liang, Hui Wang, Xi Zeng, Ruifeng Xu - Multimodal Emotion Recognition Calibration in Conversations - Proceedings of the 32nd ACM International Conference on Multimedia, 2024 13 | 14 | - Tao Meng, Yuntao Shou, Wei Ai, Nan Yin, Keqin Li - Deep Imbalanced Learning for Multimodal Emotion Recognition in Conversations - IEEE Transactions on Artificial Intelligence, 2024 15 | 16 | - Jiang Li, Xiaoping Wang, Zhigang Zeng - Tracing intricate cues in dialogue: Joint graph structure and sentiment dynamics for multimodal emotion recognition - 2024 17 | 18 | - Fangxu Yu, Junjie Guo, Zhen Wu, Xinyu Dai - Emotion-Anchored Contrastive Learning Framework for 19 | Emotion Recognition in Conversation - Findings of the Association for Computational Linguistics: NAACL 2024 20 | 21 | - Zhenyu Yang, Xiaoyang Li, Yuhu Cheng, Tong Zhang, Xuesong Wang - Emotion Recognition in Conversation Based on a Dynamic Complementary Graph Convolutional Network - IEEE Transactions on Affective Computing, 2024 22 | 23 | - Simin Hong, Jun Sun, Taihao Li - DetectiveNN: Imitating Human Emotional Reasoning with a Recall-Detect-Predict Framework for Emotion Recognition in Conversations - Findings of the Association for Computational Linguistics: EMNLP 2024 24 | 25 | - Jiang Li, Xiaoping Wang, Yingjian Liu, Zhigang Zeng - CFN-ESA: A Cross-Modal Fusion Network With Emotion-Shift Awareness for Dialogue Emotion Recognition - IEEE Transactions on Affective Computing, 2024 26 | 27 | - Dongyuan Li, Yusong Wang, Kotaro Funakoshi, and Manabu Okumura - Joyful: Joint Modality Fusion and Graph Contrastive Learning for Multimodal Emotion Recognition - Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, 2023 28 | 29 | - Haozhe Yang, Xianqiang Gao, Jianlong Wu, Tian Gan, Ning Ding, Feijun Jiang, Liqiang Nie - Self-adaptive Context and Modal-interaction Modeling For Multimodal Emotion Recognition - Findings of the Association for Computational Linguistics: ACL 2023 30 | 31 | - Ziming Li, Yan Zhou, Yaxin Liu, Fuqing Zhu, Chuanpeng Yang, Songlin Hu - QAP: A Quantum-Inspired Adaptive-Priority-Learning Model for Multimodal Emotion Recognition - Findings of the Association for Computational Linguistics: ACL 2023 32 | 33 | - Feiyu Chen, Jie Shao, Shuyuan Zhu, Heng Tao Shen - Multivariate, Multi-frequency and Multimodal: Rethinking Graph Neural Networks for Emotion Recognition in Conversation - Proceedings of the 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023 34 | 35 | - Duzhen Zhang, Feilong Chen, Xiuyi Chen, DualGATs: Dual Graph Attention Networks for Emotion Recognition in Conversations, Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2023 36 | 37 | - Geng Tu, Bin Liang, Ruibin Mao, Min Yang, Ruifeng Xu - Context or Knowledge is Not Always Necessary: A Contrastive Learning Framework for Emotion Recognition in Conversations - Findings of the Association for Computational Linguistics: ACL 2023 38 | 39 | - Yingjian Liu, Jiang Li, Xiaoping Wang, Zhigang Zeng - EmotionIC: Emotional Inertia and Contagion-Driven Dependency Modeling for Emotion Recognition in Conversation - SCIENCE CHINA Information Sciences, 2023 40 | 41 | - Cam-Van Thi Nguyen, Anh-Tuan Mai, The-Son Le, Hai-Dang Kieu, Duc-Trong Le - Conversation Understanding using Relational Temporal Graph Neural Networks with Auxiliary Cross-Modality Interaction - Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, 2023 42 | 43 | - Wenjie Zheng, Jianfei Yu, Rui Xia, Shijin Wang - A Facial Expression-Aware Multimodal Multi-task Learning Framework for Emotion Recognition in Multi-party Conversations - Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics, 2023 44 | 45 | - Tao Shi, Shao-Lun Huang - MultiEMO: An Attention-Based Correlation-Aware Multimodal Fusion Framework for Emotion Recognition in Conversations - Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2023 46 | 47 | - Geng Tu, Bin Liang, Bing Qin, Kam-Fai Wong, Ruifeng Xu - An Empirical Study on Multiple Knowledge from ChatGPT for 48 | Emotion Recognition in Conversations - Findings of the Association for Computational Linguistics: EMNLP 2023 49 | 50 | - Geng Tu, Ran Jing, Bin Liang, Min Yang, Kam-Fai Wong, Ruifeng Xu - A Training-Free Debiasing Framework with Counterfactual Reasoning for Conversational Emotion Detection - Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, 2023 51 | 52 | - Jiang Li, Xiaoping Wang, Guoqing Lv, Zhigang Zeng - GA2MIF: Graph and Attention Based Two-Stage Multi-Source Information Fusion for Conversational Emotion Detection - IEEE Transactions on Affective Computing, 2023 53 | 54 | - Ting Zhang, Zhuang Chen, Ming Zhong, Tieyun Qian - Mimicking the Thinking Process for Emotion Recognition in Conversation with Prompts and Paraphrasing - Proceedings of the Thirty-Second International Joint Conference on Artificial Intelligence, 2023 55 | 56 | - Dou Hu, Yinan Bao, Lingwei Wei, Wei Zhou, Songlin Hu - Supervised Adversarial Contrastive Learning for Emotion Recognition - Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics, 2023 57 | 58 | - Xiangyu Qin, Zhiyu Wu, Tingting Zhang, Yanran Li, Jian Luan, Bin Wang, Li Wang, Jinshi Cui - BERT-ERC: Fine-Tuning BERT Is Enough for Emotion Recognition in Conversation - Proceedings of the AAAI Conference on Artificial Intelligence, 2023 59 | 60 | - Wei Li, Luyao Zhu, Rui Mao, Erik Cambria - SKIER: A Symbolic Knowledge Integrated Model for Conversational Emotion Recognition - Proceedings of the AAAI Conference on Artificial Intelligence, 2023 61 | 62 | - Xiaoheng Zhang, Yang Li - CMCF-SRNet: A Cross-Modality Context Fusion and Semantic Refinement Network for Emotion Recognition in Conversation - Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics, 2023 63 | 64 | - Jiang Li, Xiaoping Wang, Guoqing Lv, Zhigang Zeng - GraphCFC: A Directed Graph Based Cross-Modal Feature Complementation Approach for Multimodal Conversational Emotion Recognition - IEEE Transactions on Multimedia, 2023 65 | 66 | - Joosung Lee, Wooin Lee - CoMPM: Context Modeling with Speaker’s Pre-trained Memory Tracking for Emotion Recognition in Conversation - Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2022 67 | 68 | - Weixiang Zhao, Yanyan Zhao, Xin Lu, CauAIN: Causal aware interaction network for emotion recognition in conversations - Proceedings of the Thirty-First International Joint Conference on Artificial Intelligence, 2022 69 | 70 | - Guimin Hu, Ting-En Lin, Yi Zhao, Guangming Lu, Yuchuan Wu, Yongbin Li - UniMSE: Towards Unified Multimodal Sentiment Analysis and Emotion Recognition - Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processin, 2022 71 | 72 | - Xiaohui Song, Longtao Huang, Hui Xue, Songlin Hu - Supervised Prototypical Contrastive Learning for Emotion Recognition in Conversation - Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, 2022 73 | 74 | - Dou Hu, Xiaolong Hou, Lingwei Wei, Lianxin Jiang - MM-DFN: Multimodal Dynamic Fusion Network for Emotion Recognition in Conversations - Proceedings of ICASSP 2022 - 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2022 75 | 76 | - Geng Tu, Jintao Wen, Cheng Liu, Dazhi Jiang, Erik Cambria - Context- and Sentiment-Aware Networks for Emotion Recognition in Conversation - IEEE Transactions on Artificial Intelligence, 2022 77 | 78 | - Zaijing Li, Fengxiao Tang, Ming Zhao, Yusen Zhu - EmoCaps: Emotion Capsule based Model for Conversational Emotion Recognition - Findings of the Association for Computational Linguistics: ACL 2022 79 | 80 | - Zheng Lian, Bin Liu, Jianhua Tao - CTNet: Conversational Transformer Network for Emotion Recognition - IEEE/ACM Transactions on Audio, Speech, and Language Processing, 2021 81 | 82 | - Yuzhao Mao, Guang Liu, Xiaojie Wang, Weiguo Gao, Xuan Li - DialogueTRM: Exploring Multi-Modal Emotion Dynamics in Conversations - Findings of the Association for Computational Linguistics: EMNLP 2021 83 | 84 | - Weizhou Shen, Siyue Wu, Yunyi Yang, Xiaojun Quan - Directed Acyclic Graph Network for Conversational Emotion Recognition - Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), 2021 85 | 86 | - Lixing Zhu, Gabriele Pergola, Lin Gui, Deyu Zhou, Yulan He - Topic-Driven and Knowledge-Aware Transformer for Dialogue Emotion Detection - Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, 2021 87 | 88 | - Jingwen Hu, Yuchen Liu, Jinming Zhao, Qin Jin - MMGCN: Multimodal Fusion via Deep Graph Convolution Network for Emotion Recognition in Conversation - Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), 2021 89 | 90 | - Dou Hu, Lingwei Wei, Xiaoyong Huai - DialogueCRN: Contextual Reasoning Networks for Emotion Recognition in Conversations - Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), 2021 91 | 92 | - Bongseok Lee, Yong Suk Choi - Graph Based Network with Contextualized Representations of Turns in Dialogue - Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, 2021 93 | 94 | - Jiangnan Li, Zheng Lin, Peng Fu, Weiping Wang - Past, Present, and Future: Conversational Emotion Recognition through Structural Modeling of Psychological Knowledge - Findings of the Association for Computational Linguistics: EMNLP 2021 95 | 96 | - Songlong Xing, Sijie Mai, Haifeng Hu - Adapted Dynamic Memory Network for Emotion Recognition in Conversation - IEEE Transactions on Affective Computing, 2020 97 | 98 | - Deepanway Ghosal, Navonil Majumder, Alexander Gelbukh, Rada Mihalcea, Soujanya Poria - COSMIC: COmmonSense knowledge for eMotion Identification in Conversations - Findings of the Association for Computational Linguistics: EMNLP 2020 99 | 100 | - Aman Shenoy, Ashish Sardana - Multilogue-Net: A Context-Aware RNN for Multi-modal Emotion Detection and Sentiment Analysis in Conversation - Second Grand-Challenge and Workshop on Multimodal Language (Challenge-HML), 2020 101 | 102 | - Taichi Ishiwatari, Yuki Yasuda, Taro Miyazaki, Jun Goto - Relation-aware Graph Attention Networks with Relational Position Encodings for Emotion Recognition in Conversations - Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, 2020 103 | 104 | - Deepanway Ghosal, Navonil Majumder, Soujanya Poria†, Niyati Chhaya and Alexander Gelbukh - DialogueGCN: A Graph Convolutional Neural Network for Emotion Recognition in Conversation - Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), 2019 105 | 106 | - Navonil Majumder, Soujanya Poria, Devamanyu Hazarika, Rada Mihalcea, Alexander Gelbukh,Erik Cambria - DialogueRNN: An Attentive RNN for Emotion Detection in Conversations - Proceedings of the AAAI Conference on Artificial Intelligence, 2019 -------------------------------------------------------------------------------- /ECPE.md: -------------------------------------------------------------------------------- 1 | # Papers in Emotion-Cause Pair Extraction 2 | 3 | - Huawen Feng, Junlong Liu, Junhao Zheng, Haibin Chen, Xichen Shang, Qianli Ma - Joint Constrained Learning with Boundary-adjusting for Emotion-Cause Pair Extraction - Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2023 4 | 5 | - Guimin Hu, Yi Zhao, Guangming Lu - Emotion Prediction Oriented Method With Multiple Supervisions for Emotion-Cause Pair Extraction - IEEE/ACM Transactions on Audio, Speech, and Language Processing, 2023 6 | 7 | - Bobo Li, Hao Fei, Fei Li, Tat-seng Chua, Donghong Ji - Multimodal Emotion-Cause Pair Extraction with Holistic Interaction and Label Constraint - ACM Transactions on Multimedia Computing, Communications and Applications, 2024 8 | 9 | - Fanfan Wang, Zixiang Ding, Rui Xia, Zhaoyu Li, and Jianfei Yu - Multimodal Emotion-Cause Pair Extraction in Conversations - IEEE Transaction on Affective Computing, 2023 10 | 11 | - Jiaming An, Zixiang Ding, Ke Li, and Rui Xia - Global-view and Speaker-aware Emotion Cause Extraction in Conversations - IEEE/ACM Transactions on Audio, Speech and Language Processing, 2023 -------------------------------------------------------------------------------- /ECSS.md: -------------------------------------------------------------------------------- 1 | # Papers in Emotional Conversational Speech Synthesis 2 | 3 | - Rui Liu, Yifan Hu, Yi Ren, Xiang Yin, Haizhou Li - Emotion Rendering for Conversational Speech Synthesis with Heterogeneous Graph-Based Context Modeling - Proceedings of the AAAI Conference on Artificial Intelligence, 2024 -------------------------------------------------------------------------------- /EICG.md: -------------------------------------------------------------------------------- 1 | # Papers in Emotional Image Content Generation 2 | 3 | - Jingyuan Yang, Jiawei Feng, Hui Huang - EmoGen: Emotional Image Content Generation with Text-to-Image Diffusion Models - Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024 -------------------------------------------------------------------------------- /ERG.md: -------------------------------------------------------------------------------- 1 | # Papers in Empathetic Response Generation 2 | 3 | - Jia-Hao Hsu, Jeremy Chang, Min-Hsueh Kuo, Chung-Hsien Wu - Empathetic Response Generation Based on Plug-and-Play Mechanism With Empathy Perturbation - IEEE/ACM Transactions on Audio, Speech, and Language Processing, 2023 4 | 5 | - Xiaobing Pang, Yequan Wang, Siqi Fan, Lisi Chen, Shuo Shang, Peng Han - EmpMFF: A Multi-factor Sequence Fusion Framework for Empathetic Response Generation - Proceedings of the ACM Web Conference, 2023 6 | 7 | - Guanqun Bi, Lei Shen, Yanan Cao, Meng Chen, Yuqiang Xie, Zheng Lin, Xiaodong He - DiffusEmp: A Diffusion Model-Based Framework with Multi-Grained Control for Empathetic Response Generation - Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2023 8 | 9 | - Sahand Sabour, Chujie Zheng, Minlie Huang - CEM: Commonsense-Aware Empathetic Response Generation - Proceedings of the AAAI Conference on Artificial Intelligence, 2022 10 | 11 | - Qintong Li, Piji Li, Zhaochun Ren, Pengjie Ren, Zhumin Chen - Knowledge Bridging for Empathetic Dialogue Generation - Proceedings of the AAAI Conference on Artificial Intelligence, 2022 12 | 13 | - Chujie Zheng, Yong Liu, Wei Chen, Yongcai Leng, Minlie Huang - CoMAE:AMulti-factor Hierarchical Framework for Empathetic Response Generation - Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021 14 | 15 | - Navonil Majumder, Pengfei Hong, Shanshan Peng, Jiankun Lu, Deepanway Ghosal, Alexander Gelbukh, Rada Mihalcea, Soujanya Poria - MIME: MIMicking Emotions for Empathetic Response Generation - Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), 2020 -------------------------------------------------------------------------------- /ERPS.md: -------------------------------------------------------------------------------- 1 | # Papers in Emotion Recognition from Physiological Signals 2 | 3 | - Wuliang Huang, Yiqiang Chen, Xinlong Jiang, Chenlong Gao, Qian Chen, Teng Zhang, Bingjie Yan, Yifan Wang, Jianrong Yang - Correlation-Driven Multi-Modality Graph Decomposition for Cross-Subject Emotion Recognition - Proceedings of the 32nd ACM International Conference on Multimedia, 2024 4 | 5 | - Yucheng Liu, Ziyu Jia, Haichao Wang - EmotionKD: A Cross-Modal Knowledge Distillation Framework for Emotion Recognition Based on Physiological Signals - Proceedings of the 31st ACM International Conference on Multimedia, 2023 6 | 7 | - Tengfei Song, Suyuan Liu, Wenming Zheng, Yuan Zong, Zhen Cui, Yang Li - Variational Instance-Adaptive Graph for EEG Emotion Recognition - IEEE Transactions on Affective Computing, 2021 8 | 9 | - Ziyu Jia, Youfang Lin, Jing Wang, Zhiyang Feng, Xiangheng Xie, Caijie Chen - HetEmotionNet: Two-Stream Heterogeneous Graph Recurrent Neural Network for Multi-modal Emotion Recognition - Proceedings of the 29th ACM International Conference on Multimedia, 2021 10 | 11 | - Xiaowei Zhang, Jinyong Liu, Jian Shen, Shaojie Li, Kechen Hou, Bin Hu - Emotion Recognition From Multimodal Physiological Signals Using a Regularized Deep Fusion of Kernel Machine - IEEE Transactions on Cybernetics, 2020 12 | 13 | - Tengfei Song, Wenming Zheng, Peng Song, Zhen Cui - EEG Emotion Recognition Using Dynamical Graph Convolutional Neural Networks - IEEE Transactions on Affective Computing, 2020 -------------------------------------------------------------------------------- /ESC.md: -------------------------------------------------------------------------------- 1 | # Papers in Emotional Support Conversation 2 | 3 | - Weixiang Zhao, Yanyan Zhao, Shilong Wang, Bing Qin - TransESC: Smoothing Emotional Support Conversation via Turn-Level State Transition - Findings of the Association for Computational Linguistics: ACL 2023 4 | 5 | - Yang Deng, Wenxuan Zhang, Yifei Yuan, Wai Lam - Knowledge-enhanced Mixed-initiative Dialogue System for Emotional Support Conversations - Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2023 6 | 7 | - Quan Tu, Yanran Li, Jianwei Cui, Bin Wang, Ji-Rong Wen, Rui Yan - MISC: A Mixed Strategy-Aware Model integrating COMET for Emotional Support Conversation - Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2022 8 | 9 | - Wei Peng, Yue Hu, Luxi Xing, Yuqiang Xie, Yajing Sun, Yunpeng Li - Control Globally, Understand Locally: A Global-to-Local Hierarchical Graph Network for Emotional Support Conversation - Proceedings of the Thirty-First International Joint Conference on Artificial Intelligence (IJCAI-22), 2022 10 | 11 | - Siyang Liu, Chujie Zheng, Orianna Demasi, Sahand Sabour, Yu Li, Zhou Yu, Yong Jiang, Minlie Huang - Towards Emotional Support Dialog Systems - Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), 2021 -------------------------------------------------------------------------------- /FEG.md: -------------------------------------------------------------------------------- 1 | # Papers in Facial Expression Generation 2 | 3 | - Tuomas Varanka, Huai-Qian Khor, Yante Li, Mengting Wei, Hanwei Kung, Nicu Sebe, Guoying Zhao - Towards Localized Fine-Grained Control for Facial Expression Generation - 2024 4 | 5 | - Yi Zhang, Xinhua Xu, Youjun Zhao, Yuhang Wen, Zixuan Tang, Mengyuan Liu - Facial Prior Guided Micro-Expression Generation - IEEE Transactions on Image Processing, 2023 6 | 7 | - Naima Otberdout, Claudio Ferrari, Mohamed Daoudi, Stefano Berretti, Alberto Del Bimbo - Sparse to Dense Dynamic 3D Facial Expression Generation - Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022 8 | 9 | - Naima Otberdout, Mohamed Daoudi, Anis Kacem, Lahoucine Ballihi, Stefano Berretti - Dynamic Facial Expression Generation on Hilbert Hypersphere With Conditional Wasserstein Generative Adversarial Nets - IEEE Transactions on Pattern Analysis and Machine Intelligence, 2020 -------------------------------------------------------------------------------- /FER.md: -------------------------------------------------------------------------------- 1 | # Papers in Facial Expression Recognition 2 | 3 | - Jiawei Mao, Rui Xua, Xuesong Yin, Yuanqi Chang, Binling Nie, Aibin Huang, 4 | Yigang Wang - POSTER++: A simpler and stronger facial expression recognition network, Pattern Recognition, 2024 5 | 6 | - Licai Sun, Zheng Lian, Bin Liu, Jianhua Tao - MAE-DFER: Efficient Masked Autoencoder for Self-supervised Dynamic Facial Expression Recognition - Proceedings of the 31st ACM International Conference on Multimedia, 2023 7 | 8 | - Jun Yu, Zhongpeng Cai, Renda Li, Gongpeng Zhao, Guochen Xie, Jichao Zhu, Wangyuan Zhu, Qiang Ling, Lei Wang, Cong Wang, Luyu Qiu, Wei Zheng - Exploring Large-Scale Unlabeled Faces To Enhance Facial Expression Recognition - Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, 2023 9 | 10 | - Hanyang Wang, Bo Li, Shuang Wu, Siyuan Shen, Feng Liu, Shouhong Ding, Aimin Zhou- Rethinking the Learning Paradigm for Dynamic Facial Expression Recognition - Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023 11 | 12 | - Dan Zeng, Zhiyuan Lin, Xiao Yan, Yuting Liu, Fei Wang, Bo Tang - Face2Exp: Combating Data Biases for Facial Expression Recognition - Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022 13 | 14 | - Yuhang Zhang, Chengrui Wang, Xu Ling, Weihong Deng - Learn from All: Erasing Attention Consistency for Noisy Label Facial Expression Recognition - Proceedings of European Conference on Computer Vision, 2022 15 | 16 | - Andrey V. Savchenko; Lyudmila V. Savchenko; Ilya Makarov - Classifying Emotions and Engagement in Online Learning Based on a Single Facial Expression Recognition Neural Network - IEEE Transactions on Affective Computing, 2022 17 | 18 | - Yuhang Zhang, Chengrui Wang, Weihong Deng - Relative Uncertainty Learning for Facial Expression Recognition - Advances in Neural Information Processing Systems 34 (NeurIPS), 2021 19 | 20 | - Zengqun Zhao, Qingshan Liu - Former-DFER: Dynamic Facial Expression Recognition Transformer - Proceedings of the 29th ACM International Conference on Multimedia, 2021 21 | 22 | - Delian Ruan, Yan Yan, Shenqi Lai, Zhenhua Chai, Chunhua Shen, Hanzi Wang - Feature Decomposition and Reconstruction Learning for Effective Facial Expression Recognition - Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2021 23 | 24 | - Zengqun Zhao, Qingshan Liu, Shanmin Wang - Learning Deep Global Multi-Scale and Local Attention Features for Facial Expression Recognition in the Wild - IEEE Transactions on Image Processing, 2021 25 | 26 | - Fuyan Ma, Bin Sun, Shutao Li - Facial Expression Recognition With Visual Transformers and Attentional Selective Fusion - IEEE Transactions on Affective Computing, 2021 27 | 28 | - Zengqun Zhao, Qingshan Liu, Feng Zhou - Robust Lightweight Facial Expression Recognition Network with Label Distribution Training - Proceedings of the AAAI Conference on Artificial Intelligence, 2021 29 | 30 | - Shan Li, Weihong Deng - Deep Facial Expression Recognition: A Survey - IEEE Transactions on Affective Computing, 2020 -------------------------------------------------------------------------------- /MLER.md: -------------------------------------------------------------------------------- 1 | # Papers in Multi-Label Emotion Recognition 2 | 3 | - Wenjie Zheng, Jianfei Yu, Rui Xia, A Unimodal Valence-Arousal Driven Contrastive Learning Framework for Multimodal Multi-Label Emotion Recognition - Proceedings of the 32nd ACM International Conference on Multimedia, 2024 4 | 5 | - Shiping Ge, Zhiwei Jiang, Zifeng Cheng, Cong Wang, Yafeng Yin, Qing Gu - Learning Robust Multi-Modal Representation for Multi-Label Emotion Recognition via Adversarial Masking and Perturbation - Proceedings of the ACM Web Conference, 2023 6 | 7 | - Yi Zhang, Mingyuan Chen, Jundong Shen, Chongjun Wang - Tailor Versatile Multi-modal Learning for Multi-label Emotion Recognition - Proceedings of the AAAI Conference on Artificial Intelligence,2022 -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- 1 | # Affective Computing Materials 2 | This repository compiles materials related to affective computing, currently featuring two main parts: one recommends top-tier journals and conferences in the field, and the other provides an overview of papers related to various tasks within the domain. 3 | 4 | ## Journal and Conference in Affective Computing 5 | Here is a list (top-tier) of recommended journals and conferences in the field of affective computing, covering natural language processing (NLP), computer vision (CV), and multimodal learning (MML), physiological signals. 6 | 7 | ### Tailored Journal and Conference 8 | - Journal: TAFFC (CAAI-A), a top-tier journal in the field 9 | - Conference: ACII, a top-tier conference, but with limited recognition 10 | 11 | ### NLP-oriented Affective Computing 12 | - Journal: TASLP, TACL (CAAI-B), CL (CAAI-B) 13 | - Conference: ACL, EMNLP, NAACL (CAAI-B), SIGKDD, SIGIR, WWW 14 | 15 | Note: For NLP research, TACL, CL, and NAACL are often considered the top-tier journal and conference. 16 | 17 | ### CV-oriented Affective Computing 18 | - Journal: TIP, IJCV, TPAMI 19 | - Conference: ECCV, CVPR, ICCV 20 | 21 | ### Multimodal Affective Computing 22 | - Journal: TMM, INFFUS 23 | - Conference: ACM MM 24 | 25 | Note: For multimodal research, journals and conferences in NLP and CV can also be considered. 26 | 27 | ### General Journal and Conference 28 | - Journal: TNNLS, TCYB, TOIS, SCIS, TOCHI, IJHCS 29 | - Conference: AAAI, IJCAI, CHI 30 | 31 | Despite the abundance of journals and conferences can be selected in the field of affective computing, there are still very few papers on this field in many journals and conferences such as TOCHI, IJHCS, and CHI. Affective computing researchers are mainly divided into two camps: NLP and CV, and they tend to publish their papers in journals and conferences related to their respective fields. The NLP field focuses on sentiment analysis, emotion recognition, and emotion response; the CV field focuses on facial expression recognition and generation. It is worth noting that most multimodal affective computing research is led by NLP researchers. 32 | 33 | Additionally, there are researchers focusing on affective computing based on physiological signals. 34 | 35 | ### Physiological Signal-oriented Affective Computing 36 | - Journal: TNNLS, TCYB, TOIS, SCIS, TOCHI, IJHCS 37 | - Conference: AAAI, IJCAI, CHI 38 | - Journal: TMM, INFFUS 39 | - Conference: ACM MM 40 | 41 | Note: For physiological signal research, journals and conferences are the same as the general ones. For multimodal physiological signals, TMM, INFFUS, ACM MM can also be considered. 42 | 43 | Of course, in addition to top-tier journals and conferences, there are also other journals and conferences to consider. 44 | 45 | ### NLP-oriented Affective Computing 46 | - Journal: Speech Communication, TALLIP, TKDD, IPM, KAIS, KBS, TWEB 47 | - Conference: COLING, INTERSPEECH, ICASSP, CIKM, ICDM, ECMLPKDD 48 | 49 | ### CV-oriented Affective Computing 50 | - Journal: CVIU, TCI, PR, TCSVT 51 | - Conference: ICPR, WACV 52 | 53 | ### Multimodal Affective Computing 54 | - Journal: TOMM 55 | - Conference: ICME 56 | 57 | Note: For multimodal research, journals and conferences in NLP and CV can also be considered. 58 | 59 | ### General Journal and Conference 60 | - Journal: FCS, TAI, JAIR, TIST, IJNS, NEUNET, NEUCOM, HCI, THMS, IwC, IJHCI 61 | - Conference: ECAI, AISTATS, IUI 62 | 63 | ### Physiological Signal-oriented Affective Computing 64 | - Journal: YBRBI, TNSRE, BBS 65 | - Conference: BIBM, EMBC, CogSci 66 | - Journal: FCS, TAI, JAIR, TIST, IJNS, NEUNET, NEUCOM, HCI, THMS, IwC, IJHCI 67 | - Conference: ECAI, AISTATS, IUI 68 | - Journal: TOMM 69 | - Conference: ICME 70 | 71 | Note: For multimodal physiological signals, TOMM and ICME can also be considered. 72 | 73 | ## Paper in Affective Computing 74 | Affective computing is a diverse research field that encompasses a broad range of tasks. This repository primarily covers the following core tasks: 75 | 76 | - [Sentiment Analysis](SA.md) 77 | - [Aspect-Based Sentiment Analysis](ABSA.md) 78 | - [Conversational Affect Detection (ERC&SAC)](CAD.md) 79 | - [Multi-Label Emotion Recognition](MLER.md) 80 | - [Emotion-Cause Pair Extraction](ECPE.md) 81 | - [Empathetic Response Generation](ERG.md) 82 | - [Emotional Support Conversation](ESC.md) 83 | - [Sarcasm Detection](SD.md) 84 | - [Speech Emotion Recognition](SER.md) 85 | - [Emotional Conversational Speech Synthesis](ECSS.md) 86 | - [Facial Expression Recognition](FER.md) 87 | - [Facial Expression Generation](FEG.md) 88 | - [Emotional Image Content Generation](EICG.md) 89 | - [Emotion Recognition from Physiological Signals](ERPS.md) -------------------------------------------------------------------------------- /SA.md: -------------------------------------------------------------------------------- 1 | # Papers in Sentiment Analysis 2 | 3 | - Zirun Guo, Tao Jin, Zhou Zhao - Multimodal Prompt Learning with Missing Modalities for Sentiment Analysis and Emotion Recognition - Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2024 4 | 5 | - Mingcheng Li, Dingkang Yang, Yuxuan Lei, Shunli Wang, Shuaibing Wang, Liuzhen Su, Kun Yang, Yuzheng Wang, Mingyang Sun, Lihua Zhang - A Unified Self-Distillation Framework for Multimodal Sentiment Analysis with Uncertain Missing Modalities, Proceedings of the Thirty-Eighth AAAI Conference on Artificial Intelligence, 2024 6 | 7 | - Meng Li, Zhenfang Zhu, Kefeng Li, Hongli Pei - Diversity and Balance: Multimodal Sentiment Analysis using Multimodal-Prefixed and Cross-Modal Attention - IEEE Transactions on Affective Computing, 2024 8 | 9 | - Cunhang Fan, Kang Zhu, Jianhua Tao, Guofeng Yi, Jun Xue, Zhao Lv - Multi-level Contrastive Learning: Hierarchical Alleviation of Heterogeneity in Multimodal Sentiment Analysis - IEEE Transactions on Affective Computing, 2024 10 | 11 | - Rui Liu, Haolin Zuo, Zheng Lian, Björn W. Schuller, Haizhou Li - Contrastive Learning based Modality-Invariant Feature Acquisition for Robust Multimodal Emotion Recognition with Missing Modalities - IEEE Transactions on Affective Computing, 2024 12 | 13 | - Licai Sun, Zheng Lian, Bin Liu, Jianhua Tao - Efficient Multimodal Transformer With Dual-Level Feature Restoration for Robust Multimodal Sentiment Analysis - IEEE Transactions on Affective Computing, 2023 14 | 15 | - Zaijing Li, Ting-En Lin, Yuchuan Wu, Meng Liu, Fengxiao Tang, Ming Zhao, Yongbin Li - UniSA: Unified Generative Framework for Sentiment Analysis - Proceedings of the 31st ACM International Conference on Multimedia, 2023 16 | 17 | - Yong Li, Yuanzhi Wang, Zhen Cui - Decoupled Multimodal Distilling for Emotion Recognition - Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023 18 | 19 | - Ruohong Huan, Guowei Zhong, Peng Chen, Ronghua Liang - UniMF: A Unified Multimodal Framework for Multimodal Sentiment Analysis in Missing Modalities and Unaligned Multimodal Sequences - IEEE Transactions on Multimedia, 2023 20 | 21 | - Lijun He, Ziqing Wang, Liejun Wang, Fan Li - Multimodal Mutual Attention-Based Sentiment Analysis Framework Adapted to Complicated Contexts - IEEE Transactions on Circuits and Systems for Video Technology, 2023 22 | 23 | - Chuanbo Zhu, Min Chen, Sheng Zhang, Chao Sun, Han Liang, Yifan Liu, Jincai Chen - SKEAFN: Sentiment Knowledge Enhanced Attention Fusion Network for multimodal sentiment analysis, Information Fusion, 2023 24 | 25 | - Sijie Mai, Ying Zeng, Shuangjia Zheng, Haifeng Hu - Hybrid Contrastive Learning of Tri-Modal Representation for Multimodal Sentiment Analysis - IEEE Transactions on Affective Computing, 2022 26 | 27 | - Devamanyu Hazarika, Yingting Li, Bo Cheng, Shuai Zhao, Roger Zimmermann, Soujanya Poria - Analyzing Modality Robustness in Multimodal Sentiment Analysis - Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2022 28 | 29 | - Dingkang Yang, Shuai Huang, Haopeng Kuang, Yangtao Du, Lihua Zhan - Disentangled Representation Learning for Multimodal Emotion 30 | Recognition - Proceedings of the 30th ACM International Conference on Multimedia, 2022 31 | 32 | - Wei Han, Hui Chen, Soujanya Poria - Improving Multimodal Fusion with Hierarchical Mutual Information Maximization for Multimodal Sentiment Analysis - Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, 2021 33 | 34 | - Wenmeng Yu, Hua Xu, Ziqi Yuan, Jiele Wu - Learning Modality-Specific Representations with Self-Supervised Multi-Task Learning for Multimodal Sentiment Analysis - Proceedings of the Thirty-Fifth AAAI Conference on Artificial Intelligence, 2021 35 | 36 | - Devamanyu Hazarika, Roger Zimmermann, Soujanya Poria - MISA: Modality-Invariant and -Specific Representations for Multimodal Sentiment Analysis - Proceedings of the 28th ACM International Conference on Multimedia, 2020 37 | 38 | - Yao-Hung Hubert Tsai, Shaojie Bai, Paul Pu Liang, J. Zico Kolter, Louis-Philippe Morency, Ruslan Salakhutdinov - Multimodal Transformer for Unaligned Multimodal Language Sequences - Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, 2019 -------------------------------------------------------------------------------- /SD.md: -------------------------------------------------------------------------------- 1 | # Papers in Sarcasm Detection 2 | 3 | - Tan Yue, Rui Mao, Heng Wang, Zonghai Hu, Erik Cambria - KnowleNet: Knowledge fusion network for multimodal sarcasm detection - Information Fusion, 2023 4 | 5 | - Changsong Wen, Guoli Jia, Jufeng Yang - DIP: Dual Incongruity Perceiving Network for Sarcasm Detection - Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023 6 | 7 | - Bin Liang, Chenwei Lou, Xiang Li, Lin Gui, Min Yang, Ruifeng Xu - Multi-Modal Sarcasm Detection with Interactive In-Modal and Cross-Modal Graphs - Proceedings of the 29th ACM International Conference on Multimedia, 2021 -------------------------------------------------------------------------------- /SER.md: -------------------------------------------------------------------------------- 1 | # Papers in Speech Emotion Recognition 2 | 3 | - Johannes Wagner, Andreas Triantafyllopoulos, Hagen Wierstorf, Maximilian Schmitt, Felix Burkhardt, Florian Eyben - Dawn of the Transformer Era in Speech Emotion Recognition: Closing the Valence Gap - IEEE Transactions on Pattern Analysis and Machine Intelligence, 2023 4 | 5 | - Siddique Latif, Rajib Rana, Sara Khalifa, Raja Jurdak, Junaid Qadir, Björn Schuller - Survey of Deep Representation Learning for Speech Emotion Recognition - IEEE Transactions on Affective Computing, 2021 6 | 7 | - Edmilson Morais, Ron Hoory, Weizhong Zhu, Itai Gat, Matheus Damasceno, Hagai Aronowitz - Speech Emotion Recognition Using Self-Supervised Features - ICASSP 2022 - 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2022 --------------------------------------------------------------------------------