Publications -> Conference Papers

An Affect-Rich Neural Conversational Model with Biased Attention and Weighted Cross-Entropy Loss


Authors: P. Zhong, D. Wang, and C. Miao
Title: An Affect-Rich Neural Conversational Model with Biased Attention and Weighted Cross-Entropy Loss
Abstract: Affect conveys important implicit information in human communication. Having the capability to correctly express affect during human-machine conversations is one of the major milestones in artificial intelligence. In recent years, extensive research on open-domain neural conversational models has been conducted. However, embedding affect into such models is still under explored. In this paper, we propose an end-to-end affect-rich open-domain neural conversational model that produces responses not only appropriate in syntax and semantics, but also with rich affect. Our model extends the Seq2Seq model and adopts VAD (Valence, Arousal and Dominance) affective notations to embed each word with affects. In addition, our model considers the effect of negators and intensifiers via a novel affective attention mechanism, which biases attention towards affect-rich words in input sentences. Lastly, we train our model with an affect-incorporated objective function to encourage the generation of affect-rich words in the output responses. Evaluations based on both perplexity and human evaluations show that our model outperforms the state-of-the-art baseline model of comparable size in producing natural and affect-rich responses.
Keywords: 
Conference Name: Proceedings of the Thirty-Third AAAI Conference on Artificial Intelligence
Location: Honolulu, Hawaii, USA
Publisher: AAAI
Year: 2019
Accepted PDF File: An_Affect-Rich_Neural_Conversational_Model_with_Biased_Attention_and_Weighted_Cross-Entropy_Loss_accepted.pdf
Permanent Link: https://doi.org/10.1609/aaai.v33i01.33017492
Reference: P. Zhong, D. Wang, and C. Miao, "An Affect-Rich Neural Conversational Model with Biased Attention and Weighted Cross-Entropy Loss," in Proceedings of the Thirty-Third AAAI Conference on Artificial Intelligence, Honolulu, Hawaii, USA, January-February 2019: AAAI.
bibtex: 
@inproceedings{LILY-c165, 
   author	= {Zhong, Peixiang and Wang, Di and Miao, Chunyan},
   title		= {An Affect-Rich Neural Conversational Model with Biased Attention and Weighted Cross-Entropy Loss},  
   booktitle	= {Proceedings of the Thirty-Third AAAI Conference on Artificial Intelligence}, 
   year		= {2019}, 
   month	= {January--Feburary}, 
   pages	= {7492-7500}, 
   location	= {Honolulu, Hawaii, USA},
   publisher	= {AAAI},
}