Ajou University repository

Is your chatbot perplexing?: Confident personalized conversational agent for consistent chit-chat dialogue
Citations

SCOPUS

0

Citation Export

Publication Year
2021-01-01
Journal
ICAART 2021 - Proceedings of the 13th International Conference on Agents and Artificial Intelligence
Publisher
SciTePress
Citation
ICAART 2021 - Proceedings of the 13th International Conference on Agents and Artificial Intelligence, Vol.2, pp.1226-1232
Keyword
ChatbotConfidenceDialogueNatural language processingPersonalized
Mesh Keyword
Automatic evaluationComplex dataConversational agentsHuman evaluationHuman likeLanguage modelPractical useState of the art
All Science Classification Codes (ASJC)
Artificial IntelligenceSoftware
Abstract
Chatbots are being researched and employed not only in academic settings but also in many fields as an application. Ultimately, conversational agents attempt to produce human-like responses along with dialogues. To achieve this goal, we built a novel framework that processes complex data consisting of personalities and utterances and fine-tuned a large-scale self-attention-based language model. We propose a consistent personalized conversational agent(CPC-Agent) for the framework. Our model was designed to utilize the complex knowledge of a dataset to achieve accuracy and consistency. Together with a distractor mechanism, we could generate confident responses. We compared our model to state-of-the-art models using automated metrics. Our model scored 3.29 in perplexity, 17.59 in F1 score, and 79.5 in Hits@1. In particular, the perplexity result was almost four times smaller than that of the current state-of-the-art model that scored 16.42. In addition, we conducted a human evaluation of each model to determine its response quality because the automatic evaluation metrics in dialogue tasks are still considered insufficient. Our model achieved the best rates from the voters, which indicated that our model is adequate for practical use.
Language
eng
URI
https://aurora.ajou.ac.kr/handle/2018.oak/36652
https://www.scopus.com/inward/record.uri?partnerID=HzOxMe3b&scp=85103830859&origin=inward
Journal URL
http://www.scitepress.org/DigitalLibrary/HomePage.aspx
Type
Conference
Funding
This research was supported by the MSIT(Ministry of Science and ICT), Korea, under the ITRC (Information Technology Research Center) support program(IITP-2020-2018-0-01431) and also under the National Program for Excellence in SW (2015-0-00908) both supervised by the IITP(Institute for Information & Communications Technology Planning & Evaluation).
Show full item record

Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.

Related Researcher

Sohn, Kyung-Ah Image
Sohn, Kyung-Ah손경아
Department of Software and Computer Engineering
Read More

Total Views & Downloads

File Download

  • There are no files associated with this item.