Back to Search Start Over

Metaphorical User Simulators for Evaluating Task-oriented Dialogue Systems.

Authors :
WEIWEI SUN
SHUYU GUO
SHUO ZHANG
PENGJIE REN
ZHUMIN CHEN
DE RIJKE, MAARTEN
ZHAOCHUN REN
Source :
ACM Transactions on Information Systems; Jan2024, Vol. 42 Issue 1, p1-29, 29p
Publication Year :
2024

Abstract

The article focuses on improving the evaluation of task-oriented dialogue systems (TDSs) through the use of user simulators. Topics include the limitations of current TDS evaluation methods, the challenges of employing user simulators for TDS evaluation, and the proposed solution which involves a metaphorical user simulator (MetaSim) and a tester-based evaluation framework.

Details

Language :
English
ISSN :
10468188
Volume :
42
Issue :
1
Database :
Complementary Index
Journal :
ACM Transactions on Information Systems
Publication Type :
Academic Journal
Accession number :
173170333
Full Text :
https://doi.org/10.1145/3596510