Back to Search Start Over

Data-driven subjective performance evaluation: An attentive deep neural networks model based on a call centre case

Authors :
Abdelrahman Ahmed
Uthayasankar Sivarajah
Zahir Irani
Kamran Mahroof
Vincent Charles
Source :
Annals of Operations Research.
Publication Year :
2022
Publisher :
Springer Science and Business Media LLC, 2022.

Abstract

Every contact centre engages in some form of Call Quality Monitoring in order to improve agent performance and customer satisfaction. Call centres have traditionally used a manual process to sort, select, and analyse a representative sample of interactions for evaluation purposes. Unfortunately, such a process is marked by subjectivity, which in turn results in a distorted picture of agent performance. To address the challenge of identifying and removing subjectivity, empirical research is required. In this paper, we introduce an evidence-based, machine learning-driven framework for the automatic detection of subjective calls. We analyse a corpus of seven hours of recorded calls from a real-estate call centre using Deep Neural Network (DNN) for a multi-classification problem. The study establishes the first baseline for subjectivity detection, with an accuracy of 75%, which is comparable to relevant speech studies in emotional recognition and performance classification. We conclude, among other things, that in order to achieve the best performance evaluation, subjective calls should be removed from the evaluation process or subjective scores deducted from the overall results.

Details

ISSN :
15729338 and 02545330
Database :
OpenAIRE
Journal :
Annals of Operations Research
Accession number :
edsair.doi...........181507dd8a5e13fa31bf0335c1e69406
Full Text :
https://doi.org/10.1007/s10479-022-04874-2