Assessing User Expertise in Spoken Dialog System Interactions

Eugenio Ribeiro, Fernando Batista, Isabel Trancoso, Jose Lopes, Ricardo Ribeiro, David de Matos

Research output: Chapter in Book/Report/Conference proceedingConference article in proceedingAcademicpeer-review

Abstract

Identifying the level of expertise of its users is important for a system since it can lead to a better interaction through adaptation techniques. Furthermore, this information can be used in offline processes of root cause analysis. However, not much effort has been put into automatically identifying the level of expertise of an user, especially in dialog-based interactions. In this paper we present an approach based on a specific set of task related features. Based on the distribution of the features among the two classes – Novice and Expert – we used Random Forests as a classification approach. Furthermore, we used a Support Vector Machine classifier, in order to perform a result comparison. By applying these approaches on data from a real system, Let’s Go, we obtained preliminary results that we consider positive, given the difficulty of the task and the lack of competing approaches for comparison.
Original languageEnglish
Title of host publicationAdvances in Speech and Language Technologies for Iberian Languages
Subtitle of host publicationThird International Conference, IberSPEECH 2016, Lisbon, Portugal, November 23-25, 2016, Proceedings
EditorsAlberto Abad, Alfonso Ortega, António Teixeira, Carmen García Mateo, Carlos D. Martínez Hinarejos, Fernando Perdigão, Fernando Batista, Nuno Mamede
PublisherSpringer Nature Switzerland AG
Pages245-254
ISBN (Electronic)978-3-319-49169-1
ISBN (Print)978-3-319-49168-4
DOIs
Publication statusPublished - Nov 2016
Externally publishedYes
EventInternational Conference on Advances in Speech and Language Technologies for Iberian Languages - Lisbon, Portugal
Duration: 23 Nov 201625 Nov 2016
https://link.springer.com/conference/iberspeech

Publication series

SeriesLecture Notes in Computer Science
Volume10077
ISSN0302-9743

Conference

ConferenceInternational Conference on Advances in Speech and Language Technologies for Iberian Languages
Abbreviated titleIberSPEECH 2016
CountryPortugal
CityLisbon
Period23/11/1625/11/16
Internet address

    Fingerprint

Keywords

  • User expertise
  • Let’s Go
  • SVM
  • Random Forest

Cite this

Ribeiro, E., Batista, F., Trancoso, I., Lopes, J., Ribeiro, R., & de Matos, D. (2016). Assessing User Expertise in Spoken Dialog System Interactions. In A. Abad, A. Ortega, A. Teixeira, C. García Mateo, C. D. Martínez Hinarejos, F. Perdigão, F. Batista, & N. Mamede (Eds.), Advances in Speech and Language Technologies for Iberian Languages: Third International Conference, IberSPEECH 2016, Lisbon, Portugal, November 23-25, 2016, Proceedings (pp. 245-254). Springer Nature Switzerland AG. Lecture Notes in Computer Science, Vol.. 10077 https://doi.org/10.1007/978-3-319-49169-1_24