Impact of tutor errors on student engagement in a dialog based intelligent tutoring system

Shazia Afzal*, Vinay Shashidhar, Renuka Sindhgatta, Bikram Sengupta

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

5 Citations (Scopus)

Abstract

Accurate classification of learner responses is a critical component of dialog based tutoring systems (DBT). Errors in identifying the intent and context of responses can have cascading effects on the ongoing interaction thereby affecting the learning experience and outcome. In this paper we attempt to quantify the impact of Tutor misclassifications on student behavior by analyzing differences across our hypothesized conditions namely, no-misclassification vs. misclassification using various dialog metrics. We find that not only are there significant changes in behavior across the two groups but that Tutor errors related to misunderstanding of Intent - although fewer in occurrence, appear to have a higher impact than a misclassification of a valid student answer. We also see some evidence of the effectiveness of scaffolds like FITBs in sustaining dialog thereby mitigating the effects of a Tutor error.

Original languageEnglish
Title of host publicationIntelligent Tutoring Systems - 14th International Conference, ITS 2018, Proceedings
EditorsJulita Vassileva, Roger Nkambou, Roger Azevedo
PublisherSpringer Verlag
Pages267-273
Number of pages7
ISBN (Print)9783319914633
DOIs
Publication statusPublished - 2018
Externally publishedYes
Event14th International Conference on Intelligent Tutoring Systems, ITS 2018 - Montreal, Canada
Duration: 11 Jun 201815 Jun 2018

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume10858 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference14th International Conference on Intelligent Tutoring Systems, ITS 2018
Country/TerritoryCanada
CityMontreal
Period11/06/1815/06/18

Fingerprint

Dive into the research topics of 'Impact of tutor errors on student engagement in a dialog based intelligent tutoring system'. Together they form a unique fingerprint.

Cite this