To improve the performance of dialogue systems, analyses of interactions are an important source of knowledge. When dialogue systems are deployed, the interaction can be logged for later analysis. Talkamatic AB are about to begin collection of logs resulting from dialogue system interactions, which will be available to the student.
The task is to build a toolbox for analysing logs of dialogue system interactions and presenting results from such analyses. Examples of relevant analysis features include:
Such basic analysis dimensions can then be used to detect and diagnose problems with systems which need fixing.
Staffan Larsson, Dialogue Technology Lab, and Talkamatic AB.