• Home
  • Linguistics seminar: Gabriel Skantze - Turn-taking, feedback and joint attention in spoken human-machine interaction

Linguistics seminar: Gabriel Skantze - Turn-taking, feedback and joint attention in spoken human-machine interaction

SEMINAR

Conversation can be described as a joint activity between two or more participants, and the ease of conversation relies on a close coordination of actions between them. First, since it is difficult to speak and listen at the same time, interlocutors have to take turns speaking, and this turn-taking has to be coordinated somehow. Second, while speaking, humans continually evaluate how the listener perceives and reacts to what they say and adjust their future behaviour to accommodate this feedback. Third, speakers also have to coordinate their joint focus of attention. Joint attention is fundamental to efficient communication: it allows people to interpret and predict each other's actions and prepare reactions to them.

In this talk, I will present an ongoing research effort at KTH in which we aim to model these phenomena for improving spoken interaction between humans and machines. I will start with a dyadic human-computer dialogue setting and show how we can use data-driven methods for detecting feedback-inviting cues in the user's speech. I will then move on to situated interaction where the human interacts face-to-face with a robot, making references to physical objects in the surroundings, and explore how the system can invite feedback from the user and how the user and system can achieve joint attention. Finally, we will look at multi-party interaction, where the robot interacts with several humans at the same time, and explore how gaze is used to regulate turn-taking in such settings.

Date: 2014-05-27 13:15 - 15:00

Location: T340, Olof Wijksgatan 6

Permalink

add to Outlook/iCal

To the top

Page updated: 2014-05-23 18:06

Send as email
Print page
Show as pdf

X
Loading