AIMS AND OBJECTIVES OF THE COURSE: At the end of the course the students are expected to know the innovative technologies for multimodal interactions and the methods used to provide them, to be able to apply approaches and tools to combine information from different modalities for better interpretation of user’s intentions.
DESCRIPTION OF THE COURSE: Main topics: Introduction to multimodal interactions, models and modalities of human-human and human-computer interfaces; Human-computer interactions based on image recognition; Human-computer interactions based on sound recognition and generation; Human-computer interactions with haptic devices; Multimodal devices for virtual and augmented reality; Integration of data from different sources in multimodal systems; Multimodal devices with eye movement recognition; Multimodal devices with gesture and body recognition; Multimodal devices with emotion recognition in images and sound.
