• Date: A CUSO Seminar at the University of Fribourg, November 30th, 2018
  • Location: Chemin du Musée 16, Fribourg (wooden building beside the Natural History Museum) Room 001

Description

The course will revolve around the development of multimodal approaches for the analysis of human behaviour. In particular, the course will show how the concept of multimodal communication, originally formulated in ethology and cognitive sciences, has been articulated in Artificial Intelligence terms. In the first part, the course will show how the information extracted from multiple sensors (the modalities) can be modelled jointly through the adoption of two main methodologies:

  • Early fusion: the information extracted from multiple modalities is combined before statistical modelling through the creation of a multimodal feature vector, i.e., a vector where every component is a physical measurement extracted from one of the multiple input streams
  • Late fusion: the information extracted from every individual modality is modelled statistically independently of the others and, then, the outcome of the various statistical models is combined.

In the second part, the course will provide an introduction to recent approaches made possible by the advent of deep neural networks

Speakers

  • Professor Alessandro Vinciarelli: Alessandro Vinciarelli is Full Professor at the University of Glasgow (School of Computing Science and Institute of Neuroscience and Psychology),where he works since 2010. Previously, he has been with several companies in Italy and the USA (Finmeccanica,Accenture and IBM) and with the Idiap Research Institute in Switzerland. His main research interest is Social Signal Processing, the domain aimed at modelling, analysis and synthesis of nonverbal behaviour in social interactions. He has published more than 140 works and he is or has been PI and co-PI of more than 15 national and international projects, including the European Network of Excellence on Social Signal Processing (http://sspnet.eu). He has chaired more than 25 international events - including the IEEE International Conference on Social Computing and the ACM International Conference on Multimodal Interaction - and he is a co-founder of Klewel (http://www.klewel.com), a knowledge management company recognized with several national and international awards.

Course material

The course material will be available soon.

Registration

All the students, researchers and professors registered at CUSO universities (i.e. EPFL, Universities of Fribourg, Geneva, Lausanne, Bern and Neuchâtel) are eligible to apply. Priority will be given to PhD students; PostDocs and senior researchers will be selected according to their scientific activity and closeness to the topic of the seminar. For members of the CUSO, we will reimburse travel costs for half-price second class SBB tickets up to CHF 30. You will receive reimbursement instructions during the school. Registration is open until November 29th, 2018.

Please register directly through CUSO.

Preliminary program

Classes start at 9h00 and finish at 17h.

Coffee breaks: 10h30-11h00 and 15h00-15h30

Lunch: 12h30-13h30

Organization

  • Prof. Denis Lalanne, University of Fribourg, Switzerland

  • Agnes Lisowska Masson, University of Fribourg, Switzerland