Multimodal Language

Corpus of Spontaneous Multimodal-Interactive Language

The Corpus of Spontaneous Multimodal Interactive Language (CoSMIL – headed by Juhani Järvikivi and Benjamin V. Tucker, Linguistics), funded by KIAS, is an interdisciplinary project including collaborators from Linguistics, Psychology, Speech Pathology and Audiology, and Marketing. We are collecting a large dataset of conversational language containing audio and video recordings of spontaneous interaction as well as eye movement data during computer-mediated conversation between conversation partners. The audio and the video portions will be transcribed and aligned from phonetic detail to manual and facial gestures to explore the connections and correlations between spontaneous language use and gesturing during normal conversation.

multimodal Language image 


Juhani Järvikivi

2013 Cluster

View Page