Patrik Jonell

I’m currently a PhD student in the area of adaptive conversational agents at KTH, The Royal Institute of Technology in Stockholm, Sweden. My research interests can be broadly defined as multimodal interaction. At the moment, my main research focus is machine learning for these interactions, specifically for non-verbal behavior generation in conversational agents. My goal is to give conversational agents the ability to adapt their non-verbal behavior in response to the behaviour of a conversation partner, similar to what humans do, and I use data collected from interactions between humans, along with deep learning, to progress toward that goal.

Recent publications

  1. Frontiers in
    Multimodal capture of patient behaviour for improved detection of early dementia: clinical feasibility and preliminary results
    Patrik Jonell, Birger Moëll, Krister Håkansson, Gustav Eje Henter, Taras Kucherenko, Olga Mikheeva, Göran Hagman, Jasper Holleman, Miia Kivipelto, Hedvig Kjellström, Joakim Gustafson, and Jonas Beskow
    [In review] Frontiers in Computer Science - Human-Media Interaction 2020
    Indicates equal contribution
  2. IVA Best Paper
    Let’s Face It: Probabilistic Multi-Modal Interlocutor-Aware Generation of Facial Gestures in Dyadic Settings
    In Proceedings of the 20th ACM International Conference on Intelligent Virtual Agents (IVA’20) 2020
  3. ICMI Best Paper
    Gesticulator: A framework for semantically-aware speech-driven gesture generation
    In Proceedings of the 22th ACM International Conference on Multimodal Interaction (ICMI’20) 2020
  4. IVA
    Can we trust online crowdworkers? Comparing online and offline participants in a preference test of virtual agents
    Patrik Jonell, Taras Kucherenko, Ilaria Torre, and Jonas Beskow
    In Proceedings of the 20th ACM International Conference on Intelligent Virtual Agents (IVA’20) 2020
    Indicates equal contribution
  5. GENEA
    The GENEA Challenge 2020:Benchmarking gesture-generation systems on common data
    In Proceedings of the GENEA Workshop 2020, part of IVA’20. 2020
    Indicates equal contribution
  6. CogSci
    Embodiment and gender interact in alignment to TTS voices
    Michelle Cohn, Patrik Jonell, Taylor Kim, Jonas Beskow, and Georgia Zellou
    Proceedings of the 42th Annual Meeting of the Cognitive Science Society, CogSci 2020 2020
  7. Frontiers in
    Robotics and AI
    Towards an Engagement-Aware Attentive Artificial Listener for Multi-Party Interactions
    [In review] Frontiers in Robotics and AI - Human-Robot Interaction 2020