Faculty Introduction Ja

SUMI, Kaoru

Professor
Research Fields
Affective Computing, Persuasive Technology, Human Agent Interaction, Metaverse, Interactive Digital Storytelling, Serious Games, Intelligent Systems, Artificial Intelligence
Academic Background
Graduate School of Engineering, The University of Tokyo
Subjects in Charge (Undergraduate)
Interactive System, Artificial Intelligence and Media, Modern Design and Introduction of Information Expression
Subjects in Charge (Graduate School)
Introduction to Interactive System
Degree
Ph.D.

Message for Students

Information science is a relatively new field, offering opportunities to everyone. Graduate school provides a valuable chance to freely pursue topics that match your personal interests. Research is a compelling experience where you can explore your curiosity and make use of your creativity. For many, this may be the last opportunity to conduct research with full freedom. Before entering the workforce, I strongly encourage you to produce research results that enhance your value.

Recent Activities and Roles

  • Forthcoming Book: Affective Learning and Serious Games, CRC Press (to be published soon)
  • Invited Research Fellow, Giner de los Ríos Program, University of Alcalá, Spain (Sept. 2025)
  • Associate Editor, Behaviour & Information Technology, Taylor & Francis (since 2024)
  • Incoming Associate Editor, Frontiers in Artificial Intelligence – Section: AI for Human Learning and Behavior Change
  • General Chair, Persuasive 2026 (March 2026)
  • Guest Editor, JoVE Methods Collection: Interactive Technologies for Behavior Change and Emotional Engagement
    (Special Issue Page)
  • Chair, 1st IEEE Workshop on Interactive Systems, Affective Computing Technologies and Applications (ISAC), IEEE COMPSAC (2024)
  • Coordinator, IEEE Japan Council WIE (2025–)
  • Chair, IEEE Sapporo WIE (2020–)

Honors and Awards

  • Senior Member, IEEE
  • Senior Member, ACM
  • Best Technical Design Paper Award, International Conference on Computers in Education (ICCE), 2020
  • Best Full Paper Award, International Conference on Intelligent Tutoring Systems (ITS), 2019
  • IEEE Brain Winner, Brain-Computer Interface Hackathon, IEEE SMC 2018

Achievements

ORCiD

Google Scholar

researchmap

Loop

Research Interests

Affective Computing

Research is conducted to evaluate how nonverbal information such as facial expressions and gestures affects communication.
This includes emotion recognition using physiological signals (e.g., EDA and ECG) and the development of emotional expression techniques.

Persuasive Technology

This research area focuses on persuasive technologies that support users in behavior change and decision-making.
Effective persuasive methods are designed and evaluated using virtual agents and emotional elements.

Human-Agent Interaction

Studies are conducted on interactions between humans and agents, including humanoid and animal-like forms.
By combining affective computing and persuasive technology, the effects of agents’ emotional expressions and dialogue behaviors on users are evaluated, particularly in immersive environments such as VR.
Human-robot interaction is also explored using a social robot called “Furhat,” which is capable of changing facial expressions. Emotional responses are analyzed using physiological sensors.

Metaverse

Research in the metaverse focuses on communication and learning support using agents, as well as on the Proteus effect.
In addition, the mechanisms and potential applications of sensory illusions (phantom sense) in virtual and mixed reality (VR/MR) environments are being investigated.

Learning Support & Serious Games

This area explores learning through dialogue with agents, affective feedback, and serious games that promote active engagement.
Immersive learning environments using VR/MR are designed to enhance educational and training outcomes by leveraging learners’ motivation and emotional states.

Attractive Factors of the Research

Interest is particularly directed toward how non-verbal information such as emotions and virtual spaces affects humans.
This field remains full of open research questions. System development is also approached as a way to realize novel ideas for supporting human activities.

Contact (Replace _at_ to @)

Email: kaorus_at_fun.ac.jp

Selected Major Papers & Talks

A. Selected Journal Articles

  • Kaoru Sumi and Ryo Okuyama. “Training System for Converting Current Visual Information to Bird’s Eye View.” Frontiers in Psychology, 2024.12.
    [Link]
  • Ahmed Salem and Kaoru Sumi. “Deception Detection in Educational AI: Challenges for Japanese Middle School Students in Interacting with Generative AI Robots.” Frontiers in Artificial Intelligence, 2024.12.
    [Link]
  • Nitchan Jianwattanapaisarn, Kaoru Sumi, et al. “Emotional Characteristic Analysis of Human Gait while Real-Time Movie Viewing.” Frontiers in Artificial Intelligence, 2022.
    [Link]
  • Kaoru Sumi and Shusuke Sato. “Experiences of Game-Based Learning and Reviewing History of the Experience Using Player’s Emotions.” Frontiers in Artificial Intelligence, Vol.5, 2022.
    [Link]
  • Kaoru Sumi and Riichiro Mizoguchi. “Talkabout: E-negotiations via Concept Tree Generation.”
    Journal of Decision Systems, Vol. 13, No. 4, pp. 477–499, 2005.
    [Link]
  • Kaoru Sumi and Toyoaki Nishida. “Telme: A Personalized, Context-Aware Communication Support System.”
    IEEE Intelligent Systems, Vol. 16, No. 3, pp. 21–28, 2001.
    [Link]

B. Selected Conference Papers

  • Rio Harada and Kaoru Sumi. “Persuasive Technology Through Behavior and Emotion with Pet-Type Artifacts.” Persuasive Technology 2024, LNCS 14636, Springer.
    [Link]
  • Kaoru Sumi and Ryoma Tanabe. “Empathy-Driven Persuasion: A Serious Game for Anti-Bullying Education via First-Person Perpetrator Experience.” Persuasive Technology 2025, CCIS 2542, Springer.
    [Link]
  • Shusuke Sato and Kaoru Sumi. “Story Generation System Using Player’s Emotions for Review in Game-Based Learning.” 28th International Conference on Computers in Education (ICCE), 2020.
    (Best Technical Design Paper Award)
    [Link]
  • Thomas J. Z. Tiam‑Lee and Kaoru Sumi. “Analysis and Prediction of Student Emotions While Doing Programming Exercises.” International Conference on Intelligent Tutoring Systems, LNCS, 2019.
    (Best Full Paper Award)
    [Link]
  • Kaoru Sumi. “Learning Story Marketing through Practical Experience of Story Creation System.”
    Interactive Storytelling, LNCS 6432, Springer, pp. 98–110, 2010.
    [Link]
  • Kaoru Sumi. “Capturing Common Sense Knowledge via Story Generation.”
    International Conference on Intelligent User Interfaces (IUI 2009), SIGCHI ACM, February 2009.
    [Link]

C. Book Chapters

  • Kaoru Sumi and Mizue Nagata. “Evaluating a Virtual Agent as Persuasive Technology.”
    In: Psychology of Persuasion, Nova Science Publishers, 2010.
    [Link]

D. Recent Invited / Keynote Talks

  • Kaoru Sumi: Persuasive Technology and Emotions,
    BTIW2024 at ACM MobiSys, June 2024. Keynote Talk
  • Kaoru Sumi: Artificial Intelligence for the Future of Learning and Experiences in Training Students,
    APEC ICT Skill Standards for AI, May 2023. Plenary Talk
  • Kaoru Sumi: Human to Human Interaction using Virtual Agents Posing as Another Person,
    International Conference on Artificial Life and Robotics (ICAROB2022), February 2023. Plenary Talk
  • Kaoru Sumi: Human-Computer Interaction via Affective Computing,
    ICAROB, January 2016, Okinawa. Invited Talk
  • Kaoru Sumi: Communication with a Virtual Agent via Facial Expressions,
    IJCAI Workshop on Empathic Computing (IWEC’13), August 2013, Beijing. Invited Talk