教員一覧 List of faculty members

SUMI Yasuyuki 教授

SUMI, Yasuyuki Professor

Job introductions

With a background in artificial intelligence and human interfaces theory and technology, I am involved in research, education, and social activities in a wide range of fields related to "interaction" and "knowledge creation."

Experience Media

We research and develop media technologies for recording, interpreting, and creating spaces for "experiences" related to sharing experiences, creating knowledge, and transferring skills. Specifically, we have developed and operated systems such as a meeting capture system aimed at recording and reusing daily meetings, a bookshelf system that encourages casual conversations in front of bookshelves, and PhotoChat, which facilitates chatting and information organization on photographs.

Understanding human interaction

Our goal is to build a "dictionary and grammar" of nonverbal information in human conversational interactions. We record and analyze multi-person conversations using not only video and audio, but also a range of sensors for motion capture, eye movement measurement, and bio-response measurement.

Situation-appropriate mobile assistant

We research and develop systems that facilitate encounters and information sharing among museum visitors and academic conference participants using mobile devices and information kiosks, and have developed systems called Agent Salon and Comic Diary. We conduct practical research by providing services at the research institute's open houses and academic conference events both domestically and internationally.

Idea generation support system

To support the organization of research ideas and the analysis of software development requirements, we have developed techniques for externalizing idea memos and visualizing conceptual spaces.

Recent Books

• Atsushi Nakata, Yasuyuki Sumi, Toyoaki Nishida: Extraction of conversational structure based on patterns of nonverbal behavior, IEICE Transactions on Electronics, Information and Communication Engineers, Vol.J94-D, No.1, pp.113-123. June 2011 January, 2011 .
• Yasuyuki Sumi, Masaharu Yano, and Toyoaki Nishida: Analysis environment of conversational structure with nonverbal multimodal data, The Twelfth International Conference on Multimodal Interfaces and the Seventh Workshop on Machine Learning for Multimodal Interaction (ICMI-MLMI 2010), Beijing, China, November 2010.
• SUMI Yasuyuki: Experiential Media: Real-World Media Embedded in the Context of Group Activities, Journal of the Information Processing Society of Japan, Vol. 51, No. 7, pp. 826-834. June 2010 July, 2010 .
• Toshiya Nakakura, Yasuyuki Sumi, and Toyoaki Nishida: Neary: Conversation field detection based on similarity of auditory situation, The Tenth Workshop on Mobile Computing Systems and Applications (HotMobile 2009), Santa Cruz, February 2009.
• SUMI Yasuyuki, Nishida Toyoaki, Bono Mayumi, Kurishima Hiroyuki: IMADE: Research Platform for Real-World Interactions for Understanding Conversation Structure and Content Creation, Journal of the Information Processing Society of Japan, Vol. 49, No. 8, pp. 945-949. June 2008 August, 2008 .
• SUMI Yasuyuki, Ito Jun, Nishida Toyoaki: PhotoChat: A communication support system through the sharing of photos and captions, Transactions of the Information Processing Society of Japan, Vol. 49, No. 6, pp. 1993-2003. June 2008 June, 2008 .
• Masashi Takahashi, Yasuyuki Sumi, Yoshinori Ito, Kenji Mase, Kiyoshi Kogure, Toyoaki Nishida: Proposal of a graph clustering method for time-series event discovery, Transactions of the Information Processing Society of Japan, Vol. 49, No. 6, pp. 1942-1963. June 2008 June, 2008 .
• SUMI Yasuyuki, Suwa Masaki, Hanaue Koichi, Nishida Toyoaki, Katagiri Yasuhiro, Mase Kenji: Effects of multi-perspective video on metacognition through shared experiences, Transactions of the Information Processing Society of Japan, Vol. 49, No. 4, pp. 1637-1647. June 2008 April, 2008 .
• Yasuyuki Sumi, Jun Ito and Toyoaki Nishida: PhotoChat: Communication support system based on sharing photos and notes, CHI 2008 Extended Abstracts, Works in progress, pp.3237-3242, Italy, April 2008.
• Yasuyuki Sumi, Sadanori Ito, Tetsuya Matsuguchi, Sidney Fels, Shoichiro Iwasawa, Kenji Mase, Kiyoshi Kogure, and Norihiro Hagita: Collaborative capturing, interpreting, and sharing of experiences, Personal and Ubiquitous Computing, Vol.11, No.4, pp.213-328, April 2007.