Notice Regarding Our Collaboration with Aisin Seiki
Developing a multimodal agent to support mobility in the age of autonomous driving
We have collaborated with Aisin Seiki Co., Ltd. and Toyohashi University of Technology to develop a multimodal agent.
The system we developed is designed for use inside autonomous buses, which are expected to become widespread in the future. It uses camera-based image recognition to detect the faces and body movements of passengers and crew, and uses AI to make integrated (multimodal) judgements based on images, audio and accumulated data. By combining this with “Saya,” a CG character created by the 3DCG artist duo TELYUKA, the system can recognise individual passengers and have Saya speak to them, and use a “watch-over” feature to ease the minor anxieties that can come with autonomous driving — bringing enjoyment and comfort to mobility.
For details, please see Aisin Seiki’s news page below.