Methodologies for Evaluating and Optimizing Multimodal Human-Machine-Interface of Autonomous Vehicles

Paper #:
  • 2018-01-0494

  • 2018-04-03
With the rapid development of artificial intelligence, autonomous driving technology will finally reshape an automotive industry. Although fully autonomous cars are not commercially available to common consumers at this stage, partial driving automation and conditional driving automation, which are defined as level 2 and level 3 automation by SAE J3016 standard respectively, are widely tested by automakers and researchers. A typical Human-Machine-Interface (HMI) for a vehicle takes a form to support a human domination role. Although modern driving assistance systems allow vehicles to take over control at certain scenarios, the typical human-machine-interface has not changed dramatically for a long time. With deep learning neural network technologies penetrating into automotive applications, multi-modal communications between a drive and a vehicle can be enabled by a cost-effective solution. The multi-modal human-machine-interface will allow a driver to easily interact with autonomous vehicles, supporting smooth switching between human manual control and automation. However, unlike a steering wheel of vehicles, there is no normal or standard multi-modal human-machine-interface for autonomous vehicles. Moreover, unlike buttons and knobs, which cause little confusions in applications across different countries, multi-modal communications are affected by cultural nuances. Automotive Original Equipment Manufacturers (OEMs) can promote the typical human-machine-interface in different countries or automotive markets with little adaption, but OMEs need to adjust multi-modal human-machine-interface by taking into consideration cultural impacts, driving habits, social cognition and a traffic legal system. Design methodologies for human-machine-interface systems on different level autonomous vehicles are elaborated. The goal of multi-modal human-machine-interface in partial driving (level 2 automation) and conditional driving (level 3 automation) autonomous vehicles is not only to mitigate driver’s fatigue during driving, but also keep certain amount of driver’s engagement to ensure that the driver can take over control in a short time when the switching is necessary. The two sides of the design goal of multi-modal HMI systems are actually on a trade-off curve. Methodologies to optimize multi-modal communications to support HMI design are elaborated and compared in this paper as well.
SAE MOBILUS Subscriber? You may already have access.
Attention: This item is not yet published. Pre-Order to be notified, via email, when it becomes available.
Members save up to 36% off list price.
HTML for Linking to Page
Page URL

Related Items

Technical Paper / Journal Article
Training / Education
Technical Paper / Journal Article
Training / Education
Technical Paper / Journal Article
Technical Paper / Journal Article