An AV control method using natural language understanding

This paper proposes a method of generating the user interface of an AV controller that reduces the sequences of operation by using natural language understanding and reasoning technology, and controls the AV system automatically. To confirm the validity of this system, we constructed a prototype system using a 32-bit embedded microcomputer with which the user communicates with the terminals. When the AV system has a lot of functions, the AV controller doesn't need to display a lot of icons. The user doesn't need to select an icon from many icons displayed on the screen or touch panel, because the user can communicate with the AV controller. As a result, when the user uses this proposed system, the user interface approximates to the user's mental image more than previously proposed systems. We can confirm that the user can control AV devices more easily than with the conventional operation.