Automatic usability data acquisition and interface simulation using stereolithography mock-up and internal video analysis

In this paper, we propose anew type of mock-up consisting of a transparent solid object, fabricated by stereolithography, with a small video camera embedded inside. By processing the video image of the object surface taken from the inside in real time, operation data of the mock-up (e.g., when interfaces such as buttons and dials are operated by the users) and usage (e.g., which hand and fingers are used to operate the buttons and dials of the mock-up) data can be obtained. Consequently, a simple stereolithography model without sensors or circuits can be a functional mock-up. By analyzing these automatically obtained usage data, operation data and the result of functional simulation, some usability data will be obtained or extracted. Designers can use such data to improve the usability of the product that the mock-up imitates. The feasibility and validity of the concept is confirmed and reported on the basis of three experiments: a basic experiment using a simple mock-up consisting of a button and a dial, and two detailed experiments on usability data acquisition and the simulation of a Japanese-character-input interface using stereolithography mock-ups with a small fish-eye video camera inside.