In recent years, research on Voice Assistant has been actively conducted in the areas of human interaction and lifestyle. The characteristic that only voice can interact with the device was noted for its usability in vehicles, and a number of studies were conducted to prove the effectiveness of an intelligent personal assistant (IPA) in Human-Vehicle interaction (HVI) studies. Vehicles not only enable movement but are also private spaces owned by individuals. In this paper, we examine how the user's car space is privacy-protected when using IPA with voice interaction and confirm that it provides a suitable function for the driving context, which is the original role of the car. The range of vehicles in this document includes not only private vehicles but also cultures, such as carpooling and car sharing. The experiment was conducted with Wizard of Oz prototyping designed on the basis of the current IPAlevel of functions and information, and participants were subjected to in-depth interviews after driving the simulator. Through in-depth interviews, the lack of IPA functions and the needs of voice interaction were confirmed, and the possibility of invasion of privacy of personal information was found in the overall function. The experimental results are intended to suggest not only functional and privacy suggestions for HVI when using IPA but also implications for the development of various vehicle services in the future.