Taguchi's robust design technique, also known as parameter design, focuses on making product and process designs insensitive (i.e., robust) to hard-to-control variations. In some applications, however, his approach of modeling expected loss and the resulting ''product array'' experimental format leads to unnecessarily expensive and less informative experiments. The response model approach to robust design proposed by Welch, Ku, Yang, and Sacks (1990), Box and Jones (1990), Lucas (1989), and Shoemaker, Tsui and Wu (1991) offers more flexibility and economy in experiment planning and more informative modeling. This paper develops a formal basis for the graphical data-analytic approach presented in Shoemaker et al. In particular, we decompose overall response variation into components representing the variability contributed by each noise factor, and show when this decomposition allows us to use individual control-by-noise interaction plots to minimize response variation. We then generalize the control-by-noise interaction plots to extend their usefulness, and develop a formal analysis strategy using these plots to minimize response variation. We consider both the fixed noise effect case and the situation when noise effects are random, leading to a mixed effects response model.