This article argues against a leading cognitivist and moral interpretation of shame that is present in the philosophical literature. That standard view holds that shame is the felt-response to a loss of self-esteem, which is the result of negative self-assessment. I hold that shame is a heteronomous and primitive bodily affect that is perceptual rather than judgmental in nature. Shame results from the breakdown and thwarting of our desire for anonymous, unexceptional, and disattentive co-existence with others. I use the sociological theory of Erving Goffman and the theory of shame found in philosophical anthropology to support this view. I also use the cases of shame and chronic shame that often accompany disability to show that shame is separable from negative self-assessment and, instead, emerges as an affective response to a world (of equipment, things, and people) that disallows unburdened and unreflective interpersonal equilibrium.