In this paper I argue three things: (1) that the interactionist view underlying Benacerraf's (1973) challenge to mathematical beliefs renders inexplicable the reliability of most of our beliefs in physics; (2) that examples from mathematical physics suggest that we should view reliability differently; and (3) that abstract mathematical considerations are indispensable to explanations of the reliability of our beliefs.