Does Wittgenstein have a coherent philosophy of mathematics? Here, I will be concerned with showing that the answer is positive. However, given that his life-long philosophical perspective on mathematics tends to be misleading, I focus on the specific problem posed by Paul Benacerraf in Mathematical Truth' (1973), that is: the puzzle about how to reconcile the metaphysics with the epistemology for mathematics. My aim is to show that there is an adequate anti-platonistic solution to that puzzle in the mature writings of the Austrian philosopher.