We consider the action of p-toral subgroups of U(n) on the unitary partition complex L-n. We show that if H subset of U(n) is p-toral and has noncontractible fixed points on L-n, then the image of H in the projective unitary group U(n)/S-1 is an elementary abelian p-group.