Recent experiments on the quasi-one-dimensional (1D) antiferromagnets R2BaNiO5 (R=rare earth) have shown the existence of purely 1D Haldane gap excitations propagating on the Ni chains. Below an ordering temperature, the gap excitations survive and coexist with the conventional spin waves in the ordered phase. We construct a model mixed-spin system in 2D for which the ground state can be exactly specified. Using the matrix product method, we show the existence bf Haldane gap excitations in the ordered phase. We consider different cases of ordering to study the effect of ordering on the degeneracy of the Haldane gap excitations. [S0163-1829(99)03638-3].