In a recent inelastic neutron scattering experiment in the pseudogap state of the high-temperature superconductor YBa2Cu3O6.6, an unusual "vertical" dispersion of the spin excitations with a large in-plane anisotropy was observed. In this paper, we discuss in detail the spin susceptibility of the singlet d-density wave, the triplet d-density wave as well as the more common spin density wave orders with hopping anisotropies. From numerical calculations within the framework of random phase approximation, we find nearly vertical dispersion relations for spin excitations with anisotropic incommensurability at low energy omega <= 90 meV, which are reminiscent of the experiments. At very high energy omega >= 165 meV, we also find energy-dependent incommensurability. Although there are some important differences between the three cases, unpolarized neutron measurements cannot discriminate between these alternate possibilities; the vertical dispersion, however, is a distinct feature of all three density wave states in contrast to the superconducting state, which shows an hour-glass shape dispersion.