Self-gravitating stability of a rotating fluid layer

The self-gravitating instability of the present model is discussed by using a simple linear theory. The problem is formulated for a rotating fluid layer, and a dispersion relation valid for all kinds of perturbations is derived and discussed. The self-gravitating force is found to be a destabilizing factor for a small range of wavenumbers, while it is stabilizing in other ranges, depending on the density ratio of the fluids. For high values of the angular velocity, the rotational force produces a stabilizing effect and can suppress the self-gravitating instability. In the absence of the self-gravitating force, the model of a rotating fluid layer is marginally stable.