A system of homogeneous integro-differential equations in transverse components of the magnetic field and longitudinal component of the electric field is formulated. The system makes it possible to give a rigorous description of leaky and guided modes of optical fibers with transverse anisotropy. An analysis is made of the leaky modes in fibers with step and graded profiles of the dielectric constant tensor. Examples are given that illustrate the efficiency of the approach.