The magnetic and gravitational fields (for a uniform applied magnetic intensity H) are found by solving the Einstein-Maxwell field equations exactly. A neutral test mass placed in the gravitational field induced by the Maxwell stress tensor is shown to exhibit "diamagnetic properties" of purely gravitational origin, which leads to two important consequences. Gravity confines magnetic fields and all objects possess a universal gravitationally induced dipole moment.