Based on image moment, an adaptive controller is presented by using visual information in feedback loop. The controller is designed to compensate for full robot dynamics, and reduce the design sensitivity due to robot and payload dynamics uncertainties. It is proved that the control system can achieve the motion control objective in the image coordinate system.