Registration of vehicle based panoramic image and LiDAR point cloud

Higher quality surface information would be got when data from optical images and LiDAR were integrated, owing to the fact that optical images and LiDAR point cloud have unique characteristics that make them preferable in many applications. While most previous works focus on registration of pinhole perspective cameras to 2D or 3D LiDAR data. In this paper, a method for the registration of vehicle based panoramic image and LiDAR point cloud is proposed. Using the translation among panoramic image, single CCD image, laser scanner and Position and Orientation System (POS) along with the GPS/IMU data, precise co-registration between the panoramic image and the LiDAR point cloud in the world system is achieved. Results are presented under a real world data set collected by a new developed Mobile Mapping System (MMS) integrated with a high resolution panoramic camera, two laser scanners and a POS.