Guided Sampling for Multistructure Data via Neighborhood Consensus and Residual Sorting

Robust model fitting is a critical technique for artificial intelligence. The performance of most robust model fitting techniques heavily depends on the use of sampling algorithms. In this paper, we propose an efficient guided sampling algorithm for multi-structure data by using the neighborhood consensus and the residual sorting. Specifically, a Neighborhood Consensus based Strategy (NCS) is first proposed to select the first datum (i.e., seed datum) of a minimal subset, and then a Residual Sorting based Strategy (RSS) samples the rest data of the minimal subset based on the seed datum. This strategy effectively combines the benefits of neighborhood consensus and residual sorting, where neighborhood consensus can judge whether a selected data point is an inlier, and residual sorting encourages this strategy to select data points from the same structure of the first selected data point. Moreover, to achieve better fitting performance, the Markov Chain Monte Carlo process is used to combine NCS with the random selection strategy to select the seed datum, and an appropriate size is set to the initial block of randomly sampled hypotheses for RSS. Experimental results on three vision tasks (e.g., two-view motion segmentation and 3D motion segmentation) demonstrate that the proposed algorithm achieves superior performance to several state-of-the-art sampling algorithms.