Landmark-Based Pedestrian Navigation with Enhanced Spatial Reasoning

Computer vision techniques can enhance, landmark-based navigation by better utilizing online photo collections. We use spatial reasoning to compute camera poses, which are then registered to the world using GPS information extracted from the image tags. Computed camera pose is used to augment the images with navigational arrows that fit the environment. We develop a system to use high-level reasoning to influence the selection of landmarks along a navigation paths and lower-level reasoning to select appropriate images of those landmarks. We also utilize all image matching pipeline based oil robust, local descriptors to give users of the system the ability to capture all image and receive navigational instructions overlaid oil their current: context. These enhancements to our previous navigation system produce a more natural navigation plan and more understandable images in a fully automatic way.