Dissertation/Thesis Abstract

Multi-Modality Fusion: Registering Photographs, Videos, and Lidar Range Scans
by Morago, Brittany, Ph.D., University of Missouri - Columbia, 2017, 292; 10629015
Abstract (Summary)

2D images and 3D LIDAR range scans provide very different but complementing information about a single subject and, when registered, can be used for a variety of exciting applications. Video sets can be fused with a 3D model and played in a single multi-dimensional environment. Imagery with temporal changes can be visualized simultaneously, unveiling changes in architecture, foliage, and human activity. Depth information for 2D photos and videos can be computed. Real-world measurements can be provided to users through simple interactions with traditional photographs. However, fusing multi-modality data is a very challenging task given the repetition and ambiguity that often occur in man-made scenes as well as the variety of properties different renderings of the same subject can possess. Image sets collected over a period of time during which the lighting conditions and scene content may have changed, different artistic renderings, varying sensor types, focal lengths, and exposure values can all contribute to visual variations in data sets. This dissertation addresses these obstacles using the common theme of incorporating contextual information to visualize regional properties that intuitively exist in each imagery source. We combine hard features that quantify the strong, stable edges that are often present in imagery along object boundaries and depth changes with soft features that capture distinctive texture information that can be unique to specific areas. We show that our detector and descriptor techniques can provide more accurate keypoint match sets between highly varying imagery than many traditional and state-of-the-art techniques, allowing us to fuse and align photographs, videos, and range scans containing both man-made and natural content.

Indexing (document details)
Advisor: Duan, Ye
School: University of Missouri - Columbia
Department: Computer Science
School Location: United States -- Missouri
Source: DAI-B 78/11(E), Dissertation Abstracts International
Subjects: Computer science
Keywords: 2D-3D fusion, Computer vision, Image matching, LIDAR, Multi-modality, Registration
Publication Number: 10629015
ISBN: 978-1-369-99118-5
Copyright © 2020 ProQuest LLC. All rights reserved. Terms and Conditions Privacy Policy Cookie Policy