Solving photogrammetric cold cases using AI-based image matching: New potential for monitoring the past with historical aerial images

被引:6
|
作者
Maiwald, Ferdinand [1 ]
Feurer, Denis [2 ]
Eltner, Anette [1 ]
机构
[1] Tech Univ Dresden, Inst Photogrammetry & Remote Sensing, Helmholtzstr 10, D-01069 Dresden, Germany
[2] Univ Montpellier, Inst Agro Montpellier, INRAE, UMR LISAH,IRD,AgroParisTech, 2 Pl Pierre Viala, F-34060 Montpellier, France
关键词
Historical aerial images; Feature matching; Neural networks; Structure-from-motion; Digital surface model; Multi-temporal; EVOLUTION;
D O I
10.1016/j.isprsjprs.2023.11.008
中图分类号
P9 [自然地理学];
学科分类号
0705 ; 070501 ;
摘要
With the ongoing digitization in archives, an increasing number of historical data becomes available for research. This includes historical aerial images which provide detailed information about the depicted area. Among the applications enabled by these images are change detection of land use, land cover, glaciers, and coastal environments as well as the observation of land degradation, and natural hazards. Studying the depicted areas and occurring 3D deformations requires the generation of a digital surface model (DSM) which is usually obtained via photogrammetric Structure-from-Motion (SfM). However, conventional SfM workflows often fail in registering historical aerial images due to their radiometric characteristics introduced by digitization, original image quality, or vast temporal changes between epochs. We demonstrate that the feature matching step in the Structure from Motion (SfM) pipeline is particularly crucial. To address this issue, we apply the two synergetic neural network methods SuperGlue and DISK, improving feature matching for historical aerial images. This requires several modifications to enable rotational invariance and leveraging the high resolution of aerial images. In contrast to other studies our workflow does not require any prior information such as DSMs, flight height, focal lengths, or scan resolution which are often no more extent in archives. It is shown that our methods using adapted parameter settings are even able to deal with quasi texture-less images. This enables the simultaneous processing of various kind of mono-temporal and multi-temporal data handled in a single workflow from data preparation over feature matching through to camera parameter estimation and the generation of a sparse point cloud. It outperforms conventional strategies in the number of correct feature matches, number of registered images and calculated 3D points and allows the generation of multi-temporal DSMs with high quality.With the flexibility of the method, it enables the automatic processing of formerly unusable or only to be interactively processed data, e.g. aerial images where the flight route is unknown, or with difficult radiometric properties. This makes it possible to go back even further in time, where the data quality usually decreases, and enables a holistic monitoring and comparison of environments of high interest. The code is made publicly available at https://github.com/tudipffmgt/HAI-SFM.
引用
收藏
页码:184 / 200
页数:17
相关论文
共 5 条
  • [1] AI-based security in cyberspace for medical images using image translation
    Manjula, S.
    Valarmathi, K.
    JOURNAL OF THE CHINESE INSTITUTE OF ENGINEERS, 2025,
  • [2] Examination of inline process monitoring of the cross-wedge rolling process using AI-based image recognition
    Merkel, Paulina
    Doede, Nils
    Kriwall, Mareile
    Stonis, Malte
    Behrens, Bernd-Arno
    PRODUCTION ENGINEERING-RESEARCH AND DEVELOPMENT, 2024,
  • [3] Building Change Detection from Historical Aerial Photographs Using Dense Image Matching and Object-Based Image Analysis
    Nebiker, Stephan
    Lack, Natalie
    Deuber, Marianne
    REMOTE SENSING, 2014, 6 (09) : 8310 - 8336
  • [4] Testing a New Ensemble Vegetation Classification Method Based on Deep Learning and Machine Learning Methods Using Aerial Photogrammetric Images
    Drobnjak, Sinisa
    Stojanovic, Marko
    Djordjevic, Dejan
    Bakrac, Sasa
    Jovanovic, Jasmina
    Djordjevic, Aleksandar
    FRONTIERS IN ENVIRONMENTAL SCIENCE, 2022, 10
  • [5] A study of Japanese landscapes using structure from motion derived DSMs and DEMs based on historical aerial photographs: New opportunities for vegetation monitoring and diachronic geomorphology
    Gomez, Christopher
    Hayakawa, Yuichi
    Obanawa, Hiroyuki
    GEOMORPHOLOGY, 2015, 242 : 11 - 20