Fabio Remondino

Fabio Remondino
Fondazione Bruno Kessler | FBK · 3D Optical Metrology

PhD

About

429
Publications
394,408
Reads
How we measure 'reads'
A 'read' is counted each time someone views a publication summary (such as the title, abstract, and list of authors), clicks on a figure, or views or downloads the full-text. Learn more
15,623
Citations
Citations since 2016
172 Research Items
11423 Citations
201620172018201920202021202205001,0001,500
201620172018201920202021202205001,0001,500
201620172018201920202021202205001,0001,500
201620172018201920202021202205001,0001,500
Additional affiliations
January 1999 - August 2007
ETH Zurich
Position
  • Research Assistant

Publications

Publications (429)
Article
Full-text available
Currently, there is a rapid trend in the production of airborne sensors consisting of multi-view cameras or hybrid sensors, i.e., a LiDAR scanner coupled with one or multiple cameras to enrich the data acquisition in terms of colors, texture, completeness of coverage, accuracy, etc. However, the current UAV hybrid systems are mainly equipped with a...
Article
Full-text available
Image-based 3D reconstruction has been employed in industrial metrology for micro-measurements and quality control purposes. However, generating a highly-detailed and reliable 3D reconstruction of non-collaborative surfaces is still an open issue. In this paper, a method for generating an accurate 3D reconstruction of non-collaborative surfaces thr...
Article
Full-text available
The colorization of grayscale images can, nowadays, take advantage of recent progress and the automation of deep-learning techniques. From the media industry to medical or geospatial applications, image colorization is an attractive and investigated image processing practice, and it is also helpful for revitalizing historical photographs. After exp...
Article
Key-frame selection methods were developed in the past years to reduce the complexity of frame processing in visual odometry (VO) and visual simultaneous localization and mapping (VSLAM) algorithms. Key-frames help increasing algorithm's performances by sparsifying frames while maintaining its accuracy and robustness. Unlike current selection metho...
Article
Finding robust and correct keypoints in images remains a challenge, especially when repetitive patterns are present. In this article, we propose a universal two-step filtering method to solve the mismatch problem in repetitive patterns. Having applied a mean-shift clustering algorithm to remove obvious mismatches, the proposed confusion reduction (...
Article
Full-text available
Automatic photogrammetric processing of historical (or archival) aerial photos is still a challenging task, particularly in cases of missing ancillary information, low radiometric and image quality, limited stereo coverage or large temporal span. However, with recent advances in photogrammetry and Artificial Intelligence (AI) algorithms for image p...
Article
Full-text available
Given the importance of key-frame selection in determining the positioning accuracy of Simultaneous Localization And Mapping (SLAM) and Odometry algorithms, and the urgent need in this field for a flexible key-frame selection algorithm, this paper proposes a novel and geometric method for key-frame selection built on top of ORB-SLAM3. It takes a ke...
Article
Full-text available
Aerial triangulation (AT) has reached outstanding progress in the last decades, and now fully automated solutions for nadir and oblique images are available. Usually, image correspondences (tie points) are found using hand-crafted methods, such as SIFT or its variants. But in the last years, there were many investigations and developments to promot...
Article
Full-text available
Despite the recent success of learning-based monocular depth estimation algorithms and the release of large-scale datasets for training, the methods are limited to depth map prediction and still struggle to yield reliable results in the 3D space without additional scene cues. Indeed, although state-of-the-art approaches produce quality depth maps,...
Article
Full-text available
Long-term monitoring projects are becoming more than ever crucial in assessing the effects of climate change on marine communities, especially in Antarctica, where these changes are expected to be particularly dramatic. Detailed studies of the Antarctic benthos are in fact particularly important for a better understanding of benthos dynamics and po...
Article
Full-text available
The identification of accurate and reliable image correspondences is fundamental for Structure-from-Motion (SfM) photogrammetry. Alongside handcrafted detectors and descriptors, recent machine learning-based approaches have shown promising results for tie point extraction, demonstrating matching success under strong perspective and illumination cha...
Article
Full-text available
In the field of industrial metrology, there is a rising need for 3D information at a very high resolution for micro-measurements and quality control of transparent objects such as glass bottles (beer, wine, cola, cosmetics, etc.). However, such objects are particularly challenging for optical-based 3D reconstruction methods and systems such as phot...
Article
Full-text available
In recent years, massive digitisation of cultural heritage (CH) assets has become a focus of European programmes and initiatives. Among CH settings, attention is reserved to the immense and precious museum collections, whose digital 3D reproduction can support broader non-invasive analyses and stimulate the realisation of more attractive and intera...
Article
Full-text available
The generation of digital surface models (DSMs) from multi-view high-resolution (VHR) satellite imagery has recently received a great attention due to the increasing availability of such space-based datasets. Existing production-level pipelines primarily adopt a multi-view stereo (MVS) paradigm, which exploit the statistical depth fusion of multipl...
Article
Three-dimensional (3D) measurement of non-collaborative surfaces is still an open research topic. This paper investigates and quantifies for the first time the effect of light directionality and fusion of multiple images as a method to improve the quality of photogrammetric 3D reconstruction. For this aim, an image acquisition system that employs m...
Article
Full-text available
The extraction of reliable and repeatable interest points among images is a fundamental step for automatic image orientation (Structure-From-Motion). Despite recent progresses, open issues in challenging conditions - such as wide baselines and strong light variations - are still present. Over the years, traditional hand-crafted methods have been pa...
Article
Full-text available
3D point clouds are robust representations of real-world objects and usually contain information about the shape, size, position and radiometry of the scene. However, unstructured point clouds do not directly exploit the full potential of such information and thus, further analysis is commonly required. Especially when dealing with cultural heritag...
Article
Full-text available
In recent years, a growing interest in the 3D digitisation of museum assets has been pushed by the evident advantages of digital copies in supporting and advancing the knowledge, preservation and promotion of historical artefacts. Realising photo-realistic and precise digital twins of medium and small-sized movable objects implies several operation...
Article
Full-text available
Airborne LiDAR technology has become an essential tool in archaeology during the last two decades since it allows archaeologists to measure and map items or structures that would otherwise be hidden under vegetation. In order to detect and characterise the archaeological evidence, it is a common practice to extract accurate digital terrain models (...
Chapter
Full-text available
Image matching, as the task of finding correspondences in images, is the upstream component of vision and photogrammetric applications aiming at the reconstruction of 3D scenes, their understanding and comparison. Such applications are of special importance in the context of cultural heritage, as they can support archaeologists to digitally preserv...
Article
Full-text available
Among the existing Cultural Heritage settings, Underground Built Heritage (UBH) represents a peculiar case. The scarce or lack of knowledge and documentation of these spaces frequently limits their proper management, exploitation, and valorization. When mapping these environments for documentation purposes, the primary need is to achieve a complete...
Article
Full-text available
This work presents an advanced photogrammetric pipeline for inspecting apple trees in the field, automatically detecting fruits from videos and quantifying their size and number. The proposed approach is intended to facilitate and accelerate farmers' and agronomists' fieldwork, making apple measurements more objective and giving a more extended col...
Article
Full-text available
Augmented Reality (AR) is already transforming many fields, from medical applications to industry, entertainment and heritage. In its most common form, AR expands reality with virtual 3D elements, providing users with an enhanced and enriched experience of the surroundings. Until now, most of the research work focused on techniques based on markers...
Article
Full-text available
In recent years, Artificial Intelligence (AI) methods for 3D point cloud classification has assumed an essential role in the heritage field. The association of semantic information to 3D representations became a valuable instrument for measurement, analysis, education or maintenance, in particular in the Cultural Heritage (CH) sector. Moreover, the...
Article
Los centros urbanos históricos son escenarios complejos para su reconstrucción tridimensional. Los avances en la reconstrucción automática son de gran utilidad para realizar análisis urbanísticos que de otra manera requerirían un elevado esfuerzo humano. En este artículo, se derivarán de forma automática parámetros urbanísticos para el análisis de...
Article
Full-text available
The number of approaches available for semantic segmentation of point clouds has grown exponentially in recent years. The availability of numerous annotated datasets has resulted in the emergence of deep learning approaches with increasingly promising outcomes. Even if successful, the implementation of such algorithms requires operators with a high...
Article
Full-text available
The growing deployment of multi-head camera systems encouraged the emergence of specific processing algorithms, able to face the challenges posed by slanted view geometry. Such multi-camera systems are rigidly tied by their manufacturers hence the exploitation of this internal constraint should be further exploited. Several approaches have been pro...
Article
Full-text available
ISPRS Technical Commission II focuses, at various scales, on geometric, radiometric and multi-temporal aspects of image- and range-based 3D surveying and modeling. Specifically, Commission II deals with image orientation, point cloud generation and processing, 3D feature extraction, dynamic and static scene analysis, sensor and data fusion, and mac...
Article
Full-text available
Mesh models generated by multi view stereo (MVS) algorithms often fail to represent in an adequate manner the sharp, natural edge details of the scene. The harsh depth discontinuities of edge regions are eventually a challenging task for dense reconstruction, while vertex displacement during mesh refinement frequently leads to smoothed edges that d...
Article
Full-text available
Image orientation is a fundamental task in photogrammetric applications and it is performed by extracting keypoints with hand-crafted or learning-based methods, generating tie points among the images and running a bundle adjustment procedure. Nowadays, due to large number of extracted keypoints, tie point filtering approaches attempt to eliminate r...
Article
Full-text available
The image orientation (or Structure from Motion – SfM) process needs well localized, repeatable and stable tie points in order to derive camera poses and a sparse 3D representation of the surveyed scene. The accurate identification of tie points in large image datasets is still an open research topic in the photogrammetric and computer vision commu...
Article
Full-text available
3D digital reconstruction techniques are extensively used for quality control purposes. Among them, photogrammetry and photometric stereo methods have been for a long time used with success in several application fields. However, generating highly-detailed and reliable micro-measurements of non-collaborative surfaces is still an open issue. In thes...
Article
Full-text available
Photogrammetry needs known geometric elements to provide metric traceable measurements. These known elements can be a distance between two three-dimensional object points or two camera stations, or a combination of known coordinates and/or angles to solve the seven degrees of freedom that lead to rank deficiency of the normal-equation matrix. In th...
Article
Full-text available
ISPRS Technical Commission II focuses, at various scales, on geometric, radiometric and multi-temporal aspects of image- and range-based 3D surveying and modeling. Specifically, Commission II deals with image orientation, point cloud generation and processing, 3D feature extraction, dynamic and static scene analysis, sensor and data fusion, and mac...
Article
Full-text available
Mobile and handheld mapping systems are becoming widely used nowadays as fast and cost-effective data acquisition systems for 3D reconstruction purposes. While most of the research and commercial systems are based on active sensors, solutions employing only cameras and photogrammetry are attracting more and more interest due to their significantly...
Article
Full-text available
With recent advances in technologies, deep learning is being applied more and more to different tasks. In particular, point cloud processing and classification have been studied for a while now, with various methods developed. Some of the available classification approaches are based on specific data source, like LiDAR, while others are focused on...
Article
Full-text available
Imaging network design is a crucial step in most image-based 3D reconstruction applications based on Structure from Motion (SfM) and multi-view stereo (MVS) methods. This paper proposes a novel photogrammetric algorithm for imaging network design for building 3D reconstruction purposes. The proposed methodology consists of two main steps: (i) the g...
Article
Full-text available
Automatic detection and recognition of traffic signs from images is an important topic in many applications. At first, we segmented the images using a classification algorithm to delineate the areas where the signs are more likely to be found. In this regard, shadows, objects having similar colours, and extreme illumination changes can significantl...
Article
Full-text available
Image matching is one of the most important tasks in Unmanned Arial Vehicles (UAV) photogrammetry applications. The number and distribution of extracted keypoints play an essential role in the reliability and accuracy of image matching and orientation results. Conventional detectors generally produce too many redundant keypoints. In this paper, we...
Article
Full-text available
Conventional multi-view stereo (MVS) approaches based on photo-consistency measures are generally robust, yet often fail in calculating valid depth pixel estimates in low textured areas of the scene. In this study, a novel approach is proposed to tackle this challenge by leveraging semantic priors into a PatchMatch-based MVS in order to increase co...
Article
Full-text available
The increasing importance of three-dimensional (3D) city modelling is linked to these data’s different applications and advantages in many domains. Images and Light Detection and Ranging (LiDAR) data availability are now an evident and unavoidable prerequisite, not always verified for past scenarios. Indeed, historical maps are often the only sourc...
Article
A big challenge in geodata processing is the seamless and accurate integration of airborne LiDAR (Light Detection And Ranging) and photogrammetric point clouds performed by properly considering their high variations in resolution and precision. In this paper we propose a new approach to co-register airborne point clouds acquired by LiDAR sensors an...
Article
Full-text available
The paper reports some methods to select the optimal number of neighbors and to use eigenfeatures for aerial point cloud classification. In the literature, the neighborhood selection is performed using different methods. In this paper, we propose an approach that uses the region growing algorithm. The input data is an aerial point cloud, part of th...
Article
Full-text available
The performance of an image enhancer is usually evaluated either perceptually or functionally. The perceptual evaluation is carried out from a human perspective, i.e. by considering features related to human perception of image content and details. The functional evaluation is made instead from a machine perspective, i.e. by judging the enhancer ef...
Chapter
Objects class, depth, and shape are instantly reconstructed by a human looking at a 2D image. While modern deep models solve each of these challenging tasks separately, they struggle to perform simultaneous scene 3D reconstruction and segmentation. We propose a single shot image-to-semantic voxel model translation framework. We train a generator ad...
Article
This paper presents the development of a vision metrology system for high-accuracy three-dimensional measurements of large structures requiring dimensional tolerancing. The proposed system integrates a V-STARS N platinum photogrammetric system from Geodetic Systems, a DJI M600 Pro UAS with Ronin-MX gimbal and a dual antenna for real-time kinematic...
Article
Full-text available
The image-based 3D reconstruction pipeline aims to generate complete digital representations of the recorded scene, often in the form of 3D surfaces. These surfaces or mesh models are required to be highly detailed as well as accurate enough, especially for metric applications. Surface generation can be considered as a problem integrated in the com...
Article
Full-text available
The latest advances in technical characteristics of unmanned aerial systems (UAS) and their onboard sensors opened the way for smart flying vehicles exploiting new application areas and allowing to perform missions seemed to be impossible before. One of these complicated tasks is the 3D reconstruction and monitoring of large-size, complex, grid-lik...
Article
Full-text available
The paper presents an efficient photogrammetric workflow to improve the 3D reconstruction of scenes surveyed by integrating terrestrial and Unmanned Aerial Vehicle (UAV) images. In the last years, the integration of this kind of images has shown clear advantages for the complete and detailed 3D representation of large and complex scenarios. Neverth...
Article
Full-text available
In recent years semantic segmentation of 3D point clouds has been an argument that involves different fields of application. Cultural heritage scenarios have become the subject of this study mainly thanks to the development of photogrammetry and laser scanning techniques. Classification algorithms based on machine and deep learning methods allow to...
Article
Full-text available
Automatic feature matching is a crucial step in Structure-from-Motion (SfM) applications for 3D reconstruction purposes. From an historical perspective we can say now that SIFT was the enabling technology that made SfM a successful and fully automated pipeline. SIFT was the ancestor of a wealth of detector/descriptor methods that are now available....
Article
Full-text available
The lack of benchmarking data for the semantic segmentation of digital heritage scenarios is hampering the development of automatic classification solutions in this field. Heritage 3D data feature complex structures and uncommon classes that prevent the simple deployment of available methods developed in other fields and for other types of data. Th...
Article
Full-text available
The recent years saw an extensive use of 3D point cloud data for heritage documentation, valorisation and visualisation. Although rich in metric quality, these 3D data lack structured information such as semantics and hierarchy between parts. In this context, the introduction of point cloud classification methods can play an essential role for bett...
Article
Full-text available
Objects and structures realized by connecting and bending wires are common in modern architecture, furniture design, metal sculpting, etc. The 3D reconstruction of such objects with traditional range- or image-based methods is very difficult and poses challenges due to their unique characteristics such as repeated structures, slim elements, holes,...
Article
Full-text available
Image-based 3D models generation typically involves three stages, namely: 2D image acquisition, data processing, and 3D surface generation and editing. The availability of different easy-to-use and low-cost image acquisition solutions, combined with open-source or commercial processing tools, has democratized the 3D reconstruction and digital twin...
Article
Full-text available
ISPRS Technical Commission II focuses, at various scales, on geometric, radiometric and multi-temporal aspects of image- and range-based 3D surveying and modeling. Specifically, Commission II deals with image orientation, point cloud generation and processing, 3D feature extraction, scene understanding, sensor and data fusion, sensor characterizati...
Article
Full-text available
ISPRS Technical Commission II focuses, at various scales, on geometric, radiometric and multi-temporal aspects of image- and range-based 3D surveying and modeling. Specifically, Commission II deals with image orientation, point cloud generation and processing, 3D feature extraction, scene understanding, sensor and data fusion, sensor characterizati...
Preprint
Full-text available
Patch-based stereo is nowadays a commonly used image-based technique for dense 3D reconstruction in large scale multi-view applications. The typical steps of such a pipeline can be summarized in stereo pair selection, depth map computation, depth map refinement and, finally, fusion in order to generate a complete and accurate representation of the...