Pierre Grussenmeyer

INSA Strasbourg · Department of Civil Engineering and Surveying

In this paper an exhaustive review and comprehensive analysis of recent and former deep learning methods in 3D Semantic Segmentation (3DSS) is presented. In the related literature, the taxonomy scheme used for the classification of the 3DSS deep learning methods is ambiguous. Based on the taxonomy schemes of 9 existing review papers, a new taxonomy...

In recent years novel 3D reconstruction methods have been developed to improve the conventional image-based point cloud generation techniques. These novel methods generally attempt to address various challenges encountered in conventional methods, namely, the reconstruction of reflective surfaces and the amount of processing time required, both of...

In the domain of architectural heritage conservation, the recent advancements in 3D modeling have significantly improved the reconstruction fidelity of historical edifices, particularly medieval castles of the Rhine region. The existing traditional 3D modeling methodologies, though precise, are laborious and exceedingly time-consuming, requiring a...

As underground infrastructures suffer from strikes during the ground excavation procedure resulting from poor subsurface utilities documentation, this paper aims to improve the mapping of such elements by integrating instance segmentation techniques. To perform supervised training of the well-known Mask R-CNN architecture, we created our own datase...

As evidence of ancient Majapahit civilization existence, Sanggrahan Temple has been officially recognized as a cultural heritage building by Indonesian government in 2019. Sanggrahan temple is located in Boyolangu District, Tulungagung Regency, East Java. Conservation efforts in Sanggrahan temple have been done by BPK Wilayah XI Jawa Timur . Many p...

In recent decades, photogrammetry has re-emerged as a viable solution for heritage documentation. Developments in various computer vision methods have helped photogrammetry to compete against the laser scanning technology, eventually becoming complementary solutions for the purpose of heritage recording. In the last few years, artificial intelligen...

Over the past decade, the use of machine learning and deep learning algorithms to support 3D semantic segmentation of point clouds has significantly increased, and their impressive results has led to the application of such algorithms for the semantic modeling of heritage buildings. Nevertheless, such applications still face several significant cha...

During the last decade, the use of machine and deep learning tools to support 3D semantic segmentation of point clouds remarkably increased and their impressive results have led to the application of such methods to the semantic modeling of heritage buildings. Nevertheless, a standard procedure to deal with such problem is still missing, and severa...

Depth information is a key component that allows a computer to reproduce human vision in plenty of applications from manufacturing, to robotics and autonomous driving. The Microsoft Kinect has brought depth sensing to another level resulting in a large number of low cost, small form factor depth sensors. Although these sensors can efficiently produ...

Nowadays, Mobile Laser Scanning (MLS) systems are more and more used to realize extended topographic surveys of roads. Most of them provide for each measured point an attribute corresponding to a return signal strength, so called intensity value. This value enables to easily understand uncolored MLS as it helps to differentiate materials based on t...

Dense point clouds acquired with a mobile laser scanning system (MLS) device become usual raw data for different surveyor applications: topographic maps, 3D models, road inventories, risk assessment of vegetation on road or railroads. Thanks to important evolutions in technologies, MLS devices became powerful and very popular. In the meantime, the...

Real-world three-dimensional reconstruction is a project of long-standing interest in global computer vision. Many tools have emerged these past years to accurately perceive the surrounding world either through active sensors or through passive algorithmic methods. With the advent and popularization of augmented reality on smartphones, new visualiz...

Mangrove forests play an important role in the balance of biodiversity. However, they are threatened by agriculture, aquaculture, urbanization and global warming. That’s why it is imperative to monitor this ecosystem and understand how it evolves in the face of these threats in order to better preserve it. The traditional methods are invasive and t...

During the last decade, the use of semantic models of 3D buildings and structures kept growing, fostered in particular by the spread of Building Information Models (BIMs), becoming quite popular in several civil engineering and geomatics applications. Nevertheless, semantic model production usually requires quite a lot of human interaction, which m...

In the geomatics domain the use of deep learning, a subset of machine learning, is becoming more and more widespread. In this context, the 3D semantic segmentation of heritage point clouds presents an interesting and promising approach for modelling automation, in light of the heterogeneous nature of historical building styles and features. However...

The interest in high-resolution semantic 3D models of historical buildings continuously increased during the last decade, thanks to their utility in protection, conservation and restoration of cultural heritage sites. The current generation of surveying tools allows the quick collection of large and detailed amount of data: such data ensure accurat...

The use of AI in semantic segmentation has grown significantly in recent years, aided by developments in computing power and the availability of annotated images for training data. However, in the context of close-range photogrammetry, although working with 2D images, AI is still used mostly for 3D point cloud segmentation purposes. In this paper,...

Developments in the field of artificial intelligence have made great strides in the field of automatic semantic segmentation, both in the 2D (image) and 3D spaces. Within the context of 3D recording technology it has also seen application in several areas, most notably in creating semantically rich point clouds which is usually performed manually....

This paper introduces an original method for modelling in 3D the full tube (both vault and canal) of navigable tunnels using data acquired dynamically from a boat. The recording system is composed of cameras that provide images of the vault and a multibeam echo sounder that acquires 3D profiles underwater. Reconstructing partially submerged structu...

Creating three-dimensional as-built models from point clouds is still a challenging task in the Cultural Heritage environment. Nowadays, performing such task typically requires the quite time-consuming manual intervention of an expert operator, in particular to deal with the complexities and peculiarities of heritage buildings. Motivated by these c...

The rapid development of 3D scanning technology is a welcome progress in the field of tangible cultural heritage documentation. While active sensors such as handheld Time-of-Flight (ToF) cameras and lidar have recently generated much hype, developments in low-cost imaging sensors have also seen long strides in recent decades. This paper aims to see...

Documentation of heritage objects has advanced significantly with the invention and development of many 3D sensors and processing algorithms. These technical advancements are of the utmost interest for cultural heritage stakeholders; knowledge transfer between key players is therefore essential and is indeed the main philosophy behind the CIPA Heri...

The task of semantic segmentation is an important one in the context of 3D building modelling. Indeed, developments in 3D generation techniques have rendered the point cloud ubiquitous. However pure data acquisition only captures geometric information and semantic classification remains to be performed, often manually, in order to give a tangible s...

Heritage documentation has benefitted greatly from significant developments in sensor technology during the past two decades. Miniaturisation of sensors is also an important aspect in the development of low cost sensors, always interesting in heritage projects where budgetary constraints are often present. Among these sensors, the solid-state lidar...

In recent years, the numerous advantages introduced by Building Information modelling (BIM) have led in its application on the heritage environment and giving birth to the concept of H-BIM (Heritage BIM). The resulting demand in heritage survey data processing has focused this research on the development of strategies and methods to improve the con...

One of the major quality control parameters in bundle adjustment are the posterior estimates of the covariance of the estimated parameters. Posterior covariance computations have been part of the open source Damped Bundle Adjustment Toolbox in Matlab (DBAT) since its first public release. However, for large projects, the computation of especially t...

In the context of building renovation, energy audits of buildings are performed in order to reduce energy consumption and greenhouse gas emissions. Infrared cameras allow analyzing precisely the energetic performances and the thermal comfort of a building and the analysis of thermal images of buildings represents a key step on the way to the reduct...

Producing accurate and rapid geomorphic surveys is a key issue for the growing scientific and operational area of physical river restoration. A geodetic survey using 3-D modelling (lasergrammetry, photogrammetry, tacheometry)was combinedwith a geomorphic survey (RFID bedload tracking, survey of grain size, geomorphic units evolution and geometrical...

The first national product of Surface Water Dynamics in France (SWDF) is generated on a monthly temporal scale and 10-m spatial scale using an automatic rule-based superpixel (RBSP) approach. The current surface water dynamic products from high resolution (HR) multispectral satellite imagery are typically analyzed to determine the annual trend and...

Built heritage documentation involves the 3D modelling of the geometry (typically using 3D computer graphics, photogrammetry and laser scanning techniques) and information management of semantic knowledge (i.e., using Geographic Information System (GIS) and ontology tools). The recent developed Building Information Modelling (BIM) technique combine...

3D heritage documentation has seen a surge in the past decade due to developments in reality-based 3D recording techniques. Several methods such as photogrammetry and laser scanning are becoming ubiquitous amongst architects, archaeologists, surveyors, and conservators. The main result of these methods is a 3D representation of the object in the fo...

Buildings are an important focus that needs to be modeled in three-dimensional (3D) city model. 3D models of buildings can be used to assist the construction and maintenance of cities. Currently there are many technologies that can be used to manage data and information from buildings or cities, such as Geographical Information System (GIS) and Bui...

The Damped Bundle Adjustment Toolbox (DBAT) is a free, open-source, toolbox for bundle adjustment. The purpose of DBAT is to provide an independent, open-source toolkit for statistically rigorous bundle adjustment computations. The capabilities include bundle adjustment, network analysis, point filtering, forward intersection, spatial intersection,...

The use of photogrammetry in 3D heritage documentation has matured over the recent years. In the same time, many types of sensors have also been developed in the field of imaging. While photogrammetry is considered as a low-cost alternative to TLS, several options exist in terms of sensor type with trade-offs between price, ease of use, and quality...

3D recording is an important procedure in the conservation of heritage sites. This past decade, a myriad of 3D sensors has appeared in the market with different advantages and disadvantages. Most notably, the laser scanning and photogrammetry methods have become some of the most used techniques in 3D recording. The integration of these different se...

The segmentation of a point cloud presents an important step in the 3D modelling process of heritage structures. This is true in many scale levels, including the segmentation, identification, and classification of architectural elements from the point cloud of a building. In this regard, historical buildings often present complex elements which ren...

In the context of building renovation, infrared (IR) cameras are widely used to perform the energy audit of buildings. They allow analysing precisely the energetic performances of existing buildings and thermal analyses represent a key step for the reduction of energy consumption. They are also used to assess the thermal comfort of people living or...

This paper presents the work accomplished in order to digitize and model the Winter Garden of the Earthenware Museum at Sarreguemines (Moselle, France). The objectives were to create a digital archive of this cultural heritage place and to find appropriate ways of promoting it. Topographic, photogrammetric and lasergrammetric methods were used to m...

In the context of architectural heritage preservation, constructing building information models is an important task. However, conceiving a pertinent model is a difficult, time consuming and user-dependent task. Our laboratory has been researching methods to decrease the time and errors inferred by manual segmentation of point clouds. In the perspe...

The paper explores the possibilities of using old images for 2D and 3D documentation of archaeological monuments using open source, free and commercial photogrammetric software. The available images represent the external façade of the Western gate and Al Omari Mosque in the city of Bosra al-Sham in Syria, which were severely damaged during the rec...

Built heritage has been documented by reality-based modeling for geometric description and by ontology for knowledge management. The current challenge still involves the extraction of geometric primitives and the establishment of their connection to heterogeneous knowledge. As a recently developed 3D information modeling environment, building infor...

As the use of building information model (BIM) for architectural heritage becomes more relevant, this paper explores different solutions to further automatize the modelling process. The scan-to-BIM process still requires manual intervention that is time consuming, subject to errors and user-dependent. In this paper, the main focus is the automated...

The main purpose of this article is to show that photogrammetric bundle-adjustment computations can be sequentially organized into modules. Furthermore, the chain rule can be used to simplify the computation of the analytical Jacobians needed for the adjustment. Novel projection models can be flexibly evaluated by inserting, modifying, or swapping...

Point cloud segmentation is an important first step in categorising a raw point cloud data. This step is necessary in order to better manage the data and generate other derivative products, e.g. 3D GIS or HBIM. The idea presented in this paper involves the use of 2D GIS to help in the segmentation, classification, as well as (early) semantic annota...

The Bronze Age decorated cave of Les Fraux (Dordogne, France) combines cave art and evidence for domestic and symbolic activities. The interdisciplinary research which has been conducted on the site since 2007 attempts to untangle the interwoven uses of this cave for later prehistoric communities, during short but regular human visitations, by comb...

The 3D documentation of heritage complexes or quarters often requires more than one scale due to its extended area. While the documentation of individual buildings requires a technique with finer resolution, that of the complex itself may not need the same degree of detail. This has led to the use of a multi-scale approach in such situations, which...

Water spectral indices can enhance the difference between water bodies and background features. Thus, they have been widely used to extract and map surface water bodies based on multispectral satellite imagery. The urban scene is very heterogeneous since the surface is composed of a vast diversity of man-made objects, often of mixed distribution. U...

Mechanical Sonar Scanning (MSS) is a recent technology that allows sonar to be used for static measurements in the same way as Terrestrial Laser Scanners (TLS), which makes it an attractive tool for underwater infrastructure surveys. Nevertheless, the metrological capabilities of this type of device have been little explored in the literature, part...

Three-dimensional (3D) model is a major form of cultural heritage documentation. In most cases, the properties of digital artefacts (e.g. readability, coverage) are affected by the acquisition procedure (e.g. device, workflow, conditions) and the characteristics of the physical artefact (e.g. shape, size and materials). In this paper, we study how...

Building Information Modelling (BIM) technique has been widely utilized in heritage documentation and comes to a general term Historical/Heritage BIM (HBIM). The current HBIM project mostly employs the scan-to-BIM process to manually create the geometric model from the point cloud. This paper explains how it is possible to shape from the mesh geome...

In this paper we investigate how the residuals in bundle adjustment can be split into a composition of simple functions. According to the chain rule, the Jacobian (linearisation) of the residual can be formed as a product of the Jacobians of the individual steps. When implemented, this enables a modularisation of the computation of the bundle adjus...

Terrestrial and airborne laser scanning, photogrammetry and more generally 3D recording techniques are used in a wide range of applications. After recording several individual 3D datasets known in local systems, one of the first crucial processing steps is the registration of these data into a common reference frame. To perform such a 3D transforma...

In the field of 3D heritage documentation, point cloud registration is a relatively common issue. With rising needs for Historic Building Information Models (HBIMs), this issue has become more important as it determines the quality of the data to be used for HBIM modelling. Furthermore, in the context of historical buildings, it is often interestin...

An underwater imaging system with camera and lens behind a flat port does not behave as a standard pinhole camera with additional parameters. Indeed, whenever the entrance pupil of the lens is not in contact with the flat port, the standard photogrammetric model is not suited anymore and an extended mathematical model that considers the different m...

Close-range photogrammetry as a technique to acquire reality-based 3D data has, in recent times, seen a renewed interest due to developments in sensor technologies. Furthermore, the strong democratization of UAVs (Unmanned Aerial Vehicles) or drones means that close-range photogrammetry can now be used as a viable low-cost method for 3D mapping. In...

Photogrammetry has recently seen a rapid increase in many applications, thanks to developments in computing power and algorithms. Furthermore with the democratisation of UAVs (Unmanned Aerial Vehicles), close range photogrammetry has seen more and more use due to the easier capability to acquire aerial close range images. In terms of photogrammetri...

The creation of as-built Building Information Models requires the acquisition of the as-is state of existing buildings. Laser scanners are widely used to achieve this goal since they permit to collect information about object geometry in form of point clouds and provide a large amount of accurate data in a very fast way and with a high level of det...

The use of laser scanning techniques has become a common way to measure the real world. Millions of points could be generated by this system, which brings forth the problem of visualizing and eventually performing analyses on them. In the open source domain, various software packages exist to visualize 3D point clouds. However, most of these softwa...

Three-dimensional (3D) documentation of heritage buildings has long employed both image-based and range-based techniques. Unmanned aerial vehicles (UAVs) provide a particular advantage for image-based techniques in acquiring aerial views, which are difficult to attain using classical terrestrial-based methods. The technological development of optic...

The French collection of Plan-Reliefs, scale models of fortified towns, constitutes a precious testimony of the history of France. The aim of the URBANIA project is the valorisation and the diffusion of this Heritage through the creation of virtual models. The town scale model of Strasbourg at 1/600 currently exhibited in the Historical Museum of S...

This paper is dedicated to the digitization of blocks and virtual anastylosis of an antique façade in Pont-Sainte-Maxence (France). In 2014 during the construction of a shopping center, the National Institute for Preventive Archaeological Research (INRAP) discovered a Gallo-Roman site from the 2nd century AD. The most interesting part of the site f...

Handheld 3D scanners can be used to complete large scale models with the acquisition of occluded areas or small artefacts. This may be of interest for digitization projects in the field of Cultural Heritage, where detailed areas may require a specific treatment. Such sensors present the advantage of being easily portable in the field, and easily us...

The paper presents photogrammetric archives from Aleppo (Syria), collected between 1999 and 2002 by the Committee for maintenance and restoration of the Great Mosque in partnership with the Engineering Unit of the University of Aleppo. During that period, terrestrial photogrammetric data and geodetic surveys of the Great Omayyad mosque were recorde...

The Battle of Vimy Ridge was a military engagement between the Canadian Corps and the German Empire during the Great War (1914-1918). In this battle, Canadian troops fought as a single unit and won the day. It marked an important point in Canadian history as a nation. The year 2017 marks the centenary of this battle. In commemoration of this event,...

Photogrammetry has seen an increase in the use of UAVs (Unmanned Aerial Vehicles) for both large and smaller scale cartography. The use of UAVs is also advantageous because it may be used for tasks requiring quick response, including in the case of the inspection and monitoring of buildings. The objective of the project is to study the acquisition...

The LIFE+ project " Restoring dynamics of Rhine alluvial habitats on the Rohrschollen Island " (2010-2014), aimed to restore the hydromorphological and ecological functionalities of the Rohrschollen fluvial hydrosystem: bedload dynamics, channel mobility, surface water-groundwater exchanges, renewal of pioneer ecosystems, development of lotic habit...

The Rohrschollen artificial island is a Natural Reserve located 8 km SouthEast the city of Strasbourg. The island results from several engineering works (correction and canalization) lead on the reach since the beginning of the 19th century to improve flood control, agriculture, navigation and to produce hydropower. Consequently, the main channel o...