Search

The documentation of roadway factors (such as roadway geometry, lane marking retroreflectivity/classification, and lane width) through the inventory of lane markings can reduce accidents and facilitate road safety analyses. Typically, lane marking inventory is established using either imagery or Light Detection and Ranging (LiDAR) data collected by mobile mapping systems (MMS). However, it is important to consider the strengths and weaknesses of both camera and LiDAR units when establishing lane marking inventory. Images may be susceptible to weather and lighting conditions, and lane marking might be obstructed by neighboring traffic. They also lack 3D and intensity information, although color information is available. On the other hand, LiDAR data are not affected by adverse weather and lighting conditions, and they have minimal occlusions. Moreover, LiDAR data provide 3D and intensity information. Considering the complementary characteristics of camera and LiDAR units, an image-aided LiDAR framework would be highly advantageous for lane marking inventory. In this context, an image-aided LiDAR framework means that the lane markings generated from one modality (i.e., either an image or LiDAR) are enhanced by those derived from the other one (i.e., either imagery or LiDAR). In addition, a reporting mechanism that can handle multi-modal datasets from different MMS sensors is necessary for the visualization of inventory results. This study proposes an image-aided LiDAR lane marking inventory framework that can handle up to five lanes per driving direction, as well as multiple imaging and LiDAR sensors onboard an MMS. The framework utilizes lane markings extracted from images to improve LiDAR-based extraction. Thereafter, intensity profiles and lane width estimates can be derived using the image-aided LiDAR lane markings. Finally, imagery/LiDAR data, intensity profiles, and lane width estimates can be visualized through a web portal that has been developed in this study. For the performance evaluation of the proposed framework, lane markings obtained through LiDAR-based, image-based, and image-aided LiDAR approaches are compared against manually established ones. The evaluation demonstrates that the proposed framework effectively compensates for the omission errors in the LiDAR-based extraction, as evidenced by an increase in the recall from 87.6% to 91.6%. [ABSTRACT FROM AUTHOR]

The precise extraction of road boundaries is an essential task to obtain road infrastructure data that can support various applications, such as maintenance, autonomous driving, vehicle navigation, and the generation of high-definition maps (HD map). Despite promising outcomes in prior studies, challenges persist in road extraction, particularly in discerning diverse road types. The proposed methodology integrates state-of-the-art techniques like DBSCAN and RANSAC, aiming to establish a universally applicable approach for diverse mobile mapping systems. This effort represents a pioneering step in extracting road information from image-based point cloud data. To assess the efficacy of the proposed method, we conducted experiments using a large-scale dataset acquired by two mobile mapping systems on the Yıldız Technical University campus; one system was configured as a mobile LiDAR system (MLS), while the other was equipped with cameras to operate as a photogrammetry-based mobile mapping system (MMS). Using manually measured reference road boundary data, we evaluated the completeness, correctness, and quality parameters of the road extraction performance of our proposed method based on two datasets. The completeness rates were 93.2% and 84.5%, while the correctness rates were 98.6% and 93.6%, respectively. The overall quality of the road curb extraction was 93.9% and 84.5% for the two datasets. Our proposed algorithm is capable of accurately extracting straight or curved road boundaries and curbs from complex point cloud data that includes vehicles, pedestrians, and other obstacles in urban environment. Furthermore, our experiments demonstrate that the algorithm can be applied to point cloud data acquired from different systems, such as MLS and MMS, with varying spatial resolutions and accuracy levels. [ABSTRACT FROM AUTHOR]

Mapping systems using multi-beam LiDARs are widely used nowadays for different geospatial applications graduating from indoor projects to outdoor city-wide projects. These mobile mapping systems can be either ground-based or aerial-based systems and are mostly equipped with inertial navigation systems INS. The Velodyne HDL-32 LiDAR is a well-known 360° spinning multi-beam laser scanner that is widely used in outdoor and indoor mobile mapping systems. The performance of such LiDARs is an ongoing research topic which is quite important for the quality assurance and quality control topic. The performance of this LiDAR type is correlated to many factors either related to the device itself or the design of the mobile mapping system. Regarding design, most of the mapping systems are equipped with a single Velodyne HDL32 in a specific orientation angle which is different among the mapping systems manufacturers. The LiDAR orientation angle has a significant impact on the performance in terms of the density and coverage of the produced point clouds. Furthermore, during the lifetime of this multi-beam LiDAR, one or more beams may be defected and then either continue the production or returned to the manufacturer to be fixed which then cost time and money. In this paper, the design impact analysis of a mobile laser scanning (MLS) system equipped with a single Velodyne HDL-32E will be clarified and a clear relationship is given between the orientation angle of the LiDAR and the output density of points. The ideal angular orientation of a single Velodyne HDL-32E is found to be at 35° in a mobile mapping system. Furthermore, we investigated the degradation of points density when one of the 32 beams is defected and quantified the density loss percentage and to the best of our knowledge, this is not presented in literature before. It is found that a maximum of about 8% point density loss occurs on the ground and 4% on the facades when having a defected beam of the Velodyne HDL-32E. [ABSTRACT FROM AUTHOR]

The documentation of roadway factors (such as roadway geometry, lane marking retroreflectivity/classification, and lane width) through the inventory of lane markings can reduce accidents and facilitate road safety analyses. Typically, lane marking inventory is established using either imagery or Light Detection and Ranging (LiDAR) data collected by mobile mapping systems (MMS). However, it is important to consider the strengths and weaknesses of both camera and LiDAR units when establishing lane marking inventory. Images may be susceptible to weather and lighting conditions, and lane marking might be obstructed by neighboring traffic. They also lack 3D and intensity information, although color information is available. On the other hand, LiDAR data are not affected by adverse weather and lighting conditions, and they have minimal occlusions. Moreover, LiDAR data provide 3D and intensity information. Considering the complementary characteristics of camera and LiDAR units, an image-aided LiDAR framework would be highly advantageous for lane marking inventory. In this context, an image-aided LiDAR framework means that the lane markings generated from one modality (i.e., either an image or LiDAR) are enhanced by those derived from the other one (i.e., either imagery or LiDAR). In addition, a reporting mechanism that can handle multi-modal datasets from different MMS sensors is necessary for the visualization of inventory results. This study proposes an image-aided LiDAR lane marking inventory framework that can handle up to five lanes per driving direction, as well as multiple imaging and LiDAR sensors onboard an MMS. The framework utilizes lane markings extracted from images to improve LiDAR-based extraction. Thereafter, intensity profiles and lane width estimates can be derived using the image-aided LiDAR lane markings. Finally, imagery/LiDAR data, intensity profiles, and lane width estimates can be visualized through a web portal that has been developed in this study. For the performance evaluation of the proposed framework, lane markings obtained through LiDAR-based, image-based, and image-aided LiDAR approaches are compared against manually established ones. The evaluation demonstrates that the proposed framework effectively compensates for the omission errors in the LiDAR-based extraction, as evidenced by an increase in the recall from 87.6% to 91.6%.

The precise extraction of road boundaries is an essential task to obtain road infrastructure data that can support various applications, such as maintenance, autonomous driving, vehicle navigation, and the generation of high-definition maps (HD map). Despite promising outcomes in prior studies, challenges persist in road extraction, particularly in discerning diverse road types. The proposed methodology integrates state-of-the-art techniques like DBSCAN and RANSAC, aiming to establish a universally applicable approach for diverse mobile mapping systems. This effort represents a pioneering step in extracting road information from image-based point cloud data. To assess the efficacy of the proposed method, we conducted experiments using a large-scale dataset acquired by two mobile mapping systems on the Yıldız Technical University campus; one system was configured as a mobile LiDAR system (MLS), while the other was equipped with cameras to operate as a photogrammetry-based mobile mapping system (MMS). Using manually measured reference road boundary data, we evaluated the completeness, correctness, and quality parameters of the road extraction performance of our proposed method based on two datasets. The completeness rates were 93.2% and 84.5%, while the correctness rates were 98.6% and 93.6%, respectively. The overall quality of the road curb extraction was 93.9% and 84.5% for the two datasets. Our proposed algorithm is capable of accurately extracting straight or curved road boundaries and curbs from complex point cloud data that includes vehicles, pedestrians, and other obstacles in urban environment. Furthermore, our experiments demonstrate that the algorithm can be applied to point cloud data acquired from different systems, such as MLS and MMS, with varying spatial resolutions and accuracy levels.

In recent decades, many cities have become densely populated due to increased urbanization, and the transportation infrastructure system has been heavily used. The downtime of important parts of the infrastructure, such as tunnels and bridges, seriously affects the transportation system's efficiency. For this reason, a safe and reliable infrastructure network is necessary for the economic growth and functionality of cities. At the same time, the infrastructure is ageing in many countries, and continuous inspection and maintenance are necessary. Nowadays, detailed inspections of large infrastructure are almost exclusively performed by inspectors on site, which is both time-consuming and subject to human errors. However, the recent technological advancements in computer vision, artificial intelligence (AI), and robotics have opened up the possibilities of automated inspections. Today, semiautomatic systems such as drones and other mobile mapping systems are available to collect data and reconstruct 3D digital models of infrastructure. This significantly decreases the downtime of the infrastructure, but both damage detection and assessments of the structural condition are still manually performed, with a high impact on the efficiency and accuracy of the procedure. Ongoing research has shown that deep-learning methods, especially convolutional neural networks (CNNs) combined with other image processing techniques, can automatically detect cracks on concrete surfaces and measure their metrics (e.g., length and width). However, these techniques are still under investigation. Additionally, to use these data for automatically assessing the structure, a clear link between the metrics of the cracks and the structural condition must be established. This paper presents a review of the damage of tunnel concrete lining that is detectable with optical instruments. Thereafter, state-of-the-art autonomous tunnel inspection methods are presented with a focus on innovative mobile mapping systems for optimizing data collection. Finally, the paper presents an in-depth review of how the risk associated with cracks is assessed today in concrete tunnel lining. [ABSTRACT FROM AUTHOR]

Although point features have shown their usefulness in classification with Machine Learning, point cloud visualization enhancement methods focus mainly on lighting. The visualization of point features helps to improve the perception of the 3D environment. This paper proposes Multi Feature-Rich Synthetic Colour (MFRSC) as an alternative non-photorealistic colour approach of natural-coloured point clouds. The method is based on the selection of nine features (reflectance, return number, inclination, depth, height, point density, linearity, planarity, and scattering) associated with five human perception descriptors (edges, texture, shape, size, depth, orientation). The features are reduced to fit the RGB display channels. All feature permutations are analysed according to colour distance with the natural-coloured point cloud and Image Quality Assessment. As a result, the selected feature permutations allow a clear visualization of the scene's rendering objects, highlighting edges, planes, and volumetric objects. MFRSC effectively replaces natural colour, even with less distorted visualization according to BRISQUE, NIQUE and PIQE. In addition, the assignment of features in RGB channels enables the use of MFRSC in software that does not support colorization based on point attributes (most commercially available software). MFRSC can be combined with other non-photorealistic techniques such as Eye-Dome Lighting or Ambient Occlusion. [ABSTRACT FROM AUTHOR]

The United States has over 8.8 million lane miles nationwide, which require regular maintenance and evaluations of sign retroreflectivity, pavement markings, and other pavement information. Pavement markings convey crucial information to drivers as well as connected and autonomous vehicles for lane delineations. Current means of evaluation are by human inspection or semi-automated dedicated vehicles, which often capture one to two pavement lines at a time. Mobile LiDAR is also frequently used by agencies to map signs and infrastructure as well as assess pavement conditions and drainage profiles. This paper presents a case study where over 70 miles of US-52 and US-41 in Indiana were assessed, utilizing both a mobile retroreflectometer and a LiDAR mobile mapping system. Comparing the intensity data from LiDAR data and the retroreflective readings, there was a linear correlation for right edge pavement markings with an R2 of 0.87 and for the center skip line a linear correlation with an R2 of 0.63. The p-values were 0.000 and 0.000, respectively. Although there are no published standards for using LiDAR to evaluate pavement marking retroreflectivity, these results suggest that mobile LiDAR is a viable tool for network level monitoring of retroreflectivity.

In the present work, three LiDAR technologies (Faro Focus 3D X130—Terrestrial Laser Scanner, TLS-, Kaarta Stencil 2–16—Mobile mapping system, MMS-, and DJI Zenmuse L1—Airborne LiDAR sensor, ALS-) have been tested and compared in order to assess the performances in surveying built heritage in vegetated areas. Each of the mentioned devices has their limits of usability, and different methods to capture and generate 3D point clouds need to be applied. In addition, it has been necessary to apply a methodology to be able to position all the point clouds in the same reference system. While the TLS scans and the MMS data have been geo-referenced using a set of vertical markers and sphere measured by a GNSS receiver in RTK mode, the ALS model has been geo-referenced by the GNSS receiver integrated in the unmanned aerial system (UAS), which presents different characteristics and accuracies. The resulting point clouds have been analyzed and compared, focusing attention on the number of points acquired by the different systems, the density, and the nearest neighbor distance. [ABSTRACT FROM AUTHOR]

This paper presents the results of a complex three-dimensional reconstruction of the church of Nuestra Señora de la Asunción (Ávila, Spain) as an example of a successful process of verticalization from point clouds to a comprehensive computer-aided design (CAD) model. The reconstruction was carried out using the novel and advanced wearable mobile mapping system ZEB-REVO in combination with a lifting pole, in order to cover the whole geometry of the temple and, also, to model the different constructive elements. To this end, a set of good practices was followed, which allowed for passing from reality to the CAD model, such as the use of closed loops or even the use of different parametric and non-parametric strategies to capture the real geometry of the elements. As a result, this paper outlines the main guidelines for passing from point clouds to comprehensive CAD models, the former being useful for the application of smart preventive conservation processes, heritage building information models or even advanced numerical simulations. [ABSTRACT FROM AUTHOR]

Recently, light detection and ranging (LiDAR)-based mobile mapping systems (MMS) have been utilized for extracting lane markings using deep learning frameworks. However, huge datasets are required for training neural networks. Furthermore, with accurate lane markings being detected utilizing LiDAR data, an algorithm for automatically reporting their intensity information is beneficial for identifying worn-out or missing lane markings. In this paper, a transfer learning approach based on fine-tuning of a pretrained U-net model for lane marking extraction and a strategy for generating intensity profiles using the extracted results are presented. Starting from a pretrained model, a new model can be trained better and faster to make predictions on a target domain dataset with only a few training examples. An original U-net model trained on two-lane highways (source domain dataset) was fine-tuned to make accurate predictions on datasets with one-lane highway patterns (target domain dataset). Specifically, encoder- and decoder-trained U-net models are presented wherein, during retraining of the former, only weights in the encoder path of U-net were allowed to change with decoder weights frozen and vice versa for the latter. On the test data (target domain), the encoder-trained model (F1-score: 86.9%) outperformed the decoder-trained (F1-score: 82.1%). Additionally, on an independent dataset, the encoder-trained one (F1-score: 90.1%) performed better than the decoder-trained one (F1-score: 83.2%). Lastly, on the basis of lane marking results obtained from the encoder-trained U-net, intensity profiles were generated. Such profiles can be used to identify lane marking gaps and investigate their cause through RGB imagery visualization.

In recent decades, many cities have become densely populated due to increased urbanization, and the transportation infrastructure system has been heavily used. The downtime of important parts of the infrastructure, such as tunnels and bridges, seriously affects the transportation system’s efficiency. For this reason, a safe and reliable infrastructure network is necessary for the economic growth and functionality of cities. At the same time, the infrastructure is ageing in many countries, and continuous inspection and maintenance are necessary. Nowadays, detailed inspections of large infrastructure are almost exclusively performed by inspectors on site, which is both time-consuming and subject to human errors. However, the recent technological advancements in computer vision, artificial intelligence (AI), and robotics have opened up the possibilities of automated inspections. Today, semiautomatic systems such as drones and other mobile mapping systems are available to collect data and reconstruct 3D digital models of infrastructure. This significantly decreases the downtime of the infrastructure, but both damage detection and assessments of the structural condition are still manually performed, with a high impact on the efficiency and accuracy of the procedure. Ongoing research has shown that deep-learning methods, especially convolutional neural networks (CNNs) combined with other image processing techniques, can automatically detect cracks on concrete surfaces and measure their metrics (e.g., length and width). However, these techniques are still under investigation. Additionally, to use these data for automatically assessing the structure, a clear link between the metrics of the cracks and the structural condition must be established. This paper presents a review of the damage of tunnel concrete lining that is detectable with optical instruments. Thereafter, state-of-the-art autonomous tunnel inspection methods are presented with a focus on innovative mobile mapping systems for optimizing data collection. Finally, the paper presents an in-depth review of how the risk associated with cracks is assessed today in concrete tunnel lining.

Mapping systems using multi-beam LiDARs are widely used nowadays for different geospatial applications graduating from indoor projects to outdoor city-wide projects. These mobile mapping systems can be either ground-based or aerial-based systems and are mostly equipped with inertial navigation systems INS. The Velodyne HDL-32 LiDAR is a well-known 360° spinning multi-beam laser scanner that is widely used in outdoor and indoor mobile mapping systems. The performance of such LiDARs is an ongoing research topic which is quite important for the quality assurance and quality control topic. The performance of this LiDAR type is correlated to many factors either related to the device itself or the design of the mobile mapping system. Regarding design, most of the mapping systems are equipped with a single Velodyne HDL32 in a specific orientation angle which is different among the mapping systems manufacturers. The LiDAR orientation angle has a significant impact on the performance in terms of the density and coverage of the produced point clouds. Furthermore, during the lifetime of this multi-beam LiDAR, one or more beams may be defected and then either continue the production or returned to the manufacturer to be fixed which then cost time and money. In this paper, the design impact analysis of a mobile laser scanning (MLS) system equipped with a single Velodyne HDL-32E will be clarified and a clear relationship is given between the orientation angle of the LiDAR and the output density of points. The ideal angular orientation of a single Velodyne HDL-32E is found to be at 35° in a mobile mapping system. Furthermore, we investigated the degradation of points density when one of the 32 beams is defected and quantified the density loss percentage and to the best of our knowledge, this is not presented in literature before. It is found that a maximum of about 8% point density loss occurs on the ground and 4% on the facades when having a defected beam of the Velodyne HDL-32E. [ABSTRACT FROM AUTHOR]

In the present work, three LiDAR technologies (Faro Focus 3D X130—Terrestrial Laser Scanner, TLS-, Kaarta Stencil 2–16—Mobile mapping system, MMS-, and DJI Zenmuse L1—Airborne LiDAR sensor, ALS-) have been tested and compared in order to assess the performances in surveying built heritage in vegetated areas. Each of the mentioned devices has their limits of usability, and different methods to capture and generate 3D point clouds need to be applied. In addition, it has been necessary to apply a methodology to be able to position all the point clouds in the same reference system. While the TLS scans and the MMS data have been geo-referenced using a set of vertical markers and sphere measured by a GNSS receiver in RTK mode, the ALS model has been geo-referenced by the GNSS receiver integrated in the unmanned aerial system (UAS), which presents different characteristics and accuracies. The resulting point clouds have been analyzed and compared, focusing attention on the number of points acquired by the different systems, the density, and the nearest neighbor distance.

• Santiago Urban Dataset SUD was acquired with MLS and HMLS equipment. • Occlusions are reduced by the integration of MLS and HMLS data. • Point clouds are labelled by heuristic and Deep Learning methods in eight classes. • SUD is valid for comparing semantic segmentation works. • SUD is valid for urban 3D mobility studies. Santiago Urban Dataset SUD is a real dataset that combines Mobile Laser Scanning (MLS) and Handheld Mobile Laser Scanning (HMLS) point clouds. The data is composed by 2 km of streets, sited in Santiago de Compostela (Spain). Point clouds undergo a manual labelling process supported by both heuristic and Deep Learning methods, resulting in the classification of eight specific classes: road, sidewalk, curb, buildings, vehicles, vegetation, poles , and others. Three PointNet++ models were trained; the first one using MLS point clouds, the second one with HMLS point clouds and the third one with both H&MLS point clouds. In order to ascertain the quality and efficacy of each Deep Learning model, various metrics were employed, including confusion matrices, precision, recall, F1-score, and IoU. The results are consistent with other state-of-the-art works and indicate that SUD is valid for comparing point cloud semantic segmentation works. Furthermore, the survey's extensive coverage and the limited occlusions indicate the potential utility of SUD in urban mobility research. [ABSTRACT FROM AUTHOR]

This paper presents the results of a complex three-dimensional reconstruction of the church of Nuestra Señora de la Asunción (Ávila, Spain) as an example of a successful process of verticalization from point clouds to a comprehensive computer-aided design (CAD) model. The reconstruction was carried out using the novel and advanced wearable mobile mapping system ZEB-REVO in combination with a lifting pole, in order to cover the whole geometry of the temple and, also, to model the different constructive elements. To this end, a set of good practices was followed, which allowed for passing from reality to the CAD model, such as the use of closed loops or even the use of different parametric and non-parametric strategies to capture the real geometry of the elements. As a result, this paper outlines the main guidelines for passing from point clouds to comprehensive CAD models, the former being useful for the application of smart preventive conservation processes, heritage building information models or even advanced numerical simulations.

MicroGeo had the opportunity to experiment with the ZEB Horizon instrument to acquire a piezometric well in 3D. The scenario is not the easiest to detect. This type of wells, in fact, extends in depth for several tens of meters and with traditional scanning systems it is practically impossible to obtain a complete 3D acquisition of the subject. With the ZEB Horizon Mobile Mapping System it was possible to acquire the well. The subject presents itself as a 30 m deep piezometric well with a diameter of 3.6 m, with a high difficulty of acquisition: the extremely regular surfaces of the well have made the survey activity with the SLAM technique very complex, the algorithm that generates the 3D point cloud model must be extremely powerful in order to be able to generate a correct data even in a condition of extreme surface homogeneity.

The accuracy assessment of mobile mapping system (MMS) outputs is usually reliant on manual labor to inspect the quality of a vast amount of collected geospatial data. This paper presents an automated framework for the accuracy assessment and quality inspection of point cloud data collected by MMSs operating with lightweight laser scanners and consumer-grade microelectromechanical systems (MEMS) sensors. A new, large-scale test facility has been established in a challenging navigation environment (downtown area) to support the analyses conducted in this research work. MMS point cloud data are divided into short time slices for comparison with the higher-accuracy, terrestrial laser scanner (TLS) point cloud of the test facility. MMS data quality is quantified by the results of registering the point cloud of each slice with the TLS datasets. Experiments on multiple land vehicle MMS point cloud datasets using a lightweight laser scanner and three different MEMS devices are presented to demonstrate the effectiveness of the proposed method. The mean accuracy of a consumer grade MEMS (<$100) was found to be 1.13 ± 0.47 m. The mean accuracy of two commercial MEMS (>$100) was in the range of 0.48 ± 0.23 m to 0.85 ± 0.52 m. The method presented here in can be straightforwardly implemented and adopted for the accuracy assessment of other MMSs types such as unmanned aerial vehicles (UAV)s. [ABSTRACT FROM AUTHOR]

Mechanically stabilized earth (MSE) walls rely on its weight to resist the destabilizing earth forces acting at the back of the reinforced soil area. MSE walls are a common infrastructure along national and international transportation corridors as they are low-cost and have easy-to-install precast concrete panels. The usability of such transportation corridors depends on the safety and condition of the MSE wall system. Consequently, MSE walls have to be periodically monitored according to prevailing transportation asset management criteria during the construction and serviceability life stages to ensure that their predictable performance measures are met. To date, MSE walls are monitored using qualitative approaches such as visual inspection, which provide limited information. Aside from being time-consuming, visual inspection is susceptible to bias due to human subjectivity. Manual and visual inspection in the field has been traditionally based on the use of a total station, geotechnical field instrumentation, and/or static terrestrial laser scanning (TLS). These instruments can provide highly accurate and reliable performance measures; however, their underlying data acquisition and processing strategies are time-consuming and not scalable. The proposed strategy in this research provides several global and local serviceability measures through efficient processing of point cloud data acquired by a mobile LiDAR system (MLS) for MSE walls with smooth panels without the need for installing any targets. An ultra-high-accuracy vehicle-based LiDAR data acquisition system has been used for the data acquisition. To check the viability of the proposed methodology, a case study has been conducted to evaluate the similarity of the derived serviceability measures from TLS and MLS technologies. The results of that comparison verified that the MLS-based serviceability measures are within 1 cm and 0.3° of those obtained using TLS and thus confirmed the potential for using MLS to efficiently acquire point clouds while facilitating economical, scalable, and reliable monitoring of MSE walls. [ABSTRACT FROM AUTHOR]

Highlights • The proposed method is capable of giving stable navigation and mapping solutions. • Position accuracy is around 2 m in long GNSS (more than 300 s) outage. • The mapping results achieve the meter-level accuracy. • An approximately 60% improvement of long GNSS-denied experiments is achieved. Abstract Mobile Mapping Systems (MMS) with Inertial Navigation System / Global Navigation Satellite System (INS/GNSS) and mapping sensors have been widely developed in recent years. However current systems and results are still prone to errors, especially in GNSS-denied or multipath environments. To provide robust and stable navigation information, particularly for mapping in long-term GNSS-denied environments, we propose a semi-tightly coupled integration scheme which integrates INS/GNSS with grid-based Simultaneous Localization and Mapping (SLAM). Although traditional SLAM using LiDAR can map the GNSS-denied environment efficiently, it is only in local localization. The proposed integration scheme is based on the Extended Kalman Filter (EKF) with motion constraints. In this scheme, a measurement model for grid-based SLAM is aided by the heading and velocity information. A special innovation of this scheme is the improved fusion of GNSS/INS with the use of grid-based SLAM serves like virtual odometer and virtual compass, thus gaining reliable measurements and error models to maintain good performance during INS-only mode. In addition, the initial values for example position and heading, are given to solve global localization and loop closure problems in SLAM. Finally, a smoothing and multi-resolution map strategy are applied offline to increase the robustness and performance of the proposed grid-based SLAM. Evaluation based on experimental data shows the significant improvement by the proposed semi-tightly coupled integration scheme with low-cost INS/GNSS and LiDAR, which is able to achieve 1–2 m' accuracy in terms of positioning and mapping. An approximately 60% improvement was achieved during long-term GNSS-denied environments using the proposed integration scheme. [ABSTRACT FROM AUTHOR]

Labelled point clouds are crucial to train supervised Deep Learning (DL) methods used for semantic segmentation. The objective of this research is to quantify discordances between the labels made by different people in order to assess whether such discordances can influence the success rates of a DL based semantic segmentation algorithm. An urban point cloud of 30 m road length in Santiago de Compostela (Spain) was labelled two times by ten persons. Discordances and its significance in manual labelling between individuals and rounds were calculated. In addition, a ratio test to signify discordance and concordance was proposed. Results show that most of the points were labelled accordingly with the same class by all the people. However, there were many points that were labelled with two or more classes. Class curb presented 5.9% of discordant points and 3.2 discordances for each point with concordance by all people. In addition, the percentage of significative labelling differences of the class curb was 86.7% comparing all the people in the same round and 100% comparing rounds of each person. Analysing the semantic segmentation results with a DL based algorithm, PointNet++, the percentage of concordance points are related with F-score value in R2 = 0.765, posing that manual labelling has significant impact on results of DL-based semantic segmentation methods. [ABSTRACT FROM AUTHOR]

Mobile Laser Scanning (MLS) systems have proven their usefulness in the rapid and accurate acquisition of the urban environment. From the generated point clouds, street furniture can be extracted and classified without manual intervention. However, this process of acquisition and classification is not error-free, caused mainly by disturbances. This paper analyses the effect of three disturbances (point density variation, ambient noise, and occlusions) on the classification of urban objects in point clouds. From point clouds acquired in real case studies, synthetic disturbances are generated and added. The point density reduction is generated by downsampling in a voxel-wise distribution. The ambient noise is generated as random points within the bounding box of the object, and the occlusion is generated by eliminating points contained in a sphere. Samples with disturbances are classified by a pre-trained Convolutional Neural Network (CNN). The results showed different behaviours for each disturbance: density reduction affected objects depending on the object shape and dimensions, ambient noise depending on the volume of the object, while occlusions depended on their size and location. Finally, the CNN was re-trained with a percentage of synthetic samples with disturbances. An improvement in the performance of 10–40% was reported except for occlusions with a radius larger than 1 m.

Remote sensing platforms have become an effective data acquisition tool for digital agriculture. Imaging sensors onboard unmanned aerial vehicles (UAVs) and tractors are providing unprecedented high-geometric-resolution data for several crop phenotyping activities (e.g., canopy cover estimation, plant localization, and flowering date identification). Among potential products, orthophotos play an important role in agricultural management. Traditional orthophoto generation strategies suffer from several artifacts (e.g., double mapping, excessive pixilation, and seamline distortions). The above problems are more pronounced when dealing with mid- to late-season imagery, which is often used for establishing flowering date (e.g., tassel and panicle detection for maize and sorghum crops, respectively). In response to these challenges, this paper introduces new strategies for generating orthophotos that are conducive to the straightforward detection of tassels and panicles. The orthophoto generation strategies are valid for both frame and push-broom imaging systems. The target function of these strategies is striking a balance between the improved visual appearance of tassels/panicles and their geolocation accuracy. The new strategies are based on generating a smooth digital surface model (DSM) that maintains the geolocation quality along the plant rows while reducing double mapping and pixilation artifacts. Moreover, seamline control strategies are applied to avoid having seamline distortions at locations where the tassels and panicles are expected. The quality of generated orthophotos is evaluated through visual inspection as well as quantitative assessment of the degree of similarity between the generated orthophotos and original images. Several experimental results from both UAV and ground platforms show that the proposed strategies do improve the visual quality of derived orthophotos while maintaining the geolocation accuracy at tassel/panicle locations.

The accuracy assessment of mobile mapping system (MMS) outputs is usually reliant on manual labor to inspect the quality of a vast amount of collected geospatial data. This paper presents an automated framework for the accuracy assessment and quality inspection of point cloud data collected by MMSs operating with lightweight laser scanners and consumer-grade microelectromechanical systems (MEMS) sensors. A new, large-scale test facility has been established in a challenging navigation environment (downtown area) to support the analyses conducted in this research work. MMS point cloud data are divided into short time slices for comparison with the higher-accuracy, terrestrial laser scanner (TLS) point cloud of the test facility. MMS data quality is quantified by the results of registering the point cloud of each slice with the TLS datasets. Experiments on multiple land vehicle MMS point cloud datasets using a lightweight laser scanner and three different MEMS devices are presented to demonstrate the effectiveness of the proposed method. The mean accuracy of a consumer grade MEMS ($100) was in the range of 0.48 ± 0.23 m to 0.85 ± 0.52 m. The method presented here in can be straightforwardly implemented and adopted for the accuracy assessment of other MMSs types such as unmanned aerial vehicles (UAV)s.

Cameras and laser scanners are complementary tools for a 2D/3D information generation. Systematic and random errors cause the misalignment of the multi-sensor imagery and point cloud data. In this paper, a novel feature-based approach is proposed for imagery and point cloud fine registration. The tie points and its two neighbor pixels are matched in the overlap images, which are intersected in the object space to create the differential tie plane. A preprocessing is applied to the corresponding tie points and non-robust ones are removed. Initial coarse Exterior Orientation Parameters (EOPs), Interior Orientation Parameters (IOPs), and Additional Parameters (APs) are used to transform tie plane points to the object space. Then, the nearest points of the point cloud data to the transformed tie plane points are estimated. These estimated points are used to calculate Directional Vectors (DV) of the differential planes. As a constraint equation along with the collinearity equation, each object space tie point is forced to be located on the point cloud differential plane. Two different indoor and outdoor experimental data are used to assess the proposed approach. Achieved results show about 2.5 pixels errors on checkpoints. Such results demonstrated the robustness and practicality of the proposed approach.

Mobile mapping systems (MMS) are widely used technology nowadays for spatial data collection of large scale projects like for city and highway mapping. The systems are mainly equipped with laser scanning sensors and/or imaging sensors mounted on a moving vehicle during the scene capture. Imaging sensors are normally cameras which either capture perspective or panoramic images covering the whole horizon of the vehicle. The orientation of the captured panoramic images is accurate to centimeters' level because of the precise positioning and navigation systems equipped with these mapping systems. However, the positioning accuracy of mobile mapping systems can be degraded in city centers or urban canyons because of the satellite signal disturbances. In this article, we discuss the following objectives: (1) the possibility to use the mobile mapping images for cultural heritage documentation and as built surveying and how accurate the mapping can be; (2) the concept of using the mobile mapping images as a tool of georeferencing the crowdsource images; and (3) the efficiency of using the multi-temporal mobile mapping images for occluded free cultural heritage facade orthophotos. The mobile mapping systems of CycloMedia with two panoramic products of Cyclorama images (12 MP) and HD Cycloramas (100 MP) are used for the experimental tests in this research article. [ABSTRACT FROM AUTHOR]

The paper provides some operative replies to evaluate the effectiveness and the critical issues of the simultaneous localisation and mapping (SLAM)-based mobile mapping system (MMS) called ZEB by GeoSLAM™ https://geoslam.com/technology/. In these last years, this type of handheld 3D mapping technology has increasingly developed the framework of portable solutions for close-range mapping systems that have mainly been devoted to mapping the indoor building spaces of enclosed or underground environments, such as forestry applications and tunnels or mines. The research introduces a set of test datasets related to the documentation of landscape contexts or the 3D modelling of architectural complexes. These datasets are used to validate the accuracy and informative content richness about ZEB point clouds in stand-alone solutions and in cases of combined applications of this technology with multisensor survey approaches. In detail, the proposed validation method follows the fulfilment of the endorsed approach by use of root mean square error (RMSE) evaluation and deviation analysis assessment of point clouds between SLAM-based data and 3D point cloud surfaces computed by more precise measurement methods to evaluate the accuracy of the proposed approach. Furthermore, this study specifies the suitable scale for possible handlings about these peculiar point clouds and uses the profile extraction method in addition to feature analyses such as corner and plane deviation analysis of architectural elements. Finally, because of the experiences reported in the literature and performed in this work, a possible reversal is suggested. If in the 2000s, most studies focused on intelligently reducing the light detection and ranging (LiDAR) point clouds where they presented redundant and not useful information, contrariwise, in this sense, the use of MMS methods is proposed to be firstly considered and then to increase the information only wherever needed with more accurate high-scale methods. [ABSTRACT FROM AUTHOR]

MicroGeo had the opportunity to experiment with the ZEB Horizon instrument to acquire a piezometric well in 3D. The scenario is not the easiest to detect. This type of wells, in fact, extends in depth for several tens of meters and with traditional scanning systems it is practically impossible to obtain a complete 3D acquisition of the subject. With the ZEB Horizon Mobile Mapping System it was possible to acquire the well. The subject presents itself as a 30 m deep piezometric well with a diameter of 3.6 m, with a high difficulty of acquisition: the extremely regular surfaces of the well have made the survey activity with the SLAM technique very complex, the algorithm that generates the 3D point cloud model must be extremely powerful in order to be able to generate a correct data even in a condition of extreme surface homogeneity. [ABSTRACT FROM AUTHOR]

Maintenance and expansion of transport and communications infrastructure requires ongoing construction work on a large scale. To plan and execute these in the best possible way, up-to-date and highly detailed digital maps are needed. For example, until recently, telecommunication companies have performed documentation and mapping of as-built urban structures for construction work manually and with great time expense. Mobile mapping systems offer a solution for documenting urban environments fast and mostly automated. In consequence, large amounts of recorded data emerge in short time, creating the need for automated processing and modeling of these data to provide reliable foundations for digital planning in reasonable time. We present (a) a procedure for fully automated processing of mobile mapping data for digital construction planning in the context of nationwide broadband network expansion and (b) an in-depth study of the performance of this procedure on real-world data. Our multi-stage pipeline segments georeferenced images and fuses segmentations with 3D data, which allows exact localization of surfaces and objects, which can then be passed via interface, e.g., to a geographic information system (GIS). The final system is able to distinguish between similar looking surfaces, such as concrete and asphalt, with a precision between 80% and 95%, regardless of setting or season.

Mechanically stabilized earth (MSE) walls rely on its weight to resist the destabilizing earth forces acting at the back of the reinforced soil area. MSE walls are a common infrastructure along national and international transportation corridors as they are low-cost and have easy-to-install precast concrete panels. The usability of such transportation corridors depends on the safety and condition of the MSE wall system. Consequently, MSE walls have to be periodically monitored according to prevailing transportation asset management criteria during the construction and serviceability life stages to ensure that their predictable performance measures are met. To date, MSE walls are monitored using qualitative approaches such as visual inspection, which provide limited information. Aside from being time-consuming, visual inspection is susceptible to bias due to human subjectivity. Manual and visual inspection in the field has been traditionally based on the use of a total station, geotechnical field instrumentation, and/or static terrestrial laser scanning (TLS). These instruments can provide highly accurate and reliable performance measures; however, their underlying data acquisition and processing strategies are time-consuming and not scalable. The proposed strategy in this research provides several global and local serviceability measures through efficient processing of point cloud data acquired by a mobile LiDAR system (MLS) for MSE walls with smooth panels without the need for installing any targets. An ultra-high-accuracy vehicle-based LiDAR data acquisition system has been used for the data acquisition. To check the viability of the proposed methodology, a case study has been conducted to evaluate the similarity of the derived serviceability measures from TLS and MLS technologies. The results of that comparison verified that the MLS-based serviceability measures are within 1 cm and 0.3° of those obtained using TLS and thus confirmed the potential for using MLS to efficiently acquire point clouds while facilitating economical, scalable, and reliable monitoring of MSE walls.

Lane markings are one of the essential elements of road information, which is useful for a wide range of transportation applications. Several studies have been conducted to extract lane markings through intensity thresholding of Light Detection and Ranging (LiDAR) point clouds acquired by mobile mapping systems (MMS). This paper proposes an intensity thresholding strategy using unsupervised intensity normalization and a deep learning strategy using automatically labeled training data for lane marking extraction. For comparative evaluation, original intensity thresholding and deep learning using manually established labels strategies are also implemented. A pavement surface-based assessment of lane marking extraction by the four strategies is conducted in asphalt and concrete pavement areas covered by MMS equipped with multiple LiDAR scanners. Additionally, the extracted lane markings are used for lane width estimation and reporting lane marking gaps along various highways. The normalized intensity thresholding leads to a better lane marking extraction with an F1-score of 78.9% in comparison to the original intensity thresholding with an F1-score of 72.3%. On the other hand, the deep learning model trained with automatically generated labels achieves a higher F1-score of 85.9% than the one trained on manually established labels with an F1-score of 75.1%. In concrete pavement area, the normalized intensity thresholding and both deep learning strategies obtain better lane marking extraction (i.e., lane markings along longer segments of the highway have been extracted) than the original intensity thresholding approach. For the lane width results, more estimates are observed, especially in areas with poor edge lane marking, using the two deep learning models when compared with the intensity thresholding strategies due to the higher recall rates for the former. The outcome of the proposed strategies is used to develop a framework for reporting lane marking gap regions, which can be subsequently visualized in RGB imagery to identify their cause.

Lidar technology is thriving nowadays for different applications mainly for autonomous navigation, mapping, and smart city technology. Lidars vary in different aspects and can be: multi beam, single beam, spinning, solid state, full 360 field of view FOV, single or multi pulse returns, and many other geometric and radiometric aspects. Users and developers in the mapping industry are continuously looking for new released Lidars having high properties of output density, coverage, and accuracy while keeping a lower cost. Accordingly, every Lidar type should be well evaluated for the final intended mapping aim. This evaluation is not easy to implement in practice because of the need to have all the investigated Lidars available in hand and integrated into a ready to use mapping system. Furthermore, to have a fair comparison; it is necessary to ensure the test applied in the same environment at the same travelling path among other conditions. In this paper, we are evaluating two state-of-the-art multi beam Lidar types: Ouster OS-1-64 and Hesai Pandar64 for mapping applications. The evaluation of the Lidar types is applied in a simulation environment which approximates reality. The paper shows the determination of the ideal orientation angle for the two Lidars by assessing the density, coverage, and accuracy and presenting clear performance quantifications and conclusions.

LiDAR-based mobile mapping systems (MMS) are rapidly gaining popularity for a multitude of applications due to their ability to provide complete and accurate 3D point clouds for any and every scene of interest. However, an accurate calibration technique for such systems is needed in order to unleash their full potential. In this paper, we propose a fully automated profile-based strategy for the calibration of LiDAR-based MMS. The proposed technique is validated by comparing its accuracy against the expected point positioning accuracy for the point cloud based on the used sensors’ specifications. The proposed strategy was seen to reduce the misalignment between different tracks from approximately 2 to 3 m before calibration down to less than 2 cm after calibration for airborne as well as terrestrial mobile LiDAR mapping systems. In other words, the proposed calibration strategy can converge to correct estimates of mounting parameters, even in cases where the initial estimates are significantly different from the true values. Furthermore, the results from the proposed strategy are also verified by comparing them to those from an existing manually-assisted feature-based calibration strategy. The major contribution of the proposed strategy is its ability to conduct the calibration of airborne and wheel-based mobile systems without any requirement for specially designed targets or features in the surrounding environment. The above claims are validated using experimental results conducted for three different MMS − two airborne and one terrestrial − with one or more LiDAR unit.

The advances in technology has contributed in many areas in cartography, providing the appearance of Geography Information Systems (GIS's) that are powerful tools to organize, manage and process huge data values obtained by Mapping Mobile Systems (MMS). This work is focused on the management of these data and georeferencing of desired objects found on roads. Trees, lamppost, garbage can, bus stops are examples of objects, that can be described, and their position coordinates can be represented in a map, being of a great value for localization and measuring of these objects.

Multiple laser scanner hardware configurations can be applied to Mobile Mapping Systems. As best practice, laser scanners are rotated horizontally or inclined vertically to increase the probability of contact between the laser scan plane and any surfaces that are perpendicular to the direction of travel. Vertical inclinations also maximise the number of scan profiles striking narrow vertical features, something that can be of use when trying to recognise features. Adding a second scanner allows an MMS to capture more data and improve laser coverage of an area by filling in laser shadows. However, in any MMS the orientation of each scanner on the platform must be decided upon. Changes in the horizontal or vertical orientations of the scanner can increase the range to vertical targets and the road surface, with excessive scanner angles lowering point density significantly. Limited information is available to assist the manufacturers or operators in identifying the optimal scanner orientation for roadside surveys. The method proposed in this paper applies 3D surface normals and geometric formulae to assess the influence of scanner orientation on point distribution. It was demonstrated that by changing the orientation of the scanner the number of pulses striking a target could be greatly increased, and the number of profiles intersecting with the target could also be increased—something that is particularly important for narrow vertical features. The importance of identifying the correct trade-off between the number of profiles intersecting with the target and the point spacing was also raised.

More recently, mapping sensors for land-based Mobile Mapping Systems (MMSs) have combined cameras and laser scanning measurements defined as Light Detection and Ranging (LiDAR), or laser scanner together. These mobile laser scanning systems (MLS) can be used in dynamic environments and are able of being adopted in traffic-related applications, such as the collection of road network databases, inventory of traffic sign and surface conditions, etc. However, most LiDAR systems are expensive and not easy to access. Moreover, due to the increasing demand of the autonomous driving system, the low-cost LiDAR systems, such as Velodyne or SICK, have become more and more popular these days. These kinds of systems do not provide the total solution. Users need to integrate with Inertial Navigation System/Global Navigation Satellite System (INS/GNSS) or camera by themselves to meet their requirement. The transformation between LiDAR and INS frames must be carefully computed ahead of conducting direct geo-referencing. To solve these issues, this research proposes the kinematic calibration model for a land-based INS/GNSS/LiDAR system. The calibration model is derived from the direct geo-referencing model and based on the conditioning of target points where lie on planar surfaces. The calibration parameters include the boresight and lever arm as well as the plane coefficients. The proposed calibration model takes into account the plane coefficients, laser and INS/GNSS observations, and boresight and lever arm. The fundamental idea is the constraint where geo-referenced point clouds should lie on the same plane through different directions during the calibration. After the calibration process, there are two evaluations using the calibration parameters to enhance the performance of proposed applications. The first evaluation focuses on the direct geo-referencing. We compared the target planes composed of geo-referenced points before and after the calibration. The second evaluation concentrates on positioning improvement after taking aiding measurements from LiDARSimultaneously Localization and Mapping (SLAM) into INS/GNSS. It is worth mentioning that only one or two planes need to be adopted during the calibration process and there is no extra arrangement to set up the calibration field. The only requirement for calibration is the open sky area with the clear plane construction, such as wall or building. Not only has the contribution in MMSs or mapping, this research also considers the self-driving applications which improves the positioning ability and stability. [ABSTRACT FROM AUTHOR]

Digital Terrain Models (DTMs) are essential surveying products for terrain based analyses, especially for overland flow modelling. Nowadays, many high resolution DTM products are generated by Airborne Laser Scanning (ALS). However, DTMs with even higher resolution are of great interest for a more precise overland flow modelling in urban areas. With the help of mobile mapping techniques, we can obtain much denser measurements of the ground in the vicinity of roads. In this research, a study area in Hannover, Germany was measured by a mobile mapping system. Point clouds from 485 scan strips were aligned and a DTM was extracted. In order to achieve a product with completeness, this mobile mapping produced DTM was then merged and adapted with a DTM product with 0.5 m resolution from a mapping agency. Systematic evaluations have been conducted with respect to the height accuracy of the DTM products. The results show that the final DTM product achieved a higher resolution (0.1 m) near the roads while essentially maintaining its height accuracy. [ABSTRACT FROM AUTHOR]

In the framework of the digital documentation of complex environments the advanced Geomatics researches offers integrated solution and multi-sensor strategies for the 3D accurate reconstruction of stratified structures and articulated volumes in the heritage domain. The use of handheld devices for rapid mapping, both image- and range-based, can help the production of suitable easy-to use and easynavigable 3D model for documentation projects. These types of reality-based modelling could support, with their tailored integrated geometric and radiometric aspects, valorisation and communication projects including virtual reconstructions, interactive navigation settings, immersive reality for dissemination purposes and evoking past places and atmospheres. The aim of this research is localized within the "Torino 1911" project, led by the University of San Diego (California) in cooperation with the PoliTo. The entire project is conceived for multi-scale reconstruction of the real and no longer existing structures in the whole park space of more than 400,000m2, for a virtual and immersive visualization of the Turin 1911 International "Fabulous Exposition" event, settled in the Valentino Park. Particularly, in the presented research, a 3D metric documentation workflow is proposed and validated in order to integrate the potentialities of LiDAR mapping by handheld SLAM-based device, the ZEB REVO Real Time instrument by GeoSLAM (2017 release), instead of TLS consolidated systems. Starting from these kind of models, the crucial aspects of the trajectories performances in the 3D reconstruction and the radiometric content from imaging approaches are considered, specifically by means of compared use of common DSLR cameras and portable sensors. [ABSTRACT FROM AUTHOR]