Search

Semantic segmentation of airborne point clouds is crucial for 3D scene reconstruction and remote sensing in surveying applications. Current deep learning methods for point clouds primarily focus on effectively aggregating local neighborhood information. However, they often overlook the fusion of global context information and elevation features, which are vital for airborne point clouds. In this study, we propose Dense-LGEANet, a novel network with dense connected architecture and multiscale feature supervision based on our designed LGEA module. The key component of our LGEA module is the combination of the graph convolution block and the transformer block with elevation attention. It can effectively fuse local neighborhood information and global context information to improve the accuracy of semantic segmentation of airborne point cloud. Moreover, the designed dense connected network architecture can enhance the feature extraction capability for point cloud objects at different scales by facilitating interactions between multiple up-sampling and down-sampling layers. We have conducted multiple experiments on the public point cloud dataset. Experimental results show that our method can achieve an mIoU of 58.5% and an mF1 of 72.0% on the ISPRS Vaihingen 3D dataset, while an mIoU of 67.2% and an mF1 of 78.3% on the LASDU dataset. It demonstrates the superior performance of our network and the effectiveness of the proposed feature enhancement module and network architecture.

Unmanned aerial vehicles (UAVs) have been widely used in industry and daily life, where safety is the primary consideration, resulting in their use in open outdoor environments, which are wider than complex indoor environments. However, the demand is growing for deploying UAVs indoors for specific tasks such as inspection, supervision, transportation, and management. To broaden indoor applications while ensuring safety, the quadrotor is notable for its motion flexibility, particularly in the vertical direction. In this study, we developed an improved probabilistic roadmap (PRM) planning method for safe indoor flights based on the assumption of a quadrotor model UAV. First, to represent and model a 3D environment, we generated a reduced-dimensional map using a point cloud projection method. Second, to deploy UAV indoor missions and ensure safety, we improved the PRM planning method and obtained a collision-free flight path for the UAV. Lastly, to optimize the overall mission, we performed postprocessing optimization on the path, avoiding redundant flights. We conducted experiments to validate the effectiveness and efficiency of the proposed method on both desktop and onboard PC, in terms of path-finding success rate, planning time, and path length. The results showed that our method ensures safe indoor UAV flights while significantly improving computational efficiency.

Transmission towers are easily affected by various meteorological and geological disasters. In this paper, a transmission tower tilt state assessment approach—based on high precision and dense point cloud from UAV LiDAR—was proposed. First, the transmission tower point cloud was rapidly located and extracted from the 3D point cloud obtained by UAV-LiDAR line patrol. A robust histogram local extremum extraction method with additional constraints was proposed to achieve adaptive segmentation of the tower head and tower body point cloud. Second, an accurate and efficient extraction and simplification strategy of the contour of the feature plane point cloud was proposed. The central axis of the tower was constrained by the contour of the feature plane through the four-prism structure to calculate the tilt angle of the tower and evaluate the state of the tower. Finally, the point cloud of tower head from UAV-based LiDAR was accurately matched with the designed tower head model from database, and a tower head state evaluation model based on matching offset parameters was proposed to evaluate tower head tilt state. The experimental results of simulation and measured data showed that the calculation accuracy of the tilt parameters of transmission tower body was better than 0.5 degrees, that the proposed method can effectively evaluate the risk of tower head with complex structure, and improve the rapid and mass intelligent perception level of the risk state of the transmission line tower, which has a wide prospects for application.

Research Highlights: This study carried out a feasibility analysis on the tree height extraction of a planted coniferous forest with high canopy density by combining terrestrial laser scanner (TLS) and unmanned aerial vehicle (UAV) image−based point cloud data at small and midsize tree farms. Background and Objectives: Tree height is an important factor for forest resource surveys. This information plays an important role in forest structure evaluation and forest stock estimation. The objectives of this study were to solve the problem of underestimating tree height and to guarantee the precision of tree height extraction in medium and high-density planted coniferous forests. Materials and Methods: This study developed a novel individual tree localization (ITL)-based tree height extraction method to obtain preliminary results in a planted coniferous forest plots with 107 trees (Metasequoia). Then, the final accurate results were achieved based on the canopy height model (CHM) and CHM seed points (CSP). Results: The registration accuracy of the TLS and UAV image-based point cloud data reached 6 cm. The authors optimized the precision of tree height extraction using the ITL-based method by improving CHM resolution from 0.2 m to 0.1 m. Due to the overlapping of forest canopies, the CSP method failed to delineate all individual tree crowns in medium to high-density forest stands with the matching rates of about 75%. However, the accuracy of CSP-based tree height extraction showed obvious advantages compared with the ITL-based method. Conclusion: The proposed method provided a solid foundation for dynamically monitoring forest resources in a high-accuracy and low-cost way, especially in planted tree farms.

High-precision indoor three-dimensional maps are a prerequisite for building information models, indoor location-based services, etc., but the indoor mapping solution is still in the stage of technological experiment and application scenario development. In this paper, indoor mapping equipment integrating a three-axis laser scanner and panoramic camera is designed, and the corresponding workflow and critical technologies are described. First, hardware design and software for controlling the operations and calibration of the spatial relationship between sensors are completed. Then, the trajectory of the carrier is evaluated by a simultaneous location and mapping framework, which includes reckoning of the real-time position and attitude of the carrier by a filter fusing the horizontally placed laser scanner data and inertial measurement data, as well as the global optimization by a closed-loop adjustment using a graph optimization algorithm. Finally, the 3D point clouds and panoramic images of the scene are reconstructed from two tilt-mounted laser scanners and the panoramic camera by synchronization of the position and attitude of the carrier. The experiment was carried out in a five-story library using the proposed prototype system; the results demonstrate accuracies of up to 3 cm for 2D maps, and up to 5 cm for 3D maps, and the produced point clouds and panoramic images can be utilized for modeling and further works related to large-scale indoor scenes. Therefore, the proposed system is an efficient and accurate solution for indoor 3D mapping.

Railway tunnel clearance is directly related to the safe operation of trains and upgrading of freight capacity. As more and more railway are put into operation and the operation is continuously becoming faster, the railway tunnel clearance inspection should be more precise and efficient. In view of the problems existing in traditional tunnel clearance inspection methods, such as low density, slow speed and a lot of manual operations, this paper proposes a tunnel clearance inspection approach based on 3D point clouds obtained by a mobile laser scanning system (MLS). First, a dynamic coordinate system for railway tunnel clearance inspection has been proposed. A rail line extraction algorithm based on 3D linear fitting is implemented from the segmented point cloud to establish a dynamic clearance coordinate system. Second, a method to seamlessly connect all rail segments based on the railway clearance restrictions, and a seamless rail alignment is formed sequentially from the middle tunnel section to both ends. Finally, based on the rail alignment and the track clearance coordinate system, different types of clearance frames are introduced for intrusion operation with the tunnel section to realize the tunnel clearance inspection. By taking the Shuanghekou Tunnel of the Chengdu–Kunming Railway as an example, when the clearance inspection is carried out by the method mentioned herein, its precision can reach 0.03 m, and difference types of clearances can be effectively calculated. This method has a wide application prospects.

Extraction and analysis of building façades are key processes in the three-dimensional (3D) building reconstruction and realistic geometrical modeling of the urban environment, which includes many applications, such as smart city management, autonomous navigation through the urban environment, fly-through rendering, 3D street view, virtual tourism, urban mission planning, etc. This paper proposes a building facade pieces extraction and simplification algorithm based on morphological filtering with point clouds obtained by a mobile laser scanner (MLS). First, this study presents a point cloud projection algorithm with high-accuracy orientation parameters from the position and orientation system (POS) of MLS that can convert large volumes of point cloud data to a raster image. Second, this study proposes a feature extraction approach based on morphological filtering with point cloud projection that can obtain building facade features in an image space. Third, this study designs an inverse transformation of point cloud projection to convert building facade features from an image space to a 3D space. A building facade feature with restricted facade plane detection algorithm is implemented to reconstruct façade pieces for street view service. The results of building facade extraction experiments with large volumes of point cloud from MLS show that the proposed approach is suitable for various types of building facade extraction. The geometric accuracy of building façades is 0.66 m in x direction, 0.64 in y direction and 0.55 m in the vertical direction, which is the same level as the space resolution (0.5 m) of the point cloud.

Existing indoor 3D mapping solutions suffer from high cost and poor portability. In this article, a low-cost and portable indoor 3D mapping approach using biaxial line laser scanners and a one-dimension laser range finder integrated with microelectromechanical systems is proposed. A multiple-sensor calibration approach is presented to perform the extrinsic calibration of the integrated 3D mapping system. The 2D point cloud acquired by the horizontal laser scanner and the orientation information obtained by the microelectromechanical systems are used as inputs for a simultaneous localization and mapping framework to estimate the 2D poses. The height information acquired by the laser range finder is then fused to obtain the 3D pose, which is applied to restore the actual position and orientation of the 2D point cloud generated by the tilted laser scanner to reconstruct the 3D point cloud of the indoor environment. The experimental results--three typical indoor scenes--demonstrate that the proposed approach can achieve accuracies of 3 cm and 2°. Therefore, the proposed approach is a low-cost, portable, and accurate solution for indoor 3D mapping. [ABSTRACT FROM AUTHOR]