Search

This paper explores the potential of an Integrated Sensing and Communication (ISAC) system to enhance search-and-rescue operations. While prior research has explored ISAC capabilities in Unmanned Aerial Vehicles (UAVs), our study focuses on addressing the specific challenges posed by modern communication standards (e.g., power, frequency, and bandwidth limitations) in the context of search-and-rescue missions. The paper details effective methods for processing echoed signals generated by downlink transmissions and evaluates key performance indicators, including Noise Equivalent Sigma Zero (NESZ) and channel capacity. Additionally, we utilize synchronization uplink signals transmitted by User Equipment (UE) to improve target detection and classification of possible victims by fusing SAR imagery with triangulation results from uplink signals. An experimental campaign validates the proposed setup by integrating SAR images of the environment with active localization results, both produced by a UAV equipped with a Software Defined Radio (SDR) payload. Our results demonstrate the system's capability to detect and localize buried targets in avalanche scenarios, with localization errors ranging from centimeters to 10 m depending on environmental conditions. This successful integration highlights the practical applicability of our approach in challenging search-and-rescue missions. [ABSTRACT FROM AUTHOR]

Visual object tracking is a key technology that is used in unmanned aerial vehicles (UAVs) to achieve autonomous navigation. In recent years, with the rapid development of deep learning, tracking algorithms based on Siamese neural networks have received widespread attention. However, because of complex and diverse tracking scenarios, as well as limited computational resources, most existing tracking algorithms struggle to ensure real-time stable operation while improving tracking performance. Therefore, studying efficient and fast-tracking frameworks, and enhancing the ability of algorithms to respond to complex scenarios has become crucial. Therefore, this paper proposes a cross-parallel attention and efficient match transformer for aerial tracking (SiamEMT). Firstly, we carefully designed the cross-parallel attention mechanism to encode global feature information and to achieve cross-dimensional interaction and feature correlation aggregation via parallel branches, highlighting feature saliency and reducing global redundancy information, as well as improving the tracking algorithm's ability to distinguish between targets and backgrounds. Meanwhile, we implemented an efficient match transformer to achieve feature matching. This network utilizes parallel, lightweight, multi-head attention mechanisms to pass template information to the search region features, better matching the global similarity between the template and search regions, and improving the algorithm's ability to perceive target location and feature information. Experiments on multiple drone public benchmark tests verified the accuracy and robustness of the proposed tracker in drone tracking scenarios. In addition, on the embedded artificial intelligence (AI) platform AGX Xavier, our algorithm achieved real-time tracking speed, indicating that our algorithm can be effectively applied to UAV tracking scenarios. [ABSTRACT FROM AUTHOR]

In recent years, unmanned aerial vehicles (UAVs) have gained popularity due to their flexibility, mobility, and accessibility in various fields, including search and rescue (SAR) operations. The use of UAVs in SAR can greatly enhance the task success rates in reaching inaccessible or dangerous areas, performing challenging operations, and providing real-time monitoring and modeling of the situation. This article aims to help readers understand the latest progress and trends in this field by synthesizing and organizing papers related to UAV search and rescue. An introduction to the various types and components of UAVs and their importance in SAR operations is settled first. Additionally, we present a comprehensive review of sensor integrations in UAVs for SAR operations, highlighting their roles in target perception, localization, and identification. Furthermore, we elaborate on the various applications of UAVs in SAR, including on-site monitoring and modeling, perception and localization of targets, and SAR operations such as task assignment, path planning, and collision avoidance. We compare different approaches and methodologies used in different studies, assess the strengths and weaknesses of various approaches, and provide insights on addressing the research questions relating to specific UAV operations in SAR. Overall, this article presents a comprehensive overview of the significant role of UAVs in SAR operations. It emphasizes the vital contributions of drones in enhancing mission success rates, augmenting situational awareness, and facilitating efficient and effective SAR activities. Additionally, the article discusses potential avenues for enhancing the performance of UAVs in SAR. [ABSTRACT FROM AUTHOR]

When it comes to forest management and protection, knowledge is key. Therefore, forest mapping is crucial to obtain the required knowledge towards profitable resource exploitation and increased resilience against wildfires. Within this context, this paper presents a literature review on tree classification and segmentation using data acquired by unmanned aerial vehicles, with special focus on the last decade (2013–2023). The latest research trends in this field are presented and analyzed in two main vectors, namely: (1) data, where used sensors and data structures are resumed; and (2) methods, where remote sensing and data analysis methods are described, with particular focus on machine learning approaches. The study and review methodology filtered 979 papers, which were then screened, resulting in the 144 works included in this paper. These are systematically analyzed and organized by year, keywords, purpose, sensors, and methods used, easily allowing the readers to have a wide, but at the same time detailed, view of the latest trends in automatic tree classification and segmentation using unmanned aerial vehicles. This review shows that image processing and machine learning techniques applied to forestry and segmentation and classification tasks are focused on improving the accuracy and interpretability of the results by using multi-modal data, 3D information, and AI methods. Most works use RGB or multispectral cameras, or LiDAR scanners, individually. Classification is mostly carried out using supervised methods, while segmentation mostly uses unsupervised machine learning techniques. [ABSTRACT FROM AUTHOR]

Transmission line detection is the basic task of using UAVs for transmission line inspection and other related tasks. However, the detection results based on traditional methods are vulnerable to noise, and the results may not meet the requirements. The deep learning method based on segmentation may cause a lack of vector information and cannot be applied to subsequent high-level tasks, such as distance estimation, location, and so on. In this paper, the characteristics of transmission lines in UAV images are summarized and utilized, and a lightweight powerline detection network is proposed. In addition, due to the reason that powerlines often run through the whole image and are sparse compared to the background, the FPN structure with Hough transform and the neck structure with multi-scale output are introduced. The former can make better use of edge information in a deep neural network as well as reduce the training time. The latter can reduce the error caused by the imbalance between positive and negative samples, make it easier to detect the lines running through the whole image, and finally improve the network performance. This paper also constructs a powerline detection dataset. While the net this paper proposes can achieve real-time detection, the f-score of the detection dataset reaches 85.6%. This method improves the effect of the powerline extraction task and lays the groundwork for subsequent possible high-level tasks. [ABSTRACT FROM AUTHOR]

In recent years, the three-dimensional (3D) radar detection range has played an essential role in the layout of devices such as aircraft and drones. To compensate for the shortcomings of three-dimensional calculations for radar terrain masking, a new calculation method is proposed for assessing the terrain occlusion of radar detection range. First, the high-dimensional electromagnetic data after discretization are modeled based on the tensor data structure, and the tensor grid dilation operator is constructed. Then, the dilation process begins from the overlapping section of the radar detection range and terrain, and it is adjusted by the terrain occlusion judgment factor and the dilation judgment factor to obtain the obstructed part due to the terrain. Finally, the actual radar detection range under terrain occlusion is obtained. The simulation results show that the method proposed in this paper can adapt to different grid sizes and terrain shapes, significantly enhancing computational efficiency while maintaining internal features. [ABSTRACT FROM AUTHOR]

Unmanned aerial vehicles (UAVs) are increasing in popularity in various sectors, simultaneously rasing the challenge of detecting those with low radar cross sections (RCS). This review paper aims to assess the current state-of-the-art in radar technology, focusing on multiple-input multiple-output (MIMO) and beamforming techniques, to address this growing concern. It explores the challenges associated with detecting UAVs in urban settings and adverse weather conditions, where traditional radar systems often do not succeed. This paper examines the existing literature and technological advancements to understand how these methodologies can significantly boost detection capabilities under the constraints of low RCS. In particular, MIMO technology, renowned for its spatial multiplexing, and beamforming, with its directional signal enhancement, are evaluated for their efficacy in the context of UAV surveillance and defense strategies. Ultimately, a comprehensive comparison is presented, drawing on a variety of studies to illustrate the combined potential of integrating these technologies, providing the way for future developments in radar system design and UAV detection. [ABSTRACT FROM AUTHOR]

As miniaturization technology has progressed, Synthetic Aperture Radar (SAR) can now be mounted on Unmanned Aerial Vehicles (UAVs) to carry out observational tasks. Influenced by airflow, UAVs inevitably experience deviations or vibrations during flight. In the context of cost constraints, the precision of the measurement equipment onboard UAVs may be relatively low. Nonetheless, high-resolution imaging demands more accurate track information. It is therefore of great importance to estimate high-precision tracks in the presence of both motion and measurement errors. This paper presents a robust track estimation method for airborne SAR that makes use of both envelope and phase errors. Firstly, weak navigation information is employed for motion compensation, which reduces a significant portion of the motion error. Subsequently, the track is initially estimated using additional envelope errors introduced by the Extended Omega-K (EOK) algorithm. The track is then refined using a phase-based approach. Furthermore, this paper presents the calculation method of the compensated component for each target and provides an analysis of accuracy from both theoretical and simulation perspectives. The track estimation and imaging results in the simulations and real data experiments validate the effectiveness of the proposed method, with an estimation accuracy of real data experiments within 5 cm. [ABSTRACT FROM AUTHOR]

The Meijiayan landslide in Pengshui County within Chongqing City is a medium-scale soil landslide triggered by the excavation of roadbeds. To delve into the influencing factors and assess the stability of this landslide, it is crucial to meticulously map the subterranean geological framework of the area. Such an analysis lays the groundwork for evaluating and mitigating the risks of future landslide instabilities. In this context, the semi-airborne transient electromagnetic method (SATEM), which is complemented by a receiving system mounted on an aerial platform, stands out as an innovative geophysical exploration technique. This method is adept at conducting swift measurements across complex terrains, making it particularly valuable for areas prone to such geological events. This paper presents the utilization of a cutting-edge loop source SATEM system, which was operationalized via a rotor-based unmanned aerial vehicle (UAV). The system was employed to conduct shallow geological structure detection experiments on the Meijiayan landslide. The SATEM detection outcomes have unveiled fluctuations in the electrical distribution across the upper strata, which are indicative of the subsurface geological boundaries, faults, and areas potentially rich in water within the landslide region. These discoveries affirm the viability of utilizing loop source SATEM for the identification of shallow geological structures in regions susceptible to landslides. The findings indicate that while the landslide is currently in a stable condition, it poses a significant risk of movement, especially during the rainy season, with the potential for landslides to be exacerbated by extreme or sustained rainfall events. [ABSTRACT FROM AUTHOR]

Landslides represent a major problem in human activities, especially in the proximity of cities or infrastructure. In this paper, we present the peculiar case of Pietracamela, Italy. Pietracamela is a small village located in the Central Apennines, a few kilometers north of the Gran Sasso Mountain. The peculiarity of the case study is the fact that the village is simultaneously affected by two different types of slope instabilities. The southwest sector, representing the historical part of the village, has been affected by large rockfalls generated from the "Capo le Vene" cliff located in the south of the village. The northeastern sector of the village represents the most recent urbanized area and is involved in a deep-seated landslide that, in the last decades, has damaged buildings and infrastructure. In this context, we have used two different types of remote sensing techniques to study the two phenomena. The rockfall area has been surveyed through the use of an Unmanned Aerial Vehicle (UAV) that allowed the definition of main joint sets and the volume of blocks associated with the most recent (2011) rockfall event. Three main joint sets have been highlighted, which are responsible for the failure of the "Capo le Vene" cliff. The volume of blocks that failed during the last rock failure in 2011 ranged from a few to 1500 m3. The deep-seated landslide has been studied by analyzing borehole data and 20 years of InSAR data from ERS1/2, ENVISAT, COSMO-SkyMed, and SENTINEL-1. It has been highlighted by InSAR analysis that the northeast sector of the village shows a perfectly linear displacement trend that generates movements up to about 230 mm (about 1 cm/year). [ABSTRACT FROM AUTHOR]

In this paper, we propose a comprehensive and optimised workflow for the documentation and the future maintenance and management of a historical building, integrating the state of the art of different techniques, in the challenging context of industrial archaeology. This approach has been applied to the hydraulic work of the "Sostegno del Battiferro" in Bologna, Italy, an example of built industrial heritage whose construction began in 1439 and remains in active use nowadays to control the Navile canal water flow rate. The initial step was the definition of a 3D topographic frame, including geodetic measurements, which served as a reference for the complete 3D survey integrating Terrestrial Laser Scanning (TLS), Structured Light Projection scanning, and the photogrammetric processing of Unmanned Aircraft System (UAS) imagery through a Structure from Motion (SfM) approach. The resulting 3D point cloud has supported as-built parametric modelling (Scan-to-BIM) with the consequent extraction of plans and sections. Finally, the Heritage/Historic Building Information Modelling (HBIM) model generated was rendered and tested for a VR-based immersive experience. Building Information Modelling (BIM) and virtual reality (VR) applications were tested as a support for the management of the building, the maintenance of the hydraulic system, and the training of qualified technicians. In addition, considering the historical value of the surveyed building, the methodology was also applied for dissemination purposes. [ABSTRACT FROM AUTHOR]

Forest fires pose a catastrophic threat to Earth's ecology as well as threaten human beings. Timely and accurate monitoring of forest fires can significantly reduce potential casualties and property damage. Thus, to address the aforementioned problems, this paper proposed an unmanned aerial vehicle (UAV) based on a lightweight forest fire recognition model, Fire-Net, which has a multi-stage structure and incorporates cross-channel attention following the fifth stage. This is to enable the model's ability to perceive features at various scales, particularly small-scale fire sources in wild forest scenes. Through training and testing on a real-world dataset, various lightweight convolutional neural networks were evaluated on embedded devices. The experimental outcomes indicate that Fire-Net attained an accuracy of 98.18%, a precision of 99.14%, and a recall of 98.01%, surpassing the current leading methods. Furthermore, the model showcases an average inference time of 10 milliseconds per image and operates at 86 frames per second (FPS) on embedded devices. [ABSTRACT FROM AUTHOR]

With rising global temperatures, wildfires frequently occur worldwide during the summer season. The timely detection of these fires, based on unmanned aerial vehicle (UAV) images, can significantly reduce the damage they cause. Existing Convolutional Neural Network (CNN)-based fire detection methods usually use multiple convolutional layers to enhance the receptive fields, but this compromises real-time performance. This paper proposes a novel real-time semantic segmentation network called FireFormer, combining the strengths of CNNs and Transformers to detect fires. An agile ResNet18 as the encoding component tailored to fulfill the efficient fire segmentation is adopted here, and a Forest Fire Transformer Block (FFTB) rooted in the Transformer architecture is proposed as the decoding mechanism. Additionally, to accurately detect and segment small fire spots, we have developed a novel Feature Refinement Network (FRN) to enhance fire segmentation accuracy. The experimental results demonstrate that our proposed FireFormer achieves state-of-the-art performance on the publicly available forest fire dataset FLAME—specifically, with an impressive 73.13% IoU and 84.48% F1 Score. [ABSTRACT FROM AUTHOR]

For modern radar systems, small unmanned aerial vehicles (UAVs) belong to a typical types of targets with 'low, slow, and small' characteristics. In complex combat environments, the functional requirements of radar systems are not only limited to achieving stable detection and tracking performance but also to effectively complete the recognition of small UAV targets. In this paper, a multi-dimensional feature fusion framework for small UAV target recognition utilizing a small-sized and low-cost high-resolution radar is proposed, which can fully extract and combine the geometric structure features and the micro-motion features of small UAV targets. For the performance analysis, the echo data of different small UAV targets was measured and collected with a millimeter-wave radar, and the dataset consists of high-resolution range profiles (HRRP) and micro-Doppler time–frequency spectrograms was constructed for training and testing. The effectiveness of the proposed method was demonstrated by a series of comparison experiments, and the overall accuracy of the proposed method can reach 98.5%, which demonstrates that the proposed multi-dimensional feature fusion method can achieve better recognition performance than that of classical algorithms and higher robustness than that of single features for small UAV targets. [ABSTRACT FROM AUTHOR]

Contemporary land administration (LA) systems incorporate the concepts of cadastre and land registration. Conceptually, LA is part of a global land management paradigm incorporating LA functions such as land value, land tenure, land development, and land use. The implementation of land-related policies integrated with well-maintained spatial information reflects the aim set by the United Nations to deliver tenure security for all (Sustainable Development Goal target 1.4, amongst many others). Innovative methods for data acquisition, processing, and maintaining spatial information are needed in response to the global challenges of urbanization and complex urban infrastructure. Current technological developments in remote sensing and geo-spatial information science provide enormous opportunities in this respect. Over the past decade, the increasing usage of unmanned aerial vehicles (UAVs), satellite and airborne-based acquisitions, as well as active remote sensing sensors such as LiDAR, resulted in high spatial, spectral, radiometric, and temporal resolution data. Moreover, significant progress has also been achieved in automatic image orientation, surface reconstruction, scene analysis, change detection, classification, and automatic feature extraction with the help of artificial intelligence, spatial statistics, and machine learning. These technology developments, applied to LA, are now being actively demonstrated, piloted, and scaled. This Special Issue hosts papers focusing on the usage and integration of emerging remote sensing techniques and their potential contribution to the LA domain. [ABSTRACT FROM AUTHOR]

Rice false smut (RFS) is a late-onset fungal disease that primarily affects rice panicle in recent years. Severe RFS can decrease the yield by 20–30% and severely affect rice quality. This research used hyperspectral remote sensing data from unmanned aerial vehicles (UAV). On the basis of genetic algorithm combined with partial least squares to select the feature bands, this paper creates a new method to use the Pearson correlation coefficient method and Instability Index between Classes (ISIC) method to further select characteristic bands, which further eliminated 27.78% of the feature bands when the model monitoring accuracy was improved overall. The prediction accuracy of the Gradient Boosting Decision Tree model and Random Forest model was the best, which were 85.62% and 84.10%, respectively, and the monitoring accuracy was improved by 2.22% and 2.4% compared with that before optimization. Then, based on the UAV hyperspectral data and the combination of characteristic bands selected by the three band optimization methods, the sensitive band ranges of rice false smut monitoring were determined, which were 698–800 nm and 974–997 nm. This paper provides an effective method of selecting characteristic bands of hyperspectral data and a method of monitoring crop diseases' using unmanned aerial vehicles. [ABSTRACT FROM AUTHOR]

This paper addresses the conservation problems of the cave of Altamira, a UNESCO World Heritage Site in Santillana del Mar, Cantabria, Spain, due to the effects of moisture and water inside the cave. The study focuses on the description of methods for estimating the trajectory and zones of humidity from the external environment to its eventual dripping on valuable cave paintings. To achieve this objective, several multisensor remote sensing techniques, both aerial and terrestrial, such as 3D laser scanning, a 2D ground penetrating radar, photogrammetry with unmanned aerial vehicles, and high-resolution terrestrial techniques are employed. These tools allow a detailed spatial analysis of the moisture and water in the cave. The paper highlights the importance of the dolomitic layer in the cave and how it influences the preservation of the ceiling, which varies according to its position, whether it is sealed with calcium carbonate, actively dripping, or not dripping. In addition, the crucial role of the central fracture and the areas of direct water infiltration in this process is examined. This research aids in understanding and conserving the site. It offers a novel approach to water-induced deterioration in rock art for professionals and researchers. [ABSTRACT FROM AUTHOR]

The UAV-borne video SAR (ViSAR) imaging system requires miniaturization, low power consumption, high frame rates, and high-resolution real-time imaging. In order to satisfy the requirements of real-time imaging processing for the UAV-borne ViSAR under limited memory and parallel computing resources, this paper proposes a method of embedded GPU-based real-time imaging processing for the UAV-borne ViSAR. Based on a parallel programming model of the compute unified device architecture (CUDA), this paper designed a parallel computing method for range-Doppler (RD) and map drift (MD) algorithms. By utilizing the advantages of the embedded GPU characterized with parallel computing, we improved the processing speed of real-time ViSAR imaging. This paper also adopted a unified memory management method, which greatly reduces data replication and communication latency between the CPU and the GPU. The data processing of 2048 × 2048 points took only 1.215 s on the Jetson AGX Orin platform to form a nine-consecutive-frame image with a resolution of 0.15 m, with each frame taking only 0.135 s, enabling real-time imaging at a high frame rate of 5 Hz. In actual testing, continuous mapping can be achieved without losing the scenes, intuitively obtaining the dynamic observation effects of the area. The processing results of the measured data have verified the reliability and effectiveness of the proposed scheme, satisfying the processing requirements for real-time ViSAR imaging. [ABSTRACT FROM AUTHOR]

Unmanned aerial vehicles (UAVs) have emerged as a highly efficient means of monitoring landslide-prone regions, given the growing concern for urban safety and the increasing occurrence of landslides. Designing optimal UAV flight routes is crucial for effective landslide monitoring. However, in real-world scenarios, the testing and validating of flight path planning algorithms incur high cost and safety concerns, making overall flight operations challenging. Therefore, this paper proposes the use of the Unreal Engine simulation framework to design UAV flight path planning specifically for landslide monitoring. It aims to validate the authenticity of the simulated flight paths and the correctness of the algorithms. Under the proposed simulation framework, we then test a novel flight path planning algorithm. The simulation results demonstrate that the model reconstruction obtained using the novel flight path algorithm exhibits more detailed textures, with a 3D model simulation accuracy ranging from 10 to 14 cm. Among them, the RMSE value of the novel flight route algorithm falls within the range of 10 to 11 cm, exhibiting a 2 to 3 cm improvement in accuracy compared to the traditional flight path algorithm. Additionally, it effectively reduces the flight duration by 9.3% under the same flight path compared to conventional methods. The results confirm that the simulation framework developed in this paper meets the requirements for landslide damage monitoring and validates the feasibility and correctness of the UAV flight path planning algorithm. [ABSTRACT FROM AUTHOR]

The construction of transport facilities plays a pivotal role in enhancing people's living standards, stimulating economic growth, maintaining social stability and bolstering national security. During the construction of transport facilities, it is essential to identify the distinctive features of a construction area to anticipate the construction process and evaluate the potential risks associated with the project. This paper presents a multi-objective semantic segmentation algorithm based on an improved U-Net network, which can improve the recognition efficiency of various types of features in the construction zone of transportation facilities. The main contributions of this paper are as follows: A multi-class target sample dataset based on UAV remote sensing and construction areas is established. A new virtual data augmentation method based on semantic segmentation of transport facility construction areas is proposed. A semantic segmentation model for the construction regions based on data augmentation and transfer learning is developed and future research directions are given. The results of the study show that the validity of the virtual data augmentation approach has been verified; the semantic segmentation of the transport facility model can semantically segment a wide range of target features. The highest semantic segmentation accuracy of the feature type was 97.56%. [ABSTRACT FROM AUTHOR]

This paper presents a new approach for delineating river coastlines in RGB close-range nadir aerial imagery acquired by unmanned aerial vehicles (UAVs), aimed at facilitating waterline detection through the reduction of the dimensions of a colour space and the use of coarse grids rather than pixels. Since water has uniform brightness, expressed as the value (V) component in the hue, saturation, value (HSV) colour model, the reduction in question is attained by extracting V and investigating its histogram to identify areas where V does not vary considerably. A set of 30 nadir UAV-acquired photos, taken at five different locations in Poland, were used to validate the approach. For 67% of all analysed images (both wide and narrow rivers were photographed), the detection rate was above 50% (with the false hit rate ranged between 5.00% and 61.36%, mean 36.62%). When the analysis was limited to wide rivers, the percentage of images in which detection rate exceeded 50% increased to 80%, and the false hit rates remained similar. Apart from the river width, land cover in the vicinity of the river, as well as uniformity of water colour, were found to be factors which influence the waterline detection performance. Our contribution to the existing knowledge is a rough waterline detection approach based on limited information (only the V band, and grids rather than pixels). [ABSTRACT FROM AUTHOR]

In response to the challenges of remote sensing imagery, such as unmanned aerial vehicle (UAV) aerial imagery, including differences in target dimensions, the dominance of small targets, and dense clutter and occlusion in complex environments, this paper optimizes the YOLOv8n model and proposes an innovative small-object-detection model called DDSC-YOLO. First, a DualC2f structure is introduced to improve the feature-extraction capabilities of the model. This structure uses dual-convolutions and group convolution techniques to effectively address the issues of cross-channel communication and preserving information in the original input feature mappings. Next, a new attention mechanism, DCNv3LKA, was developed. This mechanism uses adaptive and fine-grained information-extraction methods to simulate receptive fields similar to self-attention, allowing adaptation to a wide range of target size variations. To address the problem of false and missed detection of small targets in aerial photography, we designed a Semantics and Detail Infusion Feature Pyramid Network (SDI-FPN) and added a dedicated detection scale specifically for small targets, effectively mitigating the loss of contextual information in the model. In addition, the coordinate adaptive spatial feature fusion (CASFF) mechanism is used to optimize the original detection head, effectively overcoming multi-scale information conflicts while significantly improving small target localization accuracy and long-range dependency perception. Testing on the VisDrone2019 dataset shows that the DDSC-YOLO model improves the mAP0.5 by 9.3% over YOLOv8n, and its performance on the SSDD and RSOD datasets also confirms its superior generalization capabilities. These results confirm the effectiveness and significant progress of our novel approach to small target detection. [ABSTRACT FROM AUTHOR]

Battlefield surveillance radar is usually 2-D radar, which cannot realize target three-dimensional localization, leading to poor resolution for the air target in the elevation dimension. Previous researchers have used the Traditional Height Finder Radar (HFR) or multiple 2-D radar networking to estimate the target three-dimensional location. However, all of them face the problems of high cost, poor real-time performance and high requirement of space–time registration. In this paper, Reconfigurable Intelligent Surfaces (RISs) with low cost are introduced into the 2-D radar to realize the target three-dimensional localization. Taking advantage of the wide beam of 2-D radar in the elevation dimension, several Unmanned Aerial Vehicles (UAVs) carrying RISs are set in the receiving beam to form multiple auxiliary measurement channels. In addition, the traditional 2-D radar measurements combined with the auxiliary channel measurements are used to realize the target three-dimensional localization by solving a nonlinear least square problem with a convex optimization method. For the proposed RIS-assisted target three-dimensional localization problem, the Cramer–Rao Lower Bound (CRLB) is derived to measure the target localization accuracy. Simulation results verify the effectiveness of the proposed 3-D localization method, and the influences of the number, the positions and the site errors of the RISs on the localization accuracy are covered. [ABSTRACT FROM AUTHOR]

The anthropogenic climate crisis results in the gradual loss of tree species in locations where they were previously able to grow. This leads to increasing workloads and requirements for foresters and arborists as they are forced to restructure their forests and city parks. The advancements in computer vision (CV)—especially in supervised deep learning (DL)—can help cope with these new tasks. However, they rely on large, carefully annotated datasets to produce good and generalizable models. This paper presents BAMFORESTS: a dataset with 27,160 individually delineated tree crowns in 105 ha of very-high-resolution UAV imagery gathered with two different sensors from two drones. BAMFORESTS covers four areas of coniferous, mixed, and deciduous forests and city parks. The labels contain instance segmentations of individual trees, and the proposed splits are balanced by tree species and vitality. Furthermore, the dataset contains the corrected digital surface model (DSM), representing tree heights. BAMFORESTS is annotated in the COCO format and is especially suited for training deep neural networks (DNNs) to solve instance segmentation tasks. BAMFORESTS was created in the BaKIM project and is freely available under the CC BY 4.0 license. [ABSTRACT FROM AUTHOR]

Urban tree classification enables informed decision-making processes in urban planning and management. This paper introduces a novel data reformation method, pseudo tree crown (PTC), which enhances the feature difference in the input layer and results in the improvement of the accuracy and efficiency of urban tree classification by utilizing artificial intelligence (AI) techniques. The study involved a comparative analysis of the performance of various machine learning (ML) classifiers. The results revealed a significant enhancement in classification accuracy, with an improvement exceeding 10% observed when high spatial resolution imagery captured by an unmanned aerial vehicle (UAV) was utilized. Furthermore, the study found an impressive average classification accuracy of 93% achieved by a classifier built on the PyTorch framework, with ResNet50 leveraged as its convolutional neural network layer. These findings underscore the potential of AI-driven approaches in advancing urban tree classification methodologies for enhanced urban planning and management practices. [ABSTRACT FROM AUTHOR]

In recent years, with the continuous development and popularization of unmanned aerial vehicle (UAVs) technology, the surge in the number of UAVs has led to an increasingly serious problem of illegal flights. Traditional acoustic-based UAV localization techniques have limited ability to extract short-time and long-time signal features, and have poor localization performance in low signal-to-noise ratio environments. For this reason, in this paper, we propose a deep learning-based UAV localization technique in low signal-to-noise ratio environments. Specifically, on the one hand, we propose a multiple signal classification (MUSIC) pseudo-spectral normalized mean processing technique to improve the direction of arrival (DOA) performance of a traditional broadband MUSIC algorithm. On the other hand, we design a DOA estimation algorithm for UAV sound sources based on a time delay estimation neural network, which solves the problem of limited DOA resolution and the poor performance of traditional time delay estimation algorithms under low signal-to-noise ratio conditions. We verify the feasibility of the proposed method through simulation experiments and experiments in real scenarios. The experimental results show that our proposed method can locate the approximate flight path of a UAV within 20 m in a real scenario with a signal-to-noise ratio of −8 dB. [ABSTRACT FROM AUTHOR]

Structure from Motion (SfM) for large-scale UAV (Unmanned Aerial Vehicle) images has been widely used in the fields of photogrammetry and computer vision. Its efficiency, however, decreases dramatically as well as with the memory occupation rising steeply due to the explosion of data volume and the iterative BA (bundle adjustment) optimization. In this paper, an efficient SfM solution is proposed to solve the low-efficiency and high memory consumption problems. First, an algorithm is designed to find UAV image match pairs based on a graph-indexed bag-of-words (BoW) model (GIBoW), which treats visual words as vertices and link relations as edges to build a small-world graph structure. The small-world graph structure can be used to search the nearest-neighbor visual word for query features with extremely high efficiency. Reliable UAV image match pairs can effectively improve feature matching efficiency. Second, a central bundle adjustment with object point-wise parallel construction of the Schur complement (PSCBA) is proposed, which is designed as the combination of the LM (Levenberg–Marquardt) algorithm with the preconditioned conjugate gradients (PCG). The PSCBA method can dramatically reduce the memory consumption in both error and normal equations, as well as improve efficiency. Finally, by using four UAV datasets, the effectiveness of the proposed SfM solution is verified through comprehensive analysis and comparison. The experimental results show that compared with Colmap-Bow and Dbow2, the proposed graph index BoW retrieval algorithm improves the efficiency of image match pair selection with an acceleration ratio ranging from 3 to 7. Meanwhile, the parallel-constructed BA optimization algorithm can achieve accurate bundle adjustment results with an acceleration ratio by 2 to 7 times and reduce memory occupation by 2 to 3 times compared with the BA optimization using Ceres solver. For large-scale UAV images, the proposed method is an effective and reliable solution. [ABSTRACT FROM AUTHOR]

Drones, also known as unmanned aerial vehicles (UAVs), have gained numerous applications due to their low cost, ease of use, vertical takeover and landing, and ability to operate in high-risk or hard-to-reach areas. The contribution of this review is that of building the bridge between drone technology and its application and advancements in the field of Geographic Information System (GIS). The integration of drones and GIS is valuable as it reduces costs and improves accessibility for geospatial data collection. Traditional methods involving aircraft for aerial photography are expensive, requiring the hiring of aircraft, pilots, and photographers. Drones equipped with advanced cameras and artificial intelligence software can replace the conventional technique and at the same time, be economical and time-efficient. The integration of drones and GIS is expected to bring revolutionary benefits in the fields of precision agriculture, urban planning, emergency health response, disaster management, the development of smart cities, food delivery, etc. In this paper, a state-of-the-art review of the deployment of drone-integrated GIS applications in different fields is presented. Numerous techniques and associated challenges related to their development, formulation, implementation, and regulation are highlighted. It has been concluded that drone-integration solutions in GIS improve efficiency and accuracy, enhance the decision-making process, and facilitate better real-time monitoring. The findings of this review paper are intended to help and benefit researchers, business developers, emergency service providers, industrialists, and policymakers. [ABSTRACT FROM AUTHOR]

Landslide traces are crucial geomorphological features of landslides. Through the recognition of landslide traces, a better grasp of the topographical features of landslides can be achieved, thereby aiding in the enhancement of capabilities for the prevention, response, and management of landslides. Aiming at the complex topographic features of landslide traces, only using a single DEM product could provide a complete and comprehensive recognition of landslide traces. A method of landslide tracing recognition based on the fusion of multi-feature information from the Unmanned Aerial Vehicle-based Light Detection and Ranging (UAV-based LiDAR) Digital Elevation Model (DEM) is proposed. First, a high-precision DEM is constructed by using the LiDAR point cloud data. Based on the DEM, four multi-feature images that can enhance the landslide geomorphology are generated: hillshading, slope, positive openness, and sky-view factor. Furtherore, the DEM multi-feature images were fused using the Visualization for Archaeological Topography (VAT) method to obtain the DEM Multi-Feature Fusion Image (DEM-DFFI). Finally, the landslide traces were extracted from the DEM-DFFI based on fractal theory. The method presented in this paper makes full use of DEM multi-feature images and fuses them, which can accurately and clearly show the topographic and geomorphological features of landslides. Based on this, it helps improve landslide trace recognition accuracy. [ABSTRACT FROM AUTHOR]

The high-precision building exterior facade corner point (BEFCP) is an essential element in topographic and cadastral surveys. However, current extraction methods rely on the interactions of humans with the 3D real-scene models produced by unmanned aerial vehicle (UAV) oblique photogrammetry, which have a high workload, low efficiency, poor precision, and cannot satisfy the requirements of automation. The dense point cloud contains discrete 3D building structure information. Still, it is challenging to accurately filter out the partial point cloud characterizing the building structure from it in order to achieve BEFCP extraction. The BEFCPs are always located on the plumb line of the building's exterior wall. Thus, this paper back-calculated the plumb line from the image and designed a photographic ray corresponding to the image point and point cloud intersection point calculation algorithm to recover its approximate spatial position in order to successfully extract the accurate point cloud in the building structure neighborhood. It then utilized the high signal-to-noise ratio property of the point cloud as a base to eliminate the noise points and, finally, accurately located the building exterior façade corner points by recovering the building structure through segmental linear fitting of the point cloud. The proposed algorithm conducted automated building exterior facade corner point extraction via both of planar-to-stereo and rough-to-precise strategies, reached a 92.06% correctness rate and ±4.5 cm point mean square location error in the experiment, and was able to extract and distinguish the building exterior facade corner points under eaves obstruction and extreme proximity. It is suitable for all high-precision surveying and mapping tasks in building areas based on oblique photogrammetry, which can effectively improve the automation of mapping production. [ABSTRACT FROM AUTHOR]

Unmanned aerial vehicle (UAV) vision technology is becoming increasingly important, especially in wilderness rescue. For humans in the wilderness with poor network conditions and bad weather, this paper proposes a technique for road extraction and road condition detection from video captured by UAV multispectral cameras in real-time or pre-downloaded multispectral images from satellites, which in turn provides humans with optimal route planning. Additionally, depending on the flight altitude of the UAV, humans can interact with the UAV through dynamic gesture recognition to identify emergency situations and potential dangers for emergency rescue or re-routing. The purpose of this work is to detect the road condition and identify emergency situations in order to provide necessary and timely assistance to humans in the wild. By obtaining a normalized difference vegetation index (NDVI), the UAV can effectively distinguish between bare soil roads and gravel roads, refining the results of our previous route planning data. In the low-altitude human–machine interaction part, based on media-pipe hand landmarks, we combined machine learning methods to build a dataset of four basic hand gestures for sign for help dynamic gesture recognition. We tested the dataset on different classifiers, and the best results show that the model can achieve 99.99% accuracy on the testing set. In this proof-of-concept paper, the above experimental results confirm that our proposed scheme can achieve our expected tasks of UAV rescue and route planning. [ABSTRACT FROM AUTHOR]

Clusters of dead trees are forest fires-prone. To maintain ecological balance and realize its protection, timely detection of dead trees in forest remote sensing images using existing computer vision methods is of great significance. Remote sensing images captured by Unmanned aerial vehicles (UAVs) typically have several issues, e.g., mixed distribution of adjacent but different tree classes, interference of redundant information, and high differences in scales of dead tree clusters, making the detection of dead tree clusters much more challenging. Therefore, based on the Multipath dense composite network (MDCN), an object detection method called LLAM-MDCNet is proposed in this paper. First, a feature extraction network called Multipath dense composite network is designed. The network's multipath structure can substantially increase the extraction of underlying and semantic features to enhance its extraction capability for rich-information regions. Following that, in the row, column, and diagonal directions, the Longitude Latitude Attention Mechanism (LLAM) is presented and incorporated into the feature extraction network. The multi-directional LLAM facilitates the suppression of irrelevant and redundant information and improves the representation of high-level semantic feature information. Lastly, an AugFPN is employed for down-sampling, yielding a more comprehensive representation of image features with the combination of low-level texture features and high-level semantic information. Consequently, the network's detection effect for dead tree cluster targets with high-scale differences is improved. Furthermore, we make the collected high-quality aerial dead tree cluster dataset containing 19,517 images shot by drones publicly available for other researchers to improve the work in this paper. Our proposed method achieved 87.25% mAP with an FPS of 66 on our dataset, demonstrating the effectiveness of the LLAM-MDCNet for detecting dead tree cluster targets in forest remote sensing images. [ABSTRACT FROM AUTHOR]

This work explores the possibility of automating the aerial survey of bridges to generate high-resolution images necessary for digital damage inspection. High-quality unmanned aerial vehicle (UAV) based 3D reconstruction of bridges is an important step towards autonomous infrastructure inspection. However, the calculation of optimal camera poses remains challenging due to the complex structure of bridges and is therefore often conducted manually. This process is time-consuming and can lead to quality losses. Research in this field to automate this process is yet sparse and often requires high informative models of the bridge as the base for calculations, which are not given widely. Therefore, this paper proposes an automated camera pose calculation method solely based on an easily accessible polygon mesh of the bridge. For safe operation, point cloud data of the environment are used for automated ground detection and obstacle avoidance including vegetation. First, an initial set of camera poses is generated based on a voxelized mesh created in respect to the quality requirements for 3D reconstruction using defined camera specification. Thereafter, camera poses not fulfilling safety distances are removed and specific camera poses are added to increase local coverage quality. Evaluations of three bridges show that for diverse bridge types, near-complete coverage was achieved. Due to the low computational effort of the voxel approach, the runtime was kept to a minimum, even for large bridges. The subsequent algorithm is able to find alternative camera poses even in areas where the optimal pose could not be placed due to obstacles. [ABSTRACT FROM AUTHOR]

Unmanned aerial vehicle–light detection and ranging (UAV-LiDAR) provides a convenient and economical means of forest data acquisition that can penetrate canopy gaps to obtain abundant ground information, offering huge potential in forest inventory. Individual tree segmentation is a prerequisite to obtain individual tree details but is highly dependent on the accuracy of seed point detection. However, most of the existing methods, such as the local maximum (LM) and CHM-based methods, are strongly dependent on the window size, and, for individual tree segmentation, they can result in over-segmentation and under-segmentation, especially in natural forests. In this paper, we propose an adaptive crown shaped algorithm for individual tree segmentation without consideration of the window size. It was implemented in four plots with different forest types and topographies (i.e., planted coniferous forest with flat terrain, coniferous forest with sloping terrain, mixed forest with flat terrain and broadleaf forest with flat terrain). First, the normalized point clouds were rotated and blocked at multiple angles to extract the surface points of the forest. Then, the crown boundaries were delineated by analyzing the crown profiles to extract the treetops as seed points. Finally, a region growing method based on seed points was applied for individual tree segmentation. Our results showed that the recall, precision and F1-score of seed point detection reached 91.6%, 95.9% and 0.94, respectively, and that the accuracy rates for individual tree segmentation for the four plots were 87.7%, 80.6%, 73.2% and 70.5%, respectively. Our proposed method can effectively detect seed points via the adaptive crown shaped algorithm and reduce the impacts of elongated branches by applying distance thresholds between trees, enhancing the accuracy of seed point detection and subsequently improving the precision of individual tree segmentation. In addition, the proposed algorithm demonstrated superior performance in comparison to LM and CHM-based methods for the calculation of seed points, as well as outperforming PCS in individual tree segmentation. The proposed method demonstrates effectiveness and feasibility in dense forests and natural forests, providing an important reference for future research on seed point detection and individual tree segmentation. [ABSTRACT FROM AUTHOR]

The bistatic Interferometric Synthetic Aperture Radar (InSAR) system can overcome the physical limitations imposed by the baseline of monostatic dual-antenna InSAR. It provides greater flexibility and can enhance elevation measurement accuracy through a well-designed baseline configuration. Unmanned aerial vehicles (UAVs) equipped with bistatic InSAR, having relatively low cost and high flexibility, are useful for mapping and land resource exploration. However, due to challenges including spatiotemporal synchronization and motion errors, there are limited reports on UAV-borne bistatic InSAR. This paper proposes a comprehensive method for processing data from small UAV-borne bistatic InSAR by integrating two-way synchronization chain signals. The proposed method includes compensation for time and phase synchronization errors, trajectory refinement with synchronized chain and Position and Orientation System (POS) data, high-precision bistatic InSAR imaging, and interferometric processing. Height inversion results based on the proposed method are also provided, which demonstrate the effectiveness of the proposed method in improving the accuracy of interferometric measurement at calibration points from 0.66 m to 0.42 m. [ABSTRACT FROM AUTHOR]

In contemporary times, owing to the swift advancement of Unmanned Aerial Vehicles (UAVs), there is enormous potential for the use of UAVs to ensure public safety. Most research on capturing images by UAVs mainly focuses on object detection and tracking tasks, but few studies have focused on the UAV object re-identification task. In addition, in the real-world scenarios, objects frequently get together in groups. Therefore, re-identifying UAV objects and groups poses a significant challenge. In this paper, a novel dynamic screening strategy based on feature graphs framework is proposed for UAV object and group re-identification. Specifically, the graph-based feature matching module presented aims to enhance the transmission of group contextual information by using adjacent feature nodes. Additionally, a dynamic screening strategy designed attempts to prune the feature nodes that are not identified as the same group to reduce the impact of noise (other group members but not belonging to this group). Extensive experiments have been conducted on the Road Group, DukeMTMC Group and CUHK-SYSU-Group datasets to validate our framework, revealing superior performance compared to most methods. The Rank-1 on CUHK-SYSU-Group, Road Group and DukeMTMC Group datasets reaches 71.8%, 86.4% and 57.8%, respectively. Meanwhile, our method performance is explored on the UAV datasets of PRAI-1581 and Aerial Image, the infrared datasets of SYSU-MM01 and CM-Group and the NIR dataset of RBG-NIR Scene dataset; the unexpected findings demonstrate the robustness and wide applicability of our method. [ABSTRACT FROM AUTHOR]

The Bidirectional Reflectance Distribution Function (BRDF) is a critical spatial distribution parameter in the quantitative research of remote sensing and has a wide range of applications in radiometric correction, elemental inversion, and surface feature estimation. As a new means of BRDF modeling, UAV push-broom hyperspectral imaging is limited by the push-broom imaging method, and the multi-angle information is often difficult to obtain. In addition, the random variation of solar illumination during UAV low-altitude flight makes the irradiance between different push-broom hyperspectral rows and different airstrips inconsistent, which significantly affects the radiometric consistency of BRDF modeling and results in the difficulty of accurately portraying the three-dimensional spatial reflectance distribution in the UAV model. These problems largely impede the application of outdoor BRDF. Based on this, this paper proposes a fast multi-angle information acquisition scheme with a high-accuracy BRDF modeling method considering illumination variations, which mainly involves a lightweight system for BRDF acquisition and three improved BRDF models considering illumination corrections. We adopt multi-rectangular nested flight paths for multi-gray level targets, use multi-mode equipment to acquire spatial illumination changes and multi-angle reflectivity information in real-time, and introduce the illumination correction factor K through data coupling to improve the kernel, Hapke, and RPV models, and, overall, the accuracy of the improved model is increased by 20.83%, 11.11%, and 31.48%, respectively. The results show that our proposed method can acquire multi-angle information quickly and accurately using push-broom hyperspectral imaging, and the improved model eliminates the negative effect of illumination on BRDF modeling. This work is vital for expanding the multi-angle information acquisition pathway and high-efficiency and high-precision outdoor BRDF modeling. [ABSTRACT FROM AUTHOR]

Autonomous Unmanned Aerial Vehicles (UAVs) have possible applications in wildlife monitoring, disaster monitoring, and emergency Search and Rescue (SAR). Autonomous capabilities such as waypoint flight modes and obstacle avoidance, as well as their ability to survey large areas, make UAVs the prime choice for these critical applications. However, autonomous UAVs usually rely on the Global Navigation Satellite System (GNSS) for navigation and normal visibility conditions to obtain observations and data on their surrounding environment. These two parameters are often lacking due to the challenging conditions in which these critical applications can take place, limiting the range of utilisation of autonomous UAVs. This paper presents a framework enabling a UAV to autonomously navigate and detect targets in GNSS-denied and visually degraded environments. The navigation and target detection problem is formulated as an autonomous Sequential Decision Problem (SDP) with uncertainty caused by the lack of the GNSS and low visibility. The SDP is modelled as a Partially Observable Markov Decision Process (POMDP) and tested using the Adaptive Belief Tree (ABT) algorithm. The framework is tested in simulations and real life using a navigation task based on a classic SAR operation in a cluttered indoor environment with different visibility conditions. The framework is composed of a small UAV with a weight of 5 kg, a thermal camera used for target detection, and an onboard computer running all the computationally intensive tasks. The results of this study show the robustness of the proposed framework to autonomously explore and detect targets using thermal imagery under different visibility conditions. Devising UAVs that are capable of navigating in challenging environments with degraded visibility can encourage authorities and public institutions to consider the use of autonomous remote platforms to locate stranded people in disaster scenarios. [ABSTRACT FROM AUTHOR]

Estimating the geographic positions in GPS-denied environments is of great significance to the safe flight of unmanned aerial vehicles (UAVs). In this paper, we propose a novel geographic position estimation method for UAVs after road network alignment. We discuss the generally overlooked issue, namely, how to estimate the geographic position of the UAV after successful road network alignment, and propose a precise robust solution. In our method, the optimal initial solution of the geographic position of the UAV is first estimated from the road network alignment result, which is typically presented as a homography transformation between the observed road map and the reference one. The geographic position estimation is then modeled as an optimization problem to align the observed road with the reference one to improve the estimation accuracy further. Experiments on synthetic and real flight aerial image datasets show that the proposed algorithm can estimate more accurate geographic position of the UAV in real time and is robust to the errors from homography transformation estimation compared to the currently commonly-used method. [ABSTRACT FROM AUTHOR]

The accurate measurement of diameter at breast height (DBH) is one of the essential tasks for biomass estimation at an individual tree scale. This paper aims to explore the potential of unmanned aerial vehicle (UAV) based light detection and ranging (LiDAR) for trunk point extraction and direct DBH measurement. First, the trunk point cloud for each tree is extracted based on UAV LiDAR data by the multiscale cylindrical detection method. Then, the DBH is directly measured from the point cloud via the multiscale ring fitting. Lastly, we analyze the influence of scanning angle and mode on trunk point extraction and DBH measurement. The results show that the proposed method can obtain high accuracy of trunk point extraction and DBH measurement with real (R2 = 0.708) and simulated (R2 = 0.882) UAV LiDAR data. It proves that the UAV LiDAR data is feasible to directly measure the DBH. The highest accuracy was obtained with the scanning angles ranging from 50 to 65 degrees. Additionally, as the number of routes increases, the accuracy increases. This paper demonstrates that the UAV LiDAR can be used to directly measure the DBH, providing the scientific guidance for UAV path planning and LiDAR scanning design. [ABSTRACT FROM AUTHOR]

The spatial accuracy of unmanned aerial vehicles (UAVs) and the images they capture play a crucial role in the mapping process. Researchers are exploring solutions that use image-based techniques such as structure from motion (SfM) to produce topographic maps using UAVs while accessing locations with extremely high accuracy and minimal surface measurements. Advancements in technology have enabled real-time kinematic (RTK) to increase positional accuracy to 1–3 times the ground sampling distance (GSD). This paper focuses on post-processing kinematic (PPK) of positional accuracy to achieve a GSD or better. To achieve this, precise satellite orbits, clock information, and UAV global navigation satellite system observation files are utilized to calculate the camera positions with the highest positional accuracy. RTK/PPK analysis is conducted to improve the positional accuracies obtained from different flight patterns and altitudes. Data are collected at altitudes of 80 and 120 meters, resulting in GSD values of 1.87 cm/px and 3.12 cm/px, respectively. The evaluation of ground checkpoints using the proposed PPK methodology with one ground control point demonstrated root mean square error values of 2.3 cm (horizontal, nadiral) and 2.4 cm (vertical, nadiral) at an altitude of 80 m, and 1.4 cm (horizontal, oblique) and 3.2 cm (vertical, terrain-following) at an altitude of 120 m. These results suggest that the proposed methodology can achieve high positional accuracy for UAV image georeferencing. The main contribution of this paper is to evaluate the PPK approach to achieve high positional accuracy with unmanned aerial vehicles and assess the effect of different flight patterns and altitudes on the accuracy of the resulting topographic maps. [ABSTRACT FROM AUTHOR]

This article aims to present the methods of the radiometric correction of multispectral images—a short review of the existing techniques. The role of radiometric correction is essential to many applications, especially in precision farming, forestry, and climate analysis. Moreover, this paper presents a new relative approach, which considers the angle of inclination of the terrain and the angle of incidence of electromagnetic radiation on the imaged objects when obtaining the baseline data. This method was developed for data obtained from low altitudes—for imagery data acquired by sensors mounted on UAV platforms. The paper analyses the effect of the correction on the spectral information, i.e., the compatibility of the spectral reflection characteristics obtained from the image with the spectral reflection characteristics obtained in the field. The developed method of correction for multispectral data obtained from low altitudes allows for the mapping of spectral reflection characteristics to an extent that allows for the classification of terrestrial coverage with an accuracy of over 95%. In addition, it is possible to distinguish objects that are very similar in terms of spectral reflection characteristics. This research presents a new method of correction of each spectral channel obtained by the multispectral camera, increasing the accuracy of the results obtained, e.g., based on SAM coefficients or correlations, but also when distinguishing land cover types during classification. The results are characterized by high accuracy (over 94% in classification). [ABSTRACT FROM AUTHOR]

This paper focuses on the cooperative navigation of heterogeneous air-ground vehicle formations in a Global Navigation Satellite System (GNSS) challenged environment and proposes a cooperative navigation method based on motion estimation and a regionally optimal path planning strategy. In air-ground vehicle formations, unmanned ground vehicles (UGVs) are equipped with low-precision inertial navigation measurement units and wireless range sensors, which interact with unmanned aerial vehicles (UAVs) equipped with high-precision navigation equipment for cooperative measurement information and use the UAVs as aerial benchmarks for cooperative navigation. Firstly, the Interacting Multiple Model (IMM) algorithm is used to predict the next moment's motion position of the UGVs. Then regional real-time path optimization algorithms are introduced to design the motion position of the high-precision UAVs so as to improve the formation's configuration and reduce the geometric dilution of precision (GDOP) of the configuration. Simulation results show that the Dynamic Optimal Configuration Cooperative Navigation (DOC-CN) algorithm can reduce the GDOP of heterogeneous air-ground vehicle formations and effectively improve the overall navigation accuracy of the whole formation. The method is suitable for the cooperative navigation environment of heterogeneous air-ground vehicle formations under GNSS-challenged conditions. [ABSTRACT FROM AUTHOR]

The number of wheat ears is one of the most important factors in wheat yield composition. Rapid and accurate assessment of wheat ear number is of great importance for predicting grain yield and food security-related early warning signal generation. The current wheat ear counting methods rely on manual surveys, which are time-consuming, laborious, inefficient and inaccurate. Existing non-destructive wheat ear detection techniques are mostly applied to near-ground images and are difficult to apply to large-scale monitoring. In this study, we proposed a sampling survey method based on the unmanned aerial vehicle (UAV). Firstly, a small number of UAV images were acquired based on the five-point sampling mode. Secondly, an adaptive Gaussian kernel size was used to generate the ground truth density map. Thirdly, a density map regression network (DM-Net) was constructed and optimized. Finally, we designed an overlapping area of sub-images to solve the repeated counting caused by image segmentation. The MAE and MSE of the proposed model were 9.01 and 11.85, respectively. We compared the sampling survey method based on UAV images in this paper with the manual survey method. The results showed that the RMSE and MAPE of NM13 were 18.95 × 104/hm2 and 3.37%, respectively, and for YFM4, 13.65 × 104/hm2 and 2.94%, respectively. This study enables the investigation of the number of wheat ears in a large area, which can provide favorable support for wheat yield estimation. [ABSTRACT FROM AUTHOR]

Oblique photography technology based on UAV (unmanned aerial vehicle) provides an effective means for the rapid, real-scene 3D reconstruction of geographical objects on a watershed scale. However, existing research cannot achieve the automatic and high-precision reconstruction of water regions due to the sensitivity of water surface patterns to wind and waves, reflections of objects on the shore, etc. To solve this problem, a novel rapid reconstruction scheme for water regions in 3D models of oblique photography is proposed in this paper. It extracts the boundaries of water regions firstly using a designed eight-neighborhood traversal algorithm, and then reconstructs the triangulated irregular network (TIN) of water regions. Afterwards, the corresponding texture images of water regions are intelligently selected and processed using a designed method based on coordinate matching, image stitching and clipping. Finally, the processed texture images are mapped to the obtained TIN, and the real information about water regions can be reconstructed, visualized and integrated into the original real-scene 3D environment. Experimental results have shown that the proposed scheme can rapidly and accurately reconstruct water regions in 3D models of oblique photography. The outcome of this work can refine the current technical system of 3D modeling by UAV oblique photography and expand its application in the construction of twin watershed, twin city, etc. [ABSTRACT FROM AUTHOR]

The compaction quality of embankment dams directly affects the safe operation of power stations. The traditional monitoring method has the shortcomings of limited sample and time consumption. Compaction quality can be reflected by the compression ratio (CR) of the filling material. A novel method based on unmanned aerial vehicle (UAV) photogrammetry technology, which can rapidly acquire the CR of the entire filling area, is proposed in the present paper. Specifically, the CR nephogram is obtained by processing the terra information of the compaction body collected by the UAV. Validation of the CR results is performed by comparing them with the results obtained via leveling measurements. Mean absolute error between CR results and leveling measurements results is less than 1%, and the corresponding settlement value error is millimeter-level, reflecting a fairly good agreement. Furthermore, the reduced-scale experiment shows that the UAV-based CR method is more stable than manual measurements, and the efficiency is increased by more than five times, which meets the requirements of compaction quality monitoring and quality control. The CR nephogram obtained can reflect the compaction quality information rapidly, comprehensively, and accurately, thereby guiding the quality control of embankment dam construction. [ABSTRACT FROM AUTHOR]

As the scale of the power grid continues to expand, the human-based inspection method struggles to meet the needs of efficient grid operation and maintenance. Currently, the existing UAV inspection system in the market generally has short endurance power time, high flight operation requirements, low degree of autonomous flight, low accuracy of intelligent identification, slow generation of inspection reports, and other problems. In view of these shortcomings, this paper designs an intelligent inspection system based on self-developed UAVs, including autonomous planning of inspection paths, sliding film control algorithms, mobile inspection schemes and intelligent fault diagnosis. In the first stage, basic data such as latitude, longitude, altitude, and the length of the cross-arms are obtained from the cloud database of the power grid, while the lateral displacement and vertical displacement during the inspection drone operation are calculated, and the inspection flight path is generated independently according to the inspection type. In the second stage, in order to make the UAV's flight more stable, the reference-model-based sliding mode control algorithm is introduced to improve the control performance. Meanwhile, during flight, the intelligent UAV uploads the captured photos to the cloud in real time. In the third stage, a mobile inspection program is designed in order to improve the inspection efficiency. The transfer of equipment is realized in the process of UAV inspection. Finally, to improve the detection accuracy, a high-precision object detector is designed based on the YOLOX network model, and the improved model increased the m A P 0.5 : 0.95 metric by 2.22 percentage points compared to the original YOLOX_m for bird's nest detection. After a large number of flight verifications, the inspection system designed in this paper greatly improves the efficiency of power inspection, shortens the inspection cycle, reduces the investment cost of inspection manpower and material resources, and successfully fuses the object detection algorithm in the field of high-voltage power transmission lines inspection. [ABSTRACT FROM AUTHOR]

In recent years, laser scanners integrated with Unmanned Aerial Vehicles (UAVs) have exhibited great potential in conducting power line inspections in harsh environments. The point clouds collected for power line inspections have numerous advantages over remote image data. However, point cloud-based individual power line extraction, which is a crucial technology required for power line inspections, still poses several challenges such as massive 3D points, imbalanced category points, etc. Moreover, in various power line scenarios, previous studies often require manual setup and careful adjustment of different thresholds to separate different power lines, which is inefficient for practical applications. To handle these challenges, in this paper, we propose a multi-branch network to automatically extract an arbitrary number of individual power lines from point clouds collected by UAV-based laser scanners. Specifically, to handle the massive 3D point clouds in complex outdoor scenarios, we propose to leverage deep neural network for efficient and rapid feature extraction in large-scale point clouds. To mitigate imbalanced data quantities across different categories, we propose to design a weighted cross-entropy loss function to measure the varying importance of each category. To achieve the effective extraction of an arbitrary number of power lines, we propose leveraging a loss function to learn the discriminative features that can differentiate the points belonging to different power lines. Once the discriminative features are learned, the Mean Shift method can distinguish the individual power lines by clustering without supervision. The evaluations are executed on two datasets, which are acquired at different locations with UAV-mounted laser scanners. The proposed method has been thoroughly tested and evaluated, and the results and discussions confirm its outstanding ability to extract an arbitrary number of individual power lines in point clouds. [ABSTRACT FROM AUTHOR]

Solar power generation has great development potential as an abundant and clean energy source. However, many factors affect the efficiency of the photovoltaic (PV) module; among these factors, outdoor PV modules are inevitably affected by stains, thus reducing the power generation efficiency of the PV panel. This paper proposes a framework for PV module stain detection based on UAV hyperspectral images (HSIs). The framework consists of two stain detection methods: constrained energy minimization (CEM)-based and orthogonal subspace projection (OSP)-based stain detection methods. Firstly, the contaminated PV modules are analyzed and processed to enhance the data's analytical capability. Secondly, based on the known spectral signature of the PV module, stain detection methods are proposed, including CEM-based stain detection and OSP-based stain detection for PV modules. The experimental results on real data illustrate that, in comparison with contrasting methods, the proposed method achieves stain detection results that closely align with known stain percentages. Additionally, it exhibits a fitting curve similar to the more maturely developed electroluminescence-based methods currently in use. [ABSTRACT FROM AUTHOR]

With the rapid development of object detection technology for unmanned aerial vehicles (UAVs), it is convenient to collect data from UAV aerial photographs. They have a wide range of applications in several fields, such as monitoring, geological exploration, precision agriculture, and disaster early warning. In recent years, many methods based on artificial intelligence have been proposed for UAV object detection, and deep learning is a key area in this field. Significant progress has been achieved in the area of deep-learning-based UAV object detection. Thus, this paper presents a review of recent research on deep-learning-based UAV object detection. This survey provides an overview of the development of UAVs and summarizes the deep-learning-based methods in object detection for UAVs. In addition, the key issues in UAV object detection are analyzed, such as small object detection, object detection under complex backgrounds, object rotation, scale change, and category imbalance problems. Then, some representative solutions based on deep learning for these issues are summarized. Finally, future research directions in the field of UAV object detection are discussed. [ABSTRACT FROM AUTHOR]