Search

Corn ( Zea mays L.) is the most abundant food/feed crop, making accurate yield estimation a critical data point for monitoring global food production. Sensors with varying spatial/spectral configurations have been used to develop corn yield models from intra-field (0.1 m ground sample distance (GSD)) to regional scales (>250 m GSD). Understanding the spatial and spectral dependencies of these models is imperative to result interpretation, scaling, and deploying models. We leveraged high spatial resolution hyperspectral data collected with an unmanned aerial system mounted sensor (272 spectral bands from 0.4-1 μm at 0.063 m GSD) to estimate silage yield. We subjected our imagery to three band selection algorithms to quantitatively assess spectral reflectance features applicability to yield estimation. We then derived 11 spectral configurations, which were spatially resampled to multiple GSDs, and applied to a support vector regression (SVR) yield estimation model. Results indicate that accuracy degrades above 4 m GSD across all configurations, and a seven-band multispectral sensor which samples the red edge and multiple near-infrared bands resulted in higher accuracy in 90% of regression trials. These results bode well for our quest toward a definitive sensor definition for global corn yield modeling, with only temporal dependencies requiring additional investigation.

One of the most commonly used surveying techniques for landslide monitoring is a photogrammetric survey using an Unmanned Aerial System (UAS), where landslide displacements can be determined by comparing dense point clouds, digital terrain models, and digital orthomosaic maps resulting from different measurement epochs. A new data processing method for calculating landslide displacements based on UAS photogrammetric survey data is presented in this paper, whose main advantage is the fact that it does not require the production of the above-mentioned products, enabling faster and simpler displacement determination. The proposed method is based on matching features between the images from two different UAS photogrammetric surveys and calculating the displacements based only on the comparison of two reconstructed sparse point clouds. The accuracy of the method was analyzed on a test field with simulated displacements and on an active landslide in Croatia. Moreover, the results were compared with the results obtained with a commonly used method based on comparing manually tracked features on orthomosaics from different epochs. Analysis of the test field results using the presented method show the ability to determine displacements with a centimeter level accuracy in ideal conditions even with a flight height of 120 m, and on the Kostanjek landslide with a sub-decimeter level accuracy.

In the present work, three LiDAR technologies (Faro Focus 3D X130-Terrestrial Laser Scanner, TLS-, Kaarta Stencil 2-16-Mobile mapping system, MMS-, and DJI Zenmuse L1-Airborne LiDAR sensor, ALS-) have been tested and compared in order to assess the performances in surveying built heritage in vegetated areas. Each of the mentioned devices has their limits of usability, and different methods to capture and generate 3D point clouds need to be applied. In addition, it has been necessary to apply a methodology to be able to position all the point clouds in the same reference system. While the TLS scans and the MMS data have been geo-referenced using a set of vertical markers and sphere measured by a GNSS receiver in RTK mode, the ALS model has been geo-referenced by the GNSS receiver integrated in the unmanned aerial system (UAS), which presents different characteristics and accuracies. The resulting point clouds have been analyzed and compared, focusing attention on the number of points acquired by the different systems, the density, and the nearest neighbor distance.

Agriculture is considered a hotspot for wireless sensor network (WSN) facilities as they could potentially contribute towards improving on-farm management and food crop yields. This study proposes six designs of unmanned aerial system (UAS)-enabled data ferries with the intent of communicating with stationary sensor node stations in maize. Based on selection criteria and constraints, a proposed UAS data ferrying design was shortlisted from which a field experiment was conducted for two growing seasons to investigate the adoptability of the selected design along with an established WSN system. A data ferry platform comprised of a transceiver radio, a mini-laptop, and a battery was constructed and mounted on the UAS. Real-time monitoring of soil and temperature parameters was enabled through the node stations with data retrieved by the UAS data ferrying. The design was validated by establishing communication at different heights (31 m, 61 m, and 122 m) and lateral distances (0 m, 38 m, and 76 m) from the node stations. The communication success rate (CSR) was higher at a height of 31 m and within a lateral distance of 38 m from the node station. Lower communication was accredited to potential interference from the maize canopy and water losses from the maize canopy.

Unmanned aerial systems (UAVs) are dramatically evolving and promoting several civil applications. However, they are still prone to many security issues that threaten public safety. Security becomes even more challenging when they are connected to the Internet as their data stream is exposed to attacks. Unmanned traffic management (UTM) represents one of the most important topics for small unmanned aerial systems for beyond-line-of-sight operations in controlled low-altitude airspace. However, without securing the flight path exchanges between drones and ground stations or control centers, serious security threats may lead to disastrous situations. For example, a predefined flight path could be easily altered to make the drone perform illegal operations. Motivated by these facts, this paper discusses the security issues for UTM's components and addresses the security requirements for such systems. Moreover, we propose UTM-Chain, a lightweight blockchain-based security solution using hyperledger fabric for UTM of low-altitude UAVs which fits the computational and storage resources limitations of UAVs. Moreover, UTM-Chain provides secure and unalterable traffic data between the UAVs and their ground control stations. The performance of the proposed system related to transaction latency and resource utilization is analyzed by using cAdvisor. Finally, the analysis of security aspects demonstrates that the proposed UTM-Chain scheme is feasible and extensible for the secure sharing of UAV data.

Construction activities typically create large amounts of ground disturbance, which can lead to increased rates of soil erosion. Construction stormwater practices are used on active jobsites to protect downstream waterbodies from offsite sediment transport. Federal and state regulations require routine pollution prevention inspections to ensure that temporary stormwater practices are in place and performing as intended. This study addresses the existing challenges and limitations in the construction stormwater inspections and presents a unique approach for performing unmanned aerial system (UAS)-based inspections. Deep learning-based object detection principles were applied to identify and locate practices installed on active construction sites. The system integrates a post-processing stage by clustering results. The developed framework consists of data preparation with aerial inspections, model training, validation of the model, and testing for accuracy. The developed model was created from 800 aerial images and was used to detect four different types of construction stormwater practices at 100% accuracy on the Mean Average Precision (MAP) with minimal false positive detections. Results indicate that object detection could be implemented on UAS-acquired imagery as a novel approach to construction stormwater inspections and provide accurate results for site plan comparisons by rapidly detecting the quantity and location of field-installed stormwater practices.

With the increasing interest in leveraging mobile robotics for fire detection and monitoring arises the need to design recognition technology systems for these extreme environments. This work focuses on evaluating the sensing capabilities and image processing pipeline of thermal imaging sensors for fire detection applications, paving the way for the development of autonomous systems for early warning and monitoring of fire events. The contributions of this work are threefold. First, we overview image processing algorithms used in thermal imaging regarding data compression and image enhancement. Second, we present a method for data-driven thermal imaging analysis designed for fire situation awareness in robotic perception. A study is undertaken to test the behavior of the thermal cameras in controlled fire scenarios, followed by an in-depth analysis of the experimental data, which reveals the inner workings of these sensors. Third, we discuss key takeaways for the integration of thermal cameras in robotic perception pipelines for autonomous unmanned aerial vehicle (UAV)-based fire surveillance.

Unmanned aerial systems (UAS) are increasingly used in precision agriculture to collect crop health related data. UAS can capture data more often and more cost-effectively than sending human scouts into the field. However, in large crop fields, flight time, and hence data collection, is limited by battery life. In a conventional UAS approach, human operators are required to exchange depleted batteries many times, which can be costly and time consuming. In this study, we developed a novel, fully autonomous aerial scouting approach that preserves battery life by sampling sections of a field for sensing and predicting crop health for the whole field. Our approach uses reinforcement learning (RL) and convolutional neural networks (CNN) to accurately and autonomously sample the field. To develop and test the approach, we ran flight simulations on an aerial image dataset collected from an 80-acre corn field. The excess green vegetation Index was used as a proxy for crop health condition. Compared to the conventional UAS scouting approach, the proposed scouting approach sampled 40% of the field, predicted crop health with 89.8% accuracy, reduced labor cost by 4.8× and increased agricultural profits by 1.36×.

Wetlands provide critical ecosystem services across a range of environmental gradients and are at heightened risk of degradation from anthropogenic pressures and continued development, especially in coastal regions. There is a growing need for high-resolution (spatially and temporally) habitat identification and precise delineation of wetlands across a variety of stakeholder groups, including wetlands loss mitigation programs. Traditional wetland delineations are costly, time-intensive and can physically degrade the systems that are being surveyed, while aerial surveys are relatively fast and relatively unobtrusive. To assess the efficacy and feasibility of using two variable-cost LiDAR sensors mounted on a commercial hexacopter unmanned aerial system (UAS) in deriving high resolution topography, we conducted nearly concomitant flights over a site located in the Atlantic Coastal plain that contains a mix of palustrine forested wetlands, upland coniferous forest, upland grass and bare ground/dirt roads. We compared point clouds and derived topographic metrics acquired using the Quanergy M8 and the Velodyne HDL-32E LiDAR sensors with airborne LiDAR and results showed that the less expensive and lighter payload sensor outperforms the more expensive one in deriving high resolution, high accuracy ground elevation measurements under a range of canopy cover densities and for metrics of point cloud density and digital terrain computed both globally and locally using variable size tessellations. The mean point cloud density was not significantly different between wetland and non-wetland areas, but the two sensors were significantly different by wetland/non-wetland type. Ultra-high-resolution LiDAR-derived topography models can fill evolving wetlands mapping needs and increase accuracy and efficiency of detection and prediction of sensitive wetland ecosystems, especially for heavily forested coastal wetland systems.

This article analyzes the use of Remotely Piloted Aircrafts (RPA) in VOR (Very High Frequency Omnidirectional Range) flight inspection. Initially, tests were performed to check whether the Autopilot Positioning System (APS) met the regulatory requirements. The results of these tests indicated that the APS provided information within the standard regulations. A Hardware in the Loop (HIL) platform was implemented to perform flight tests following the waypoints generated by a mission automation routine. One test was performed without introducing disturbance into the proposed test platform. The other four tests were performed introducing errors in latitude and longitude in the APS into the platform. The errors introduced had the same characteristics as those measured in the initial tests, in order for the simulation tests to be as similar as possible to the real situation. The tests performed with positioning errors only did not lead to false misalignment detection. However, introducing positioning errors and a 4° VOR misalignment error, a misalignment of 3.99° was observed during the flight test. This is a value greater than the maximum one allowed by the regulations, and the system indicates the VOR misalignment. Five flight inspection tests were performed. In addition to the APS errors, tests with a modulation error were also conducted. Introducing a 4° VOR misalignment in conjunction with modulation error, a misalignment of 4.02° was observed, resulting in successful misalignment detection.

Optical imaging systems are one of the most common sensors used for collecting data with small Unmanned Aerial Systems (sUAS). Plenty of research exists which present custom-made optical imaging systems for specific missions. However, the research commonly leaves out the explanation of design parameters and considerations taken during the design of the optical imaging system, especially the image stabilization strategy used, which is a significant issue in sUAS imaging missions. This paper surveys useful methodologies for designing a stabilized optical imaging system by presenting an overview of the important aspects that must be addressed in the designing phase and which tools and techniques are available and should be chosen according to the design requirements.

Audio analysis over an Unmanned Aerial Systems (UAS) is of interest it is an essential step for on-board sound source localization and separation. This could be useful for search & rescue operations, as well as for detection of unauthorized drone operations. In this paper, an analysis of the previously introduced Acoustic Interactions for Robot Audition (AIRA)-UAS corpus is presented, which is a set of recordings produced by the ego-noise of a drone performing different aerial maneuvers and by other drones flying nearby. It was found that the recordings have a very low Signal-to-Noise Ratio (SNR), that the noise is dynamic depending of the drone's movements, and that their noise signatures are highly correlated. Three popular filtering techniques were evaluated in this work in terms of noise reduction and signature extraction, which are: Berouti's Non-Linear Noise Subtraction, Adaptive Quantile Based Noise Estimation, and Improved Minima Controlled Recursive Averaging. Although there was moderate success in noise reduction, no filter was able to keep intact the signature of the drone flying in parallel. These results are evidence of the challenge in audio processing over drones, implying that this is a field prime for further research.

Using unmanned robotic systems in military operations such as reconnaissance or surveillance, as well as in many civil applications, is common practice. In this article, the problem of monitoring the specified area of interest by a fleet of unmanned aerial systems is examined. The monitoring is planned via the Cooperative Aerial Model, which deploys a number of waypoints in the area; these waypoints are visited successively by unmanned systems. The original model proposed in the past assumed that the area to be explored is perfectly flat. A new formulation of this model is introduced in this article so that the model can be used in a complex environment with uneven terrain and/or with many obstacles, which may occlude some parts of the area of interest. The optimization algorithm based on the simulated annealing principles is proposed for positioning of waypoints to cover as large an area as possible. A set of scenarios has been designed to verify and evaluate the proposed approach. The key experiments are aimed at finding the minimum number of waypoints needed to explore at least the minimum requested portion of the area. Furthermore, the results are compared to the algorithm based on the lawnmower pattern.

The deployment of small unmanned aircraft systems (UAS) to collect routine in situ vertical profiles of the thermodynamic and kinematic state of the atmosphere in conjunction with other weather observations could significantly improve weather forecasting skill and resolution. High-resolution vertical measurements of pressure, temperature, humidity, wind speed and wind direction are critical to the understanding of atmospheric boundary layer processes integral to air-surface (land, ocean and sea ice) exchanges of energy, momentum, and moisture; how these are affected by climate variability; and how they impact weather forecasts and air quality simulations. We explore the potential value of collecting coordinated atmospheric profiles at fixed surface observing sites at designated times using instrumented UAS. We refer to such a network of autonomous weather UAS designed for atmospheric profiling and capable of operating in most weather conditions as a 3D Mesonet. We outline some of the fundamental and high-impact science questions and sampling needs driving the development of the 3D Mesonet and offer an overview of the general concept of operations. Preliminary measurements from profiling UAS are presented and we discuss how measurements from an operational network could be realized to better characterize the atmospheric boundary layer, improve weather forecasts, and help to identify threats of severe weather.

This paper presents a novel system for automatic forest-fire measurement using cameras distributed at ground stations and mounted on Unmanned Aerial Systems (UAS). It can obtain geometrical measurements of forest fires in real-time such as the location and shape of the fire front, flame height and rate of spread, among others. Measurement of forest fires is a challenging problem that is affected by numerous potential sources of error. The proposed system addresses them by exploiting the complementarities between infrared and visual cameras located at different ground locations together with others onboard Unmanned Aerial Systems (UAS). The system applies image processing and geo-location techniques to obtain forest-fire measurements individually from each camera and then integrates the results from all the cameras using statistical data fusion techniques. The proposed system has been extensively tested and validated in close-to-operational conditions in field fire experiments with controlled safety conditions carried out in Portugal and Spain from 2001 to 2006.