Search

Seagrasses provide ecosystem services worth USD 2.28 trillion annually. However, their direct threats and our incomplete knowledge hamper our capabilities to protect and manage them. This study aims to evaluate if the NICFI Satellite Data Program basemaps could map Seychelles’ extensive seagrass meadows, directly supporting the country’s ambitions to protect this ecosystem. The Seychelles archipelago was divided into three geographical regions. Half-yearly basemaps from 2015 to 2020 were combined using an interval mean of the 10th percentile and median before land and deep water masking. Additional features were produced using the Depth Invariant Index, Normalised Differences, and segmentation. With 80% of the reference data, an initial Random Forest followed by a variable importance analysis was performed. Only the top ten contributing features were retained for a second classification, which was validated with the remaining 20%. The best overall accuracies across the three regions ranged between 69.7% and 75.7%. The biggest challenges for the NICFI basemaps are its four-band spectral resolution and uncertainties owing to sampling bias. As part of a nationwide seagrass extent and blue carbon mapping project, the estimates herein will be combined with ancillary satellite data and contribute to a full national estimate in a near-future report. However, the numbers reported showcase the broader potential for using NICFI basemaps for seagrass mapping at scale.

Change detection in urban areas can be helpful for urban resource management and smart city planning. The effects of human activities on the environment and ground have gained momentum over the past decades, causing remote sensing data sources analysis (such as satellite images) to become an option for swift change detection in the environment and urban areas. We proposed a semi-transfer learning method of EfficientNetV2 T-Unet (EffV2 T-Unet) that combines the effectiveness of composite scaled EfficientNetV2 T as the first path or encoder for feature extraction and convolutional layers of Unet as the second path or decoder for reconstructing the binary change map. In the encoder path, we use EfficientNetV2 T, which was trained by the ImageNet dataset. In this research, we employ two datasets to evaluate the performance of our proposed method for binary change detection. The first dataset is Sentinel-2 satellite images which were captured in 2017 and 2021 in urban areas of northern Iran. The second one is the Onera Satellite Change Detection dataset (OSCD). The performance of the proposed method is compared with YoloX-Unet families, ResNest-Unet families, and other well-known methods. The results demonstrated our proposed method’s effectiveness compared to other methods. The final change map reached an overall accuracy of 97.66%.

Reflectance composites that capture bare soil pixels from multispectral image data are increasingly being analysed to model soil constituents such as soil organic carbon. These temporal composites are used instead of single-date multispectral images to account for the frequent vegetation cover of soils and, thus, to get broader spatial coverage of bare soil pixels. Most soil compositing techniques require thresholds derived from spectral indices such as the Normalised Difference Vegetation Index (NDVI) and the Normalised Burn Ratio 2 (NBR2) to separate bare soils from all other land cover types. However, the threshold derivation is handled based on expert knowledge of a specific area, statistical percentile definitions or in situ data. For operational processors, such site-specific and partly manual strategies are not applicable. There is a need for a more generic solution to derive thresholds for large-scale processing without manual intervention. This study presents a novel HIstogram SEparation Threshold (HISET) methodology deriving spectral index thresholds and testing them for a Sentinel-2 temporal data stack. The technique is spectral index-independent, data-driven and can be evaluated based on a quality score. We tested HISET for building six soil reflectance composites (SRC) using NDVI, NBR2 and a new index combining the NDVI and a short-wave infrared (SWIR) band (PV+IR2). A comprehensive analysis of the spectral and spatial performance and accuracy of the resulting SRCs proves the flexibility and validity of HISET. Disturbance effects such as spectral confusion of bare soils with non-photosynthetic-active vegetation (NPV) could be reduced by choosing grassland and crops as input LC for HISET. The NBR2-based SRC spectra showed the highest similarity with LUCAS spectra, the broadest spatial coverage of bare soil pixels and the least number of valid observations per pixel. The spatial coverage of bare soil pixels is validated against the database of the Integrated Administration and Control System (IACS) of the European Commission. Validation results show that PV+IR2-based SRCs outperform the other two indices, especially in spectrally mixed areas of bare soil, photosynthetic-active vegetation and NPV. The NDVI-based SRCs showed the lowest confidence values (95%) in all bands. In the future, HISET shall be tested in other areas with different environmental conditions and LC characteristics to evaluate if the findings of this study are also valid.

The solar irradiance is the source of energy used by passive optical remote sensing to measure the ground reflectance and, from there, derive the ground properties. Therefore, the precise knowledge of the incoming solar irradiance is fundamental for the atmospheric correction (AC) algorithms. These algorithms use the simulation results of a model of the interactions of the atmosphere with the incoming solar irradiance to determine the atmospheric contribution of the remote sensing observations. This study presents the differences in the atmospherically corrected ground reflectance of multi- and hyper-spectral sensors assuming three different solar models: Thuillier 2003, Fontenla 2011 and TSIS-1 HRS. The results show no difference when the solar irradiance model is preserved through the full processing chain. The differences appear when the solar irradiance model used in the atmospheric correction changes, and this difference is larger between some irrradiance models (e.g., TSIS and Thuillier 2003) than for others (e.g., Fontenla 2011 and TSIS).

Dense matching plays a crucial role in computer vision and remote sensing, to rapidly provide stereo products using inexpensive hardware. Along with the development of deep learning, the Guided Aggregation Network (GA-Net) achieves state-of-the-art performance via the proposed Semi-Global Guided Aggregation layers and reduces the use of costly 3D convolutional layers. To solve the problem of GA-Net requiring large GPU memory consumption, we design a pyramid architecture to modify the model. Starting from a downsampled stereo input, the disparity is estimated and continuously refined through the pyramid levels. Thus, the disparity search is only applied for a small size of stereo pair and then confined within a short residual range for minor correction, leading to highly reduced memory usage and runtime. Tests on close-range, aerial, and satellite data demonstrate that the proposed algorithm achieves significantly higher efficiency (around eight times faster consuming only 20–40% GPU memory) and comparable results with GA-Net on remote sensing data. Thanks to this coarse-to-fine estimation, we successfully process remote sensing datasets with very large disparity ranges, which could not be processed with GA-Net due to GPU memory limitations.

Timely information on land use, vegetation coverage, and air and water quality, are crucial for monitoring and managing territories, especially for areas in which there is dynamic urban expansion. However, getting accessible, accurate, and reliable information is not an easy task, since the significant increase in remote sensing data volume poses challenges for the timely processing and analysis of the resulting massive data volume. From this perspective, classical methods for urban monitoring present some limitations and more innovative technologies, such as artificial-intelligence-based algorithms, must be exploited, together with performing cloud platforms and ad hoc pre-processing steps. To this end, this paper presents an approach to the use of cloud-enabled deep-learning technology for urban sprawl detection and monitoring, through the fusion of optical and synthetic aperture radar data, by integrating the Google Earth Engine cloud platform with deep-learning techniques through the use of the open-source TensorFlow library. The model, based on a U-Net architecture, was applied to evaluate urban changes in Phoenix, the second fastest-growing metropolitan area in the United States. The available ancillary information on newly built areas showed good agreement with the produced change detection maps. Moreover, the results were temporally related to the appearance of the SARS-CoV-2 (commonly known as COVID-19) pandemic, showing a decrease in urban expansion during the event. The proposed solution may be employed for the efficient management of dynamic urban areas, providing a decision support system to help policy makers in the measurement of changes in territories and to monitor their impact on phenomena related to urbanization growth and density. The reference data were manually derived by the authors over an area of approximately 216 km2, referring to 2019, based on the visual interpretation of high resolution images, and are openly available.

Large-scale gridded population datasets available at the global or continental scale have become an important source of information in applications related to sustainable development. In recent years, the emergence of new population models has leveraged the inclusion of more accurate and spatially detailed proxy layers describing the built-up environment (e.g., built-area and building footprint datasets), enhancing the quality, accuracy and spatial resolution of existing products. However, due to the consistent lack of vertical and functional information on the built-up environment, large-scale gridded population datasets that rely on existing built-up land proxies still report large errors of under- and overestimation, especially in areas with predominantly high-rise buildings or industrial/commercial areas, respectively. This research investigates, for the first time, the potential contributions of the new World Settlement Footprint—3D (WSF3D) dataset in the field of large-scale population modelling. First, we combined a Random Forest classifier with spatial metrics derived from the WSF3D to predict the industrial versus non-industrial use of settlement pixels at the Pan-European scale. We then examined the effects of including volume and settlement use information into frameworks of dasymetric population modelling. We found that the proposed classification method can predict industrial and non-industrial areas with overall accuracies and a kappa-coefficient of ~84% and 0.68, respectively. Additionally, we found that both, integrating volume and settlement use information considerably increased the accuracy of population estimates between 10% and 30% over commonly employed models (e.g., based on a binary settlement mask as input), mainly by eliminating systematic large overestimations in industrial/commercial areas. While the proposed method shows strong promise for overcoming some of the main limitations in large-scale population modelling, future research should focus on improving the quality of the WFS3D dataset and the classification method alike, to avoid the false detection of built-up settlements and to reduce misclassification errors of industrial and high-rise buildings.

This study presents a novel method to identify optically deep water using purely spectral approaches. Optically deep waters, where the seabed is too deep for a bottom reflectance signal to be returned, is uninformative for seabed mapping. Furthermore, owing to the attenuation of light in the water column, submerged vegetation at deeper depths is easily confused with optically deep waters, thereby inducing misclassifications that reduce the accuracy of these seabed maps. While bathymetry data could mask out deeper areas, they are not always available or of sufficient spatial resolution for use. Without bathymetry data and based on the coastal aerosol blue green (1-2-3) bands of the Sentinel-2 imagery, this study investigates the use of band ratios and a false colour HSV transformation of both L1C and L2A images to separate optically deep and shallow waters across varying water quality over four tropical and temperate submerged sites: Tanzania, the Bahamas, the Caspian Sea (Kazakhstan) and the Wadden Sea (Denmark and Germany). Two supervised thresholds based on annotated reference data and an unsupervised Otsu threshold were applied. The band ratio group usually featured the best overall accuracies (OA), F1 scores and Matthews correlation coefficients, although the individual band combination might not perform consistently across different sites. Meanwhile, the saturation and hue band yielded close to best performance for the L1C and L2A images, featuring OA of up to 0.93 and 0.98, respectively, and a more consistent behaviour than the individual band ratios. Nonetheless, all these spectral methods are still susceptible to sunglint, the Sentinel-2 parallax effect, turbidity and water colour. Both supervised approaches performed similarly and were superior to the unsupervised Otsu’s method—the supervised methods featuring OA were usually over 0.70, while the unsupervised OA were usually under 0.80. In the absence of bathymetry data, this method could effectively remove optically deep water pixels in Sentinel-2 imagery and reduce the issue of dark pixel misclassification, thereby improving the benthic mapping of optically shallow waters and their seascapes.

Spectral unmixing represents both an application per se and a pre-processing step for several applications involving data acquired by imaging spectrometers. However, there is still a lack of publicly available reference data sets suitable for the validation and comparison of different spectral unmixing methods. In this paper, we introduce the DLR HyperSpectral Unmixing (DLR HySU) benchmark dataset, acquired over German Aerospace Center (DLR) premises in Oberpfaffenhofen. The dataset includes airborne hyperspectral and RGB imagery of targets of different materials and sizes, complemented by simultaneous ground-based reflectance measurements. The DLR HySU benchmark allows a separate assessment of all spectral unmixing main steps: dimensionality estimation, endmember extraction (with and without pure pixel assumption), and abundance estimation. Results obtained with traditional algorithms for each of these steps are reported. To the best of our knowledge, this is the first time that real imaging spectrometer data with accurately measured targets are made available for hyperspectral unmixing experiments. The DLR HySU benchmark dataset is openly available online and the community is welcome to use it for spectral unmixing and other applications.

In this paper, we address various challenges in multi-pedestrian and vehicle tracking in high-resolution aerial imagery by intensive evaluation of a number of traditional and Deep Learning based Single- and Multi-Object Tracking methods. We also describe our proposed Deep Learning based Multi-Object Tracking method AerialMPTNet that fuses appearance, temporal, and graphical information using a Siamese Neural Network, a Long Short-Term Memory, and a Graph Convolutional Neural Network module for more accurate and stable tracking. Moreover, we investigate the influence of the Squeeze-and-Excitation layers and Online Hard Example Mining on the performance of AerialMPTNet. To the best of our knowledge, we are the first to use these two for regression-based Multi-Object Tracking. Additionally, we studied and compared the L1 and Huber loss functions. In our experiments, we extensively evaluate AerialMPTNet on three aerial Multi-Object Tracking datasets, namely AerialMPT and KIT AIS pedestrian and vehicle datasets. Qualitative and quantitative results show that AerialMPTNet outperforms all previous methods for the pedestrian datasets and achieves competitive results for the vehicle dataset. In addition, Long Short-Term Memory and Graph Convolutional Neural Network modules enhance the tracking performance. Moreover, using Squeeze-and-Excitation and Online Hard Example Mining significantly helps for some cases while degrades the results for other cases. In addition, according to the results, L1 yields better results with respect to Huber loss for most of the scenarios. The presented results provide a deep insight into challenges and opportunities of the aerial Multi-Object Tracking domain, paving the way for future research.

The field of human population mapping is constantly evolving, leveraging the increasing availability of high-resolution satellite imagery and the advancements in the field of machine learning. In recent years, the emergence of global built-area datasets that accurately describe the extent, location, and characteristics of human settlements has facilitated the production of new population grids, with improved quality, accuracy, and spatial resolution. In this research, we explore the capabilities of the novel World Settlement Footprint 2019 Imperviousness layer (WSF2019-Imp), as a single proxy in the production of a new high-resolution population distribution dataset for all of Africa—the WSF2019-Population dataset (WSF2019-Pop). Results of a comprehensive qualitative and quantitative assessment indicate that the WSF2019-Imp layer has the potential to overcome the complexities and limitations of top-down binary and multi-layer approaches of large-scale population mapping, by delivering a weighting framework which is spatially consistent and free of applicability restrictions. The increased thematic detail and spatial resolution (~10 m at the Equator) of the WSF2019-Imp layer improve the spatial distribution of populations at local scales, where fully built-up settlement pixels are clearly differentiated from settlement pixels that share a proportion of their area with green spaces, such as parks or gardens. Overall, eighty percent of the African countries reported estimation accuracies with percentage mean absolute errors between ~15% and ~32%, and 50% of the validation units in more than half of the countries reported relative errors below 20%. Here, the remaining lack of information on the vertical dimension and the functional characterisation of the built-up environment are still remaining limitations affecting the quality and accuracy of the final population datasets.

Semi-Global Matching (SGM) approximates a 2D Markov Random Field (MRF) via multiple 1D scanline optimizations, which serves as a good trade-off between accuracy and efficiency in dense matching. Nevertheless, the performance is limited due to the simple summation of the aggregated costs from all 1D scanline optimizations for the final disparity estimation. SGM-Forest improves the performance of SGM by training a random forest to predict the best scanline according to each scanline’s disparity proposal. The disparity estimated by the best scanline acts as reference to adaptively adopt close proposals for further post-processing. However, in many cases more than one scanline is capable of providing a good prediction. Training the random forest with only one scanline labeled may limit or even confuse the learning procedure when other scanlines can offer similar contributions. In this paper, we propose a multi-label classification strategy to further improve SGM-Forest. Each training sample is allowed to be described by multiple labels (or zero label) if more than one (or none) scanline gives a proper prediction. We test the proposed method on stereo matching datasets, from Middlebury, ETH3D, EuroSDR image matching benchmark, and the 2019 IEEE GRSS data fusion contest. The result indicates that under the framework of SGM-Forest, the multi-label strategy outperforms the single-label scheme consistently.

Masking of cirrus clouds in optical satellite imagery is an important step in automated processing chains. Firstly, it is a prerequisite to a subsequent removal of cirrus effects, and secondly, it affects the atmospheric correction, i.e., aerosol and surface reflectance retrievals. Cirrus clouds can be detected with a narrow bandwidth channel near 1.38 μ m and operational detection algorithms have been developed for Landsat-8 and Sentinel-2 images. However, concerning cirrus removal in the case of elevated surfaces, current methods do not separate the ground reflected signal from the cirrus signal in the 1.38 μ m channel when performing an atmospheric correction, often resulting in an overcorrection of the cirrus influence. We propose a new operational algorithm using a Digital Elevation Model (DEM) to estimate the surface and cirrus cloud contributions in the 1.38 μ m channel and to remove cirrus effects during the surface reflectance retrieval. Due to the highly variable nature of cirrus clouds and terrain conditions, no generic quantitative results could be derived. However, results for typical cases and the achieved improvement in cirrus removal are given for selected scenes and critical issues and limitations of the approach are discussed.

This paper proposes the use of spectral unmixing and sparse reconstruction methods to restore a simulated dataset for the Environmental Mapping and Analysis Program (EnMAP), the forthcoming German spaceborne hyperspectral mission. The described method independently decomposes each image element into a set of representative spectra, which come directly from the image and have previously undergone a low-pass filtering in noisy bands. The residual vector from the unmixing process is considered as mostly composed of noise and ignored in the reconstruction process. The first assessment of the results is encouraging, as the original bands taken into account are reconstructed with a high signal-to-noise ratio and low overall distortions. Furthermore, the same method could be applied for the inpainting of dead pixels, which could affect EnMAP data, especially at the end of the satellite’s life cycle.

Given that ground stationary infrastructures for traffic monitoring are barely able to handle everyday traffic volumes, there is a risk that they could fail altogether in situations arising from mass events or disasters. In this work, we present an alternative approach for traffic monitoring during disaster and mass events, which is based on an airborne optical sensor system. With this system, optical image sequences are automatically examined on board an aircraft to estimate road traffic information, such as vehicle positions, velocities and driving directions. The traffic information, estimated in real time on board, is immediately downlinked to a ground station. The airborne sensor system consists of a three-head camera system, a real-time-capable GPS/INS unit, five industrial PCs and a downlink unit. The processing chain for automatic extraction of traffic information contains modules for the synchronization of image and navigation data streams, orthorectification and vehicle detection and tracking modules. The vehicle detector is based on a combination of AdaBoost and support vector machine classifiers. Vehicle tracking relies on shape-based matching operators. The processing chain is evaluated on a large number of image sequences recorded during several campaigns, and the data quality is compared to that obtained from induction loops. In summary, we can conclude that the achieved overall quality of the traffic data extracted by the airborne system is in the range of 68% and 81%. Thus, it is comparable to data obtained from stationary ground sensor networks.

The global coastal seascape offers a multitude of ecosystem functions and services to the natural and human-induced ecosystems. However, the current anthropogenic global warming above pre-industrial levels is inducing the degradation of seascape health with adverse impacts on biodiversity, economy, and societies. Bathymetric knowledge empowers our scientific, financial, and ecological understanding of the associated benefits, processes, and pressures to the coastal seascape. Here we leverage two commercial high-resolution multispectral satellite images of the Pleiades and two multibeam survey datasets to measure bathymetry in two zones (0−10 m and 10−30 m) in the tropical Anguilla and British Virgin Islands, northeast Caribbean. A methodological framework featuring a combination of an empirical linear transformation, cloud masking, sun-glint correction, and pseudo-invariant features allows spatially independent calibration and test of our satellite-derived bathymetry approach. The best R2 and RMSE for training and validation vary between 0.44−0.56 and 1.39−1.76 m, respectively, while minimum vertical errors are less than 1 m in the depth ranges of 7.8−10 and 11.6−18.4 m for the two explored zones. Given available field data, the present methodology could provide simple, time-efficient, and accurate spatio-temporal satellite-derived bathymetry intelligence in scientific and commercial tasks i.e., navigation, coastal habitat mapping and resource management, and reducing natural hazards.

Recent advances in the availability of very high-resolution (VHR) satellite data together with efficient data acquisition and large area coverage have led to an upward trend in their applications for automatic 3-D building model reconstruction which require large-scale and frequent updates, such as disaster monitoring and urban management. Digital Surface Models (DSMs) generated from stereo satellite imagery suffer from mismatches, missing values, or blunders, resulting in rough building shape representations. To handle 3-D building model reconstruction using such low-quality DSMs, we propose a novel automatic multistage hybrid method using DSMs together with orthorectified panchromatic (PAN) and pansharpened data (PS) of multispectral (MS) satellite imagery. The algorithm consists of multiple steps including building boundary extraction and decomposition, image-based roof type classification, and initial roof parameter computation which are prior knowledge for the 3-D model fitting step. To fit 3-D models to the normalized DSM (nDSM) and to select the best one, a parameter optimization method based on exhaustive search is used sequentially in 2-D and 3-D. Finally, the neighboring building models in a building block are intersected to reconstruct the 3-D model of connecting roofs. All corresponding experiments are conducted on a dataset including four different areas of Munich city containing 208 buildings with different degrees of complexity. The results are evaluated both qualitatively and quantitatively. According to the results, the proposed approach can reliably reconstruct 3-D building models, even the complex ones with several inner yards and multiple orientations. Furthermore, the proposed approach provides a high level of automation by limiting the number of primitive roof types and by performing automatic parameter initialization.

High spatial and temporal resolution satellite remote sensing estimates are the silver bullet for monitoring of coastal marine areas globally. From 2000, when the first commercial satellite platforms appeared, offering high spatial resolution data, the mapping of coastal habitats and the extraction of bathymetric information have been possible at local scales. Since then, several platforms have offered such data, although not at high temporal resolution, making the selection of suitable images challenging, especially in areas with high cloud coverage. PlanetScope CubeSats appear to cover this gap by providing their relevant imagery. The current study is the first that examines the suitability of them for the calculation of the Satellite-derived Bathymetry. The availability of daily data allows the selection of the most qualitatively suitable images within the desired timeframe. The application of an empirical method of spaceborne bathymetry estimation provides promising results, with depth errors that fit to the requirements of the International Hydrographic Organization at the Category Zone of Confidence for the inclusion of these data in navigation maps. While this is a pilot study in a small area, more studies in areas with diverse water types are required for solid conclusions on the requirements and limitations of such approaches in coastal bathymetry estimations.

Various deep learning applications benefit from multi-task learning with multiple regression and classification objectives by taking advantage of the similarities between individual tasks. This can result in improved learning efficiency and prediction accuracy for the task-specific models compared to separately trained models. In this paper, we make an observation of such influences for important remote sensing applications like elevation model generation and semantic segmentation tasks from the stereo half-meter resolution satellite digital surface models (DSMs). Mainly, we aim to generate good-quality DSMs with complete, as well as accurate level of detail (LoD)2-like building forms and to assign an object class label to each pixel in the DSMs. For the label assignment task, we select the roof type classification problem to distinguish between flat, non-flat, and background pixels. To realize those tasks, we train a conditional generative adversarial network (cGAN) with an objective function based on least squares residuals and an auxiliary term based on normal vectors for further roof surface refinement. Besides, we investigate recently published deep learning architectures for both tasks and develop the final end-to-end network, which combines different models, as using them first separately, they provide the best results for their individual tasks.

The tremendous advances in deep neural networks have demonstrated the superiority of deep learning techniques for applications such as object recognition or image classification. Nevertheless, deep learning-based methods usually require a large amount of training data, which mainly comes from manual annotation and is quite labor-intensive. In order to reduce the amount of manual work required for generating enough training data, we hereby propose to leverage existing labeled data to generate image annotations automatically. Specifically, the pixel labels are firstly transferred from one image modality to another image modality via geometric transformation to create initial image annotations, and then additional information (e.g., height measurements) is incorporated for Bayesian inference to update the labeling beliefs. Finally, the updated label assignments are optimized with a fully connected conditional random field (CRF), yielding refined labeling for all pixels in the image. The proposed approach is tested on two different scenarios, i.e., (1) label propagation from annotated aerial imagery to unmanned aerial vehicle (UAV) imagery and (2) label propagation from map database to aerial imagery. In each scenario, the refined image labels are used as pseudo-ground truth data for training a convolutional neural network (CNN). Results demonstrate that our model is able to produce accurate label assignments even around complex object boundaries; besides, the generated image labels can be effectively leveraged for training CNNs and achieve comparable classification accuracy as manual image annotations, more specifically, the per-class classification accuracy of the networks trained by the manual image annotations and the generated image labels have a difference within ± 5 % .

Most of the existing pan-sharpening quality assessment methods consider only the spectral quality and there are just few investigations, which concentrate on spatial characteristics. Spatial quality of pan-sharpened images is vital in elaborating the capability of object extraction, identification, or reconstruction, especially regarding man-made objects and their application for large scale mapping in urban areas. This paper presents an Edge based image Fusion Metric (EFM) for spatial quality evaluation of pan-sharpening in high resolution satellite imagery. Considering Modulation Transfer Function (MTF) as a precise measurement of edge response, MTFs of pan-sharpened images are assessed and compared to those obtained from the original multispectral or panchromatic images. Spatial quality assessment of pan-sharpening is done by comparison of MTF curves of the pan-sharpened and reference images. The capability of the proposed method is evaluated by quality assessment of two different residential and industrial urban areas of WorldView-2 pan-sharpened images. Obtained results clearly show the wide spatial discrepancy in quality of Pan-sharpened images, resulting from different fusion methods, and confirm the need for spatial quality assessment of fused products. The results also prove the capability of the proposed EFM as a powerful tool for evaluation and comparison of different image fusion techniques and products.

High resolution Digital Surface Models (DSMs) produced from airborne laser-scanning or stereo satellite images provide a very useful source of information for automated 3D building reconstruction. In this paper an investigation is reported about extraction of 3D building models from high resolution DSMs and orthorectified images produced from Worldview-2 stereo satellite imagery. The focus is on the generation of 3D models of parametric building roofs, which is the basis for creating Level Of Detail 2 (LOD2) according to the CityGML standard. In particular the building blocks containing several connected buildings with tilted roofs are investigated and the potentials and limitations of the modeling approach are discussed. The edge information extracted from orthorectified image has been employed as additional source of information in 3D reconstruction algorithm. A model driven approach based on the analysis of the 3D points of DSMs in a 2D projection plane is proposed. Accordingly, a building block is divided into smaller parts according to the direction and number of existing ridge lines for parametric building reconstruction. The 3D model is derived for each building part, and finally, a complete parametric model is formed by merging the 3D models of the individual building parts and adjusting the nodes after the merging step. For the remaining building parts that do not contain ridge lines, a prismatic model using polygon approximation of the corresponding boundary pixels is derived and merged to the parametric models to shape the final model of the building. A qualitative and quantitative assessment of the proposed method for the automatic reconstruction of buildings with parametric roofs is then provided by comparing the final model with the existing surface model as well as some field measurements.

Global Digital Elevation Models (GDEM) are considered very attractive for current research and application areas due to their free and wide range accessibility. The ASTER Global Digital Elevation Model exhibits the highest spatial resolution data of all global DEMs and it is generated for almost the whole globe. Unfortunately, ASTERGDEM data include many artifacts and height errors that decrease the quality and elevation accuracy significantly. This study provides a method for quality improvement of the ASTER GDEM data by correcting systematic height errors using ICESat laser altimetry data and removing artifacts and anomalies based on a segment-based outlier detection and elimination algorithm. Additionally, elevation errors within water bodies are corrected using a water mask produced from a high-resolution shoreline data set. Results indicate that the accuracy of the corrected ASTER GDEM is significantly improved and most artifacts are appropriately eliminated. Nevertheless, artifacts containing lower height values with respect to the neighboring ground pixels are not entirely eliminated due to confusion with some real non-terrain 3D objects. The proposed method is particularly useful for areas where other high quality DEMs such as SRTM are not available.

A digital surface model (DSM) provides the geometry and structure of an urban environment with buildings being the most prominent objects in it. Built-up areas change with time due to the rapid expansion of cities. New buildings are being built, existing ones are expanded, and old buildings are torn down. As a result, 3D surface models can increase the understanding and explanation of complex urban scenarios. They are very useful in numerous fields of remote sensing applications, in tasks related to 3D reconstruction and city modeling, planning, visualization, disaster management, navigation, and decision-making, among others. DSMs are typically derived from various acquisition techniques, like photogrammetry, laser scanning, or synthetic aperture radar (SAR). The generation of DSMs from very high resolution optical stereo satellite imagery leads to high resolution DSMs which often suffer from mismatches, missing values, or blunders, resulting in coarse building shape representation. To overcome these problems, we propose a method for 3D surface model generation with refined building shapes to level of detail (LoD) 2 from stereo half-meter resolution satellite DSMs using deep learning techniques. Mainly, we train a conditional generative adversarial network (cGAN) with an objective function based on least square residuals to generate an accurate LoD2-like DSM with enhanced 3D object shapes directly from the noisy stereo DSM input. In addition, to achieve close to LoD2 shapes of buildings, we introduce a new approach to generate an artificial DSM with accurate and realistic building geometries from city geography markup language (CityGML) data, on which we later perform a training of the proposed cGAN architecture. The experimental results demonstrate the strong potential to create large-scale remote sensing elevation models where the buildings exhibit better-quality shapes and roof forms than just using the matching process. Moreover, the developed model is successfully applied to a different city that is unseen during the training to show its generalization capacity.

Superpixels, as a state-of-the-art segmentation paradigm, have recently been widely used in computer vision and pattern recognition. Despite the effectiveness of these algorithms, there are still many limitations and challenges dealing with Very High-Resolution (VHR) satellite images especially in complex urban scenes. In this paper, we develop a superpixel algorithm as a modified edge-based version of Simple Linear Iterative Clustering (SLIC), which is here called ESLIC, compatible with VHR satellite images. Then, based on the modified properties of generated superpixels, a heuristic multi-scale approach for building extraction is proposed, based on the stereo satellite imagery along with the corresponding Digital Surface Model (DSM). First, to generate the modified superpixels, an edge-preserving term is applied to retain the main building boundaries and edges. The resulting superpixels are then used to initially refine the stereo-extracted DSM. After shadow and vegetation removal, a rough building mask is obtained from the normalized DSM, which highlights the appropriate regions in the image, to be used as the input of a multi-scale superpixel segmentation of the proper areas to determine the superpixels inside the building. Finally, these building superpixels with different scales are integrated and the output is a unified building mask. We have tested our methods on building samples from a WorldView-2 dataset. The results are promising, and the experiments show that superpixels generated with the proposed ESLIC algorithm are more adherent to the building boundaries, and the resulting building mask retains urban object shape better than those generated with the original SLIC algorithm.

Seagrasses are traversing the epoch of intense anthropogenic impacts that significantly decrease their coverage and invaluable ecosystem services, necessitating accurate and adaptable, global-scale mapping and monitoring solutions. Here, we combine the cloud computing power of Google Earth Engine with the freely available Copernicus Sentinel-2 multispectral image archive, image composition, and machine learning approaches to develop a methodological workflow for large-scale, high spatiotemporal mapping and monitoring of seagrass habitats. The present workflow can be easily tuned to space, time and data input; here, we show its potential, mapping 2510.1 km2 of P. oceanica seagrasses in an area of 40,951 km2 between 0 and 40 m of depth in the Aegean and Ionian Seas (Greek territorial waters) after applying support vector machines to a composite of 1045 Sentinel-2 tiles at 10-m resolution. The overall accuracy of P. oceanica seagrass habitats features an overall accuracy of 72% following validation by an independent field data set to reduce bias. We envision that the introduced flexible, time- and cost-efficient cloud-based chain will provide the crucial seasonal to interannual baseline mapping and monitoring of seagrass ecosystems in global scale, resolving gain and loss trends and assisting coastal conservation, management planning, and ultimately climate change mitigation.

Bathymetry mapping forms the basis of understanding physical, economic, and ecological processes in the vastly biodiverse coastal fringes of our planet which are subjected to constant anthropogenic pressure. Here, we pair recent advances in cloud computing using the geospatial platform of the Google Earth Engine (GEE) with optical remote sensing technology using the open Sentinel-2 archive, obtaining low-cost in situ collected data to develop an empirical preprocessing workflow for estimating satellite-derived bathymetry (SDB). The workflow implements widely used and well-established algorithms, including cloud, atmospheric, and sun glint corrections, image composition and radiometric normalisation to address intra- and inter-image interferences before training, and validation of four SDB algorithms in three sites of the Aegean Sea in the Eastern Mediterranean. Best accuracy values for training and validation were R2 = 0.79, RMSE = 1.39 m, and R2 = 0.9, RMSE = 1.67 m, respectively. The increased accuracy highlights the importance of the radiometric normalisation given spatially independent calibration and validation datasets. Spatial error maps reveal over-prediction over low-reflectance and very shallow seabeds, and under-prediction over high-reflectance (17 m). We provide access to the developed code, allowing users to map bathymetry by customising the time range based on the field data acquisition dates and the optical conditions of their study area.

Recent years have witnessed the fast development of UAVs (unmanned aerial vehicles). As an alternative to traditional image acquisition methods, UAVs bridge the gap between terrestrial and airborne photogrammetry and enable flexible acquisition of high resolution images. However, the georeferencing accuracy of UAVs is still limited by the low-performance on-board GNSS and INS. This paper investigates automatic geo-registration of an individual UAV image or UAV image blocks by matching the UAV image(s) with a previously taken georeferenced image, such as an individual aerial or satellite image with a height map attached or an aerial orthophoto with a DSM (digital surface model) attached. As the biggest challenge for matching UAV and aerial images is in the large differences in scale and rotation, we propose a novel feature matching method for nadir or slightly tilted images. The method is comprised of a dense feature detection scheme, a one-to-many matching strategy and a global geometric verification scheme. The proposed method is able to find thousands of valid matches in cases where SIFT and ASIFT fail. Those matches can be used to geo-register the whole UAV image block towards the reference image data. When the reference images offer high georeferencing accuracy, the UAV images can also be geolocalized in a global coordinate system. A series of experiments involving different scenarios was conducted to validate the proposed method. The results demonstrate that our approach achieves not only decimeter-level registration accuracy, but also comparable global accuracy as the reference images.

Digital surface models (DSMs) derived from spaceborne and airborne sensors enable the monitoring of the vertical structures for forests in large areas. Nevertheless, due to the lack of an objective performance assessment for this task, it is difficult to select the most appropriate data source for DSM generation. In order to fill this gap, this paper performs change detection analysis including forest decrease and tree growth. The accuracy of the DSMs is evaluated by comparison with measured tree heights from inventory plots (field data). In addition, the DSMs are compared with LiDAR data to perform a pixel-wise quality assessment. DSMs from four different satellite stereo sensors (ALOS/PRISM, Cartosat-1, RapidEye and WorldView-2), one satellite InSAR sensor (TanDEM-X), two aerial stereo camera systems (HRSC and UltraCam) and two airborne laser scanning datasets with different point densities are adopted for the comparison. The case study is a complex central European temperate forest close to Traunstein in Bavaria, Germany. As a major experimental result, the quality of the DSM is found to be robust to variations in image resolution, especially when the forest density is high. The forest decrease results confirm that besides aerial photogrammetry data, very high resolution satellite data, such as WorldView-2, can deliver results with comparable quality as the ones derived from LiDAR, followed by TanDEM-X and Cartosat DSMs. The quality of the DSMs derived from ALOS and Rapid-Eye data is lower, but the main changes are still correctly highlighted. Moreover, the vertical tree growth and their relationship with tree height are analyzed. The major tree height in the study site is between 15 and 30 m and the periodic annual increments (PAIs) are in the range of 0.30–0.50 m.

Automatic crowd detection in aerial images is certainly a useful source of information to prevent crowd disasters in large complex scenarios of mass events. A number of publications employ regression-based methods for crowd counting and crowd density estimation. However, these methods work only when a correct manual count is available to serve as a reference. Therefore, it is the objective of this paper to detect high-density crowds in aerial images, where counting– or regression–based approaches would fail. We compare two texture–classification methodologies on a dataset of aerial image patches which are grouped into ranges of different crowd density. These methodologies are: (1) a Bag–of–words (BoW) model with two alternative local features encoded as Improved Fisher Vectors and (2) features based on a Gabor filter bank. Our results show that a classifier using either BoW or Gabor features can detect crowded image regions with 97% classification accuracy. In our tests of four classes of different crowd-density ranges, BoW–based features have a 5%–12% better accuracy than Gabor.