Search

The Remote sensing provides a synoptic view of land by detecting the energy reflected from Earth's surface. The Hyperspectral images (HSI) use perfect sensors that extract more than a hundred of images, with more detailed information than using traditional Multispectral data. In this paper, we aim to study this aspect of communication in the case of passive reception. First, a brief overview of acquisition process and treatment of Hyperspectral images is provided. Then, we explain representation spaces and the various analysis methods of these images. Furthermore, the factors influencing this analysis are investigated and some applications, in this area, are presented. Finally, we explain the relationship between Hyperspectral images and Datamining and we outline the open issues related to this area. So we consider the case study: HSI AVIRIS 92AV3C. This study serves as map of route for integrating classification methods in the higher dimensionality data. Keywords-component: Hyperspectral images, Passive Sensing,Classification, Data mining.

Hyperspectral images usually consist of more than one hundred spectral bands, which have potentials to provide rich spatial and spectral information. However, the application of hyperspectral data is still challengeable due to “the curse of dimensionality”. In this context, many techniques, which aim to make full use of both the spatial and spectral information, are investigated. In order to preserve the geometrical information, meanwhile, with less spectral bands, we propose a novel method, which combines principal components analysis (PCA), guided image filtering and the random forest classifier (RF). In detail, PCA is firstly employed to reduce the dimension of spectral bands. Secondly, the guided image filtering technique is introduced to smooth land object, meanwhile preserving the edge of objects. Finally, the features are fed into RF classifier. To illustrate the effectiveness of the method, we carry out experiments over the popular Indian Pines data set, which is collected by Airborne Visible/Infrared Imaging Spectrometer (AVIRIS) sensor. By comparing the proposed method with the method of only using PCA or guided image filter, we find that effect of the proposed method is better.

We present a single-capture photometric stereo method using a hyperspectral camera. A spectrally and spatially designed illumination enables a point-wise estimation of reflectance spectra and surface normals from a single hyperspectral image. The illumination works as a reflectance probe in wide spectral regions where reflectance spectra are measured, and the full spectra are estimated by interpolation. It also works as the resource for shadings in other spectral regions. The accuracy of estimation is evaluated in a simulation. Also, we prepare an experimental setup and demonstrate a surface reconstruction against a real scene.

Hyperspectral imaging (HSI) is used in a wide range of applications such as remote sensing, space imagery, mineral detection, and exploration. Unfortunately, it is difficult to acquire hyperspectral images with high spatial and spectral resolution due to instrument limitations. The super-resolution techniques are used to reconstruct low-resolution hyperspectral images. However, traditional superresolution (SR) approaches do not allow direct use of both spatial and spectral information, which is a decisive for an optimal reconstruction. This paper proposes a single image SR algorithm for HSI. The algorithm uses the fact that the spatial and spectral information can be integrated to make an accurate estimate of the high-resolution HSI. To achieve this, two types of spatio- pectral downsampling, and a three-dimensional interpolation are proposed in order to increase coherence between the spatial and spectral information. The resulting reconstructions using the proposed method are up to 2 dB better than traditional SR approaches. Las imágenes hiperespectrales (HSI) son de vital importancia en una amplia gama de aplicaciones, tales como la teledetección, imágenes espaciales, la detección y la exploración de minerales. Desafortunadamente, es difícil adquirir HSI de alta resolución espacio-espectral debido a las limitaciones de los equipos de sensado. Para obtener versiones de HSI de alta calidad se usan técnicas tradicionales de superresolución. Éstas técnicas no permiten el uso directo de la información espacial y espectral que son un factor decisivo para una óptima reconstrucción. En este trabajo se propone la implementación de un novedoso algoritmo de superresolución de una sola imagen hiperespectral. El algoritmo integra la información espacial y espectral en las HSI para realizar una estimación precisa de alta resolución. Esta integración se obtiene mediante el uso de dos tipos de muestreo espacio-espectral y un interpolador tridimensional, que permite aumentar la coherencia de la información inherente en la imagen. Las imágenes resultantes son superiores hasta 2 dB comparas con reconstrucciones obtenidas por enfoques tradicionales.

We present a novel hyperspectral image reconstruction algorithm, which overcomes the long-standing tradeoff between spectral accuracy and spatial resolution in existing compressive imaging approaches. Our method consists of two steps: First, we learn nonlinear spectral representations from real-world hyperspectral datasets; for this, we build a convolutional autoencoder which allows reconstructing its own input through its encoder and decoder networks. Second, we introduce a novel optimization method, which jointly regularizes the fidelity of the learned nonlinear spectral representations and the sparsity of gradients in the spatial domain, by means of our new fidelity prior. Our technique can be applied to any existing compressive imaging architecture, and has been thoroughly tested both in simulation, and by building a prototype hyperspectral imaging system. It outperforms the state-of-the-art methods from each architecture, both in terms of spectral accuracy and spatial resolution, while its computational complexity is reduced by two orders of magnitude with respect to sparse coding techniques. Moreover, we present two additional applications of our method: hyperspectral interpolation and demosaicing. Last, we have created a new high-resolution hyperspectral dataset containing sharper images of more spectral variety than existing ones, available through our project website.

In order to understand the characteristics of the data collected by hyperspectral imaging systems, it is important to discuss the physics behind the scene radiance field incident on the imaging system. A dominant effect in hyperspectral remote sensing is the mixing of radiant energies contributed from different materials present in a given pixel. The basic assumption of mixture modelling is that within a given scene, the surface is covered by a small number of distinct materials that have relatively constant spectral properties. It is most common to assume that the radiance reflected by different materials in a pixel can spectrally combine in a linear additive manner to produce the pixel radiance/reflectance, even when that might not be the case e.g. where the mixing process leads to nonlinear combinations of the radiance and where the linear assumption fails to hold. This can occur where there is significant relative three-dimensional structure within a given pixel. Without detailed knowledge of the dimensional structure, it can be very difficult to correctly ‘‘un-mix’’ the contributions of the various materials. This work aims to evaluate the correctness of the linear assumption in the mixture modelling using some laboratory measurements. Study was conducted using some sheets made of cellulose materials of different colours in 400-800 nm spectral range. Experimental results have shown that a correction term must be applied to the gains and offsets in the linear model. The obtained results can be extended to satellite sensors that acquire images in the above mentioned spectral range.

Over the past thirty years, the hyperspectral remote sensing technology is attracted more and more attentions by the researchers. The dimension reduction technology for hyperspectral remote sensing image data is one of the hotspots in current research of hyperspectral remote sensing. In order to solve the problems of nonlinearity, the high dimensions and the redundancy of the bands that exist in the hyperspectral data, this paper proposes a dimension reduction method for hyperspectral remote sensing image data based on the global mixture coordination factor analysis. In the first place, a linear low dimensional manifold is obtained from the nonlinear and high dimensional hyperspectral image data by mixture factor analysis method. In the second place, the parameters of linear low dimensional manifold are estimated by the EM algorithm of find a local maximum of the data log-likelihood. In the third place, the manifold is aligned to a global parameterization by the global coordinated factor analysis model and then the lowdimension image data of hyperspectral image data is obtained at last. Through the comparison of different dimensionality reduction method and different classification method for the low-dimensional data, the result illuminates the proposed method can retain maximum spectral information in hyperspectral image data and can eliminate the redundant among bands.

Rapid advancement in remote sensing open new avenues to explore the hyperspectral Hyperion imagery pre-processing techniques, analysis and application for land use mapping. The hyperspectral data consists of 242 bands out of which 196 calibrated/useful bands are available for hyperspectral applications. Atmospheric correction applied to the hyperspectral calibrated bands make the data more useful for its further processing/ application. Principal component (PC) analysis applied to the hyperspectral calibrated bands reduced the dimensionality of the data and it is found that 99% of the data is held in first 10 PCs. Feature extraction is one of the important application by using vegetation delineation and normalized difference vegetation index. The machine learning classifiers uses the technique to identify the pixels having significant difference in the spectral signature which is very useful for classification of an image. Supervised machine learning classifier technique has been used for classification of hyperspectral image which resulted in overall efficiency of 86.6703 and Kappa co-efficient of 0.7998.

Hyperspectral image enhancement has been a concern for the remote sensing society for detailed end member detection. Hyperspectral remote sensor collects images in hundreds of narrow, continuous spectral channels, whereas multispectral remote sensor collects images in relatively broader wavelength bands. However, the spatial resolution of the hyperspectral sensor image is comparatively lower than that of the multispectral. As a result, spectral signatures from different end members originate within a pixel, known as mixed pixels. This paper presents an approach for obtaining an image which has the spatial resolution of the multispectral image and spectral resolution of the hyperspectral image, by fusion of hyperspectral and multispectral image. The proposed methodology also addresses the band remapping problem, which arises due to different regions of spectral coverage by multispectral and hyperspectral images. Therefore we apply algorithms to restore the spatial information of the hyperspectral image by fusing hyperspectral bands with only those bands which come under each multispectral band range. The proposed methodology is applied over Henry Island, of the Sunderban eco-geographic province. The data is collected by the Hyperion hyperspectral sensor and LISS IV multispectral sensor.

In the recent past, remotely sensed data with high spectral resolution has been made available and has been explored for various agricultural and geological applications. While these spectral signatures of the objects of interest provide important clues, the relatively poor spatial resolution of these hyperspectral images limits their utility and performance. In this context, hyperspectral image enhancement using multispectral data has been actively pursued to improve spatial resolution of such imageries and thus enhancing its use for classification and composition analysis in various applications. But, this also poses a challenge in terms of managing the trade-off between improved spatial detail and the distortion of spectral signatures in these fused outcomes. This paper proposes a strategy of using vector decomposition, as a model to transfer the spatial detail from relatively higher resolution data, in association with sensor simulation to generate a fused hyperspectral image while preserving the inter band spectral variability. The results of this approach demonstrates that the spectral separation between classes has been better captured and thus helped improve classification accuracies over mixed pixels of the original low resolution hyperspectral data. In addition, the quantitative analysis using a rank-correlation metric shows the appropriateness of the proposed method over the other known approaches with regard to preserving the spectral signatures.

Remote Sensing plays very important role in many different study fields, like hydrology, crop management, environmental and ecosystem studies. For all mentioned areas of interest different remote sensing and image processing techniques, such as: image classification (object and pixel- based), object identification, change detection, etc. can be applied. Most of this techniques use spectral reflectance coefficients as the basis for the identification and distinction of different objects and materials, e.g. monitoring of vegetation stress, identification of water pollutants, yield identification, etc. Spectral characteristics are usually acquired using discrete methods such as spectrometric measurements in both laboratory and field conditions. Such measurements however can be very time consuming, which has led many international researchers to investigate the reliability and accuracy of using image-based methods. According to published and ongoing studies, in order to acquire these spectral characteristics from images, it is necessary to have hyperspectral data. The presented article describes a series of experiments conducted using the push-broom Headwall MicroHyperspec A-series VNIR. This hyperspectral scanner allows for registration of images with more than 300 spectral channels with a 1.9 nm spectral bandwidth in the 380- 1000 nm range. The aim of these experiments was to establish a methodology for acquiring spectral reflectance characteristics of different forms of land cover using such sensor. All research work was conducted in controlled conditions from low altitudes. Hyperspectral images obtained with this specific type of sensor requires a unique approach in terms of post-processing, especially radiometric correction. Large amounts of acquired imagery data allowed the authors to establish a new post- processing approach. The developed methodology allowed the authors to obtain spectral reflectance coefficients from a hyperspectral sensor mounted on an unmanned aerial vehicle, ensuring a high accuracy of obtained data.

Chinese HY-1C/1D satellites will use a 5nm/10nm-resolutional visible-near infrared(VNIR) hyperspectral sensor with the solar calibrator to cross-calibrate with other sensors. The hyperspectral radiance data are composed of average radiance in the sensor’s passbands and bear a spectral smoothing effect, a transform from the hyperspectral radiance data to the 1-nm-resolution apparent spectral radiance by spectral reconstruction need to be implemented. In order to solve the problem of noise cumulation and deterioration after several times of iteration by the iterative algorithm, a novel regression method based on SVM is proposed, which can approach arbitrary complex non-linear relationship closely and provide with better generalization capability by learning. In the opinion of system, the relationship between the apparent radiance and equivalent radiance is nonlinear mapping introduced by spectral response function(SRF), SVM transform the low-dimensional non-linear question into high-dimensional linear question though kernel function, obtaining global optimal solution by virtue of quadratic form. The experiment is performed using 6S-simulated spectrums considering the SRF and SNR of the hyperspectral sensor, measured reflectance spectrums of water body and different atmosphere conditions. The contrastive result shows: firstly, the proposed method is with more reconstructed accuracy especially to the high-frequency signal; secondly, while the spectral resolution of the hyperspectral sensor reduces, the proposed method performs better than the iterative method; finally, the root mean square relative error(RMSRE) which is used to evaluate the difference of the reconstructed spectrum and the real spectrum over the whole spectral range is calculated, it decreses by one time at least by proposed method.

Close range hyperspectral imaging is a developing method for the analysis and identification of material composition in many applications, such as in within the earth sciences. Using compact imaging devices in the field allows near-vertical topography to be imaged, thus bypassing the key limitations of viewing angle and resolution that preclude the use of airborne and spaceborne platforms. Terrestrial laser scanning allows 3D topography to be captured with high precision and spatial resolution. The combination of 3D geometry from laser scanning, and material properties from hyperspectral imaging allows new fusion products to be created, adding new information for solving application problems. This paper highlights the advantages of terrestrial lidar and hyperspectral integration, focussing on the qualitative and quantitative aspects, with examples from a geological field application. Accurate co-registration of the two data types is required. This allows 2D pixels to be linked to the 3D lidar geometry, giving increased quantitative analysis as classified material vectors are projected to 3D space for calculation of areas and examination of spatial relationships. User interpretation of hyperspectral results in a spatially-meaningful manner is facilitated using visual methods that combine the geometric and mineralogical products in a 3D environment. Point cloud classification and the use of photorealistic modelling enhance qualitative validation and interpretation, and allow image registration accuracy to be checked. A method for texture mapping of lidar meshes with multiple image textures, both conventional digital photos and hyperspectral results, is described. The integration of terrestrial laser scanning and hyperspectral imaging is a valuable means of providing new analysis methods, suitable for many applications requiring linked geometric and chemical information.

Imaging with a conventional frame camera from a moving remotely piloted aircraft system (RPAS) is by design very inefficient. Less than 1 % of the flying time is used for collecting light. This unused potential can be utilized by an innovative imaging concept, the spatio-spectral camera. The core of the camera is a frame sensor with a large number of hyperspectral filters arranged on the sensor in stepwise lines. It combines the advantages of frame cameras with those of pushbroom cameras. By acquiring images in rapid succession, such a camera can collect detailed hyperspectral information, while retaining the high spatial resolution offered by the sensor. We have developed two versions of a spatio-spectral camera and used them in a variety of conditions. In this paper, we present a summary of three missions with the in-house developed COSI prototype camera (600–900 nm) in the domains of precision agriculture (fungus infection monitoring in experimental wheat plots), horticulture (crop status monitoring to evaluate irrigation management in strawberry fields) and geology (meteorite detection on a grassland field). Additionally, we describe the characteristics of the 2nd generation, commercially available ButterflEYE camera offering extended spectral range (475–925 nm), and we discuss future work.

[Departement_IRSTEA]Ecotechnologies [TR1_IRSTEA]INSPIRE [ADD1_IRSTEA]Équiper l'agriculture; International audience; The use of digital soil mapping, with the help of spectroscopic data, provides a non-destructive and cost-efficient alternative to soil property laboratory measurements. Visible, near-infrared and short wave infrared (VNIR/ SWIR, 400–2500 nm) hyperspectral imaging is one of the most promising tools for topsoil property mapping. The aim of this study was to test the sensitivity of soil property prediction results to coarsening image spectral resolution. This may offer an analysis of the potential of forthcoming hyperspectral satellite sensors, e.g., HYPerspectral X IMagery (HYPXIM) or Environmental Mapping and Analysis Program (EnMAP), and existing multispectral sensors, e.g., SENTINEL-2 Multispectral Sensor Instrument (MSI) or LANDSAT-8 Operational Land Imager (OLI), for soil properties mapping. This study used VNIR/SWIR hyperspectral airborne data acquired by the AISA-DUAL sensor (initial spectral and spatial resolutions of approximately 5 nm and 5 m, respectively) over a 300 km2 Mediterranean rural region. Ten spectral configurations were built and divided in the following two groups: i) six spectral configurations corresponding to simulated sensors with regular spectral resolution from 5 nm to 200 nm (i.e., the Full Width at Half Maximum (FWHM) remains constant throughout the considered spectral domain; this includes the simulation of the forthcoming HYPXIM and EnMAP hyperspectral satellites) and ii) four spectral configurations corresponding to existing multispectral sensors with irregular spectral resolution (i.e., the FWHM differs from spectral sampling interval; Advanced Spaceborne Thermal Emission and Reflection Radiometer (ASTER), SENTINEL-2 MSI, LANDSAT-7 Enhanced Thematic Mapper (ETM+) and LANDSAT-8 OLI). The soil property studied in this paper is the clay content, defined as the percentage of granulometric fraction finer than 2 μm by weight of the soil, which will be estimated using the partial least squares regression method. Our results showed that i) spectral configurations with regular spectral resolutions from 5 to 100 nm provided similar and good clay content prediction performances (R2val > 0.7 and RPIQ > 3) and allowed clay mapping with correct short-scale variations, ii) the spectral configuration with a regular spectral resolution of 200 nm provided unsatisfactory clay content prediction performance (R2val ≃ 0.01 and RPIQ ≃ 1.65) and iii) the ASTER sensor was the only existing multispectral sensor that provided both correct performance of clay content estimation (R2val ≃ 0.8 and RPIQ ≃ 3.72) and correct clay mapping. Therefore, clay mapping by the ASTER multispectral data should be pursued while awaiting the launch of forthcoming hyperspectral satellite sensors (e.g., HYPXIM and EnMAP), which will be good candidates for future large clay mapping campaigns over bare soils.

Hyperspectral images are well-known for their fine spectral resolution to discriminate different materials. However, their spatial resolution is relatively low due to the trade-off in imaging sensor technologies, resulting in limitations in their applications. Inspired by recent achievements in convolutional neural network (CNN) based super-resolution (SR) for natural images, a novel three-dimensional full CNN (3D-FCNN) is constructed for spatial SR of hyperspectral images in this paper. Specifically, 3D convolution is used to exploit both the spatial context of neighboring pixels and spectral correlation of neighboring bands, such that spectral distortion when directly applying traditional CNN based SR algorithms to hyperspectral images in band-wise manners is alleviated. Furthermore, a sensor-specific mode is designed for the proposed 3D-FCNN such that none of the samples from the target scene are required for training. Fine-tuning by a small number of training samples from the target scene can further improve the performance of such a sensor-specific method. Extensive experimental results on four benchmark datasets from two well-known hyperspectral sensors, namely hyperspectral digital imagery collection experiment (HYDICE) and reflective optics system imaging spectrometer (ROSIS) sensors, demonstrate that our proposed 3D-FCNN outperforms several existing SR methods by ensuring higher quality both in reconstruction and spectral fidelity.

Based on the well-known Singular Value Decomposition (SVD), Singular Spectrum Analysis (SSA) has been widely employed for time series analysis and forecasting in decomposing the original series into a sum of components. As such, each 1-D signal can be represented with varying trend, oscillations and noise for easy enhancement of the signal. Taking each spectral signature in Hyperspectral Imaging (HSI) as a 1-D signal, SSA has been successfully applied for signal decomposition and noise removal whilst preserving the discriminating power of the spectral profile. Two well-known remote sensing datasets for land cover analysis, AVIRIS 92AV3C and Salinas C, are used for performance assessment. Experimental results using Support Vector Machine (SVM) in pixel based classification have indicated that SSA has suppressed the noise in significantly improving the classification accuracy.

The AisaOWL is a recent-to-market thermal hyperspectral instrument. As such, there is little information about the sensor performance in the literature. The sensor covers the 7.6– $12.6~\mu \text{m}$ part of the long-wave infrared region with 102 continuous bands, and is capable of imaging in low-light conditions. This paper presents an independent characterization of the AisaOWL sensor, examining the spectral accuracy of black body measurements at different temperatures and validating manufacturer recommendations for warm-up, integration, and calibration times. This analysis is essential for establishing high quality operational procedures and in giving confidence to users of the data. In this paper, the sensor has been found to have a maximum error of 2 °C in absolute temperature measurement, and provides spectra most accurate in the 8– $9~\mu \text{m}$ region. The recommended warm-up time of 15 min has been confirmed, with a 1% increase in error identified for data collected only 7 min after switch on. The optimal integration time of 1.18 ms has been validated and an exponential decrease in performance observed outside the 0.85–1.2 ms range. The detector used by the sensor is shown to have stability issues and this has been examined by comparing black body data processed with different calibration data. While the detector is operating in a stable regime compatible with the calibration, these black body readings stay within 5% across the central bands, approaching 10% below $8~\mu \text{m}$ and just exceeding 20% above 11 $\mu \text{m}$ .

Hyperspectral imaging has become an essential tool in analytical chemistry. Indeed, it is used to explore complex and heterogeneous samples providing simultaneously spectral and spatial information in the acquired data cube. Many chemometric tools have been developed and optimised to extract latent features in such data structure, but it has to be said that the spatial information (ie, pixel neighbourhood) is almost not used during the data analysis framework. It is in this sense that we propose the neighbouring pixel data augmentation as a new and simple way to consider all dimensions of the cube. We will share the potential of the concept on the basis of 2 data set explorations using Raman hyperspectral imaging and deep UV synchrotron fluorescenxce microscopy. It shall be first demonstrated that more information can be extracted when neighbouring pixel data augmentation is used. Furthermore, a good behaviour against noise will be also observed.

Hyperspectral radiative transfer simulations are a versatile tool in remote sensing but can pose a major computational burden. We describe a simple method to construct hyperspectral simulation results by using only a small spectral subsample of the simulated wavelength range, thus leading to major speedups in such simulations. This is achieved by computing principal components for a small number of representative hyperspectral spectra and then deriving a reconstruction matrix for a specific spectral subset of channels to compute the hyperspectral data. The method is applied and discussed in detail using the example of top of atmosphere radiances in the oxygen A band, leading to speedups in the range of one to two orders of magnitude when compared to radiative transfer simulations at full spectral resolution.

Hyperspectral imaging has been widely applied in remote sensing scientific fields. For this study, hyperspectral imaging data covering the spectral region from 400 to 1000 nm were collected from an unmanned aerial vehicle visible/near-infrared imaging hyperspectrometer (UAV-VNIRIS). Theoretically, the spectral calibration parameters of the UAV-VNIRIS measured in the laboratory should be refined when applied to the hyperspectral data obtained from the UAV platform due to variations between the laboratory and actual flight environments. Therefore, accurate spectral calibration of the UAV-VNIRIS is essential to further applications of the hyperspectral data. Shifts in both the spectral center wavelength position and the full-width at half-maximum (FWHM) were retrieved using two different methods (Methods I and II) based on spectrum matching of atmospheric absorption features at oxygen bands near 760 nm and water vapor bands near 820 and 940 nm. Comparison of the spectral calibration results of these two methods over the calibration targets showed that the derived center wavelength and FWHM shifts are similar. For the UAV-VNIRIS observed data used here, the shifts in center wavelength derived from both Methods I and II over the three absorption bands are less than 0.13 nm, and less than 0.22 nm in terms of FWHM. The findings of this paper revealed: 1) the UAV-VNIRIS payload on the UAV platform performed well in terms of spectral calibration; and 2) the applied methods are effective for on-orbit spectral calibration of the hyper spectrometer.

Multitemporal hyperspectral remote sensing data have the potential to detect altered areas on the earth’s surface. However, dissimilar radiometric and geometric properties between the multitemporal data due to the acquisition time or position of the sensors should be resolved to enable hyperspectral imagery for detecting changes in natural and human-impacted areas. In addition, data noise in the hyperspectral imagery spectrum decreases the change-detection accuracy when general change-detection algorithms are applied to hyperspectral images. To address these problems, we present an unsupervised change-detection algorithm based on statistical analyses of spectral profiles; the profiles are generated from a synthetic image fusion method for multitemporal hyperspectral images. This method aims to minimize the noise between the spectra corresponding to the locations of identical positions by increasing the change-detection rate and decreasing the false-alarm rate without reducing the dimensionality of the original hyperspectral data. Using a quantitative comparison of an actual dataset acquired by airborne hyperspectral sensors, we demonstrate that the proposed method provides superb change-detection results relative to the state-of-the-art unsupervised change-detection algorithms.

We design and implement a portable hyperspectral imaging spectrometer, which has high spectral resolution, high spatial resolution, small volume, and low weight. The flight test has been conducted, and the hyperspectral images are acquired successfully. To achieve high performance, small volume, and regular appearance, an improved Dyson structure is designed and used in the hyperspectral imaging spectrometer. The hyperspectral imaging spectrometer is suitable for the small platform such as CubeSat and UAV (unmanned aerial vehicle), and it is also convenient to use for hyperspectral imaging acquiring in the laboratory and the field.

We describe an optical system and a method for measuring the human iris spectral reflectance in vivo by hyperspectral imaging analysis. It is important to monitor age-related changes in the reflectance properties of the iris as they are a prognostic factor for several eye pathologies. In this paper, we report the outcomes of our most recent research, resulting from the improvement of our imaging system. In particular, a custom tunable light source was developed: the images are now acquired in the spectral range 440 – 900 nm. With this system, we are able to obtain a spectral resolution of 20nm, while each image of 2048 × 1536 pixels has a spatial resolution of 10.7 µm. The results suggest that the instrument could be exploited for measuring iris pigmentation changes over time. These measurements could provide new diagnostic capabilities in ophthalmology. Further studies are required to determine the measurements’ repeatability and to develop a spectral library for results evaluation and to detect differences among subsequent screenings of the same subject.

Hyperspectral imaging was first used in remote sensing and since then, it has been used in many other applications such as cancer diagnosis, precision farming and assessment of the level of flaking in ancient murals. In order to make hyperspectral imaging available for a wide variety of applications, its imagers can be made to operate using different methods and developed into different configurations. This leads to each variant having a set of specifications suitable for certain applications. The many variants of hyperspectral imager produce a set of three-dimensional spatial spatialspectral datacube, which is made up of hundreds of spectral images of one scene. A snapshot hyperspectral imaging probe has recently been developed by integrating a fiber bundle, which is made up of specially-arranged optical fibers, with a spectrograph-based hyperspectral imager. The snapshot method is able to produce a datacube using the information from each scan. The fiber bundle has 100 fiberlets which are arranged in a row in the one-dimensional proximal end, and are rearranged into a 10×10 hexagonal array in the two-dimensional distal end. The image captured by the two-dimensional end of the fiber bundle is reduced from two to one spatial dimension at the one-dimensional end. The raw data acquired from each scan has to be remapped into a datacube with the correct representation of the spectral and spatial features of the captured scene. This paper reports the spatial calibrations of both ends of the fiber bundle and image processing that have to be performed for such a remapping. MOE (Min. of Education, S’pore) Published version

Hyperspectral remote sensing based on unmanned airborne vehicles is a field increasing in importance. The combined functionality of simultaneous hyperspectral and geometric modeling is less developed. A configuration has been developed that enables the reconstruction of the hyperspectral three-dimensional (3D) environment. The hyperspectral camera is based on a linear variable filter and a high frame rate, high resolution camera enabling point-to-point matching and 3D reconstruction. This allows the information to be combined into a single and complete 3D hyperspectral model. In this paper, we describe the camera and illustrate capabilities and difficulties through real-world experiments.

Hyperspectral image classification has been a vibrant area of research in recent years. Given a set of observations, i.e., pixel vectors in a hyperspectral image, classification approaches try to allocate a unique label to each pixel vector. However, the classification of hyperspectral images is a challenging task for a number of reasons, such as the presence of redundant features, the imbalance among the limited number of available training samples, and the high dimensionality of the data.

A prototype fiber-based imaging spectrometer was developed to provide snapshot hyperspectral imaging tuned for biomedical applications. The system is designed for imaging in the visible spectral range from 400 to 700 nm for compatibility with molecular imaging applications as well as satellite and remote sensing. An 81 × 96 pixel spatial sampling density is achieved by using a custom-made fiber-optic bundle. The design considerations and fabrication aspects of the fiber bundle and imaging spectrometer are described in detail. Through the custom fiber bundle, the image of a scene of interest is collected and divided into discrete spatial groups, with spaces generated in between groups for spectral dispersion. This reorganized image is scaled down by an image taper for compatibility with following optical elements, dispersed by a prism, and is finally acquired by a CCD camera. To obtain an (x, y, λ) datacube from the snapshot measurement, a spectral calibration algorithm is executed for reconstruction of the spatial-spectral signatures of the observed scene. System characterization of throughput, resolution, and crosstalk was performed. Preliminary results illustrating changes in oxygen-saturation in an occluded human finger are presented to demonstrate the system's capabilities.

International audience; SYSIPHE is an airborne hyperspectral imaging system covering all atmospheric transmission bands from 0.4μm to 11.5μm: visible, NIR, SWIR, MWIR and LWIR. The ground sampling distance is 0.5m over a 500m swath, with higher resolution available in the visible and NIR. The imaging system, developed by Onera and Norsk Elektro Optikk, is flown on a Do-228 aircraft operated by DLR. The SYSIPHE system may also integrate a real-time processing capability developed by FFI and a ground post-processing chain, the STAD, developed by Onera. The main information products are georeferenced images of spectral radiance, spectral emissivity and reflectance as well as a surface temperature map. The system has completed its first flight campaign successfully in 2013. A qualification campaign for Defence needs was done during the summer 2015. SYSIPHE represents a significant enhancement of airborne sensing capabilities in Europe. The system will be made available soon to external users.; SYSIPHE est un système hyperspectral aéroporté couvrant toutes les bandes de transmission atmosphérique de 0,4µm à 11,5µm: visible, proche infrarouge, infrarouge moyen, infrarouge lointain. Le pas d'échantillonnage au sol est de 50cm avec une fauchée de 500m, avec une meilleure résolution disposnible dans le visible et le proche infrarouge. Le système d'imagerie, développé par l'Onera et Norsk Elektro Optikk, est embarqué dans un avion Do-228 opéré par le DLR. Le système SYSIPHE peut aussi intégrer un outil de traitement temps réel développé par le FFI et une chaîne de traitement au sol, le STAD, développé par l'Onera. Les principales sorties du système sont des images référencées de la luminance spectrique, de l'émissivité spectrale et de la réflectance, ainsi que de la température. Le premier vol du système a été fait avec succès en 2013. Une campagne de qualification pour les besoins de la Défense Nationale a été réalisée durant l'été 2015. SYSIPHE représente une amélioration importante des capacités d'imagerie aérienne en Europe. Le système sera bientôt disponible à des utilisateurs extérieurs.

International audience; Image visualization techniques are mostly based on three bands as RGB color composite channels for human eye to characterize the scene. This, however, is not effective in case of hyper-spectral images (HSI) because they contain dozens of informative spectral bands. To eliminate redundancy of spectral information among these bands, dimensionality reduction (DR) is applied while at the same trying to retain maximum information. In this paper, we propose a new method of information-preserved hyper-spectral satellite image visualization that is based on fusion of unsupervised band selection techniques and color matching function (CMF) stretching. The results show consistent, edge-preserved and pre-attentive feature less images with high class separability. Different visualization techniques are compared to demonstrate the effectiveness of our scheme that can prompt an important advancement in the field.

With the advent of UAVs and lightweight hyperspectral imagers, leaf-scale hyperspectral images of agricultural fields are available by low-altitude observation. Although leaf-scale hyperspectral images eliminate the effect of volume scattering and spectral mixing, the hyperspectral profile is affected by the surface shape of the leaf, i.e., shade and shadow. Because diffuse reflection of leaves has directional characteristics, the normalized vectors of the diffuse reflection are distributed around a point on a unit hypersphere. The center of the diffuse reflection is equivalent to the Lambert coefficients of the leaves. In this paper, we propose a method in which Lambert coefficients are estimated by investigating directional characteristics of leaf-scale hyperspectral images based on von Mises-Fisher distribution (vMF).

International audience; Hyperspectral unmixing consists in determining the reference spectral signatures composing a hyperspectral image and their relative abundance fractions in each pixel. In practice, the identified signatures may be affected by a significant spectral variability resulting for instance from the temporal evolution of the imaged scene. This phenomenon can be accounted for by using a perturbed linear mixing model. This paper studies an online estimation algorithm for the parameters of this extended linear mixing model. This algorithm is of interest for the practical applications where the size of the hyper-spectral images precludes the use of batch procedures. The performance of the proposed method is evaluated on synthetic data.

We have developed a prototype full waveform hyperspectral LiDAR and investigated its potential for remote sensing applications. Traditionally hyperspectral remote sensing is based on passive measurement of sunlit targets. These methods are sensitive to errors in illumination conditions and lack the range information. Our prototype can measure both the range and the spectral information from a single laser pulse. At this stage, the instrument is optimized for short range terrestrial applications. An active hyperspectral LiDAR opens up new possibilities for LiDAR data analysis. The lack of spectral information in traditional monochrome LiDARs rules out many of the classification techniques available for processing of hyperspectral data. Similarly, passive hyperspectral data does not allow extensive use of the classifications based on 3D shape parameters. With both hyperspectral and range data available in a single dataset, the best of the techniques can be applied to form more reliable classification results. The data also allows the mapping of spectral indices in 3D. As an example a Norway spruce is measured and spatial distribution of several spectral indices is illustrated.

This paper proposes a class-based spectral estimation method for high-resolution red, green, and blue (RGB) images and corresponding low-resolution spectral data. Each spectrum in the low-resolution data is assumed to be a mixture of spectra of different classes. Then, the spectral estimation matrix for every class is derived using a regression approach, in which the clustering results of the high-resolution RGB image are used to incorporate spectral unmixing. Experiments confirm reduced normalized root mean squared error for the spectral images if the number of classes in the clustering is appropriately selected. In addition, the experimental results show that the spectra are accurately reconstructed even when they are observed as mixed spectra in the low-resolution data.

In the compression technique of hyperspectral image (HSI), PSNR of the reconstructed image is usually used for evaluating the performance of the coding results. For the spectral analysis applications of HSI, it is also important to consider the error in the result of spectral analysis. In the vegetation analysis, for example, the distortion of the vegetation index should be considered in addition to the distortion in the spectral data. This paper presents a HSI compression considering the error of both vegetation index and spectral data. The proposed method separates a hyperspectral data into spectral data for vegetation index and residual data. Both of the data are encoded by using a seamless coding individually. By holding the spectral channels required for vegetation index in the head of the code-stream, a precise vegetation analysis can be done in a low bit rate. Additionally, by decoding the residual data, the spectral data can be reconstructed in low distortion.

This study proposes a piecewise Wiener estimation method to reconstruct a spectral reflectance image from a three-band image by multipoint spectral information collected simultaneously with image acquisition. A three-band image is divided into several blocks and the spectral estimation is carried out using the Wiener estimation matrix assigned to each block. Each Wiener estimation matrix is constructed on the basis of spectral measurement data. The experimental results show that the proposed method reduces the average estimation error monotonically as the number of spectral measurements increases. In addition, the computational time of the piecewise Wiener estimation costs only severalfold of the computational time of the conventional single-matrix method.

Near Infrared Hyperspectral Imaging (NIRHSI) is an emerging technology platform that integrates conventional imaging and spectroscopy to attain both spatial and spectral information from an object. Two important problems in NIRHSI are those of data load and unserviceable pixels in the NIR sensor. Hyperspectral imaging experiments generate large amounts of data (typically > 50 MB per image), which tend to overwhelm the memory capacity of conventional computer systems. This inhibits the utilisation of NIRHSI for routine online industrial application. In general, approximately 1% of pixels in NIR detectors are unserviceable or ‘dead’, containing no useful information. While this percentage of pixels is insignificant for single wavelength imaging, the problem is amplified in NIRHSI, where > 100 wavelength images are typically acquired. This paper describes an approach for reducing the data load of hyperspectral experiments by using sample-specific vector-to-scalar operators for real time feature extraction and a systematic procedure for compensating for ‘dead’ pixels in the NIR sensor. The feasibility of this approach was tested for prediction of moisture content in carrot tissue.

International audience; Morphological attribute profiles are among the most prominent spectral-spatial pixel description methods. They are efficient, effective and highly customizable multi-scale tools based on hierarchical representations of a scalar input image. Their application to multivariate images in general, and hyperspectral images in particular, has been so far conducted using the marginal strategy, i.e. by processing each image band (eventually obtained through a dimension reduction technique) independently. In this paper, we investigate the alternative vector strategy, which consists in processing the available image bands simultaneously. The vector strategy is based on a vector ordering relation that leads to the computation of a single max-and min-tree per hyperspectral dataset, from which attribute profiles can then be computed as usual. We explore known vector ordering relations for constructing such max-trees and subsequently vector attribute profiles, and introduce a combination of marginal and vector strategies. We provide an experimental comparison of these approaches in the context of hyperspectral classification with common datasets, where the proposed approach outperforms the widely used marginal strategy.

In this paper, we present a new lossy compression method for hyperspectral images that aims to optimally compress in both spatial and spectral domains and simultaneously minimizes the effect of the compression on linear spectral unmixing performance. To achieve this, a nonnegative Tucker decomposition is applied. This decomposition is a function of three dimension parameters. By employing a link between this decomposition and the linear spectral mixing model, an optimization problem is defined to find the optimal parameters by minimizing the root-mean-square error between the abundance matrices of the original and reconstructed data sets. The resulting optimization problem is solved by a particle swarm optimization algorithm. An approximate method for fast estimation of the free parameters is introduced as well. Our simulation results show that, in comparison with well-known state-of-the-art lossy compression methods, an improved compression and spectral unmixing performance of the reconstructed hyperspectral image is obtained. It is noteworthy to mention that the superiority of our method becomes more apparent as the compression ratio grows.

Mainly due to the limited spatial resolution of the data acquisition devices, hyperspectral image pixels generally result from the mixture of several components that are present in the observed surface. Spectral mixture analysis (or spectral unmixing) is a key processing step which aims at identifying the spectral signatures of these materials and quantifying their spatial distribution over the image. The main purpose of this chapter is to introduce the spectral unmixing problem and to discuss some linear and nonlinear models and algorithms used to solve it. We will show that, capitalizing on several decades of methodological developments in the geoscience and remote sensing community, most of the unmixing algorithms proposed to unmix remotely sensed images can be directly applied in the chemometrics field to process hyperspectral data arising from various scanning microscopic techniques such as scanning transmission electron microscopy and Raman imaging.

Hyperspectral data compression and dimensionality reduction has received considerable interest in recent years due to the high spectral resolution of these images. Contrarily to the conventional dimensionality reduction schemes, the spectral compressive acquisition method (SpeCA) performs dimensionality reduction based on random projections. The SpeCA methodology has applications in Hyperspectral Compressive Sensing and also in dimensionality reduction. Due to the extremely large volumes of data collected by imaging spectrometers, high performance computing architectures are needed for data compression of high dimensional hyperspectral data under real-time constrained applications. In this paper a parallel implementation of SpeCA on Graphics Processing Units (GPUs) using the compute unified device architecture (CUDA) is proposed. The proposed implementation is performed in a pixel-by-pixel fashion using coalesced accesses to memory and exploiting shared memory to store temporary data. Furthermore, the kemeIs have been optimized to minimize the threads divergence, therefore, achieving high GPU occupancy. The experimental results obtained for simulated and real hyperspectral data sets reveal speedups up to 21 tim es, which demonstrates that the GPU implementation can significantly accelerate the methods execution over big datasets while maintaining the methods accuracy. info:eu-repo/semantics/publishedVersion

Conventional feature extraction methods cannot fully exploit both the spectral and spatial information of hyperspectral imagery. In this paper, we propose an ensemble method of subspace independent component analysis (ICA) and edge-preserving filtering (EPF) for the classification of hyper-spectral data to achieve this task. First, several subsets are randomly selected from the original feature space. Second, ICA is used to extract spectral independent components followed by a recent and effective EPF method, rolling guidance filter (RGF), to produce spatial features. The spatial features are treated as the input of a random forest (RF) classifier. Finally , the classification results from each subset are integrated together to produce the final map. Experimental results on real hyperspectral data demonstrate the effectiveness of the proposed method. A sensitivity analysis of this new classifier is also performed.

The paper revises and clarifies definitions of the term scale and scaling conversions for imaging spectroscopy of soil and vegetation. We demonstrate a new four-dimensional scale concept that includes not only spatial but also the spectral, directional and temporal components. Three scaling remote sensing techniques are reviewed: (1) radiative transfer, (2) spectral (un)mixing, and (3) data fusion. Relevant case studies are given in the context of their up- and/or down-scaling abilities over the soil/vegetation surfaces and a multi-source approach is proposed for their integration. Radiative transfer (RT) models are described to show their capacity for spatial, spectral up-scaling, and directional down-scaling within a heterogeneous environment. Spectral information and spectral derivatives, like vegetation indices (e.g. TCARI/OSAVI), can be scaled and even tested by their means. Radiative transfer of an experimental Norway spruce (Picea abies (L.) Karst.) research plot in the Czech Republic was simulated by the Discrete Anisotropic Radiative Transfer (DART) model to prove relevance of the correct object optical properties scaled up to image data at two different spatial resolutions. Interconnection of the successive modelling levels in vegetation is shown. A future development in measurement and simulation of the leaf directional spectral properties is discussed. We describe linear and/or non-linear spectral mixing techniques and unmixing methods that demonstrate spatial down-scaling. Relevance of proper selection or acquisition of the spectral endmembers using spectral libraries, field measurements, and pure pixels of the hyperspectral image is highlighted. An extensive list of advanced unmixing techniques, a particular example of unmixing a reflective optics system imaging spectrometer (ROSIS) image from Spain, and examples of other mixture applications give insight into the present status of scaling capabilities. Simultaneous spatial and temporal down-scaling by means of a data fusion technique is described. A demonstrative example is given for the moderate resolution imaging spectroradiometer (MODIS) and LANDSAT Thematic Mapper (TM) data from Brazil. Corresponding spectral bands of both sensors were fused via a pyramidal wavelet transform in Fourier space. New spectral and temporal information of the resultant image can be used for thematic classification or qualitative mapping. All three described scaling techniques can be integrated as the relevant methodological steps within a complex multi-source approach. We present this concept of combining numerous optical remote sensing data and methods to generate inputs for ecosystem process models. (c) 2006 Elsevier B.V. All rights reserved.

© 1980-2012 IEEE. The availability of hyperspectral images with improved spectral and spatial resolutions provides the opportunity to obtain accurate land-cover classification. In this paper, a novel methodology that combines spectral and spatial information for supervised hyperspectral image classification is proposed. A feature reduction strategy based on independent component analysis is the main core of the spectral analysis, where the exploitation of prior information coupled to the evaluation of the reconstruction error assures the identification of the best class-informative subset of independent components. Reduced attribute profiles (APs), which are designed to address well-known issues related to information redundancy that affect the common morphological APs, are then employed for the modeling and fusion of the contextual information. Four real hyperspectral data sets, which are characterized by different spectral and spatial resolutions with a variety of scene typologies (urban, agriculture areas), have been used for assessing the accuracy and generalization capabilities of the proposed methodology. The obtained results demonstrate the classification effectiveness of the proposed approach in all different scene typologies, with respect to other state-of-the-art techniques.

An adaptive, hyperspectral imager is presented. We propose a system with easily adaptable spectral resolution, adjustable acquisition time, and high spatial resolution which is independent of spectral resolution. The system yields the possibility to define a variety of acquisition schemes, and in particular near snapshot acquisitions that may be used to measure the spectral content of given or automatically detected regions of interest. The proposed system is modelled and simulated, and tests on a first prototype validate the approach to achieve near snapshot spectral acquisitions without resorting to any computationally heavy post-processing, nor cumbersome calibration.

Hyperspectral imaging has been providing vital information on the Earth landscape in response to the changing environment, land use and natural phenomena. While conventional hyperspectral imaging instruments have typically used rows of linescan CCDs, CMOS image sensors (CIS) have been slowly penetrating space instrumentation for the past decade, and Earth observation (EO) is no exception. CIS provide distinct advantages over CCDs that are relevant to EO hyperspectral imaging. The lack of charge transfer through the array allows the reduction of cross talk usually present in CCDs due to imperfect charge transfer efficiency, and random pixel addressing makes variable integration time possible, and thus improves the camera sensitivity and dynamic range. We have developed a 10T pixel design that integrates a pinned photodiode with global shutter and in-pixel correlated double sampling (CDS) to increase the signal to noise ratio in less intense spectral regimes, allowing for both high resolution and low noise hyperspectral imaging for EO. This paper details the characterization of a test device, providing baseline performance measurements of the array such as noise, responsivity, dark current and global shutter efficiency, and also discussing benchmark hyperspectral imaging requirements such as dynamic range, pixel crosstalk, and image lag.

We consider a compressive hyperspectral imaging reconstruction problem, where three-dimensional spatio-spectral information about a scene is sensed by a coded aperture snapshot spectral imager (CASSI). The approximate message passing (AMP) framework is utilized to reconstruct hyperspectral images from CASSI measurements, and an adaptive Wiener filter is employed as a three-dimensional image denoiser within AMP. We call our algorithm "AMP-3D-Wiener." The simulation results show that AMP-3D-Wiener outperforms existing widely-used algorithms such as gradient projection for sparse reconstruction (GPSR) and two-step iterative shrinkage/thresholding (TwIST) given the same amount of runtime. Moreover, in contrast to GPSR and TwIST, AMP-3D-Wiener need not tune any parameters, which simplifies the reconstruction process., to appear in Globalsip 2015

International audience; Spectral unmixing is one of the most important and studied topics in hyperspectral image analysis. By means of spectral unmixing it is possible to decompose a hyperspectral image in its spectral components, the so-called endmembers, and their respective fractional spatial distributions, so-called abundance maps. New hyperspectral missions will allow to acquire hyperspectral images in new ways, for instance, in temporal series or in multi-angular acquisitions. Working with these incoming huge databases of multi-way hyperspec-tral images will raise new challenges to the hyperspectral community. Here, we propose the use of compression-based non-negative tensor canonical polyadic (CP) decompositions to analyze this kind of datasets. Furthermore, we show that the non-negative CP decomposition could be understood as a multi-linear spectral unmixing technique. We evaluate the proposed approach by means of Mars synthetic datasets built upon multi-angular in-lab hyperspectral acquisitions.

International audience; The problem with visualization of hyper-spectral images on tri-stimulus displays arises from the fact that they contain hundreds of spectral bands while generally used display devices support only three bands/channels namely blue, green and red. Therefore, for visualization a hyper-spectral (HS) image has to be reduced to three bands. The main challenge while performing this band reduction is to retain and display the maximum information available in a hyper-spectral image. Human visual system focuses attention on certain regions in images called " salient regions ". Therefore to provide a comprehensive representation of hyper-spectral data on tri-stimulus displays we propose to use a weighted fusion method of saliency maps and hyper-spectral bands. The efficacy of the proposed algorithm has been demonstrated by tests on both urban and countryside images of AVIRIS and ROSIS sensors. .