Search

Ice storms can cause major power disruptions and detection of ice formation on power cables can avoid them by taking preventive actions such as removing the ice before a major problem occurs. In this paper, a computer vision solution was developed to detect ice on difficult imaging scenarios where illumination and variety of locations can change the image of the cable and background considerably. The methodology starts with edge detection and support vector regression was applied to predict the upper threshold for the Canny edge detector. We found that this improves the later classification accuracy. A total of 44 image features based on the gray level co-occurrence matrix, statistical features and Hough transform were extracted and then processed by principal component analysis and sequential forward selection to reduce the feature dimension. Final detection was performed using four different classifiers. It was found that eight features achieved optimal performance using a support vector machine. [ABSTRACT FROM AUTHOR]

Under long-term synergy effect of multi-factors, especially the thermal stress, insulating paper will be degraded and its insulation performance will decline due to carbonization and degradation of cellulose. This paper presents an optical approach for aging feature extraction of the insulating paper, where one of the image processing methods called texture analysis is utilized. By conducting laboratory accelerated thermal aging tests, insulating paper samples with different aging conditions for both Nomex and Kraft, evaluated with the aging time, are prepared. After taking optical microscopic images of insulating paper samples belong to different aging groups, up to 14 texture features are extracted using the gray-level co-occurrence matrix (GLCM). With different feature selection methods applied, several of them are finally selected to represent the aging condition of insulating. Numerical tests with both supervised and unsupervised algorithms, as well as a linear regression method verifies the validity of these features in characterizing the aging condition of the insulating paper. [ABSTRACT FROM PUBLISHER]

Nonrigid image registration plays an important role in the field of computer vision and medical application. The methods based on Demons algorithm for image registration usually use intensity difference as similarity criteria. However, intensity based methods can not preserve image texture details well and are limited by local minima. In order to solve these problems, we propose a Gabor feature based LogDemons registration method in this article, called GFDemons. We extract Gabor features of the registered images to construct feature similarity metric since Gabor filters are suitable to extract image texture information. Furthermore, because of the weak gradients in some image regions, the update fields are too small to transform the moving image to the fixed image correctly. In order to compensate this deficiency, we propose an inertial constraint strategy based on GFDemons, named IGFDemons, using the previous update fields to provide guided information for the current update field. The inertial constraint strategy can further improve the performance of the proposed method in terms of accuracy and convergence. We conduct experiments on three different types of images and the results demonstrate that the proposed methods achieve better performance than some popular methods. [ABSTRACT FROM AUTHOR]

In this paper, we aim to handle the intraclass variation resulting from the geometric transformation and the illumination change for more robust texture classification. To this end, we propose a novel feature descriptor called Radon representation-based feature descriptor (RRFD). RRFD converts the original pixel represented images into Radon-pixel images by using the Radon transform. The new Radon-pixel representation is more informative in geometry and has a much lower dimension. Subsequently, RRFD efficiently achieves affine invariance by projecting an image (or an image patch) from the space of Radon-pixel pairs onto an invariant feature space by using a ratiogram, i.e., the histogram of ratios between the areas of triangle pairs. The illumination invariance is also achieved by defining an illumination invariant distance metric on the invariant feature space. Comparing to the existing Radon transform-based texture features, which only achieve rotation and/or scaling invariance, RRFD achieves affine invariance. The experimental results on CUReT show that RRFD is a powerful feature descriptor that is suitable for texture classification. [ABSTRACT FROM AUTHOR]

Sea ice has a significant effect on climate change and ship navigation. Hence, it is crucial to draw sea-ice maps that reflect the geographical distribution of different types of sea ice. Many automatic sea-ice classification methods using synthetic aperture radar (SAR) images are based on the polarimetric characteristics or image texture features of sea ice. They either require professional knowledge to design the parameters and features or are sensitive to noise and condition changes. Moreover, ice changes over time are often ignored. In this article, we propose a new SAR sea-ice image classification method based on a combined learning of spatial and temporal features, derived from residual convolutional neural networks (ResNet) and long short-term memory (LSTM) networks. In this way, we achieve automatic and refined classification of sea-ice types. First, we construct a seven-type ice data set according to the Canadian Ice Service ice charts. We extract spatial feature vectors of a time series of sea-ice samples using a trained ResNet network. Then, using the feature vectors as inputs, the LSTM network further learns the variation of the set of sea-ice samples with time. Finally, the extracted high-level features are fed into a softmax classifier to output the most recent ice type. Taking both spatial features and time variation into consideration, our method can achieve a high classification accuracy of 95.7% for seven ice types. Our method can automatically produce more objective sea-ice interpretation maps, allowing detailed sea-ice distribution and improving the efficiency of sea-ice monitoring tasks. [ABSTRACT FROM AUTHOR]

Topological data analysis (TDA) has emerged as one of the most promising techniques to reconstruct the unknown shapes of high-dimensional spaces from observed data samples. TDA, thus, yields key shape descriptors in the form of persistent topological features that can be used for any supervised or unsupervised learning task, including multi-way classification. Sparse sampling, on the other hand, provides a highly efficient technique to reconstruct signals in the spatial-temporal domain from just a few carefully-chosen samples. Here, we present a new method, referred to as the Sparse-TDA algorithm, that combines favorable aspects of the two techniques. This combination is realized by selecting an optimal set of sparse pixel samples from the persistent features generated by a vector-based TDA algorithm. These sparse samples are selected from a low-rank matrix representation of persistent features using QR pivoting. We show that the Sparse-TDA method demonstrates promising performance on three benchmark problems related to human posture recognition and image texture classification. [ABSTRACT FROM AUTHOR]

In this paper, we propose an effective blind quality assessment method for screen content images (SCIs), called perceptual quality measure by spatial continuity (PQSC). With the center-surround mechanism in the human visual system (HVS), the proposed method extracts the statistical features on chromatic and textural variations in SCIs to measure the visual distortion. First, by considering the chromatic continuity between spatially adjacent pixels, photo-metric invariant chromatic descriptors are extracted as zero-order and first-order features. Second, motivated by the perceptual mechanism that the HVS is sensitive to image texture variation, we employ local ternary pattern operator to effectively depict the spatial continuity of texture. With these extracted chromatic and textural features, we further adopt histogram to compute the statistical chromatic and textural features. Support vector regression (SVR) is used to train the quality prediction model from visual features to human ratings. Experimental results on three public benchmark databases demonstrate that the performance of our method is superior to the current blind image quality assessment methods, even better than some full reference image quality assessment counterparts. [ABSTRACT FROM AUTHOR]

In this paper, we propose a novel no reference quality assessment method by incorporating statistical luminance and texture features (NRLT) for screen content images (SCIs) with both local and global feature representation. The proposed method is designed inspired by the perceptual property of the human visual system (HVS) that the HVS is sensitive to luminance change and texture information for image perception. In the proposed method, we first calculate the luminance map through the local normalization, which is further used to extract the statistical luminance features in global scope. Second, inspired by existing studies from neuroscience that high-order derivatives can capture image texture, we adopt four filters with different directions to compute gradient maps from the luminance map. These gradient maps are then used to extract the second-order derivatives by local binary pattern. We further extract the texture feature by the histogram of high-order derivatives in global scope. Finally, support vector regression is applied to train the mapping function from quality-aware features to subjective ratings. Experimental results on the public large-scale SCI database show that the proposed NRLT can achieve better performance in predicting the visual quality of SCIs than relevant existing methods, even including some full reference visual quality assessment methods. [ABSTRACT FROM PUBLISHER]

Remote sensing images exhibit significant contrast and intensity regions and edges, which makes them highly suitable for using different texture features to properly represent and classify the objects that they contain. In this paper, we present a new technique based on multiple morphological component analysis (MMCA) that exploits multiple textural features for decomposition of remote sensing images. The proposed MMCA framework separates a given image into multiple pairs of morphological components (MCs) based on different textural features, with the ultimate goal of improving the signal-to-noise level and the data separability. A distinguishing feature of our proposed approach is the possibility to retrieve detailed image texture information, rather than using a single spatial characteristic of the texture. In this paper, four textural features: content, coarseness, contrast, and directionality (including horizontal and vertical), are considered for generating the MCs. In order to evaluate the obtained MCs, we conduct classification by using both remotely sensed hyperspectral and polarimetric synthetic aperture radar (SAR) scenes, showing the capacity of the proposed method to deal with different kinds of remotely sensed images. The obtained results indicate that the proposed MMCA framework can lead to very good classification performances in different analysis scenarios with limited training samples. [ABSTRACT FROM PUBLISHER]

This paper proposes a new texture enhancement method which uses an image decomposition that allows different visual characteristics of textures to be represented by separate components in contrast with previous methods which either enhance texture indirectly or represent all texture information using a single image component. Our method is intended to be used as a preprocessing step prior to the use of texture-based image segmentation algorithms. Our method uses a modification of morphological component analysis (MCA) which allows texture to be separated into multiple morphological components each representing a different visual characteristic of texture. We select four such texture characteristics and propose new dictionaries to extract these components using MCA. We then propose procedures for modifying each texture component and recombining them to produce a texture-enhanced image. We applied our method as a preprocessing step prior to a number of texture-based segmentation methods and compared the accuracy of the results, finding that our method produced results superior to comparator methods for all segmentation algorithms tested. We also demonstrate by example the main mechanism by which our method produces superior results, namely that it causes the clusters of local texture features of each distinct image texture to mutually diverge within the multidimensional feature space to a vastly superior degree versus the comparator enhancement methods. [ABSTRACT FROM AUTHOR]

A major yet largely unsolved problem in the semantic classification of very high resolution remote sensing images is the design and selection of appropriate features. At a ground sampling distance below half a meter, fine-grained texture details of objects emerge and lead to a large intraclass variability while generally keeping the between-class variability at a low level. Usually, the user makes an educated guess on what features seem to appropriately capture characteristic object class patterns. Here, we propose to avoid manual feature selection and let a boosting classifier choose optimal features from a vast Randomized Quasi-Exhaustive (RQE) set of feature candidates directly during training. This RQE feature set consists of a multitude of very simple features that are computed efficiently via integral images inside a sliding window. This simple but comprehensive feature candidate set enables the boosting classifier to assemble the most discriminative textures at different scale levels to classify a small number of broad urban land-cover classes. We do an extensive evaluation on several data sets and compare performance against multiple feature extraction baselines in different color spaces. In addition, we verify experimentally if we gain any classification accuracy if moving from boosting stumps to trees. Cross-validation minimizes the possible bias caused by specific training/testing setups. It turns out that boosting in combination with the proposed RQE feature set outperforms all baseline features while still remaining computationally efficient. Particularly boosting trees (instead of stumps) captures class patterns so well that results suggest to completely leave feature selection to the classifier. [ABSTRACT FROM PUBLISHER]

It is very important to extract high quality texture features from images. This is, however, often laborious, because the randomness in the color distribution patterns for texture elements makes texture measurement very difficult, despite these elements having a very similar visual appearance. In this paper, we propose the use of multi-scale color histograms to measure the effect of color distribution patterns efficiently and without having to compute the actual patterns, which saves considerable effort. Meanwhile, the hue-saturation-intensity color model is mainly adopted to take the advantage of human visual experiences in texture recognition. We discuss and validate the effectiveness and efficiency of our method by applying to various benchmarks. The results show that we can extract quality dominant textures automatically in real time, and faster by several orders of magnitude than existing methods. [ABSTRACT FROM AUTHOR]

Image feature extraction and similarity measure in feature space are active research topics. They are basic components in a content-based image retrieval (CBIR) system. In this letter, we present a new statistical model-based image feature extraction method in the wavelet domain and a novel Kullback divergence-based similarity measure. First, a Gaussian mixture model (GMM) and a more systematic generalized Gaussian mixture model (GGMM) are employed to describe the statistical characteristics of the wavelet coefficients and the model parameters are employed to construct a compact image feature space. A nontrivial expectation-maximization (EM) algorithm for the GGMM model is derived. Subsequently, a new Kullback divergence-based similarity measure with lowcomputation cost is derived and analyzed. The Brodatz texture image database and some other image databases are used to evaluate the retrieval performance based on the presented new methods. Experimental results indicate that the GMM and the GGMM-based image texture features are very effective in representing multiscale image characteristics and that the new methods outperforms other conventional wavelet-based methods in retrieval performance with a comparable level of computational complexity. It is also demonstrated that for image features extracted by the new statistical models, the similarity measure based on Kullback divergence is more effective than conventional similarity measures. [ABSTRACT FROM AUTHOR]

This paper deals with spatial analysis of texture in synthetic aperture radar (SAR) images. A new parametric model for local two-point statistics of the image is introduced, in order to characterize the spatially nonstationary and anisotropic behavior of the image. The texture is first modeled by a nonstationary Gaussian process resulting from the convolution of a Gaussian white noise with a field of anisotropic Gaussian kernel with spatially varying parameters. Hence, under the hypothesis of locally stationary signal, the analytic expression of the local autocovariance is derived. It is then explained how to simulate nonstationary K-distributed random fields by combining the new model with an already existing simulation method. A method for parameter estimation is then introduced. This method, based on the statistical product model, first corrects the speckle contribution to the local autocovariance and estimates the parameters of the model by analyzing the shape of the autocovariance. The algorithm is then evaluated over simulated and experimental data. Stationary simulations permit to show that, for a sufficient sample size, the estimator is unbiased. A test over a nonstationary simulation proves the ability of the algorithm to capture the spatial fluctuations of the texture. Finally, the method is applied to the experimental SAR data, and it is shown that a large amount of spatial information may be retrieved from the data. [ABSTRACT FROM AUTHOR]

The goal of exemplar-based texture synthesis is to generate texture images that are visually similar to a given exemplar. Recently, promising results have been reported by methods relying on convolutional neural networks (ConvNets) pretrained on large-scale image datasets. However, these methods have difficulties in synthesizing image textures with non-local structures and extending to dynamic or sound textures. In this article, we present a conditional generative ConvNet (cgCNN) model which combines deep statistics and the probabilistic framework of generative ConvNet (gCNN) model. Given a texture exemplar, cgCNN defines a conditional distribution using deep statistics of a ConvNet, and synthesizes new textures by sampling from the conditional distribution. In contrast to previous deep texture models, the proposed cgCNN does not rely on pre-trained ConvNets but learns the weights of ConvNets for each input exemplar instead. As a result, cgCNN can synthesize high quality dynamic, sound and image textures in a unified manner. We also explore the theoretical connections between our model and other texture models. Further investigations show that the cgCNN model can be easily generalized to texture expansion and inpainting. Extensive experiments demonstrate that our model can achieve better or at least comparable results than the state-of-the-art methods. [ABSTRACT FROM AUTHOR]

Many representation methods were built for gray image textures. However, they are not effective for color textures in general. To alleviate this problem, in this paper we propose a novel Compact Interchannel Sampling Difference Descriptor (CISDD) for color texture classification. In particular, considering sampling-based method can capture more directional information, we first use a heavy-tailed distribution, t-distribution to generate sample points in the image patch to calculate the micro-block difference. Then we model the interchannel relationship of color texture image by using dense micro-block differences. Furthermore, we utilize principal component analysis (PCA) to reduce the dimensions of the features encoded by the Fisher vector, and construct a Compact Interchannel Sampling Difference Descriptor (CISDD) for representing color texture image. Finally, experimental results on five published standard texture datasets (KTH-TIPS, VisTex, CUReT, USPTex and Colored Brodatz) reveal that CISDD is effective and outperforms thirteen representative color texture classification methods. [ABSTRACT FROM AUTHOR]

Texture is an important characteristic for different computer vision tasks and applications. Local binary pattern (LBP) is considered one of the most efficient texture descriptors yet. However, LBP has some notable limitations, in particular its sensitivity to noise. In this paper, we address these criteria by introducing a novel texture descriptor, robust adaptive median binary pattern (RAMBP). RAMBP is based on a process involving classification of noisy pixels, adaptive analysis window, scale analysis, and a comparison of image medians. The proposed method handles images with highly noisy textures and increases the discriminative properties by capturing microstructure and macrostructure texture information. The method was evaluated on popular texture datasets for classification and retrieval tasks and under different high noise conditions. Without any training or prior knowledge of the noise type, RAMBP achieved the best classification compared to state-of-the-art techniques. It scored more than 90% under 50% impulse noise densities, more than 95% under Gaussian noised textures with a standard deviation $\sigma = 5$ , more than 99% under Gaussian blurred textures with a standard deviation $\sigma = 1.25$ , and more than 90% for mixed noise. The proposed method yielded competitive results and proved to be one of the best descriptors in noise-free texture classification. Furthermore, RAMBP showed high performance for the problem of noisy texture retrieval providing high scores of recall and precision measures for textures with high noise levels. Finally, compared with the state-of-the-art methods, RAMBP achieves a good running time with low feature dimensionality. [ABSTRACT FROM AUTHOR]

Manual inspection is commonly used to maintain the quality of light-emitting diode thin-film ceramic substrates. However, manual inspection has certain inherent and inevitable shortcomings. This paper describes an auto-inspection system for detecting defects on this type of integrated substrate surface using machine vision. A sequence of sub-images of an integrated substrate is grabbed and reconstructed into a high-resolution image. The unwrapped image is then shrunk to focus on the region of interest, which contains repeating and arranged substrates. A novel image restoration scheme based on randomized principal component analysis (RPCA) is proposed. That method is associated with the homogeneity cues difference histogram (HCDH) to construct a substrate defect map. RPCA is used to detect defective pixels while HCDH is used to estimate pattern size. The proposed method is compared with golden-template self-generating method, discrete Fourier transformation, non-negative matrix factorization and singular value decomposition for image restoration. The criteria for evaluating the different methods are the g-mean, figure of merit and average computation time. It finds that our method is more efficient and effective than others. [ABSTRACT FROM PUBLISHER]

The objects in natural images are often texturally inhomogeneous and prone to be falsely segmented into different parts by conventional methods. To overcome the difficulties caused by texture inhomogeneity, a new active contour model is proposed to extract inhomogeneous insulators from aerial images. First, a semilocal operator is employed to extract the texture features of insulators under the Beltrami framework. The layer of semilocal texture feature is single, and thus, it can avoid the high dimensionality of feature space. Then, a new convex energy functional is defined by taking the Xie's nonconvex model into a global minimization active contour framework during the process of segmentation. The proposed energy functional consists of not only the semilocal texture features of insulators but also their spatial relationship, which improves its ability to deal with textural inhomogeneity. Moreover, it can also avoid the existence of local minima in the minimization of the Xie's nonconvex model, thereby being independent of initial contour. In the process of contour evolution and numerical minimization, a fast dual formulation is employed to overcome the drawbacks of the usual level set and gradient descent method and to make the evolution of the contour more efficient. The experimental results on aerial insulator images confirm the ability of the proposed algorithm to effectively segment inhomogeneous textures with an overall average rmse of 1.87 pixels, a precision of 85.59%, and a recall of 86.47%. In addition, the proposed algorithm is extended to animal images, and satisfactory segmentation results can be obtained as well. [ABSTRACT FROM PUBLISHER]

In this paper, we present the results of applying global morphological texture descriptors to the problem of content-based remote sensing image retrieval. Specifically, we explore the potential of recently developed multiscale texture descriptors, namely, the circular covariance histogram and the rotation-invariant point triplets. Moreover, we introduce a couple of new descriptors, exploiting the Fourier power spectrum of the quasi-flat-zone-based scale space of their input. The descriptors are evaluated with the UC Merced Land Use-Land Cover data set, which has been only recently made public. The proposed approach is shown to outperform the best known retrieval scores, despite its shorter feature vector length, thus asserting the practical interest of global content descriptors as well as of mathematical morphology in this context. [ABSTRACT FROM AUTHOR]

Polarimetric synthetic aperture radar (PolSAR) data are used extensively for terrain classification applying SAR features from various target decompositions and certain textural features. However, one source of information has so far been neglected from PolSAR classification: Color. It is a common practice to visualize PolSAR data by color coding methods and thus, it is possible to extract powerful color features from such pseudocolor images so as to provide additional data for a superior terrain classification. In this paper, we first review previous attempts for PolSAR classifications using various feature combinations and then we introduce and perform in-depth investigation of the application of color features over the Pauli color-coded images besides SAR and texture features. We run an extensive set of comparative evaluations using 24 different feature set combinations over three images of the Flevoland- and the San Francisco Bay region from the RADARSAT-2 and the AIRSAR systems operating in C- and L-bands, respectively. We then consider support vector machines and random forests classifier topologies to test and evaluate the role of color features over the classification performance. The classification results show that the additional color features introduce a new level of discrimination and provide noteworthy improvement in classification performance (compared with the traditionally employed PolSAR and texture features) within the application of land use and land cover classification. [ABSTRACT FROM PUBLISHER]

In this paper, an efficient algorithm for texture recognition of synthetic aperture radar (SAR) images is developed based on wavelet transform as a feature extraction tool and support vector machine (SVM) as a classifier. SAR image segmentation is an important step in texture recognition of SAR images. SAR images cannot be segmented successfully by using traditional methods because of the existence of speckle noise in SAR images. The algorithm, proposed in this paper, extracts the texture feature by using wavelet transform; then, it forms a feature vector composed of kurtosis value of wavelet energy feature of SAR image. In the next step, segmentation of different textures is applied by using feature vector and level set function. At last, an SVM classifier is designed and trained by using normalized feature vectors of each region texture. The testing sets of SAR images are segmented by this trained SVM. Experimental results on both agricultural and urban SAR images show that the proposed algorithm is effective for classification of different textures in SAR images, and it is also insensitive to the intensity. [ABSTRACT FROM AUTHOR]

In this paper, we investigated the behavior of 22 co-occurrence statistics combined to six gray-scale quantization levels to classify breast lesions on ultrasound (BUS) images. The database of 436 BUS images used in this investigation was formed by 217 carcinoma and 219 benign lesions images. The region delimited by a minimum bounding rectangle around the lesion was employed to calculate the gray-level co-occurrence matrix (GLCM). Next, 22 co-occurrence statistics were computed regarding six quantization levels (8, 16, 32, 64, 128, and 256), four orientations (0° , 45° , 90° , and 135° ), and ten distances (1, 2,...,10 pixels). Also, to reduce feature space dimensionality, texture descriptors of the same distance were averaged over all orientations, which is a common practice in the literature. Thereafter, the feature space was ranked using mutual information technique with minimal-redundancy-maximal-relevance (mRMR) criterion. Fisher linear discriminant analysis (FLDA) was applied to assess the discrimination power of texture features, by adding the first m-ranked features to the classification procedure iteratively until all of them were considered. The area under ROC curve (AUC) was used as figure of merit to measure the performance of the classifier. It was observed that averaging texture descriptors of a same distance impacts negatively the classification performance, since the best AUC of 0.81 was achieved with 32 gray levels and 109 features. On the other hand, regarding the single texture features (i.e., without averaging procedure), the quantization level does not impact the discrimination power, since AUC=0.87 was obtained for the six quantization levels. Moreover, the number of features was reduced (between 17 and 24 features). The texture descriptors that contributed notably to distinguish breast lesions were contrast and correlation computed from GLCMs with orientation of 90° and distance more than five pixels. [ABSTRACT FROM AUTHOR]

In this paper, we address seabed characterization and recognition in sonar images using keypoint-based approaches. Keypoint-based texture recognition has recently emerged as a powerful framework to address invariances to contrast change and geometric distortions. We investigate here to which extent keypoint-based techniques are relevant for sonar texture analysis which also involves such invariance issues. We deal with both the characterization of the visual signatures of the keypoints and the spatial patterns they form. In this respect, spatial statistics are considered. We report a quantitative evaluation for sonar seabed texture data sets comprising six texture classes such as mud, rock, and gravely sand. We clearly demonstrate the improvement brought by keypoint-based techniques compared to classical features used for sonar texture analysis such as cooccurrence and Gabor features. In this respect, we demonstrate that the joint characterization of the visual signatures of the visual keypoints and their spatial organization reaches the best recognition performances (about 97% of correct classification w.r.t. 70% and 81% using cooccurrence and Gabor features). Furthermore, the combination of difference of Gaussian keypoints and scale-invariant feature transform descriptors is recommended as the most discriminating keypoint-based framework for the analysis of sonar seabed textures. [ABSTRACT FROM AUTHOR]

In this paper, we introduce a method to detect co-saliency from an image pair that may have some objects in common. The co-saliency is modeled as a linear combination of the single-image saliency map (SISM) and the multi-image saliency map (MISM). The first term is designed to describe the local attention, which is computed by using three saliency detection techniques available in literature. To compute the MISM, a co-multilayer graph is constructed by dividing the image pair into a spatial pyramid representation. Each node in the graph is described by two types of visual descriptors, which are extracted from a representation of some aspects of local appearance, e.g., color and texture properties. In order to evaluate the similarity between two nodes, we employ a normalized single-pair SimRank algorithm to compute the similarity score. Experimental evaluation on a number of image pairs demonstrates the good performance of the proposed method on the co-saliency detection task. [ABSTRACT FROM AUTHOR]

This paper introduces a new form of representation for three-dimensional (3-D) video objects. We have developed a technique to extract disparity and texture data from video objects that are captured simultaneously with multiple-camera configurations. For this purpose, we derive an “area of interest” (AOI) for each of the camera views, which represents an area on the video object's surface that is best visible from this specific camera viewpoint. By combining all AOIs, we obtain the video object plane as an unwrapped surface of a 3-D object, containing all texture data visible from any of the cameras. This texture surface can be encoded like any 2-D video object plane, while the 3-D information is contained in the associated disparity map. It is then possible to reconstruct different viewpoints from the texture surface by simple disparity-based projection. The merits of the technique are efficient multiview encoding of single video objects and support for viewpoint adaptation functionality, which is desirable in mixing natural and synthetic images. We have performed experiments with the MPEG-4 video verification model, where the disparity map is encoded by use of the tools provided for grayscale alpha data encoding. Due to its simplicity, the technique is suitable for applications that require real-time viewpoint adaptation toward video objects [ABSTRACT FROM PUBLISHER]