Search

BACKGROUND: Non-intrusive inspection systems based on X-ray radiography techniques are routinely used at transport hubs to ensure the conformity of cargo content with the supplied shipping manifest. As trade volumes increase and regulations become more stringent, manual inspection by trained operators is less and less viable due to low throughput. Machine vision techniques can assist operators in their task by automating parts of the inspection workflow. Since cars are routinely involved in trafficking, export fraud, and tax evasion schemes, they represent an attractive target for automated detection and flagging for subsequent inspection by operators. OBJECTIVE: Development and evaluation of a novel method for the automated detection of cars in complex X-ray cargo imagery. METHODS: X-ray cargo images from a stream-of-commerce dataset were classified using a window-based scheme. The limited number of car images was addressed by using an oversampling scheme. Different Convolutional Neural Network (CNN) architectures were compared with well-established bag of words approaches. In addition, robustness to concealment was evaluated by projection of objects into car images. RESULTS: CNN approaches outperformed all other methods evaluated, achieving 100% car image classification rate for a false positive rate of 1-in-454. Cars that were partially or completely obscured by other goods, a modus operandi frequently adopted by criminals, were correctly detected. CONCLUSIONS: We believe that this level of performance suggests that the method is suitable for deployment in the field. It is expected that the generic object detection workflow described can be extended to other object classes given the availability of suitable training data. [ABSTRACT FROM AUTHOR]

Growing microtubules are protected from depolymerization by the presence of a GTP or GDP/Pi cap. End-binding proteins of the EB1 family bind to the stabilizing cap, allowing monitoring of its size in real time. The cap size has been shown to correlate with instantaneous microtubule stability. Here we have quantitatively characterized the properties of cap size fluctuations during steady-state growth and have developed a theory predicting their timescale and amplitude from the kinetics of microtubule growth and cap maturation. In contrast to growth speed fluctuations, cap size fluctuations show a characteristic timescale, which is defined by the lifetime of the cap sites. Growth fluctuations affect the amplitude of cap size fluctuations; however, cap size does not affect growth speed, indicating that microtubules are far from instability during most of their time of growth. Our theory provides the basis for a quantitative understanding of microtubule stability fluctuations during steady-state growth. [ABSTRACT FROM AUTHOR]

We review the relatively immature field of automated image analysis for X-ray cargo imagery. There is increasing demand for automated analysis methods that can assist in the inspection and selection of containers, due to the ever-growing volumes of traded cargo and the increasing concerns that customs- and security-related threats are being smuggled across borders by organised crime and terrorist networks. We split the field into the classical pipeline of image preprocessing and image understanding. Preprocessing includes: image manipulation; quality improvement; Threat Image Projection (TIP); and material discrimination and segmentation. Image understanding includes: Automated Threat Detection (ATD); and Automated Contents Verification (ACV). We identify several gaps in the literature that need to be addressed and propose ideas for future research. Where the current literature is sparse we borrow from the single-view, multi-view, and CT X-ray baggage domains, which have some characteristics in common with X-ray cargo. [ABSTRACT FROM AUTHOR]

BACKGROUND: Large-scale transmission radiography scanners are used to image vehicles and cargo containers. Acquired images are inspected for threats by a human operator or a computer algorithm. To make accurate detections, it is important that image values are precise. However, due to the scale (∼ 5 m tall) of such systems, they can be mechanically unstable, causing the imaging array to wobble during a scan. This leads to an effective loss of precision in the captured image. OBJECTIVE: We consider the measurement of wobble and amelioration of the consequent loss of image precision. METHODS: Following our previous work, we use Beam Position Detectors (BPDs) to measure the cross-sectional profile of the X-ray beam, allowing for estimation, and thus correction, of wobble. We propose: (i) a model of image formation with a wobbling detector array; (ii) a method of wobble correction derived from this model; (iii) methods for calibrating sensor sensitivities and relative offsets; (iv) a Random Regression Forest based method for instantaneous estimation of detector wobble; and (v) using these estimates to apply corrections to captured images of difficult scenes. RESULTS: We show that these methods are able to correct for 87% of image error due wobble, and when applied to difficult images, a significant visible improvement in the intensity-windowed image quality is observed. CONCLUSIONS: The method improves the precision of wobble affected images, which should help improve detection of threats and the identification of different materials in the image. [ABSTRACT FROM AUTHOR]

A new neuroanatomic approach to evaluate the fiber orientation in gross histological sections of the human brain was developed. Serial sections of a human brainstem were used to derive fiber orientation maps by analysis of polarized light sequences of these sections. Fiber inclination maps visualize angles of inclination, and fiber direction maps show angles of direction. These angles define vectors which can be visualized as RGB-colors. The serial sections were aligned to each other using the minimized Euclidian distance as fit criterion. In the 3D data set of the human brainstem the major fiber tracts were segmented, and three-dimensional models of these fiber tracts were generated. The presented results demonstrate that two kinds of fiber atlases are feasible: a fiber orientation atlas representing a vector in each voxel, which shows the nerve fiber orientation, and a volume-based atlas representing the major fiber tracts. These models can be used for the evaluation of diffusion tensor data as well as for neurosurgical planning. [Copyright &y& Elsevier]

Speech deepfakes are artificial voices generated by machine learning models. Previous literature has highlighted deepfakes as one of the biggest security threats arising from progress in artificial intelligence due to their potential for misuse. However, studies investigating human detection capabilities are limited. We presented genuine and deepfake audio to n = 529 individuals and asked them to identify the deepfakes. We ran our experiments in English and Mandarin to understand if language affects detection performance and decision-making rationale. We found that detection capability is unreliable. Listeners only correctly spotted the deepfakes 73% of the time, and there was no difference in detectability between the two languages. Increasing listener awareness by providing examples of speech deepfakes only improves results slightly. As speech synthesis algorithms improve and become more realistic, we can expect the detection task to become harder. The difficulty of detecting speech deepfakes confirms their potential for misuse and signals that defenses against this threat are needed., Competing Interests: The authors have declared that no competing interests exist., (Copyright: © 2023 Mai et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.)

Defective DNA mismatch repair is one pathogenic pathway to colorectal cancer. It is characterised by microsatellite instability which provides a molecular biomarker for its detection. Clinical guidelines for universal testing of this biomarker are not met due to resource limitations; thus, there is interest in developing novel methods for its detection. Raman spectroscopy (RS) is an analytical tool able to interrogate the molecular vibrations of a sample to provide a unique biochemical fingerprint. The resulting datasets are complex and high-dimensional, making them an ideal candidate for deep learning, though this may be limited by small sample sizes. This study investigates the potential of using RS to distinguish between normal, microsatellite stable (MSS) and microsatellite unstable (MSI-H) adenocarcinoma in human colorectal samples and whether deep learning provides any benefit to this end over traditional machine learning models. A 1D convolutional neural network (CNN) was developed to discriminate between healthy, MSI-H and MSS in human tissue and compared to a principal component analysis-linear discriminant analysis (PCA-LDA) and a support vector machine (SVM) model. A nested cross-validation strategy was used to train 30 samples, 10 from each group, with a total of 1490 Raman spectra. The CNN achieved a sensitivity and specificity of 83% and 45% compared to PCA-LDA, which achieved a sensitivity and specificity of 82% and 51%, respectively. These are competitive with existing guidelines, despite the low sample size, speaking to the molecular discriminative power of RS combined with deep learning. A number of biochemical antecedents responsible for this discrimination are also explored, with Raman peaks associated with nucleic acids and collagen being implicated.

Inferring the connectivity of biological neural networks from neural activation data is an open problem. We propose that the analogous problem in artificial neural networks is more amenable to study and may illuminate the biological case. Here, we study the specific problem of assigning artificial neurons to locations in a network of known architecture, specifically the LeNet image classifier. We evaluate a supervised learning approach based on features derived from the eigenvectors of the activation correlation matrix. Experiments highlighted that for an image dataset to be effective for accurate localisation, it should fully activate the network and contain minimal confounding correlations. No single image dataset was found that resulted in perfect assignment, however perfect assignment was achieved using a concatenation of features from multiple image datasets., Competing Interests: Declaration of Competing Interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (Copyright © 2022 The Author(s). Published by Elsevier Ltd.. All rights reserved.)

Raman Spectroscopy has long been anticipated to augment clinical decision making, such as classifying oncological samples. Unfortunately, the complexity of Raman data has thus far inhibited their routine use in clinical settings. Traditional machine learning models have been used to help exploit this information, but recent advances in deep learning have the potential to improve the field. However, there are a number of potential pitfalls with both traditional and deep learning models. We conduct a literature review to ascertain the recent machine learning methods used to classify cancers using Raman spectral data. We find that while deep learning models are popular, and ostensibly outperform traditional learning models, there are many methodological considerations which may be leading to an over-estimation of performance; primarily, small sample sizes which compound sub-optimal choices regarding sampling and validation strategies. Amongst several recommendations is a call to collate large benchmark Raman datasets, similar to those that have helped transform digital pathology, which researchers can use to develop and refine deep learning models.

A range of explanations have been advanced for the systems of colour names found in different languages. Some explanations give special, fundamental status to a subset of colour categories. We argue that a subset of colour categories, if fundamental, will be coherent - meaning that a non-trivial criterion distinguishes them from the other colour categories. We test the coherence of subsets of achromatic (white, black and grey), primary (white, black, red, green, yellow, blue) and basic (primaries plus brown, orange, purple, pink and grey) colour categories in English. Criteria for defining colour categories were expressed in terms of behavioural, linguistic and geometric features derived from colour naming and linguistic usage data; and were discovered using machine learning methods. We find that achromatic and basic colour categories are coherent subsets but not primaries. These results support claims that the basic colour categories have special status, and undermine claims about the fundamental role of primaries in colour naming systems., Competing Interests: Declaration of Competing Interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (Copyright © 2020 Elsevier Ltd. All rights reserved.)

The spectral reflectance function of a surface specifies the fraction of the illumination reflected by it at each wavelength. Jointly with the illumination spectral density, this function determines the apparent colour of the surface. Models for the distribution of spectral reflectance functions in the natural environment are considered. The realism of the models is assessed in terms of the individual reflectance functions they generate, and in terms of the overall distribution of colours which they give rise to. Both realism assessments are made in comparison to empirical datasets. Previously described models (PCA- and fourier-based) of reflectance function statistics are evaluated, as are improved versions; and also a novel model, which synthesizes reflectance functions as a sum of sigmoid functions. Key model features for realism are identified. The new sigmoid-sum model is shown to be the most realistic, generating reflectance functions that are hard to distinguish from real ones, and accounting for the majority of colours found in natural images with the exception of an abundance of vegetation green and sky blue., Competing Interests: The authors have declared that no competing interests exist.

Ordinary language users group colours into categories that they refer to by a name e.g. pale green. Data on the colour categories of English speakers was collected using online crowd sourcing - 1,000 subjects produced 20,000 unconstrained names for 600 colour stimuli. From this data, using the framework of Information Geometry, a Riemannian metric was computed throughout the RGB cube. This is the first colour metric to have been computed from colour categorization data. In this categorical metric the distance between two close colours is determined by the difference in the distribution of names that the subject population applied to them. This contrasts with previous colour metrics which have been driven by stimulus discriminability, or acceptability of a colour match. The categorical metric is analysed and shown to be clearly different from discriminability-based metrics. Natural units of categorical length, area and volume are derived. These allow a count to be made of the number of categorically-distinct regions of categorically-similar colours that fit within colour space. Our analysis estimates that 27 such regions fit within the RGB cube, which agrees well with a previous estimate of 30 colours that can be identified by name by untrained subjects., Competing Interests: The authors have declared that no competing interests exist.

Image segmentation is a fundamental precursor to quantitative image analysis. At present, no standardised methodology exists for segmenting images of fluorescent proxies for trace evidence. Experiments evaluated (i) whether manual segmentation is reproducible within and between examiners (with three participants repeatedly tracing three images) (ii) whether manually defining a threshold level offers accurate and reproducible results (with 20 examiners segmenting 10 images), and (iii) whether a global thresholding algorithm might perform with similar accuracy, while offering improved reproducibility and efficiency (16 algorithms tested). Statistically significant differences were seen between examiners' traced outputs. Manually thresholding produced good accuracy on average (within ±1% of the expected values), but poor reproducibility (with multiple outliers). Three algorithms (Yen, MaxEntropy, and RenyiEntropy) offered similar accuracy, with improved reproducibility and efficiency. Together, these findings suggest that appropriate algorithms could perform thresholding tasks as part of a robust workflow for reconstruction studies employing fluorescent proxies for trace evidence., (© 2018 The Authors Journal of Forensic Sciences published by Wiley Periodicals, Inc. on behalf of American Academy of Forensic Sciences.)

Background: X-ray imaging is a crucial and ubiquitous tool for detecting threats to transport security, but interpretation of the images presents a logistical bottleneck. Recent advances in Deep Learning image classification offer hope of improving throughput through automation. However, Deep Learning methods require large quantities of labelled training data. While photographic data is cheap and plentiful, comparable training sets are seldom available for the X-ray domain., Objective: To determine whether and to what extent it is feasible to exploit the availability of photo data to supplement the training of X-ray threat detectors., Methods: A new dataset was collected, consisting of 1901 matched pairs of photo & X-ray images of 501 common objects. Of these, 258 pairs were of 69 objects considered threats in the context of aviation. This data was used to test a variety of transfer learning approaches. A simple model of threat cue availability was developed to understand the limits of this transferability., Results: Appearance features learned from photos provide a useful basis for training classifiers. Some transfer from the photo to the X-ray domain is possible as ∼40% of danger cues are shared between the modalities, but the effectiveness of this transfer is limited since ∼60% of cues are not., Conclusions: Transfer learning is beneficial when X-ray data is very scarce-of the order of tens of training images in our experiments-but provides no significant benefit when hundreds or thousands of X-ray images are available.

Many operations of vision require image regions to be isolated and inter-related. This is challenging when they are different in detail and extent. Practical methods of Computer Vision approach this through the tools of downsampling, pyramids, cropping and patches. In this paper we develop an ideal geometric structure for this, compatible with the existing scale space model of image measurement. Its elements are apertures which view the image like fuzzy-edged portholes of frosted glass. We establish containment and cause/effect relations between apertures, and show that these link them into cross-scale atlases. Atlases formed of Gaussian apertures are shown to be a continuous version of the image pyramid used in Computer Vision, and allow various types of image description to naturally be expressed within their framework. We show that views through Gaussian apertures are approximately equivalent to the jets of derivative of Gaussian filter responses that form part of standard Scale Space theory. This supports a view of the simple cells of mammalian V1 as implementing a system of local views of the retinal image of varying extent and resolution. As a worked example we develop a keypoint descriptor scheme that outperforms previous schemes that do not make use of learning.

Subjective assessments of spatial regularity are common in everyday life and also in science, for example in developmental biology. It has recently been shown that regularity is an adaptable visual dimension. It was proposed that regularity is coded via the peakedness of the distribution of neural responses across receptive field size. Here, we test this proposal for jittered square lattices of dots. We examine whether discriminability correlates with a simple peakedness measure across different presentation conditions (dot number, size, and average spacing). Using a filter-rectify-filter model, we determined responses across scale. Consistently, two peaks are present: a lower frequency peak corresponding to the dot spacing of the regular pattern and a higher frequency peak corresponding to the pattern element (dot). We define the "peakedness" of a particular presentation condition as the relative heights of these two peaks for a perfectly regular pattern constructed using the corresponding dot size, number and spacing. We conducted two psychophysical experiments in which observers judged relative regularity in a 2-alternative forced-choice task. In the first experiment we used a single reference pattern of intermediate regularity and, in the second, Thurstonian scaling of patterns covering the entire range of regularity. In both experiments discriminability was highly correlated with peakedness for a wide range of presentation conditions. This supports the hypothesis that regularity is coded via peakedness of the distribution of responses across scale., (Copyright © 2018 Elsevier Ltd. All rights reserved.)

Neurons communicate with each other through synapses, which show enrichment for specialized receptors. Although many studies have explored spatial enrichment and diffusion of these receptors in dissociated neurons using single particle tracking, much less is known about their dynamic properties at synapses in complex tissue like brain slices. Here we report the use of smaller and highly specific quantum dots conjugated with a recombinant single domain antibody fragment (VHH fragment) against green fluorescent protein to provide information on diffusion of adhesion molecules at the growth cone and neurotransmitter receptors at synapses. Our data reveals that QD-nanobodies can measure neurotransmitter receptor dynamics at both excitatory and inhibitory synapses in primary neuronal cultures as well as in ex vivo rat brain slices. We also demonstrate that this approach can be applied to tagging multiple proteins to simultaneously monitor their behavior. Thus, we provide a strategy for multiplex imaging of tagged membrane proteins to study their clustering, diffusion and transport both in vitro as well as in native tissue environments such as brain slices.

We demonstrate identification of position, material, orientation, and shape of objects imaged by a ^{85}Rb atomic magnetometer performing electromagnetic induction imaging supported by machine learning. Machine learning maximizes the information extracted from the images created by the magnetometer, demonstrating the use of hidden data. Localization 2.6 times better than the spatial resolution of the imaging system and successful classification up to 97% are obtained. This circumvents the need of solving the inverse problem and demonstrates the extension of machine learning to diffusive systems, such as low-frequency electrodynamics in media. Automated collection of task-relevant information from quantum-based electromagnetic imaging will have a relevant impact from biomedicine to security.

We have shown in previous work that the perception of order in point patterns is consistent with an interval scale structure (Protonotarios, Baum, Johnston, Hunter, & Griffin, 2014). The psychophysical scaling method used relies on the confusion between stimuli with similar levels of order, and the resulting discrimination scale is expressed in just-noticeable differences (jnds). As with other perceptual dimensions, an interesting question is whether suprathreshold (perceptual) differences are consistent with distances between stimuli on the discrimination scale. To test that, we collected discrimination data, and data based on comparison of perceptual differences. The stimuli were jittered square lattices of dots, covering the range from total disorder (Poisson) to perfect order (square lattice), roughly equally spaced on the discrimination scale. Observers picked the most ordered pattern from a pair, and the pair of patterns with the greatest difference in order from two pairs. Although the judgments of perceptual difference were found to be consistent with an interval scale, like the discrimination judgments, no common interval scale that could predict both sets of data was possible. In particular, the midpattern of the perceptual scale is 11 jnds away from the ordered end, and 5 jnds from the disordered end of the discrimination scale.

The astrocytic GLT-1 (or EAAT2) is the major glutamate transporter for clearing synaptic glutamate. While the diffusion dynamics of neurotransmitter receptors at the neuronal surface are well understood, far less is known regarding the surface trafficking of transporters in subcellular domains of the astrocyte membrane. Here, we have used live-cell imaging to study the mechanisms regulating GLT-1 surface diffusion in astrocytes in dissociated and brain slice cultures. Using GFP-time lapse imaging, we show that GLT-1 forms stable clusters that are dispersed rapidly and reversibly upon glutamate treatment in a transporter activity-dependent manner. Fluorescence recovery after photobleaching and single particle tracking using quantum dots revealed that clustered GLT-1 is more stable than diffuse GLT-1 and that glutamate increases GLT-1 surface diffusion in the astrocyte membrane. Interestingly, the two main GLT-1 isoforms expressed in the brain, GLT-1a and GLT-1b, are both found to be stabilized opposed to synapses under basal conditions, with GLT-1b more so. GLT-1 surface mobility is increased in proximity to activated synapses and alterations of neuronal activity can bidirectionally modulate the dynamics of both GLT-1 isoforms. Altogether, these data reveal that astrocytic GLT-1 surface mobility, via its transport activity, is modulated during neuronal firing, which may be a key process for shaping glutamate clearance and glutamatergic synaptic transmission. GLIA 2016;64:1252-1264., (© 2016 The Authors. Glia Published by Wiley Periodicals, Inc.)

Clathrin-mediated endocytosis (CME) is a fundamental property of eukaryotic cells. Classical CME proceeds via the formation of clathrin-coated pits (CCPs) at the plasma membrane, which invaginate to form clathrin-coated vesicles, a process that is well understood. However, clathrin also assembles into flat clathrin lattices (FCLs); these structures remain poorly described, and their contribution to cell biology is unclear. We used quantitative imaging to provide the first comprehensive description of FCLs and explore their influence on plasma membrane organization. Ultrastructural analysis by electron and superresolution microscopy revealed two discrete populations of clathrin structures. CCPs were typified by their sphericity, small size, and homogeneity. FCLs were planar, large, and heterogeneous and present on both the dorsal and ventral surfaces of cells. Live microscopy demonstrated that CCPs are short lived and culminate in a peak of dynamin recruitment, consistent with classical CME. In contrast, FCLs were long lived, with sustained association with dynamin. We investigated the biological relevance of FCLs using the chemokine receptor CCR5 as a model system. Agonist activation leads to sustained recruitment of CCR5 to FCLs. Quantitative molecular imaging indicated that FCLs partitioned receptors at the cell surface. Our observations suggest that FCLs provide stable platforms for the recruitment of endocytic cargo., (© 2014 Grove et al. This article is distributed by The American Society for Cell Biology under license from the author(s). Two months after publication it is available to the public under an Attribution–Noncommercial–Share Alike 3.0 Unported Creative Commons License (http://creativecommons.org/licenses/by-nc-sa/3.0).)

Human observers readily make judgements about the degree of order in planar arrangements of points (point patterns). Here, based on pairwise ranking of 20 point patterns by degree of order, we have been able to show that judgements of order are highly consistent across individuals and the dimension of order has an interval scale structure spanning roughly 10 just-notable-differences (jnd) between disorder and order. We describe a geometric algorithm that estimates order to an accuracy of half a jnd by quantifying the variability of the size and shape of spaces between points. The algorithm is 70% more accurate than the best available measures. By anchoring the output of the algorithm so that Poisson point processes score on average 0, perfect lattices score 10 and unit steps correspond closely to jnds, we construct an absolute interval scale of order. We demonstrate its utility in biology by using this scale to quantify order during the development of the pattern of bristles on the dorsal thorax of the fruit fly., (© 2014 The Author(s) Published by the Royal Society. All rights reserved.)

Adherent cell lines are widely used across all fields of biology, including drug discovery, toxicity studies, and regenerative medicine. However, adherent cell processes are often limited by a lack of advances in cell culture systems. While suspension culture processes benefit from decades of development of instrumented bioreactors, adherent cultures are typically performed in static, noninstrumented flasks and well-plates. We previously described a microfabricated bioreactor that enables a high degree of control on the microenvironment of the cells while remaining compatible with standard cell culture protocols. In this report, we describe its integration with automated image-processing capabilities, allowing the continuous monitoring of key cell culture characteristics. A machine learning-based algorithm enabled the specific detection of one cell type within a co-culture setting, such as human embryonic stem cells against the background of fibroblast cells. In addition, the algorithm did not confuse image artifacts resulting from microfabrication, such as scratches on surfaces, or dust particles, with cellular features. We demonstrate how the automation of flow control, environmental control, and image acquisition can be employed to image the whole culture area and obtain time-course data of mouse embryonic stem cell cultures, for example, for confluency., (© 2014 Society for Laboratory Automation and Screening.)

Characterization of second order local image structure by a 6D vector (or jet) of Gaussian derivative measurements is considered. We consider the affect on jets of a group of transformations-affine intensity-scaling, image rotation and reflection, and their compositions-that preserve intrinsic image structure. We show how this group stratifies the jet space into a system of orbits. Considering individual orbits as points, a 3D orbifold is defined. We propose a norm on jet space which we use to induce a metric on the orbifold. The metric tensor shows that the orbifold is intrinsically curved. To allow visualization of the orbifold and numerical computation with it, we present a mildly-distorting but volume-preserving embedding of it into euclidean 3-space. We call the resulting shape, which is like a flattened lemon, the second order local-image-structure solid. As an example use of the solid, we compute the distribution of local structures in noise and natural images. For noise images, analytical results are possible and they agree with the empirical results. For natural images, an excess of locally 1D structure is found.

We have used information-theoretic measures to compute the amount of dependency which exists between two and three gradient directions at separate locations in an ensemble of natural images. Control experiments were performed on other image classes: phase randomized natural images, whitened natural images and Gaussian noise images. The results show that, for an ensemble of natural images, the amount of 2-point and 3-point gradient direction dependency is equivalent to its ensemble of phase randomized natural images. Therefore, we conclude that the amount of gradient direction dependency in an ensemble of natural images is determined by the ensemble's mean power spectrum rather than the phase spectra of the images. Moreover, this relationship does not extend to individual natural images, the amount of dependency between gradient magnitudes, or gradient directions at high gradient magnitude locations.

Much is understood of how quantitative aspects of image structure are measured by VI simple cells, but less about how qualitative structure is determined from these measurements. We review Geometric Texton Theory (GTT) that aims to describe this step from quantitative to qualitative. GTT proposes that qualitative feature categories arise through consideration of the maximum likelihood (ML) explanations of image measurements. It posits that a pair of output vectors of an ensemble of co-localised neurons signal the same feature category if and only if the corresponding ML explanations are qualitatively similar. We present mathematical and empirical results relevant to GTT for the limited case of measurement by 1D filters of up to 2nd order. The mathematical results identify the simplest explanations for measurements by such filters, while the empirical results identify the ML. We find that the ML explanations are not the most simple under any of the definitions of simple that we examined. However, the ML explanations do have properties predicted by GTT. In particular they change rapidly and qualitatively for certain narrow regions of measurement space, while remaining qualitative stable between those transition regions. Three feature categories arise naturally from the data: light bars, dark bars and edges. The results are consistent with GTT.

We introduce Geometric Texton Theory (GTT), a theory of categorical visual feature classification that arises through consideration of the metamerism that affects families of co-localised linear receptive-field operators. A refinement of GTT that uses maximum likelihood (ML) to resolve this metamerism is presented. We describe a method for discovering the ML element of a metamery class by analysing a database of natural images. We apply the method to the simplest case--the ML element of a canonical metamery class defined by co-registering the location and orientation of profiles from images, and affinely scaling their intensities so that they have identical responses to 1-D, zeroth- and first-order, derivative of Gaussian operators. We find that a step edge is the ML profile. This result is consistent with our proposed theory of feature classification.

Diffusion tensor magnetic resonance imaging (DT-MRI) is unique in providing information about both the structural integrity and the orientation of white matter fibers in vivo and, through "tractography", revealing the trajectories of white matter tracts. DT-MRI is therefore a promising technique for detecting differences in white matter architecture between different subject populations. However, while studies involving analyses of group averages of scalar quantities derived from DT-MRI data have been performed, as yet there have been no similar studies involving the whole tensor. Here we present the first step towards realizing such a study, i.e., the spatial normalization of whole tensor data sets. The approach is illustrated by spatial normalization of 10 DT-MRI data sets to a standard anatomical template. Both qualitative and quantitative approaches are described for assessing the results of spatial normalization. Techniques are then described for combining the spatially normalized data sets according to three definitions of average, i.e., the mean, median, and mode of a distribution of tensors. The current absence of, and hence need for, appropriate statistical tests for comparison of results derived from group-averaged DT-MRI data sets is then discussed. Finally, the feasibility of performing tractography on the group-averaged DT-MRI data set is investigated and the possibility and implications of generating a generic map of brain connectivity from a group of subjects is considered.