Search

The need to complete multiple tasks concurrently is a common occurrence both daily life and in occupational activities, which can often include simultaneous cognitive and physical demands. As one example, there is increasing availability of head-worn display technologies that can be employed when a user is mobile (e.g., while walking). This new method of information presentation may, however, introduce risks of adverse outcomes such as a decrement to gait performance. The goal of this study was thus to quantify the effects of a head-worn display (i.e., smart glasses) on motor variability during gait and to compare these effects with those of other common information displays (i.e., smartphone and paper-based system). Twenty participants completed four walking conditions, as a single task and in three dual-task conditions (three information displays). In the dual-task conditions, the information display was used to present several cognitive tasks. Three different measures were used to quantify variability in gait parameters for each walking condition (using the cycle-to-cycle standard deviation, sample entropy, and the “goal-equivalent manifold” approach). Our results indicated that participants used less adaptable gait strategies in dual-task walking using the paper-based system and smartphone conditions compared with single-task walking. Gait performance, however, was less affected during dual-task walking with the smart glasses. We conclude that the risk of an adverse gait event (e.g., a fall) in head-down walking conditions (i.e., the paper-based system and smartphone conditions) were higher than in single-task walking, and that head-worn displays might help reduce the risk of such events during dual-task gait conditions. [ABSTRACT FROM AUTHOR]

Basic color terms used in Mandarin Chinese have been controversial since first discussed by Berlin and Kay in 1969. Previous studies showed much inconsistency on what should be considered as basic color terms in Mandarin Chinese. In the present study, we investigated categories of color rather than merely the color terms used by Taiwanese native Mandarin speakers. Using samples conforming to the Berlin and Kay survey, various colors were chosen from a collection of Natural Color System (NCS) colored papers and mounted on a piece of neutral gray card. The card was then mounted on a touch-screen, under D65 illumination. Thirty-two single-character color related Mandarin terms were selected from a Chinese character database according to frequency of use. Participants were required to select the color sample that matched the term by pressing a virtual button on the touch screen. The results show that certain terms can be directly correlated to basic color terms in English, comparable with the results of Berlin and Kay’s original study and those that followed. However, some terms, such as Mo (墨 ink), Tie (鐵 iron), and Cai (菜vegetable), show a wide spread of term maps and inconsistent use among subjects. Principle component analysis (PCA) procedures were used to analysis the commodity of data among subjects. The findings suggest that the basic color categories among Mandarin Chinese speakers are similar to those found in the World Color Survey (WCS), but are represented by wide-spread and inconsistent color terms among speakers. [ABSTRACT FROM AUTHOR]

Biometric recognition technology based on eye-movement dynamics has been in development for more than ten years. Different visual tasks, feature extraction and feature recognition methods are proposed to improve the performance of eye movement biometric system. However, the correct identification and verification rates, especially in long-term experiments, as well as the effects of visual tasks and eye trackers’ temporal and spatial resolution are still the foremost considerations in eye movement biometrics. With a focus on these issues, we proposed a new visual searching task for eye movement data collection and a new class of eye movement features for biometric recognition. In order to demonstrate the improvement of this visual searching task being used in eye movement biometrics, three other eye movement feature extraction methods were also tested on our eye movement datasets. Compared with the original results, all three methods yielded better results as expected. In addition, the biometric performance of these four feature extraction methods was also compared using the equal error rate (EER) and Rank-1 identification rate (Rank-1 IR), and the texture features introduced in this paper were ultimately shown to offer some advantages with regard to long-term stability and robustness over time and spatial precision. Finally, the results of different combinations of these methods with a score-level fusion method indicated that multi-biometric methods perform better in most cases. [ABSTRACT FROM AUTHOR]

Analysis of functional magnetic resonance imaging (fMRI) data has revealed that brain regions can be grouped into functional brain networks (fBNs) or communities. A community in fMRI analysis signifies a group of brain regions coupled functionally with one another. In neuroimaging, functional connectivity (FC) measure can be utilized to quantify such functionally connected regions for disease diagnosis and hence, signifies the need of devising novel FC estimation methods. In this paper, we propose a novel method of learning FC by constraining its rank and the sum of non-zero coefficients. The underlying idea is that fBNs are sparse and can be embedded in a relatively lower dimension space. In addition, we propose to extract overlapping networks. In many instances, communities are characterized as combinations of disjoint brain regions, although recent studies indicate that brain regions may participate in more than one community. In this paper, large-scale overlapping fBNs are identified on resting state fMRI data by employing non-negative matrix factorization. Our findings support the existence of overlapping brain networks. [ABSTRACT FROM AUTHOR]

This paper presents vehicle-to-vehicle telescreen (VVT) and a multicast scheme to disseminate digital signage multimedia services to vehicular ad hoc networks (VANETs). Multimedia dissemination in VANETs is challenging because of the high packet losses (PLs), delays and longer disconnection times, which degrade the network quality of service (QoS) and user quality of experience (QoE). To reduce the PLs and delays, most existing multimedia multicast schemes in VANETs primarily select routes based on longer route expiration times (RET) or lowest path delays. The RET-based schemes suffer less from PLs when there are fewer active multicastings in the network. When the number of active multicastings increases, delay-based schemes suffer less from PLs comparatively. This tradeoff implies to design an adaptive mechanism by mutually complementing the RET-based and delay-based schemes to reduce PLs and delays. In this paper, we propose a multicriteria adaptive opportunistic treecast routing protocol (MAOTRP), which adapts the route selection mechanism according to active multicastings for efficient multimedia dissemination in VVT. The MAOTRP adjusts the weights of route selection parameters, including RET and delays, by considering their contribution in improving packet delivery ratio. MAOTRP extends a tree-based multicast protocol to provide robustness through alternate routes for link failures to reduce PLs. Through several experimental evaluations, we show that the proposed dissemination scheme improves QoS and QoE, and reduces the average disconnection time. [ABSTRACT FROM AUTHOR]

By utilizing cognitive mapping and leveraging georeferenced text data, this paper aims to suggest a new visualization method that combines the advantages of both conventional and state-of-the-art research techniques to depict the collective identity of place in a single image. The study addressed two research questions: (1) Can crowd-sourced text data be utilized in representing place identity? (2) Can collective place identity be expressed in the form of a cognitive map? By confirming that text data gathered from social media effectively demonstrate people’s behaviors and perceptions related to places, we propose a novel method to create a visual representation of urban identity–a “crowd-sourced cognitive map”. In particular, to improve the conventional cognitive mapping method to depict the collective identity of a city, we draw cognitive maps of Bundang and Ilsan developed in the 1990s, as well as Songdo and Dongtan developed in the 2000s, just outside of the administrative boundaries of Seoul in Korea, through a computational method based on crowd-sourced opinions collected from social media. We open the possibility for the use of social media text data to capture the identity of cities and suggest a graphical image through which people without prior information could also easily apprehend the overall image of a city. The work in this paper is expected to provide a methodological technique for appropriate decision-making and the evaluation of urban identity to shape a more unique and imageable city. [ABSTRACT FROM AUTHOR]

Diabetic retinopathy (DR) is a disease which is widely diagnosed using (colour fundus) images. Efficiency and accuracy are critical in diagnosing DR as lack of timely intervention can lead to irreversible visual impairment. In this paper, we examine strategies for scrutinizing images which affect diagnostic performance of medical practitioners via an eye-tracking study. A total of 56 subjects with 0 to 18 years of experience participated in the study. Every subject was asked to detect DR from 40 images. The findings indicate that practitioners use mainly two types of strategies characterized by either higher dwell duration or longer track length. The main findings of the study are that higher dwell-based strategy led to higher average accuracy (> 85%) in diagnosis, irrespective of the expertise of practitioner; whereas, the average obtained accuracy with a long-track length-based strategy was dependent on the expertise of the practitioner. In the second part of the paper, we use the experimental findings to recommend a scanning strategy for fast and accurate diagnosis of DR that can be potentially used by image readers. This is derived by combining the eye-tracking gaze maps of medical experts in a novel manner based on a set of rules. This strategy requires scrutiny of images in a manner which is consistent with spatial preferences found in human perception in general and in the domain of fundus images in particular. The Levenshtein distance-based assessment of gaze patterns also establish the effectiveness of the derived scanning pattern and is thus recommended for image readers. [ABSTRACT FROM AUTHOR]

Objective: There is a need for structure to achieve functional patient engagement within mental healthcare organizations, and for clarification on how to proceed on a strategic level. The aim of this paper is to shed light on the implementation of a strategic organizational structure for patient engagement in mental health by examining why and how to implement a structure, the organizational and environmental factors that facilitate or limit the process, and the perceived consequences of the implementation. Method: This paper evaluates the implementation of a strategic committee for patient engagement in a mental healthcare organization in Montreal (Quebec, Canada). The research was designed as a qualitative single case study using a deductive approach by means of a conceptual framework. Data sources consisted in ten semi-structured interviews, three focus groups, and organizational documents. Results: The strategic committee for patient engagement was implemented as a means to formalize patient partner participation, following the introduction of a vision of full citizenship. Important aspects of its implementation included its composition and role, the elaboration of a framework for patient partner participation, and finally, ongoing application and evaluation of the framework. Several facilitating factors were identified, including executive management support, leadership, and a vision behind the participation. Limiting factors mainly consisted of resistance towards patient participation and the existence of stigma. Consequences included increased and improved patient engagement, as well as reduced stigma within the organization. Conclusion: This study shows that the implementation of a strategic organizational structure for patient engagement is comprehensive. It further shows the importance of a vision and an articulate leadership involving several actors. Further research is needed regarding the impact of this type of strategic structure on a clinical level. [ABSTRACT FROM AUTHOR]

An important task of human visual cognition is to make inferences about properties of objects. One such property is an object's causal history: what happened to the object in its past (e.g., “this paper has been folded”). There is relatively little research on whether and how we make such inferences. We took photographs of objects from six different materials (‘wax’, ‘aluminum foil’, ‘gold foil’, ‘chicken wire’, ‘putty’, ‘cardboard’) transformed by one of four shape-altering transformations (‘folded’, ‘bent’, ‘crumpled’, ‘twisted’). By varying execution of transformation and viewpoint, we obtained 30 images of each material/transformation combination (720 images). We asked different groups of participants to: (1) name transformations and materials, (2) rate images with respect to the extent they belonged to each transformation or material class, and (3) classify images into the four transformation classes. Our results show that participants can infer transformations from object shape–with accuracy being modulated by object material. This inference of causal history from observed object shape shows that we can distinguish between intrinsic (material) and extrinsic (transformation) properties of the object. The separation of observed shape features by their causal origin (‘shape scission’) presumably involves both perceptual and cognitive abilities. [ABSTRACT FROM AUTHOR]

Direct volume rendering has become an essential tool to explore and analyse 3D medical images. Despite several advances in the field, it remains a challenge to produce an image that highlights the anatomy of interest, avoids occlusion of important structures, provides an intuitive perception of shape and depth while retaining sufficient contextual information. Although the computer graphics community has proposed several solutions to address specific visualization problems, the medical imaging community still lacks a general volume rendering implementation that can address a wide variety of visualization use cases while avoiding complexity. In this paper, we propose a new open source framework called the Programmable Ray Integration Shading Model, or PRISM, that implements a complete GPU ray-casting solution where critical parts of the ray integration algorithm can be replaced to produce new volume rendering effects. A graphical user interface allows clinical users to easily experiment with pre-existing rendering effect building blocks drawn from an open database. For programmers, the interface enables real-time editing of the code inside the blocks. We show that in its default mode, the PRISM framework produces images very similar to those produced by a widely-adopted direct volume rendering implementation in VTK at comparable frame rates. More importantly, we demonstrate the flexibility of the framework by showing how several volume rendering techniques can be implemented in PRISM with no more than a few lines of code. Finally, we demonstrate the simplicity of our system in a usability study with 5 medical imaging expert subjects who have none or little experience with volume rendering. The PRISM framework has the potential to greatly accelerate development of volume rendering for medical applications by promoting sharing and enabling faster development iterations and easier collaboration between engineers and clinical personnel. [ABSTRACT FROM AUTHOR]

It has been evidenced that in attention-window tasks, the participants fixate on the center of a screen while inspecting two stimuli that appear at the same time in parafoveal vision. Such tasks have successfully been used to estimate a person's breadth of attention under various conditions. While behavioral investigations of visual attention have often made use of response accuracy, recent research has shown that the pupil size can also be used to track shifts of attention to the periphery. The main finding of previous studies is that the harder the evaluation of the stimuli becomes, e.g., because they appear farther away from the central fixation point, the stronger the pupils dilate. In this paper, we present experimental data suggesting that in an attention-window task, the pupil size can also be used to assess whether the participants attend to static, non-moving, or dynamic, moving stimuli. That is, regression models containing information on presentation mode (static vs. dynamic) and the visual angle between spatially separated stimuli better predict accuracy of perception and pupil dilation than model without these sources of information. This finding is useful for researchers who aim at understanding the human attentional system, including potential differences in its sensitivity to static and dynamic objects. [ABSTRACT FROM AUTHOR]

In previous papers, we introduced a normative scheme for scene construction and epistemic (visual) searches based upon active inference. This scheme provides a principled account of how people decide where to look, when categorising a visual scene based on its contents. In this paper, we use active inference to explain the visual searches of normal human subjects; enabling us to answer some key questions about visual foraging and salience attribution. First, we asked whether there is any evidence for ‘epistemic foraging’; i.e. exploration that resolves uncertainty about a scene. In brief, we used Bayesian model comparison to compare Markov decision process (MDP) models of scan-paths that did–and did not–contain the epistemic, uncertainty-resolving imperatives for action selection. In the course of this model comparison, we discovered that it was necessary to include non-epistemic (heuristic) policies to explain observed behaviour (e.g., a reading-like strategy that involved scanning from left to right). Despite this use of heuristic policies, model comparison showed that there is substantial evidence for epistemic foraging in the visual exploration of even simple scenes. Second, we compared MDP models that did–and did not–allow for changes in prior expectations over successive blocks of the visual search paradigm. We found that implicit prior beliefs about the speed and accuracy of visual searches changed systematically with experience. Finally, we characterised intersubject variability in terms of subject-specific prior beliefs. Specifically, we used canonical correlation analysis to see if there were any mixtures of prior expectations that could predict between-subject differences in performance; thereby establishing a quantitative link between different behavioural phenotypes and Bayesian belief updating. We demonstrated that better scene categorisation performance is consistently associated with lower reliance on heuristics; i.e., a greater use of a generative model of the scene to direct its exploration. [ABSTRACT FROM AUTHOR]

Affective analysis of images in social networks has drawn much attention, and the texts surrounding images are proven to provide valuable semantic meanings about image content, which can hardly be represented by low-level visual features. In this paper, we propose a novel approach for visual affective classification (VAC) task. This approach combines visual representations along with novel text features through a fusion scheme based on Dempster-Shafer (D-S) Evidence Theory. Specifically, we not only investigate different types of visual features and fusion methods for VAC, but also propose textual features to effectively capture emotional semantics from the short text associated to images based on word similarity. Experiments are conducted on three public available databases: the International Affective Picture System (IAPS), the Artistic Photos and the MirFlickr Affect set. The results demonstrate that the proposed approach combining visual and textual features provides promising results for VAC task. [ABSTRACT FROM AUTHOR]

A saliency attention model for predicting eye direction is proposed in this paper. This work is inspired by the success of the topological structure and Earth Mover’s Distance (EMD) approach. Firstly, we extract visual saliency features such as color contrast, intensity contrast, orientation, and texture. Then, we eliminate disconnected regions in the feature maps to keep topological structure. Secondly, we calculate center surround difference using across-scale EMD between different scales feature maps, rather than utilizing the Difference of Gaussian (DoG), which is used in many other saliency attention models. Thirdly, we across-scale fuse the feature maps in different scale and same feature. Lastly, we take advantage of competition function to calculate feature maps in same feature to form a saliency map, which is use to predict eye direction. Experimental results demonstrated the proposed model outperformed the state-of-the-art schemes in eye direction prediction community. [ABSTRACT FROM AUTHOR]

Vision-based vehicle detection is an important issue for advanced driver assistance systems. In this paper, we presented an improved multi-vehicle detection and tracking method using cascade Adaboost and Adaptive Kalman filter(AKF) with target identity awareness. A cascade Adaboost classifier using Haar-like features was built for vehicle detection, followed by a more comprehensive verification process which could refine the vehicle hypothesis in terms of both location and dimension. In vehicle tracking, each vehicle was tracked with independent identity by an Adaptive Kalman filter in collaboration with a data association approach. The AKF adaptively adjusted the measurement and process noise covariance through on-line stochastic modelling to compensate the dynamics changes. The data association correctly assigned different detections with tracks using global nearest neighbour(GNN) algorithm while considering the local validation. During tracking, a temporal context based track management was proposed to decide whether to initiate, maintain or terminate the tracks of different objects, thus suppressing the sparse false alarms and compensating the temporary detection failures. Finally, the proposed method was tested on various challenging real roads, and the experimental results showed that the vehicle detection performance was greatly improved with higher accuracy and robustness. [ABSTRACT FROM AUTHOR]

With the development of modern cities, roads, and landscapes, it is becoming increasingly important for infrastructure such as tunnels to provide an esthetically pleasing experience. In this respect, it is necessary to conduct studies that consider the esthetic design of tunnel portals using esthetics research. Regarding the esthetic evaluation of tunnel portals, this paper fully considers the dynamic visual effect from the driver's perspective. This study combines the use of Blender, SpeedTree Modeler Cinema, Adobe Photoshop CS6, and other software for secondary development. These programs are connected to the driving simulation platform Euro Truck Simulator 2 (which is equipped with a driving simulator) to construct a set of driving simulation tests that enable the esthetic evaluation of a tunnel portal. The Banlun Tunnel on the Funing–Longliu Expressway in Yunnan Province, China, is used as a case study, and four impact factors that vary significantly in esthetic design are included: the linearity, color, greening and texture of the portal. Using an orthogonal experimental design, the influence of the esthetic degree was simulated and evaluated, and the order of sensitivity to esthetic factors of a headwall tunnel portal was sequentially determined as follows: the portal texture exerts the maximum impact on the beauty degree of the headwall portal, followed by the portal greening and the portal color, while the portal linearity exerts the minimum impact. The results show that the developed driving simulation test system can be used to determine the sensitivity of esthetic factors for a tunnel portal and obtain an optimal collocation of esthetic factors on different levels; hence, it provides feedback for use in designing the optimum esthetic tunnel portal. This test system can be used as a reference when conducting future evaluations and studies on tunnel portal esthetics. [ABSTRACT FROM AUTHOR]

Introduction: Perinatal management and prognostic value of clinical evaluation and diagnostic tools have changed with the generalization of therapeutic hypothermia (TH) in infants with hypoxic-ischemic encephalopathy (HIE) Aim: to ascertain the prognostic value of amplitude integrated electroencephalogram (aEEG) in neonates with HIE considering hours of life and treatment with TH. Methods: A systematic review was performed. Inclusion criteria were studies including data of neonates with HIE, treated or not with TH, monitored with aEEG and with neurodevelopmental follow-up of at least 12 months. The period of bibliographic search was until February 2016. No language restrictions were initially applied. Consulted databases were MEDLINE, Scopus, CINHAL and the Spanish language databases GuiaSalud and Bravo. Article selection was performed by two independent reviewers. Quality for each individual paper selected was evaluated using QUADAS-2. Review Manager (RevMan) version 5.3 software was used. Forest plots were constructed to graphically show sensitivity and specificity for all included studies, separating patients treated or not with hypothermia. Summary statistics were estimated using bivariate models and random effects approaches with the R package MADA from summary ROC curves. Meta-regression was used to estimate heterogeneity and trends. Results: from the 403 articles initially identified, 17 were finally included and critically reviewed. In infants not treated with hypothermia the maximum reliability of an abnormal aEEG background to predict death or moderate/severe disability was at 36 hours of life, when a positive post-test probability of 97.90% was achieved (95%CI 88.40 to 99.40%). Positive likelihood ratio (+LR) at these hours of life was 26.60 (95%CI 4.40 to 94.90) and negative likelihood ratio (-LR) was 0.23 (95%CI 0.10 to 0.44). A high predictive value was already present at 6 hours of life in this group of patients, with a positive post-test probability of 88.20% (95%CI 79.80 to 93%) and a +LR of 4.34 (95%CI 2.31 to 7.73). In patients treated with TH the maximum predictive eliability was achieved at 72 hours of life (post-test probability of 95.70%, 95%CI 84.40 to 98.50%). +LR at this age was 24.30 (95%CI 5.89 to 71.30) and–LR was 0.40 (95%CI 0.25 to 0.57). Predictive value of aEEG at 6 hours of life was low in these patients (59.10%, 95%CI 55.70 to 63%). Conclusion: This study confirms that aEEG´s background activity, as recorded during the first 72 hours after birth, has a strong predictive value in infants with HIE treated or not with TH. Predictive values of traces throughout the following 72 hours are a helpful guide when considering and counselling parents about the foreseeable long-term neurological outcome [ABSTRACT FROM AUTHOR]

The perception and production of biological movements is characterized by the 1/3 power law, a relation linking the curvature and the velocity of an intended action. In particular, motions are perceived and reproduced distorted when their kinematics deviate from this biological law. Whereas most studies dealing with this perceptual-motor relation focused on visual or kinaesthetic modalities in a unimodal context, in this paper we show that auditory dynamics strikingly biases visuomotor processes. Biologically consistent or inconsistent circular visual motions were used in combination with circular or elliptical auditory motions. Auditory motions were synthesized friction sounds mimicking those produced by the friction of the pen on a paper when someone is drawing. Sounds were presented diotically and the auditory motion velocity was evoked through the friction sound timbre variations without any spatial cues. Remarkably, when subjects were asked to reproduce circular visual motion while listening to sounds that evoked elliptical kinematics without seeing their hand, they drew elliptical shapes. Moreover, distortion induced by inconsistent elliptical kinematics in both visual and auditory modalities added up linearly. These results bring to light the substantial role of auditory dynamics in the visuo-motor coupling in a multisensory context. [ABSTRACT FROM AUTHOR]

Humans are excellent at perceiving different features of the actions performed by others. For instance, by viewing someone else manipulating an unknown object, one can infer its weight–an intrinsic feature otherwise not directly accessible through vision. How such perceptual skill develops during childhood remains unclear. To confront this gap, the current study had children (N:63, 6–10 years old) and adults (N:21) judge the weight of objects after observing videos of an actor lifting them. Although 6-year-olds could already discriminate different weights, judgment accuracy had not reached adult-like levels by 10 years of age. Additionally, children's stature was a more reliable predictor of their ability to read others' actions than was their chronological age. This paper discusses the results in light of a potential link between motor development and action perception. [ABSTRACT FROM AUTHOR]

This paper presents an evaluation of the effectiveness of two types of deceleration markings on freeways in China: fishbone-shaped (FS) markings and edge-rate (ER) markings. An actual 4-lane, 6-km long freeway in Province Hebei was created in a driving simulator and used for the experiments. Three scenarios of deceleration markings were adopted: one without markings, one with FS markings, and the third with ER markings. For each scenario, three traffic flow levels were adopted (low, medium, and heavy). The appropriate dimensions of deceleration markings were first established using relevant design guidelines and then used to develop the simulation scenarios using Multigen Creator software. Sixty drivers carried out the simulation experiments with eye tracker equipment. The adequacy of deceleration markings was analyzed with respect to speed, perceived distance, pupil diameter, and geometric parameters. The results showed that both types of deceleration markings made a certain effect on vehicle speed, drivers’visual behavior, and mental characteristics. However, the effect of the FS markings was more pronounced than that of the ER marking. Specifically, the FS markings showed a speed reduction of 12.3 km/h to 15.2 km/h and a perceived distance of 70 m to 90 m, compared with 6.7 km/h to 9.9 km/h and 40 m to 60 m, respectively, for the ER markings. Application comments of the results are provided in the conclusion. [ABSTRACT FROM AUTHOR]

Motivational intensity has been previously linked to information processing. In particular, it has been argued that affects which are high in motivational intensity tend to narrow cognitive scope. A similar effect has been attributed to negative affect, which has been linked to narrowing of cognitive scope. In this paper, we investigated how these phenomena manifest themselves during visual word search. We conducted three studies in which participants were instructed to perform word category identification. We manipulated motivational intensity by controlling reward expectations and affect via reward outcomes. Importantly, we altered visual search paradigms, assessing the effects of affective manipulations as modulated by information arrangement. We recorded multiple physiological signals (EEG, EDA, ECG and eye tracking) to assess whether motivational states can be predicted by physiology. Across the three studies, we found that high motivational intensity narrowed visual attentional scope by altering visual search strategies, especially when information was displayed sparsely. Instead, when information was vertically listed, approach-directed motivational intensity appeared to improve memory encoding. We also observed that physiology, in particular eye tracking, may be used to detect biases induced by motivational intensity, especially when information is sparsely organised. [ABSTRACT FROM AUTHOR]

This paper presents the first empirical investigation that compares Euler and linear diagrams when they are used to represent set cardinality. A common approach is to use area-proportional Euler diagrams but linear diagrams can exploit length-proportional straight-lines for the same purpose. Another common approach is to use numerical annotations. We first conducted two empirical studies, one on Euler diagrams and the other on linear diagrams. These suggest that area-proportional Euler diagrams with numerical annotations and length-proportional linear diagrams without numerical annotations support significantly better task performance. We then conducted a third study to investigate which of these two notations should be used in practice. This suggests that area-proportional Euler diagrams with numerical annotations most effectively supports task performance and so should be used to visualize set cardinalities. However, these studies focused on data that can be visualized reasonably accurately using circles and the results should be taken as valid within that context. Future work needs to determine whether the results generalize both to when circles cannot be used and for other ways of encoding cardinality information. [ABSTRACT FROM AUTHOR]

Recognizing a person in a crowded environment is a challenging, yet critical, visual-search task for both humans and machine-vision algorithms. This paper explores the possibility of combining a residual neural network (ResNet), brain-computer interfaces (BCIs) and human participants to create “cyborgs” that improve decision making. Human participants and a ResNet undertook the same face-recognition experiment. BCIs were used to decode the decision confidence of humans from their EEG signals. Different types of cyborg groups were created, including either only humans (with or without the BCI) or groups of humans and the ResNet. Cyborg groups decisions were obtained weighing individual decisions by confidence estimates. Results show that groups of cyborgs are significantly more accurate (up to 35%) than the ResNet, the average participant, and equally-sized groups of humans not assisted by technology. These results suggest that melding humans, BCI, and machine-vision technology could significantly improve decision-making in realistic scenarios. [ABSTRACT FROM AUTHOR]

It is evident through biology research that, biological neural network could be implemented through two means: by congenital heredity, or by posteriority learning. However, traditionally, artificial neural network, especially the Deep learning Neural Networks (DNNs) are implemented only through exhaustive training and learning. Fixed structure is built, and then parameters are trained through huge amount of data. In this way, there are a lot of redundancies in the implemented artificial neural network. This redundancy not only requires more effort to train the network, but also costs more computing resources when used. In this paper, we proposed a bionic way to implement artificial neural network through construction rather than training and learning. The hierarchy of the neural network is designed according to analysis of the required functionality, and then module design is carried out to form each hierarchy. We choose the Drosophila’s visual neural network as a test case to verify our method’s validation. The results show that the bionic artificial neural network built through our method could work as a bionic compound eye, which can achieve the detection of the object and their movement, and the results are better on some properties, compared with the Drosophila’s biological compound eyes. [ABSTRACT FROM AUTHOR]

Modality exclusivity norms have been developed in different languages for research on the relationship between perceptual and conceptual systems. This paper sets up the first modality exclusivity norms for Chinese, a Sino-Tibetan language with semantics as its orthographically relevant level. The norms are collected through two studies based on Chinese sensory words. The experimental designs take into consideration the morpho-lexical and orthographic structures of Chinese. Study 1 provides a set of norms for Mandarin Chinese single-morpheme words in mean ratings of the extent to which a word is experienced through the five sense modalities. The degrees of modality exclusivity are also provided. The collected norms are further analyzed to examine how sub-lexical orthographic representations of sense modalities in Chinese characters affect speakers’ interpretation of the sensory words. In particular, we found higher modality exclusivity rating for the sense modality explicitly represented by a semantic radical component, as well as higher auditory dominant modality rating for characters with transparent phonetic symbol components. Study 2 presents the mean ratings and modality exclusivity of coordinate disyllabic compounds involving multiple sense modalities. These studies open new perspectives in the study of modality exclusivity. First, links between modality exclusivity and writing systems have been established which has strengthened previous accounts of the influence of orthography in the processing of visual information in reading. Second, a new set of modality exclusivity norms of compounds is proposed to show the competition of influence on modality exclusivity from different linguistic factors and potentially allow such norms to be linked to studies on synesthesia and semantic transparency. [ABSTRACT FROM AUTHOR]

Classically, in the bouba-kiki association task, a subject is asked to find the best association between one of two shapes–a round one and a spiky one–and one of two pseudowords–bouba and kiki. Numerous studies report that spiky shapes are associated with kiki, and round shapes with bouba. This task is likely the most prevalent in the study of non-conventional relationships between linguistic forms and meanings, also known as sound symbolism. However, associative tasks are explicit in the sense that they highlight phonetic and visual contrasts and require subjects to establish a crossmodal link between stimuli of different natures. Additionally, recent studies have raised the question whether visual resemblances between the target shapes and the letters explain the pattern of association, at least in literate subjects. In this paper, we report a more implicit testing paradigm of the bouba-kiki effect with the use of a lexical decision task with character strings presented in round or spiky frames. Pseudowords and words are, furthermore, displayed with either an angular or a curvy font to investigate possible graphemic bias. Innovative analyses of response times are performed with GAMLSS models, which offer a large range of possible distributions of error terms, and a generalized Gama distribution is found to be the most appropriate. No sound symbolic effect appears to be significant, but an interaction effect is in particular observed between spiky shapes and angular letters leading to faster response times. We discuss these results with respect to the visual saliency of angular shapes, priming, brain activation, synaesthesia and ideasthesia. [ABSTRACT FROM AUTHOR]

Audio description (AD) is one of the main methods that people who are blind or low vision (B/LV) use to access film, television, and theatre content. AD is a second audio track inserted into the space(s) where speech is absent, which tends to be only a few seconds. Contained in that second track is an audio description of the important visual information contained within a specific scene. However, as there is insufficient time to describe all visual information, decisions about what is important to describe and how to present that information (style) to optimize a B/LV viewer’s entertainment experience are required. Most research to date has considered only short-term, single-episode experiences to gauge viewers’ reactions to the AD content. In addition, this research typically has used a monotone, single style of audio description, which is defined as “the conventional style” in this paper. We use an integrative style instead, that is defined as ‘AD designed to fit a specific show”, and differed between shows. We carried out a within-subjects longitudinal study with eight episodes of a dark comedy, using different description styles and describers in order to assess viewer engagement and preferences for AD describer style, language use, timing, and fit to the show. Twenty-four blind participants viewed and rated all eight episodes. Major findings included that most participants found the integrative style entertaining, a fit with the specific episodes, and enjoyable. Some participants, however, preferred the conventional style and struggled with the language and topic of a dark comedy and its associated descriptions. [ABSTRACT FROM AUTHOR]

Patient reported outcome measures (PROMs) become increasingly important for assessing the effectiveness of a drug or medical device. In order for a PROM to be claimed in labeling, the PROM has to be valid, reliable and able to detect a change if the targeted disease status changes. One approach to assess the quality of a patient reported outcome measure (PROM) is to investigate the association between the PROM and an objective clinical endpoint measuring the status of a disease/condition. However, methods assessing the association between continuous and discrete variables are limited, especially for correlated measurements. In this paper, we propose a method to assess such association with any type of samples with or without correlation. The method involves estimating the probability revealing the status of a subject’s disease/condition (called truth thereafter) through the subject’s reported outcomes. The probability is a conditional probability revealing truth given the relative location of the subject’s objective outcome compared to the subject-specific latent threshold in the objective endpoint. A consistent estimator for the probability is derived. The operating characteristics of the consistent estimator are illustrated using simulation. Our method is applied to hypothetical clinical trial data generated for an ophthalmic device as an illustration. [ABSTRACT FROM AUTHOR]

In the human retina, rod and cone cells detect incoming light with a molecule called rhodopsin. After rhodopsin molecules are activated (by photon impact), these molecules activate the rest of the signalling process for a brief period of time until they are deactivated by a multistage process. First, active rhodopsin is phosphorylated multiple times. Following this, they are further inhibited by the binding of molecules called arrestins. Finally, they decay into opsins. The time required for each of these stages becomes progressively longer, and each stage further reduces the activity of rhodopsin. However, while this deactivation process itself is well researched, the roles of the above stages in signal (and image) processing are poorly understood. In this paper, we will show that the activity of rhodopsin molecules during the deactivation process can be described as the fractional integration of an incoming signal. Furthermore, we show how this affects an image; specifically, the effect of fractional integration in video and signal processing and how it reduces noise and the improves adaptability under different lighting conditions. Our experimental results provide a better understanding of vertebrate and human vision, and why the rods and cones of the retina differ from the light detectors in cameras. [ABSTRACT FROM AUTHOR]

Minimization functionals related to Euler’s elastica energy has a broad range of applications in computer vision and image processing. This paper proposes a novel Euler’s elastica and curvature-based variational model for image restoration corrupted with multiplicative noise. It combines Euler’s elastica curvature with a Weberized total variation (TV) regularization and gets a novel Euler’s elastica energy and TV-based minimization functional. The combined approach in this variational model can preserve edges while reducing the blocky effect in smooth regions. The implicit gradient descent scheme is applied to efficiently finding the minimizer of the proposed functional. Experimental results demonstrate the effectiveness of the proposed model in visual improvement, as well as an increase in the peak signal-to-noise ratio, compared to the PDE-based methods. [ABSTRACT FROM AUTHOR]

The last decade has seen the emergence of new views about the mechanisms underlying specificity (or, conversely, generalization) of visual skill learning. Here, we trained participants at orientation discrimination paradigm at a peripheral position to induce position and orientation specificity and to test its underlying mechanisms. Specifically, we aimed to test whether the within-quadrant spatial gradient of generalization is determined by cortical magnification, which would show that retinotopic plasticity contributes to learning and specificity. Additionally, we aimed to test whether late parts of the learning relate differently to specificity compared to early parts. This is relevant in the context of double training papers, which suggest that rule-based mechanisms of specificity in fast, early learning also would apply to late, slower learning. Our data showed partial but significant position and orientation specificity within quadrants. Interestingly, specificity was greatest for those participants who had continued to show threshold decreases during the last five sessions of training (late, asymptotic learning). Performance gains during early learning were less related to specificity. A trend for skill to spread over larger distances towards periphery than towards central vision suggested contributions to transfer of early visual areas showing cortical magnification of central vision. Control experiments however did not support this hypothesis. In summary, our study demonstrates significant specificity after extensive perceptual learning, and indicates that asymptotic learning recruits specific mechanisms that promote specificity, and that may not be recruited yet in early parts of the learning. The contributions of different mechanisms to early and late learning suggests that following these different learning periods, generalization relies on different principles and is subjected to different limits. [ABSTRACT FROM AUTHOR]

Purpose: To test to what degree retinal fluid (RF) after the loading phase and at the end of year 1 predicts long-term functional outcomes in neovascular macular degeneration (nAMD), as do macular (MA) atrophy, treatment density and treatment interval extension. Methods: In this retrospective single-center cohort study, a consecutive series of eyes with treatment-naïve nAMD followed under a treat-and-extend (T&E) protocol followed over ≥2 years. Best-corrected visual acuity (BCVA), presence of retinal fluid (RF) and macular atrophy (MA) were registered along with central retinal thickness (CRT) and treatment density over time. The relationship between these variables was tested by regression analysis. Results: A total of 433 eyes were followed for 4.9 ± 2.2 years. A series of univariate analyses were run to select the covariates for the final multivariate regression model. CRT after loading, time to dryness, intraretinal fluid and MA after one year were found to predict visual function over 2 to 5 years. A final regression model was adjusted for visual acuity (VA) at baseline and showed that CRT after loading was predictive only in the short term (2 years) and that MA had the greatest predictive value for VA after 2 to 5 years. Intraretinal fluid (IRF) significantly predicted VA only after 4 years. The final regression model explained 21 to 32% of the variation in VA. Conclusions: In this large retrospective cohort, the presence of MA after one year was the strongest predictor of VA after 2 to 5 years, explaining a vision loss of 13 to 20 letters. The presence of IRF and SRF at any point of time had a comparably weak predictive potential for the outcomes over 5 and more years. [ABSTRACT FROM AUTHOR]

Purpose: To develop and validate a holography based vision simulator for the demonstration of expected postoperative vision corresponding to monofocal and multifocal intraocular lenses (IOL) to cataract patients before surgery. Methods: An artificial eye model is used to measure the optical performance of different IOL types. The resultant aberrations and degradations are then modeled using phase holograms and shown to subjects on a holographic display. We measure the contrast and resolution loss, halos around the light sources, and point spread function (PSF) corresponding to three different IOLs. We tested the holography based vision simulator on 13 healthy subjects and 6 cataract patients. Results: Monofocal, bifocal, and trifocal IOLs exhibited a contrast decrease of 5%, 42%, and 45% and a resolution limit of 4.49, 4.00, and 4.00 lp/mm (using 0.05 MTF criteria), respectively. Monofocal IOLs have the best resolution and contrast at the optimal focus distance, and multifocal lenses offer extended depth-of-field but exhibit prominent halos and reduced contrast/resolution. Conclusion: We confirmed that the visual functions of IOLs could be successfully modeled using phase holograms and simulated using a holographic display without using a physical IOL. Patients can experience the effects of different IOL options prior to surgery, which helps with IOL selection, expectation management, and patient satisfaction. [ABSTRACT FROM AUTHOR]

Purpose: In patients with diabetic macular edema (DME) from YOSEMITE/RHINE, dual angiopoietin-2/vascular endothelial growth factor-A (VEGF-A) inhibition with faricimab resulted in visual/anatomic improvements with extended dosing. The SWAN trial (jRCTs031230213) will assess the efficacy, durability, and safety of faricimab during the treatment maintenance phase in patients with DME using a treat-and-extend (T&E)-based regimen adapted to clinical practice and the characteristics of patients achieving extended dosing intervals. Methods: SWAN is a 2-year, open-label, single-arm, interventional, multicenter trial enrolling adults with center-involving DME. All patients will receive three initial faricimab 6.0 mg doses every 4 weeks (Q4W). From week 12 onwards, in patients without active DME, dosing intervals will be extended in 8-week increments up to Q24W. In contrast, patients with active DME (central subfield thickness [CST] >325 μm and intraretinal fluid [IRF] or subretinal fluid [SRF] resulting in vision loss/disease aggravation) will receive a dose within a day and the dosing interval will be shortened by 4 weeks to a minimum of Q8W relative to the previous dosing interval. Recruitment commenced in August 2023 across a planned 16 sites in Japan. Results: The primary endpoint is change in best-corrected visual acuity (BCVA) from baseline at 1 year (averaged over weeks 52, 56, and 60). Key secondary endpoints include: change from baseline in BCVA, CST, and National Eye Institute Visual Function Questionnaire scores over time; proportion of patients with BCVA (decimal visual acuity) ≥0.5, ≥0.7, ≥1.0, or ≤0.1; proportion of patients with absence of DME, and IRF and/or SRF over time. Safety endpoints include incidence/severity of ocular/nonocular adverse events. Conclusions: The SWAN trial is expected to provide evidence to support individualized faricimab dosing regimens, with the potential to reduce the burden of frequent treatments on patients, caregivers, and healthcare systems. [ABSTRACT FROM AUTHOR]

Contrary to popular lore, optimal visual acuity is typically better than 20/20. Could correcting acuity beyond 20/20 offer any benefit? An affirmative answer could present new confounds in studies of aging, development, psychiatric illness, neurodegenerative disorders, or any other population where refractive error might be more likely. An affirmative answer would also offer a novel explanation of inter-observer variability in visual performance. To address the question, we had individuals perform two well-studied visual tasks, once with 20/20 vision and once with optical correction, so that observers could see one line better on an eye chart. In the contour integration task, observers sought to identify the screen quadrant location of a sparsely defined (integrated) shape embedded in varying quantities of randomly oriented "noise" elements. In the collinear facilitation task, observers sought to detect a low-contrast element flanked by collinear or orthogonal high-contrast elements. In each case, displays were scaled in size to modulate element visibility and spatial frequency (4–12 cycles/deg). We found that improving acuity beyond 20/20 improved contour integration for the high spatial frequency displays. Although improving visual acuity did not affect collinear facilitation, it did improve detection of the central low-contrast target, especially at high spatial frequencies. These results, which were large in magnitude, suggest that optically correcting beyond 20/20 improves the detection and integration of contour elements, especially those that are smaller and of higher spatial frequency. Refractive blur within the normal range may confound special population studies, explain inter-observer differences, and meaningfully impact performance in low-visibility environments. [ABSTRACT FROM AUTHOR]

Purpose: To investigate pre-, intra-, and postoperative factors influencing postoperative visual acuity, degree of metamorphopsia, and retinal sensitivity after vitrectomy in patients with rhegmatogenous retinal detachment and foveal detachment. Methods: We reviewed retrospectively 33 consecutive eyes of 32 patients, who underwent vitrectomy for rhegmatogenous retinal detachment with foveal detachment between August 2018 and October 2020 and obtained retinal reattachment. Pre-, intra-, and postoperative characteristics were comprehensively analyzed using multivariate models to evaluate the presence of factors influencing best-corrected visual acuity, vertical/horizontal metamorphopsia scores using M-CHARTS (Inami & Co., Ltd., Tokyo, Japan), and retinal sensitivity using the MP-3 (NIDEK Co., Aichi, Japan) at 1-year postoperatively. Results: Preoperative total retinal detachment was the only factor significantly associated with worse best-corrected visual acuity at 1-year postoperatively (β = 0.589, P<0.001). Intraoperative internal limiting membrane peeling (β = 0.443, P = 0.003) and longer duration after recognizing visual dysfunction (β = 0.425, P = 0.005) were significantly associated with higher vertical metamorphopsia scores at 1 year. The horizontal metamorphopsia score was significantly related to the duration after recognizing visual dysfunction (β = 0.457, P = 0.008). The disappearance of the EZ line on optical coherence tomography at 3 months postoperatively (β = −0.638, P<0.001) was significantly associated with lower retinal sensitivity at 1 year. Conclusions: Our study findings suggest that best-corrected visual acuity, metamorphopsia, and retinal sensitivity at 1 year after vitrectomy for rhegmatogenous retinal detachment with foveal detachment are influenced by distinct factors. [ABSTRACT FROM AUTHOR]

Knowledge of the human visual system helps to develop better computational models of visual attention. State-of-the-art models have been developed to mimic the visual attention system of young adults that, however, largely ignore the variations that occur with age. In this paper, we investigated how visual scene processing changes with age and we propose an age-adapted framework that helps to develop a computational model that can predict saliency across different age groups. Our analysis uncovers how the explorativeness of an observer varies with age, how well saliency maps of an age group agree with fixation points of observers from the same or different age groups, and how age influences the center bias tendency. We analyzed the eye movement behavior of 82 observers belonging to four age groups while they explored visual scenes. Explorative- ness was quantified in terms of the entropy of a saliency map, and area under the curve (AUC) metrics was used to quantify the agreement analysis and the center bias tendency. Analysis results were used to develop age adapted saliency models. Our results suggest that the proposed age-adapted saliency model outperforms existing saliency models in predicting the regions of interest across age groups. [ABSTRACT FROM AUTHOR]

Event-related potential (ERP) studies feature among the most cited papers in the field of body representation, with recent research highlighting the potential of ERPs as neuropsychiatric biomarkers. Despite this, investigation into how reliable early visual ERPs and body-sensitive effects are over time has been overlooked. This study therefore aimed to assess the stability of early body-sensitive effects and visual P1, N1 and VPP responses. Participants were asked to identify pictures of their own bodies, other bodies and houses during an EEG test session that was completed at the same time, once a week, for four consecutive weeks. Results showed that amplitude and latency of early visual components and their associated body-sensitive effects were stable over the 4-week period. Furthermore, correlational analyses revealed that VPP component amplitude might be more reliable than VPP latency and specific electrode sites might be more robust indicators of body-sensitive cortical activity than others. These findings suggest that visual P1, N1 and VPP responses, alongside body-sensitive N1/VPP effects, are robust indications of neuronal activity. We conclude that these components are eligible to be considered as electrophysiological biomarkers relevant to body representation. [ABSTRACT FROM AUTHOR]

The waggle dance is one of the most popular examples of animal communication. Forager bees direct their nestmates to profitable resources via a complex motor display. Essentially, the dance encodes the polar coordinates to the resource in the field. Unemployed foragers follow the dancer’s movements and then search for the advertised spots in the field. Throughout the last decades, biologists have employed different techniques to measure key characteristics of the waggle dance and decode the information it conveys. Early techniques involved the use of protractors and stopwatches to measure the dance orientation and duration directly from the observation hive. Recent approaches employ digital video recordings and manual measurements on screen. However, manual approaches are very time-consuming. Most studies, therefore, regard only small numbers of animals in short periods of time. We have developed a system capable of automatically detecting, decoding and mapping communication dances in real-time. In this paper, we describe our recording setup, the image processing steps performed for dance detection and decoding and an algorithm to map dances to the field. The proposed system performs with a detection accuracy of 90.07%. The decoded waggle orientation has an average error of -2.92° (± 7.37°), well within the range of human error. To evaluate and exemplify the system’s performance, a group of bees was trained to an artificial feeder, and all dances in the colony were automatically detected, decoded and mapped. The system presented here is the first of this kind made publicly available, including source code and hardware specifications. We hope this will foster quantitative analyses of the honey bee waggle dance. [ABSTRACT FROM AUTHOR]

This paper investigates the influence of depth of field on change detection in both pictorial and solid scenes. In this work, a within-subjects experiment is conducted using a flicker paradigm, with which the hit rate and response time for change detection are obtained. The results show that depth of field has effects on change detection: the hit rate is smaller and response time is longer in the scene with small depth of field than in the scene with large depth of field or uniform blur. It is concluded that when depth of field is small and binocular disparity is not zero in a picture, the influence of depth of field on change detection is more significant than binocular disparity. This conclusion leads to the result that the change in the sharp area is detected easier and faster than in the area that is closer to the observer. [ABSTRACT FROM AUTHOR]

Emotions play a significant role in internal regulatory processes. In this paper, we advocate four key ideas. First, novelty detection can be grounded in the sensorimotor experience and allow higher order appraisal. Second, cognitive processes, such as those involved in self-assessment, influence emotional states by eliciting affects like boredom and frustration. Third, emotional processes such as those triggered by self-assessment influence attentional processes. Last, close emotion-cognition interactions implement an efficient feedback loop for the purpose of top-down behavior regulation. The latter is what we call ‘Emotional Metacontrol’. We introduce a model based on artificial neural networks. This architecture is used to control a robotic system in a visual search task. The emotional metacontrol intervenes to bias the robot visual attention during active object recognition. Through a behavioral and statistical analysis, we show that this mechanism increases the robot performance and fosters the exploratory behavior to avoid deadlocks. [ABSTRACT FROM AUTHOR]

In recent years, image databases are growing at exponential rates, making their management, indexing, and retrieval, very challenging. Typical image retrieval systems rely on sample images as queries. However, in the absence of sample query images, hand-drawn sketches are also used. The recent adoption of touch screen input devices makes it very convenient to quickly draw shaded sketches of objects to be used for querying image databases. This paper presents a mechanism to provide access to visual information based on users’ hand-drawn partially colored sketches using touch screen devices. A key challenge for sketch-based image retrieval systems is to cope with the inherent ambiguity in sketches due to the lack of colors, textures, shading, and drawing imperfections. To cope with these issues, we propose to fine-tune a deep convolutional neural network (CNN) using augmented dataset to extract features from partially colored hand-drawn sketches for query specification in a sketch-based image retrieval framework. The large augmented dataset contains natural images, edge maps, hand-drawn sketches, de-colorized, and de-texturized images which allow CNN to effectively model visual contents presented to it in a variety of forms. The deep features extracted from CNN allow retrieval of images using both sketches and full color images as queries. We also evaluated the role of partial coloring or shading in sketches to improve the retrieval performance. The proposed method is tested on two large datasets for sketch recognition and sketch-based image retrieval and achieved better classification and retrieval performance than many existing methods. [ABSTRACT FROM AUTHOR]

Medical image collections contain a wealth of information which can assist radiologists and medical experts in diagnosis and disease detection for making well-informed decisions. However, this objective can only be realized if efficient access is provided to semantically relevant cases from the ever-growing medical image repositories. In this paper, we present an efficient method for representing medical images by incorporating visual saliency and deep features obtained from a fine-tuned convolutional neural network (CNN) pre-trained on natural images. Saliency detector is employed to automatically identify regions of interest like tumors, fractures, and calcified spots in images prior to feature extraction. Neuronal activation features termed as neural codes from different CNN layers are comprehensively studied to identify most appropriate features for representing radiographs. This study revealed that neural codes from the last fully connected layer of the fine-tuned CNN are found to be the most suitable for representing medical images. The neural codes extracted from the entire image and salient part of the image are fused to obtain the saliency-injected neural codes (SiNC) descriptor which is used for indexing and retrieval. Finally, locality sensitive hashing techniques are applied on the SiNC descriptor to acquire short binary codes for allowing efficient retrieval in large scale image collections. Comprehensive experimental evaluations on the radiology images dataset reveal that the proposed framework achieves high retrieval accuracy and efficiency for scalable image retrieval applications and compares favorably with existing approaches. [ABSTRACT FROM AUTHOR]

A subset of neurons in the posterior parietal and premotor areas of the primate brain respond to the locations of visual targets in a hand-centred frame of reference. Such hand-centred visual representations are thought to play an important role in visually-guided reaching to target locations in space. In this paper we show how a biologically plausible, Hebbian learning mechanism may account for the development of localized hand-centred representations in a hierarchical neural network model of the primate visual system, VisNet. The hand-centered neurons developed in the model use an invariance learning mechanism known as continuous transformation (CT) learning. In contrast to previous theoretical proposals for the development of hand-centered visual representations, CT learning does not need a memory trace of recent neuronal activity to be incorporated in the synaptic learning rule. Instead, CT learning relies solely on a Hebbian learning rule, which is able to exploit the spatial overlap that naturally occurs between successive images of a hand-object configuration as it is shifted across different retinal locations due to saccades. Our simulations show how individual neurons in the network model can learn to respond selectively to target objects in particular locations with respect to the hand, irrespective of where the hand-object configuration occurs on the retina. The response properties of these hand-centred neurons further generalise to localised receptive fields in the hand-centred space when tested on novel hand-object configurations that have not been explored during training. Indeed, even when the network is trained with target objects presented across a near continuum of locations around the hand during training, the model continues to develop hand-centred neurons with localised receptive fields in hand-centred space. With the help of principal component analysis, we provide the first theoretical framework that explains the behavior of Hebbian learning in VisNet. [ABSTRACT FROM AUTHOR]

Neural mechanisms which bind items into sequences have been investigated in a large body of research in animal neurophysiology and human neuroimaging. However, a major problem in interpreting this data arises from a fact that several unrelated processes, such as memory load, sensory adaptation, and reward expectation, also change in a consistent manner as the sequence unfolds. In this paper we use computational simulations and data from two fMRI experiments to show that a host of unrelated neural processes can masquerade as sequence representations. We show that dissociating such unrelated processes from a dedicated sequence representation is an especially difficult problem for fMRI data, which is almost exclusively the modality used in human experiments. We suggest that such fMRI results must be treated with caution and in many cases the assumed neural representation might actually reflect unrelated processes. [ABSTRACT FROM AUTHOR]

A new Brain-Computer Interface (BCI) technique, which is called a hybrid BCI, has recently been proposed to address the limitations of conventional single BCI system. Although some hybrid BCI studies have shown promising results, the field of hybrid BCI is still in its infancy and there is much to be done. Especially, since the hybrid BCI systems are so complicated and complex, it is difficult to understand the constituent and role of a hybrid BCI system at a glance. Also, the complicated and complex systems make it difficult to evaluate the usability of the systems. We systematically reviewed and analyzed the current state-of-the-art hybrid BCI studies, and proposed a systematic taxonomy for classifying the types of hybrid BCIs with multiple taxonomic criteria. After reviewing 74 journal articles, hybrid BCIs could be categorized with respect to 1) the source of brain signals, 2) the characteristics of the brain signal, and 3) the characteristics of operation in each system. In addition, we exhaustively reviewed recent literature on usability of BCIs. To identify the key evaluation dimensions of usability, we focused on task and measurement characteristics of BCI usability. We classified and summarized 31 BCI usability journal articles according to task characteristics (type and description of task) and measurement characteristics (subjective and objective measures). Afterwards, we proposed usability dimensions for BCI and hybrid BCI systems according to three core-constructs: Satisfaction, effectiveness, and efficiency with recommendations for further research. This paper can help BCI researchers, even those who are new to the field, can easily understand the complex structure of the hybrid systems at a glance. Recommendations for future research can also be helpful in establishing research directions and gaining insight in how to solve ergonomics and HCI design issues surrounding BCI and hybrid BCI systems by usability evaluation. [ABSTRACT FROM AUTHOR]

The optomotor response of animals is commonly used to measure their visual performance, e.g., rats of different genetically altered strains or various drug tests. With the presentation of stimuli using computer screens or projectors, the common idea focuses on measuring the eye movement or head and/or body movement to characterize changes of the head gaze. However, traditional methods rely on either the invasive fixation of animals, or the judgment of a human observer who reports the stimulus-tracking movements. In this paper, we propose a novel head gaze determination system to automatically track the head movement of rats without artificial markers. The experiments were done to demonstrate the process of optimizing parameters in image processing. As a result, the head angle curve of the proposed method is consistent with that of ground-truth data annotated manually according to predefined rules. Hence, the proposed method provides a simple, convenient, and objective solution to automatically generate the head gaze orientations from massive amounts of recorded data for further visual performance analysis. [ABSTRACT FROM AUTHOR]

Music training can improve cognitive functions. Previous studies have shown that children and adults with music training demonstrate better verbal learning and memory performance than those without such training. Although prior studies have shown an association between music training and changes in the structural and functional organization of the brain, there is no concrete evidence of the underlying neural correlates of the verbal memory encoding phase involved in such enhanced memory performance. Therefore, we carried out an electroencephalography (EEG) study to investigate how music training was associated with brain activity during the verbal memory encoding phase. Sixty participants were recruited, 30 of whom had received music training for at least one year (the MT group) and 30 of whom had never received music training (the NMT group). The participants in the two groups were matched for age, education, gender distribution, and cognitive capability. Their verbal and visual memory functions were assessed using standardized neuropsychological tests and EEG was used to record their brain activity during the verbal memory encoding phase. Consistent with previous studies, the MT group demonstrated better verbal memory than the NMT group during both the learning and the delayed recall trials in the paper-and-pencil tests. The MT group also exhibited greater learning capacity during the learning trials. Compared with the NMT group, the MT group showed an increase in long-range left and right intrahemispheric EEG coherence in the theta frequency band during the verbal memory encoding phase. In addition, their event-related left intrahemispheric theta coherence was positively associated with subsequent verbal memory performance as measured by discrimination scores. These results suggest that music training may modulate the cortical synchronization of the neural networks involved in verbal memory formation. [ABSTRACT FROM AUTHOR]

Purpose: Stereopsis is a critical visual function, however clinical stereotests are time-consuming, coarse in resolution, suffer memorization artifacts, poor repeatability, and low agreement with other tests. Foraging Interactive D-prime (FInD) Stereo and Angular Indication Measurement (AIM) Stereo were designed to address these problems. Here, their performance was compared with 2-Alternative-Forced-Choice (2-AFC) paradigms (FInD Stereo only) and clinical tests (Titmus and Randot) in 40 normally-sighted and 5 binocularly impaired participants (FInD Stereo only). Methods: During FInD tasks, participants indicated which cells in three 4*4 charts of bandpass-filtered targets (1,2,4,8c/° conditions) contained depth, compared with 2-AFC and clinical tests. During the AIM task, participants reported the orientation of depth-defined bars in three 4*4 charts. Stereoscopic disparity was adaptively changed after each chart. Inter-test agreement, repeatability and duration were compared. Results: Test duration was significantly longer for 2-AFC (mean = 317s;79s per condition) than FInD (216s,18s per chart), AIM (179s, 60s per chart), Titmus (66s) or RanDot (97s). Estimates of stereoacuity differed across tests and were higher by a factor of 1.1 for AIM and 1.3 for FInD. No effect of stimulus spatial frequency was found. Agreement among tests was generally low (R2 = 0.001 to 0.24) and was highest between FInD and 2-AFC (R2 = 0.24;p<0.01). Stereoacuity deficits were detected by all tests in binocularly impaired participants. Conclusions: Agreement among all tests was low. FInD and AIM inter-test agreement was comparable with other methods. FInD Stereo detected stereo deficits and may only require one condition to identify these deficits. AIM and FInD are response-adaptive, self-administrable methods that can estimate stereoacuity reliably within one minute. [ABSTRACT FROM AUTHOR]