Search

Predicting human gaze behavior within computer vision is integral for developing interactive systems that can anticipate user attention, address fundamental questions in cognitive science, and hold implications for fields like human-computer interaction (HCI) and augmented/virtual reality (AR/VR) systems. Despite methodologies introduced for modeling human eye gaze behavior, applying these models to medical imaging for scanpath prediction remains unexplored. Our proposed system aims to predict eye gaze sequences from radiology reports and CXR images, potentially streamlining data collection and enhancing AI systems using larger datasets. However, predicting human scanpaths on medical images presents unique challenges due to the diverse nature of abnormal regions. Our model predicts fixation coordinates and durations critical for medical scanpath prediction, outperforming existing models in the computer vision community. Utilizing a two-stage training process and large publicly available datasets, our approach generates static heatmaps and eye gaze videos aligned with radiology reports, facilitating comprehensive analysis. We validate our approach by comparing its performance with state-of-the-art methods and assessing its generalizability among different radiologists, introducing novel strategies to model radiologists' search patterns during CXR image diagnosis. Based on the radiologist's evaluation, MedGaze can generate human-like gaze sequences with a high focus on relevant regions over the CXR images. It sometimes also outperforms humans in terms of redundancy and randomness in the scanpaths., Comment: Submitted to the Journal

Human-AI collaboration to identify and correct perceptual errors in chest radiographs has not been previously explored. This study aimed to develop a collaborative AI system, CoRaX, which integrates eye gaze data and radiology reports to enhance diagnostic accuracy in chest radiology by pinpointing perceptual errors and refining the decision-making process. Using public datasets REFLACX and EGD-CXR, the study retrospectively developed CoRaX, employing a large multimodal model to analyze image embeddings, eye gaze data, and radiology reports. The system's effectiveness was evaluated based on its referral-making process, the quality of referrals, and performance in collaborative diagnostic settings. CoRaX was tested on a simulated error dataset of 271 samples with 28% (93 of 332) missed abnormalities. The system corrected 21% (71 of 332) of these errors, leaving 7% (22 of 312) unresolved. The Referral-Usefulness score, indicating the accuracy of predicted regions for all true referrals, was 0.63 (95% CI 0.59, 0.68). The Total-Usefulness score, reflecting the diagnostic accuracy of CoRaX's interactions with radiologists, showed that 84% (237 of 280) of these interactions had a score above 0.40. In conclusion, CoRaX efficiently collaborates with radiologists to address perceptual errors across various abnormalities, with potential applications in the education and training of novice radiologists., Comment: Under Review in Journal

The charge equilibration of laser-accelerated carbon ion beams in 2 mg/cm3 foam target was investigated experimentally. The ions were generated through target normal sheath acceleration mechanism in laser-foil interaction scheme. This allows to get the equilibrium charge state in wide energy range near Bragg peak within a single shot. By using foam, the charge equilibration measurement in density regime between gas and solid state was firstly reached out experimentally. It was found that the theoretical predictions with tabulated cross section data for gas target greatly underestimated the charge states. The experimental data are in close agreement with both semi-empirical formula as well as rate equation predictions based on ion-solid interactions. The important role of target density effects that increase the ionization probability and decrease the electron capture probability through frequent multi-collisions in foam are demonstrated. The double electron processes are shown to have little influence on the average charge states. The findings are essential for high energy density physics research where the foams are widely used, and have impacts on a broad range of applications in medical, biological and material fields. The method also provides a new approach to investigate the interaction mechanism of swift heavy ions in matter by taking advantage of the laser-accelerated short-pulse wide-energy range ions.

Nuclear isomers play a key role in the creation of the elements in the universe and have a number of fascinating potential applications related to the controlled release of nuclear energy on demand. Particularly, $^{93m}$Mo isomer is a good candidate for studying the depletion of nuclear isomer via nuclear excitation by electron capture. For such purposes, efficient approach for $^{93m}$Mo production needs to be explored. In the present work, we demonstrate experimentally an efficient production of $^{93m}$Mo through $^{93}$Nb(p, n) reaction induced by intense laser pulse. When a ps-duration, 100-J laser pulse is employed, the $^{93m}$Mo isomer at 2425 keV (21/2$^+$, $T_{1/2}$ = 6.85 h) are generated with a high yield of $1.8\times10^6$ particles/shot. The resulting peak efficiency is expected to be $10^{17}$ particles/s, which is at least five orders of magnitudes higher than using classical proton accelerator. The effects of production and destruction of $^{93m}$Mo on the controversial astrophysical p-isotope $^{92}$Mo are studied. It is found that the $^{93}$Nb(p, n)-$^{93m}$Mo reaction is an important production path for ^{93m}Mo seed nucleus, and the influence of ^{93m}Mo-^{92}Mo reaction flow on ^{92}Mo production cannot be ignored. In addition, we propose to directly measure the astrophysical rate of (p, n) reaction using laser-induced proton beam since the latter one fits the Maxwell-Boltzmann distribution well. We conclude that laser-induced proton beam opens a new path to produce nuclear isomers with high peak efficiency towards the understanding of p-nuclei nucleosythesis., Comment: 21 pages, 9 figure

Thoroughly understanding the transport and energy loss of intense ion beams in dense matter is essential for high-energy-density physics and inertial confinement fusion. Here, we report a stopping power experiment with a high-intensity laser-driven proton beam in cold, dense matter. The measured energy loss is one order of magnitude higher than the expectation of individual particle stopping models. We attribute this finding to the proximity of beam ions to each other, which is usually insignificant for relatively-low-current beams from classical accelerators. The ionization of the cold target by the intense ion beam is important for the stopping power calculation and has been considered using proper ionization cross section data. Final theoretical values agree well with the experimental results. Additionally, we extend the stopping power calculation for intense ion beams to plasma scenario based on Ohm's law. Both the proximity- and the Ohmic effect can enhance the energy loss of intense beams in dense matter, which are also summarized as the beam-density effect. This finding is useful for the stopping power estimation of intense beams and significant to fast ignition fusion driven by intense ion beams.

Expressions and facial action units (AUs) are two levels of facial behavior descriptors. Expression auxiliary information has been widely used to improve the AU detection performance. However, most existing expression representations can only describe pre-determined discrete categories (e.g., Angry, Disgust, Happy, Sad, etc.) and cannot capture subtle expression transformations like AUs. In this paper, we propose a novel fine-grained \textsl{Global Expression representation Encoder} to capture subtle and continuous facial movements, to promote AU detection. To obtain such a global expression representation, we propose to train an expression embedding model on a large-scale expression dataset according to global expression similarity. Moreover, considering the local definition of AUs, it is essential to extract local AU features. Therefore, we design a \textsl{Local AU Features Module} to generate local facial features for each AU. Specifically, it consists of an AU feature map extractor and a corresponding AU mask extractor. First, the two extractors transform the global expression representation into AU feature maps and masks, respectively. Then, AU feature maps and their corresponding AU masks are multiplied to generate AU masked features focusing on local facial region. Finally, the AU masked features are fed into an AU classifier for judging the AU occurrence. Extensive experiment results demonstrate the superiority of our proposed method. Our method validly outperforms previous works and achieves state-of-the-art performances on widely-used face datasets, including BP4D, DISFA, and BP4D+.

Since Facial Action Unit (AU) annotations require domain expertise, common AU datasets only contain a limited number of subjects. As a result, a crucial challenge for AU detection is addressing identity overfitting. We find that AUs and facial expressions are highly associated, and existing facial expression datasets often contain a large number of identities. In this paper, we aim to utilize the expression datasets without AU labels to facilitate AU detection. Specifically, we develop a novel AU detection framework aided by the Global-Local facial Expressions Embedding, dubbed GLEE-Net. Our GLEE-Net consists of three branches to extract identity-independent expression features for AU detection. We introduce a global branch for modeling the overall facial expression while eliminating the impacts of identities. We also design a local branch focusing on specific local face regions. The combined output of global and local branches is firstly pre-trained on an expression dataset as an identity-independent expression embedding, and then finetuned on AU datasets. Therefore, we significantly alleviate the issue of limited identities. Furthermore, we introduce a 3D global branch that extracts expression coefficients through 3D face reconstruction to consolidate 2D AU descriptions. Finally, a Transformer-based multi-label classifier is employed to fuse all the representations for AU detection. Extensive experiments demonstrate that our method significantly outperforms the state-of-the-art on the widely-used DISFA, BP4D and BP4D+ datasets.

We report on charge state measurements of laser-accelerated carbon ions in the energy range of several MeV penetrating a dense partially ionized plasma. The plasma was generated by irradiation of a foam target with laser-induced hohlraum radiation in the soft X-ray regime. We used the tri-cellulose acetate (C$_{9}$H$_{16}$O$_{8}$) foam of 2 mg/cm$^{-3}$ density, and $1$-mm interaction length as target material. This kind of plasma is advantageous for high-precision measurements, due to good uniformity and long lifetime compared to the ion pulse length and the interaction duration. The plasma parameters were diagnosed to be T$_{e}$=17 eV and n$_{e}$=4 $\times$ 10$^{20}$ cm$^{-3}$. The average charge states passing through the plasma were observed to be higher than those predicted by the commonly-used semiempirical formula. Through solving the rate equations, we attribute the enhancement to the target density effects which will increase the ionization rates on one hand and reduce the electron capture rates on the other hand. In previsous measurement with partially ionized plasma from gas discharge and z-pinch to laser direct irradiation, no target density effects were ever demonstrated. For the first time, we were able to experimentally prove that target density effects start to play a significant role in plasma near the critical density of Nd-Glass laser radiation. The finding is important for heavy ion beam driven high energy density physics and fast ignitions., Comment: 7 pages, 4 figures, 35 conferences

We present an innovative framework, Crowdsourcing Autonomous Traffic Simulation (CATS) framework, in order to safely implement and realize orderly traffic flows. We firstly provide a semantic description of the CATS framework using theories of economics to construct coupling constraints among drivers, in which drivers monitor each other by making use of transportation resources and driving credit. We then introduce an emotion-based traffic simulation, which utilizes the Weber-Fechner law to integrate economic factors into drivers' behaviors. Simulation results show that the CATS framework can significantly reduce traffic accidents and improve urban traffic conditions.

Ultrahigh-intensity lasers (10$^{18}$-10$^{22}$W/cm$^{2}$) have opened up new perspectives in many fields of research and application [1-5]. By irradiating a thin foil, an ultrahigh accelerating field (10$^{12}$ V/m) can be formed and multi-MeV ions with unprecedentedly high intensity (10$^{10}$A/cm$^2$) in short time scale ($\sim$ps) are produced [6-14]. Such beams provide new options in radiography [15], high-yield neutron sources [16], high-energy-density-matter generation [17], and ion fast ignition [18,19]. An accurate understanding of the nonlinear behavior of beam transport in matter is crucial for all these applications. We report here the first experimental evidence of anomalous stopping of a laser-generated high-current proton beam in well-characterized dense ionized matter. The observed stopping power is one order of magnitude higher than single-particle slowing-down theory predictions. We attribute this phenomenon to collective effects where the intense beam drives an decelerating electric field approaching 1GV/m in the dense ionized matter. This finding will have considerable impact on the future path to inertial fusion energy., Comment: 8 pages, 4 figures

In this paper we present a novel crowd simulation method by modeling the generation and contagion of panic emotion under multi-hazard circumstances. Specifically, we first classify hazards into different types (transient and persistent, concurrent and non-concurrent, static and dynamic ) based on their inherent characteristics. Then, we introduce the concept of perilous field for each hazard and further transform the critical level of the field to its invoked-panic emotion. After that, we propose an emotional contagion model to simulate the evolving process of panic emotion caused by multiple hazards in these situations. Finally, we introduce an Emotional Reciprocal Velocity Obstacles (ERVO) model to simulate the crowd behaviors by augmenting the traditional RVO model with emotional contagion, which combines the emotional impact and local avoidance together for the first time. Our experimental results show that this method can soundly generate realistic group behaviors as well as panic emotion dynamics in a crowd in multi-hazard environments., Comment: Already accepted by IEEE Transactions on Systems, Man, and Cybernetics 2019, 15 pages and 13 figures

Increasing attention is being given to the modeling and simulation of traffic flow and crowd movement, two phenomena that both deal with interactions between pedestrians and cars in many situations. In particular, crowd simulation is important for understanding mobility and transportation patterns. In this paper, we propose an emotion-based crowd simulation model integrating physical strength consumption. Inspired by the theory of "the devoted actor," the movements of each individual in our model are determined by modeling the influence of physical strength consumption and the emotion of panic. In particular, human physical strength consumption is computed using a physics-based numerical method. Inspired by the James-Lange theory, panic levels are estimated by means of an enhanced emotional contagion model that leverages the inherent relationship between physical strength consumption and panic. To the best of our knowledge, our model is the first method integrating physical strength consumption into an emotion-based crowd simulation model by exploiting the relationship between physical strength consumption and emotion. We highlight the performance on different scenarios and compare the resulting behaviors with real-world video sequences. Our approach can reliably predict changes in physical strength consumption and panic levels of individuals in an emergency situation.