Search

Vehicle-to-everything (V2X) communication is pivotal in enhancing cooperative awareness in vehicular networks. Typically, awareness is viewed as a vehicle's ability to perceive and share real-time kinematic information. We present a novel definition of awareness in V2X communications, conceptualizing it as a multi-faceted concept involving vehicle detection, tracking, and maintaining their safety distances. To enhance this awareness, we propose a deep reinforcement learning framework for the joint control of beacon rate and transmit power (DRL-JCBRTP). Our DRL−JCBRTP framework integrates LSTM-based actor networks and MLP-based critic networks within the Soft Actor-Critic (SAC) algorithm to effectively learn optimal policies. Leveraging local state information, the DRL-JCBRTP scheme uses an innovative reward function to increase the minimum awareness failure distance. Our SLMLab-Gym-VEINS simulations show that the DRL-JCBRTP scheme outperforms existing beaconing schemes in minimizing awareness failure probability and maximizing awareness distance, ultimately improving driving safety. [ABSTRACT FROM AUTHOR]

As autonomous vehicles (AVs) are advancing to higher levels of autonomy and performance, the associated technologies are becoming increasingly diverse. Lane-keeping systems (LKS), corresponding to a key functionality of AVs, considerably enhance driver convenience. With drivers increasingly relying on autonomous driving technologies, the importance of safety features, such as fail-safe mechanisms in the event of sensor failures, has gained prominence. Therefore, this paper proposes a reinforcement learning (RL) control method for lane-keeping, which uses surrounding object information derived through LiDAR sensors instead of camera sensors for LKS. This approach uses surrounding vehicle and object information as observations for the RL framework to maintain the vehicle's current lane. The learning environment is established by integrating simulation tools, such as IPG CarMaker, which incorporates vehicle dynamics, and MATLAB Simulink for data analysis and RL model creation. To further validate the applicability of the LiDAR sensor data in real-world settings, Gaussian noise is introduced in the virtual simulation environment to mimic sensor noise in actual operational conditions. [ABSTRACT FROM AUTHOR]

Photoacoustic imaging has emerged as a promising biomedical imaging technique that enables visualization of the optical absorption characteristics of biological tissues in vivo. Among the different photoacoustic imaging system configurations, optical-resolution photoacoustic microscopy stands out by providing high spatial resolution using a tightly focused laser beam, which is typically transmitted through optical fibers. Achieving high-quality images depends significantly on optical fluence, which is directly proportional to the signal-to-noise ratio. Hence, optimizing the laser-fiber coupling is critical. Conventional coupling systems require manual adjustment of the optical path to direct the laser beam into the fiber, which is a repetitive and time-consuming process. In this study, we propose an automated laser-fiber coupling module that optimizes laser delivery and minimizes the need for manual intervention. By incorporating a motor-mounted mirror holder and proportional derivative control, we successfully achieved efficient and robust laser delivery. The performance of the proposed system was evaluated using a leaf-skeleton phantom in vitro and a human finger in vivo, resulting in high-quality photoacoustic images. This innovation has the potential to significantly enhance the quality and efficiency of optical-resolution photoacoustic microscopy. [ABSTRACT FROM AUTHOR]

Reinforcement learning agents that have not been seen during training must be robust in test environments. However, the generalization problem is challenging to solve in reinforcement learning using high-dimensional images as the input. The addition of a self-supervised learning framework with data augmentation in the reinforcement learning architecture can promote generalization to a certain extent. However, excessively large changes in the input images may disturb reinforcement learning. Therefore, we propose a contrastive learning method that can help manage the trade-off relationship between the performance of reinforcement learning and auxiliary tasks against the data augmentation strength. In this framework, strong augmentation does not disturb reinforcement learning and instead maximizes the auxiliary effect for generalization. Results of experiments on the DeepMind Control suite demonstrate that the proposed method effectively uses strong data augmentation and achieves a higher generalization than the existing methods. [ABSTRACT FROM AUTHOR]

As interest in point cloud processing has gradually increased in the industry, point cloud sampling techniques have been researched to improve deep learning networks. As many conventional models use point clouds directly, the consideration of computational complexity has become critical for practicality. One of the representative ways to decrease computations is downsampling, which also affects the performance in terms of precision. Existing classic sampling methods have adopted a standardized way regardless of the task-model property in learning. However, this limits the improvement of the point cloud sampling network's performance. That is, the performance of such task-agnostic methods is too low when the sampling ratio is high. Therefore, this paper proposes a novel downsampling model based on the transformer-based point cloud sampling network (TransNet) to efficiently perform downsampling tasks. The proposed TransNet utilizes self-attention and fully connected layers to extract meaningful features from input sequences and perform downsampling. By introducing attention techniques into downsampling, the proposed network can learn about the relationships between point clouds and generate a task-oriented sampling methodology. The proposed TransNet outperforms several state-of-the-art models in terms of accuracy. It has a particular advantage in generating points from sparse data when the sampling ratio is high. We expect that our approach can provide a promising solution for downsampling tasks in various point cloud applications. [ABSTRACT FROM AUTHOR]

This paper proposes a novel model predictive control (MPC) algorithm that increases the path tracking performance according to the control input. The proposed algorithm reduces the path tracking errors of MPC by updating the sampling time of the next step according to the control inputs (i.e., the lateral velocity and front steering angle) calculated in each step of the MPC algorithm. The scenarios of a mixture of straight and curved driving paths were constructed, and the optimal control input was calculated in each step. In the experiment, a scenario was created with the Automated Driving Toolbox of MATLAB, and the path-following performance characteristics and computation times of the existing and proposed MPC algorithms were verified and compared with simulations. The results prove that the proposed MPC algorithm has improved path-following performance compared to those of the existing MPC algorithm. [ABSTRACT FROM AUTHOR]