Search

Sign language is one of the most effective communication tools for people with hearing difficulties. Most existing works focus on improving the performance of sign language tasks on RGB videos, which may suffer from degraded recording conditions, such as fast movement of hands with motion blur and textured signer's appearance. The bio-inspired event camera, which asynchronously captures brightness change with high speed, could naturally perceive dynamic hand movements, providing rich manual clues for sign language tasks. In this work, we aim at exploring the potential of event camera in continuous sign language recognition (CSLR) and sign language translation (SLT). To promote the research, we first collect an event-based benchmark EvSign for those tasks with both gloss and spoken language annotations. EvSign dataset offers a substantial amount of high-quality event streams and an extensive vocabulary of glosses and words, thereby facilitating the development of sign language tasks. In addition, we propose an efficient transformer-based framework for event-based SLR and SLT tasks, which fully leverages the advantages of streaming events. The sparse backbone is employed to extract visual features from sparse events. Then, the temporal coherence is effectively utilized through the proposed local token fusion and gloss-aware temporal aggregation modules. Extensive experimental results are reported on both simulated (PHOENIX14T) and EvSign datasets. Our method performs favorably against existing state-of-the-art approaches with only 0.34% computational cost (0.84G FLOPS per video) and 44.2% network parameters. The project is available at https://zhang-pengyu.github.io/EVSign., Comment: To appear on ECCV 2024

This study employs gyrokinetic simulations to investigate ion temperature gradient (ITG) turbulence in realistic fusion plasmas featuring reverse magnetic shear. Negative magnetic shear is found to suppress the ITG instability due to the scarcity of mode rational surfaces, as evidenced by a comparison of instabilities for different magnetic shears. This suppression effect remains observable in nonlinear turbulence with zonal flow artificially eliminated, where the emergence of turbulence solitons aligns with mode rational surface peaks. However, the suppression effect diminishes in the presence of self-consistently generated zonal flow, along with the occurance of turbulence solitons. The zonal flow is found to originated from a force driven process by the primary instability, instead of the conventional modulational instability. The study further reveals a remarkable phenomenon that the Dimits shift no longer exists for negative magnetic shear, which are attributed to the weakness of zonal flow around marginal stability. However, away from marginal stability, the turbulent transport is primarily regulated by the zonal flow regardless of different magnetic shears., Comment: 10 pages