Search

This review paper provides a comprehensive analysis of recent advances in automatic speech recognition (ASR) with bidirectional encoder representations from transformers BERT and connectionist temporal classification (CTC) transformers. The paper first introduces the fundamental concepts of ASR and discusses the challenges associated with it. It then explains the architecture of BERT and CTC transformers and their potential applications in ASR. The paper reviews several studies that have used these models for speech recognition tasks and discusses the results obtained. Additionally, the paper highlights the limitations of these models and outlines potential areas for further research. All in all, this review provides valuable insights for researchers and practitioners who are interested in ASR with BERT and CTC transformers.

Chiral magnets have garnered significant interest due to the emergence of unique phenomena prohibited in inversion-symmetric magnets. While the equilibrium characteristics of chiral magnets have been extensively explored through the Dzyaloshinskii-Moriya interaction (DMI), non-equilibrium properties like magnetic damping have received comparatively less attention. We present the inaugural direct observation of chiral damping through Brillouin light scattering (BLS) spectroscopy. Employing BLS spectrum analysis, we independently deduce the Dzyaloshinskii-Moriya interaction (DMI) and chiral damping, extracting them from the frequency shift and linewidth of the spectrum peak, respectively. The resulting linewidths exhibit clear odd symmetry with respect to the magnon wave vector, unambiguously confirming the presence of chiral damping. Our study introduces a novel methodology for quantifying chiral damping, with potential ramifications on diverse nonequilibrium phenomena within chiral magnets.

Knowledge graphs (KGs) have become ubiquitous publicly available knowledge sources, and are nowadays covering an ever increasing array of domains. However, not all knowledge represented is useful or pertaining when considering a new application or specific task. Also, due to their increasing size, handling large KGs in their entirety entails scalability issues. These two aspects asks for efficient methods to extract subgraphs of interest from existing KGs. To this aim, we introduce KGPrune, a Web Application that, given seed entities of interest and properties to traverse, extracts their neighboring subgraphs from Wikidata. To avoid topical drift, KGPrune relies on a frugal pruning algorithm based on analogical reasoning to only keep relevant neighbors while pruning irrelevant ones. The interest of KGPrune is illustrated by two concrete applications, namely, bootstrapping an enterprise KG and extracting knowledge related to looted artworks., Comment: Accepted as a demo paper at ECAI 2024

We present significant improvements to our previous work on noise reduction in {\sl Herschel} observation maps by defining sparse filtering tools capable of handling, in a unified formalism, a significantly improved noise reduction as well as a deconvolution in order to reduce effects introduced by the limited instrumental response (beam). We implement greater flexibility by allowing a wider choice of parsimonious priors in the noise-reduction process. More precisely, we introduce a sparse filtering and deconvolution approach approach of type $l^2$-$l^p$, with $p > 0$ variable and apply it to a larger set of molecular clouds using {\sl Herschel} 250 $\mu $m data in order to demonstrate their wide range of application. In the {\sl Herschel} data, we are able to use this approach to highlight extremely fine filamentary structures and obtain singularity spectra that tend to show a significantly less $\log$-normal behavior and a filamentary nature in the less dense regions. We also use high-resolution adaptive magneto-hydrodynamic simulation data to assess the quality of deconvolution in such a simulated beaming framework., Comment: 24 pages, 32 figures, official acceptance date on 16/05/2024 (Astronomy & Astrophysics)

The rise of new complex attacks scenarios in Internet of things (IoT) environments necessitate more advanced and intelligent cyber defense techniques such as various Intrusion Detection Systems (IDSs) which are responsible for detecting and mitigating malicious activities in IoT networks without human intervention. To address this issue, deep reinforcement learning (DRL) has been proposed in recent years, to automatically tackle intrusions/attacks. In this paper, a comprehensive survey of DRL-based IDS on IoT is presented. Furthermore, in this survey, the state-of-the-art DRL-based IDS methods have been classified into five categories including wireless sensor network (WSN), deep Q-network (DQN), healthcare, hybrid, and other techniques. In addition, the most crucial performance metrics, namely accuracy, recall, precision, false negative rate (FNR), false positive rate (FPR), and F-measure, are detailed, in order to evaluate the performance of each proposed method. The paper provides a summary of datasets utilized in the studies as well.

Protecting Internet of things (IoT) devices against cyber attacks is imperative owing to inherent security vulnerabilities. These vulnerabilities can include a spectrum of sophisticated attacks that pose significant damage to both individuals and organizations. Employing robust security measures like intrusion detection systems (IDSs) is essential to solve these problems and protect IoT systems from such attacks. In this context, our proposed IDS model consists on a combination of convolutional neural network (CNN) and long short-term memory (LSTM) deep learning (DL) models. This fusion facilitates the detection and classification of IoT traffic into binary categories, benign and malicious activities by leveraging the spatial feature extraction capabilities of CNN for pattern recognition and the sequential memory retention of LSTM for discerning complex temporal dependencies in achieving enhanced accuracy and efficiency. In assessing the performance of our proposed model, the authors employed the new CICIoT2023 dataset for both training and final testing, while further validating the model's performance through a conclusive testing phase utilizing the CICIDS2017 dataset. Our proposed model achieves an accuracy rate of 98.42%, accompanied by a minimal loss of 0.0275. False positive rate(FPR) is equally important, reaching 9.17% with an F1-score of 98.57%. These results demonstrate the effectiveness of our proposed CNN-LSTM IDS model in fortifying IoT environments against potential cyber threats.

Red-teaming, or identifying prompts that elicit harmful responses, is a critical step in ensuring the safe and responsible deployment of large language models (LLMs). Developing effective protection against many modes of attack prompts requires discovering diverse attacks. Automated red-teaming typically uses reinforcement learning to fine-tune an attacker language model to generate prompts that elicit undesirable responses from a target LLM, as measured, for example, by an auxiliary toxicity classifier. We show that even with explicit regularization to favor novelty and diversity, existing approaches suffer from mode collapse or fail to generate effective attacks. As a flexible and probabilistically principled alternative, we propose to use GFlowNet fine-tuning, followed by a secondary smoothing phase, to train the attacker model to generate diverse and effective attack prompts. We find that the attacks generated by our method are effective against a wide range of target LLMs, both with and without safety tuning, and transfer well between target LLMs. Finally, we demonstrate that models safety-tuned using a dataset of red-teaming prompts generated by our method are robust to attacks from other RL-based red-teaming approaches.

This paper provides a comprehensive review of the future of cybersecurity through Generative AI and Large Language Models (LLMs). We explore LLM applications across various domains, including hardware design security, intrusion detection, software engineering, design verification, cyber threat intelligence, malware detection, and phishing detection. We present an overview of LLM evolution and its current state, focusing on advancements in models such as GPT-4, GPT-3.5, Mixtral-8x7B, BERT, Falcon2, and LLaMA. Our analysis extends to LLM vulnerabilities, such as prompt injection, insecure output handling, data poisoning, DDoS attacks, and adversarial instructions. We delve into mitigation strategies to protect these models, providing a comprehensive look at potential attack scenarios and prevention techniques. Furthermore, we evaluate the performance of 42 LLM models in cybersecurity knowledge and hardware security, highlighting their strengths and weaknesses. We thoroughly evaluate cybersecurity datasets for LLM training and testing, covering the lifecycle from data creation to usage and identifying gaps for future research. In addition, we review new strategies for leveraging LLMs, including techniques like Half-Quadratic Quantization (HQQ), Reinforcement Learning with Human Feedback (RLHF), Direct Preference Optimization (DPO), Quantized Low-Rank Adapters (QLoRA), and Retrieval-Augmented Generation (RAG). These insights aim to enhance real-time cybersecurity defenses and improve the sophistication of LLM applications in threat detection and response. Our paper provides a foundational understanding and strategic direction for integrating LLMs into future cybersecurity frameworks, emphasizing innovation and robust model deployment to safeguard against evolving cyber threats., Comment: 50 pages, 8 figures

In this paper, we introduce a large class of (so-called) conditional indicators, on a complete probability space with respect to a sub $\sigma$-algebra. A conditional indicator is a positive mapping, which is not necessary linear, but may share common features with the conditional expectation, such as the tower property or the projection property. Several characterizations are formulated. Beyond the definitions, we provide some non trivial examples that are used in finance and may inspire new developments in the theory of operators on Riesz spaces.

In this paper, a general framework is developed for continuous-time financial market models defined from simple strategies through conditional topologies that avoid stochastic calculus and do not necessitate semimartingale models. We then compare the usual no-arbitrage conditions of the literature, e.g. the usual no-arbitrage conditions NFL, NFLVR and NUPBR and the recent AIP condition. With appropriate pseudo-distance topologies, we show that they hold in continuous time if and only if they hold in discrete time. Moreover, the super-hedging prices in continuous time coincide with the discrete-time super-hedging prices, even without any no-arbitrage condition.

Despite its amazing quantitative successes and contributions to revolutionary technologies, physics currently faces many unsolved mysteries ranging from the meaning of quantum mechanics to the nature of the dark energy that will determine the future of the Universe. It is clearly prohibitive for the general reader, and even the best informed physicists, to follow the vast number of technical papers published in the thousands of specialized journals. For this reason, we have asked the leading experts across many of the most important areas of physics to summarise their global assessment of some of the most important issues. In lieu of an extremely long abstract summarising the contents, we invite the reader to look at the section headings and their authors, and then to indulge in a feast of stimulating topics spanning the current frontiers of fundamental physics from The Future of Physics by William D Phillips and What characterises topological effects in physics? by Gerard t Hooft through the contributions of the widest imaginable range of world leaders in their respective areas. This paper is presented as a preface to exciting developments by senior and young scientists in the years that lie ahead, and a complement to the less authoritative popular accounts by journalists., Comment: 54 pages, 13 figures

As more devices connect to the internet, it becomes crucial to address their limitations and basic security needs. While much research focuses on utilizing ML and DL to tackle security challenges, there is often a tendency to overlook the practicality and feasibility of implementing these methods in real-time settings. This oversight stems from the constrained processing power and memory of certain devices (IoT devices), as well as concerns about the generalizability of these approaches. Focusing on the detection of DNS-tunneling attacks in a router as a case study, we present an end-to-end process designed to effectively address these challenges. The process spans from developing a lightweight DNS-tunneling detection model to integrating it into a resource-constrained device for real-time detection. Through our experiments, we demonstrate that utilizing stateless features for training the ML model, along with features chosen to be independent of the network configuration, leads to highly accurate results. The deployment of this carefully crafted model, optimized for embedded devices across diverse environments, resulted in high DNS-tunneling attack detection with minimal latency. With this work, we aim to encourage solutions that strike a balance between theoretical advancements and the practical applicability of ML approaches in the ever-evolving landscape of device security.

This work investigates the role of the emerging Analog In-memory computing (AIMC) paradigm in enabling Medical AI analysis and improving the certainty of these models at the edge. It contrasts AIMC's efficiency with traditional digital computing's limitations in power, speed, and scalability. Our comprehensive evaluation focuses on brain tumor analysis, spleen segmentation, and nuclei detection. The study highlights the superior robustness of isotropic architectures, which exhibit a minimal accuracy drop (0.04) in analog-aware training, compared to significant drops (up to 0.15) in pyramidal structures. Additionally, the paper emphasizes IMC's effective data pipelining, reducing latency and increasing throughput as well as the exploitation of inherent noise within AIMC, strategically harnessed to augment model certainty.

Unmanned aerial vehicle (UAV) is a promising technology for last-mile cargo delivery. However, the limited on-board battery capacity, cellular unreliability, and frequent handoffs in the airspace are the main obstacles to unleash its full potential. Given that existing cellular networks were primarily designed to service ground users, re-utilizing the same architecture for highly mobile aerial users, e.g., cargo-UAVs, is deemed challenging. Indeed, to ensure a safe delivery using cargo-UAVs, it is crucial to utilize the available energy efficiently, while guaranteeing reliable connectivity for command-and-control and avoiding frequent handoff. To achieve this goal, we propose a novel approach for joint cargo-UAV trajectory planning and cell association. Specifically, we formulate the cargo-UAV mission as a multi-objective problem aiming to 1) minimize energy consumption, 2) reduce handoff events, and 3) guarantee cellular reliability along the trajectory. We leverage reinforcement learning (RL) to jointly optimize the cargo-UAV's trajectory and cell association. Simulation results demonstrate a performance improvement of our proposed method, in terms of handoffs, disconnectivity, and energy consumption, compared to benchmarks.

The usual theory of asset pricing in finance assumes that the financial strategies, i.e. the quantity of risky assets to invest, are real-valued so that they are not integer-valued in general, see the Black and Scholes model for instance. This is clearly contrary to what it is possible to do in the real world. Surprisingly, it seems that there is no many contributions in that direction in the literature, except for a finite number of states. In this paper, for arbitrary {\Omega}, we show that, in discrete-time, it is possible to evaluate the minimal super-hedging price when we restrict ourselves to integer-valued strategies. To do so, we only consider terminal claims that are continuous piecewise affine functions of the underlying asset. We formulate a dynamic programming principle that can be directly implemented on an historical data and which also provides the optimal integer-valued strategy. The problem with general payoffs remains open but should be solved with the same approach.

The role a school and its teachers play in a child's life is undeniable. Both influence how children understand the world they live in, their place in that world, and their perceptions of future possibilities. Schools where students have opportunities to engage with multicultural curriculum materials, experience culturally responsive and sustaining school climates, and learn in classrooms led by teachers from racially, ethnically, and linguistically diverse backgrounds are especially impactful. Furthermore, students of color who have teachers of color are also less likely to experience exclusionary discipline practices and are more likely to improve their academic performance and graduate high school. Increasing teacher diversity is thus an effective strategy for creating more equitable learning environments and outcomes for all students. Increasing teacher diversity is of particular importance to the charter school sector as charter schools are more likely to serve students of color than traditional public schools. This publication is designed to support charter school leaders' efforts to achieve educational equity by focusing on one key strategy--building a pipeline of teachers of color through effective recruiting, hiring, and sustaining strategies. This report is divided into the following sections: (1) Section 1 provides an overview of the research on the importance of having a diverse teacher workforce; (2) Section 2 features strategies Drew Charter School and DSST are successfully implementing to recruit, hire, and sustain teachers of color; and (3) Section 3 highlights key strategies for recruiting, hiring, and sustaining teachers of color.