Search

To ensure the reliability of DNN systems and address the test generation problem for neural networks, this paper proposes a fuzzing test generation technique based on many-objective optimization algorithms. Traditional fuzz testing employs random search, leading to lower testing efficiency and tends to generate numerous invalid test cases. By utilizing many-objective optimization techniques, effective test cases can be generated. To achieve high test coverage, this paper proposes several improvement strategies. The frequency-based fuzz sampling strategy assigns priorities based on the frequency of selection of initial data, avoiding the repetitive selection of the same data and enhancing the quality of initial data better than random sampling strategies. To address the issue that global search may yield test not satisfying semantic constraints, a local search strategy based on the Monte Carlo tree search is proposed to enhance the algorithm's local search capabilities. Furthermore, we improve the diversity of the population and the algorithm's global search capability by updating SPEA2's external archive based on a decomposition-based archiving strategy. To validate the effectiveness of the proposed approach, experiments were conducted on several public datasets and various neural network models. The results reveal that, compared to random and clustering-based sampling, the frequency-based fuzz sampling strategy provides a greater improvement in coverage rate in the later stages of iterations. On complex networks like VGG16, the improved SPEA2 algorithm increased the coverage rate by about 12% across several coverage metrics, and by approximately 40% on LeNet series networks. The experimental results also indicates that the newly generated test cases not only exhibit higher coverage rates but also generate adversarial samples that reveal model errors.

This preliminary white paper proposes a novel 8-bit floating-point data format HiFloat8 (abbreviated as HiF8) for deep learning. HiF8 features tapered precision. For normal value encoding, it provides 7 exponent values with 3-bit mantissa, 8 exponent values with 2-bit mantissa, and 16 exponent values with 1-bit mantissa. For denormal value encoding, it extends the dynamic range by 7 extra powers of 2, from 31 to 38 binades (notice that FP16 covers 40 binades). Meanwhile, HiF8 encodes all the special values except that positive zero and negative zero are represented by only one bit-pattern. Thanks to the better balance between precision and dynamic range, HiF8 can be simultaneously used in both forward and backward passes of AI training. In this paper, we will describe the definition and rounding methods of HiF8, as well as the tentative training and inference solutions. To demonstrate the efficacy of HiF8, massive simulation results on various neural networks, including traditional neural networks and large language models (LLMs), will also be presented., Comment: 13 Pages, 4 Figures, 9 Tables

Personalized search has been extensively studied in various applications, including web search, e-commerce, social networks, etc. With the soaring popularity of short-video platforms, exemplified by TikTok and Kuaishou, the question arises: can personalization elevate the realm of short-video search, and if so, which techniques hold the key? In this work, we introduce $\text{PR}^2$, a novel and comprehensive solution for personalizing short-video search, where $\text{PR}^2$ stands for the Personalized Retrieval and Ranking augmented search system. Specifically, $\text{PR}^2$ leverages query-relevant collaborative filtering and personalized dense retrieval to extract relevant and individually tailored content from a large-scale video corpus. Furthermore, it utilizes the QIN (Query-Dominate User Interest Network) ranking model, to effectively harness user long-term preferences and real-time behaviors, and efficiently learn from user various implicit feedback through a multi-task learning framework. By deploying the $\text{PR}^2$ in production system, we have achieved the most remarkable user engagement improvements in recent years: a 10.2% increase in CTR@10, a notable 20% surge in video watch time, and a 1.6% uplift of search DAU. We believe the practical insights presented in this work are valuable especially for building and improving personalized search systems for the short video platforms.

Scale-calibrated ranking systems are ubiquitous in real-world applications nowadays, which pursue accurate ranking quality and calibrated probabilistic predictions simultaneously. For instance, in the advertising ranking system, the predicted click-through rate (CTR) is utilized for ranking and required to be calibrated for the downstream cost-per-click ads bidding. Recently, multi-objective based methods have been wildly adopted as a standard approach for Calibrated Ranking, which incorporates the combination of two loss functions: a pointwise loss that focuses on calibrated absolute values and a ranking loss that emphasizes relative orderings. However, when applied to industrial online applications, existing multi-objective CR approaches still suffer from two crucial limitations. First, previous methods need to aggregate the full candidate list within a single mini-batch to compute the ranking loss. Such aggregation strategy violates extensive data shuffling which has long been proven beneficial for preventing overfitting, and thus degrades the training effectiveness. Second, existing multi-objective methods apply the two inherently conflicting loss functions on a single probabilistic prediction, which results in a sub-optimal trade-off between calibration and ranking. To tackle the two limitations, we propose a Self-Boosted framework for Calibrated Ranking (SBCR)., Comment: KDD 2024

By accurately measuring composition and energy spectrum of cosmic ray, the origin problem of so called "keen" region (energy > 1 PeV) can be solved. However, up to the present, the results of the spectrum in the knee region obtained by several previous experiments have shown obvious differences, so they cannot give effective evidence for judging the theoretical models on the origin of the knee. Recently, the Large High Altitude Air Shower Observatory (LHAASO) has reported several major breakthroughs and important results in astro-particle physics field. Relying on its advantages of wide-sky survey, high altitude location and large area detector arrays, the research content of LHAASO experiment mainly includes ultra high-energy gamma-ray astronomy, measurement of cosmic ray spectra in the knee region, searching for dark matter and new phenomena of particle physics at higher energy. The electron and Thermal Neutron detector (EN-Detector) is a new scintillator detector which applies thermal neutron detection technology to measure cosmic ray extensive air shower (EAS). This technology is an extension of LHAASO. The EN-Detector Array (ENDA) can highly efficiently measure thermal neutrons generated by secondary hadrons so called "skeleton" of EAS. In this paper, we perform the optimization of ENDA configuration, and obtain expectations on the ENDA results, including thermal neutron distribution, trigger efficiency and capability of cosmic ray composition separation. The obtained real data results are consistent with those by the Monte Carlo simulation.

Ground-based cosmic ray experiments detect cosmic ray mainly by measuring the longitudinal and lateral distribution of secondary particles produced in the extensive air shower (EAS). The EAS of cosmic ray in the knee energy region is simulated via CORSIKA software. Several simulation samples with different energy, composition and zenith angles were carried out to understand the longitudinal development of electron, muon and Cherenkov light in EAS. All the results presented were obtained assuming an observation plane at an altitude of 4400 m a.s.l. The differences of longitudinal development between electron and Cherenkov light were studied, and the reconstruction uncertainty of shower maximum for electron from Cherenkov light was estimated to be 10-15g/cm$^2$ for nuclei above 1 PeV. The performances of energy measurement and the composition discrimination ability based on longitudinal development were studied and compared with that from lateral distribution. It was found that number of electron per depth at its shower maximum has the smallest shower-to-shower fluctuations, but the shower-to-shower fluctuations of electron density measured at observation level was very close to it when the appropriate zenith angle was employed. The shower-to-shower fluctuations of shower maximum for electron is 50-55 g/cm$^2$ for proton, and 20-25 g/cm$^2$ for iron, but the composition discrimination ability between nuclei from muon density measured at observation level is much better than the shower maximum variable from longitudinal development. The hadronic model dependencies of the longitudinal development and lateral distribution were also discussed.

The knee of cosmic ray spectra reflects the maximum energy accelerated by galactic cosmic ray sources or the limit to the ability of galaxy to bind cosmic rays. The measuring of individual energy spectra is a crucial tool to ascertain the origin of the knee. The Extensive Air Shower of cosmic rays in the knee energy region is simulated via CORSIKA software. The energy resolution for different secondary components and primary nuclei identification capability are studied. The energy reconstruction by using electromagnetic particles in the energy around knee is better than by using other secondary particles. The resolution is 10-19 percent for proton, and 4-8 percent for iron. For the case of primary nuclei identification capability, the discriminability of density of muons is best both at low (around 100 TeV) and high (around 10 PeV) energy, the discriminability of the shape of lateral distribution of electron and gamma-rays are good at low energy and the discriminability of density of neutrons is good at high energy. The differences between the lateral distributions of secondary particles simulated by EPOS-LHC and QGSJet-II-04 hadronic model are also studied. The results in this work can provide important information for selecting the secondary components and detector type during energy reconstruction and identifying the primary nuclei of cosmic rays in the knee region., Comment: 16 pages, 17 figures