Search

Deep neural networks (DNNs) are powerful for cognitive tasks such as image classification, object detection, and scene segmentation. One drawback however is the significant high computational complexity and memory consumption, which makes them unfeasible to run real-time on embedded platforms because of the limited hardware resources. Block floating point (BFP) quantization is one of the representative compression approaches for reducing the memory and computational burden owing to their capability to effectively capture the broad data distribution of DNN models. Unfortunately, prior works on BFP-based quantization empirically choose the block size and the precision that preserve accuracy. In this paper, we develop a BFP-based bitwidth-aware analytical modeling framework (called ``BitQ'') for the best BFP implementation of DNN inference on embedded platforms. We formulate and resolve an optimization problem to identify the optimal BFP block size and bitwidth distribution by the trade-off of both accuracy and performance loss. Experimental results show that compared with an equal bitwidth setting, the BFP DNNs with optimized bitwidth allocation provide efficient computation, preserving accuracy on famous benchmarks. The source code and data are available at https://github.com/Cheliosoops/BitQ.

We propose a novel text-to-video (T2V) generation benchmark, ChronoMagic-Bench, to evaluate the temporal and metamorphic capabilities of the T2V models (e.g. Sora and Lumiere) in time-lapse video generation. In contrast to existing benchmarks that focus on visual quality and textual relevance of generated videos, ChronoMagic-Bench focuses on the model's ability to generate time-lapse videos with significant metamorphic amplitude and temporal coherence. The benchmark probes T2V models for their physics, biology, and chemistry capabilities, in a free-form text query. For these purposes, ChronoMagic-Bench introduces 1,649 prompts and real-world videos as references, categorized into four major types of time-lapse videos: biological, human-created, meteorological, and physical phenomena, which are further divided into 75 subcategories. This categorization comprehensively evaluates the model's capacity to handle diverse and complex transformations. To accurately align human preference with the benchmark, we introduce two new automatic metrics, MTScore and CHScore, to evaluate the videos' metamorphic attributes and temporal coherence. MTScore measures the metamorphic amplitude, reflecting the degree of change over time, while CHScore assesses the temporal coherence, ensuring the generated videos maintain logical progression and continuity. Based on ChronoMagic-Bench, we conduct comprehensive manual evaluations of ten representative T2V models, revealing their strengths and weaknesses across different categories of prompts, and providing a thorough evaluation framework that addresses current gaps in video generation research. Moreover, we create a large-scale ChronoMagic-Pro dataset, containing 460k high-quality pairs of 720p time-lapse videos and detailed captions ensuring high physical pertinence and large metamorphic amplitude. [Homepage](https://pku-yuangroup.github.io/ChronoMagic-Bench/)., Comment: NeurIPS D&B 2024 (Spotlight)

Streaming data clustering is a popular research topic in the fields of data mining and machine learning. Compared to static data, streaming data, which is usually analyzed in data chunks, is more susceptible to encountering the dynamic cluster imbalanced issue. That is, the imbalanced degree of clusters varies in different streaming data chunks, leading to corruption in either the accuracy or the efficiency of streaming data analysis based on existing clustering methods. Therefore, we propose an efficient approach called Learning Self-Refined Organizing Map (LSROM) to handle the imbalanced streaming data clustering problem, where we propose an advanced SOM for representing the global data distribution. The constructed SOM is first refined for guiding the partition of the dataset to form many micro-clusters to avoid the missing small clusters in imbalanced data. Then an efficient merging of the micro-clusters is conducted through quick retrieval based on the SOM, which can automatically yield a true number of imbalanced clusters. In comparison to existing imbalanced data clustering approaches, LSROM is with a lower time complexity $O(n\log n)$, while achieving very competitive clustering accuracy. Moreover, LSROM is interpretable and insensitive to hyper-parameters. Extensive experiments have verified its efficacy., Comment: 13 pages, 7 figures

Recent advances in Text-to-Video generation (T2V) have achieved remarkable success in synthesizing high-quality general videos from textual descriptions. A largely overlooked problem in T2V is that existing models have not adequately encoded physical knowledge of the real world, thus generated videos tend to have limited motion and poor variations. In this paper, we propose \textbf{MagicTime}, a metamorphic time-lapse video generation model, which learns real-world physics knowledge from time-lapse videos and implements metamorphic generation. First, we design a MagicAdapter scheme to decouple spatial and temporal training, encode more physical knowledge from metamorphic videos, and transform pre-trained T2V models to generate metamorphic videos. Second, we introduce a Dynamic Frames Extraction strategy to adapt to metamorphic time-lapse videos, which have a wider variation range and cover dramatic object metamorphic processes, thus embodying more physical knowledge than general videos. Finally, we introduce a Magic Text-Encoder to improve the understanding of metamorphic video prompts. Furthermore, we create a time-lapse video-text dataset called \textbf{ChronoMagic}, specifically curated to unlock the metamorphic video generation ability. Extensive experiments demonstrate the superiority and effectiveness of MagicTime for generating high-quality and dynamic metamorphic videos, suggesting time-lapse video generation is a promising path toward building metamorphic simulators of the physical world.

In this work, we extend the resummation for the thrust distribution in Higgs decays up to the fifth logarithmic order. We show that one needs the accurate values of the three-loop soft functions for reliable predictions in the back-to-back region. This is especially true in the gluon channel, where the soft function exhibits poor perturbative convergence., Comment: 31 pages, 6 figures, 3 tables

In this Letter, we present for the first time a calculation of the complete next-to-leading order corrections to the $gg \to ZH$ process. We use the method of small mass expansion to tackle the most challenging two-loop virtual amplitude, in which the top quark mass dependence is retained throughout the calculations. We show that our method provides reliable numeric results in all kinematic regions, and present phenomenological predictions for the total and differential cross sections at the Large Hadron Collider and its future upgrades. Our results are necessary ingredients towards reducing the theoretical uncertainties of the $pp \to ZH$ cross sections down to the percent-level, and provide important theoretical inputs for future precision experimental collider programs.

We present a precise and efficient computation of the two-loop amplitudes entering the Higgs boson pair production process via gluon fusion. Our approach is based on the small-Higgs-mass expansion while keeping the full dependence on the top quark mass and other kinematic invariants. We compare our results to the up-to-date predictions based on a combination of sector decomposition and high-energy expansion. We find that our method provides precision numeric predictions in the entire phase space, while at the same time is highly efficient as the computation can be easily performed on a normal desktop or laptop computer. Our method is valuable for practical phenomenological studies of the Higgs boson pair production process, and can also be applied to other similar processes.

We investigate top quark pair production near the threshold where the pair invariant mass $M_{t\bar{t}}$ approaches $2m_t$, which provides sensitive observables to extract the top quark mass $m_t$. Using the effective field theory methods, we derive a factorization and resummation formula for kinematic distributions in the threshold limit up to the next-to-leading power, which resums higher order Coulomb corrections to all orders in the strong coupling constant. Our formula is similar to those in the literature but differs in several important aspects. We apply our formula to the $M_{t\bar{t}}$ distribution, as well as to the double differential cross section with respect to $M_{t\bar{t}}$ and the rapidity of the $t\bar{t}$ pair. We find that the resummation effects significantly increase the cross sections near the threshold, and lead to predictions better compatible with experimental data than the fixed-order ones. We demonstrate that incorporating resummation effects in the top quark mass determination can shift the extracted value of $m_t$ by as large as 1.4 GeV. The shift is much larger than the estimated uncertainties in previous experimental studies, and leads to a value of the top quark pole mass more consistent with the current world average., Comment: 44 pages, 14 figures; comments are welcome; v2: journal version

We investigate the invariant-mass distribution of top-quark pairs near the $2m_t$ threshold, which has strong impact on the determination of the top-quark mass $m_t$. We show that higher-order non-relativistic corrections lead to large contributions which are not included in the state-of-the-art theoretical predictions. We derive a factorization formula to resum such corrections to all orders in the strong-coupling, and calculate necessary ingredients to perform the resummation at next-to-leading power. We combine the resummation with fixed-order results and present phenomenologically relevant numeric results. We find that the resummation effect significantly enhances the differential cross section in the threshold region, and makes the theoretical prediction more compatible with experimental data. We estimate that using our prediction in the determination of $m_t$ will lead to a value closer to the result of direct measurement., Comment: 6 pages, 4 figures; v4: references added