Search

Joint Detection and Embedding (JDE) trackers have demonstrated excellent performance in Multi-Object Tracking (MOT) tasks by incorporating the extraction of appearance features as auxiliary tasks through embedding Re-Identification task (ReID) into the detector, achieving a balance between inference speed and tracking performance. However, solving the competition between the detector and the feature extractor has always been a challenge. Meanwhile, the issue of directly embedding the ReID task into MOT has remained unresolved. The lack of high discriminability in appearance features results in their limited utility. In this paper, a new learning approach using cross-correlation to capture temporal information of objects is proposed. The feature extraction network is no longer trained solely on appearance features from each frame but learns richer motion features by utilizing feature heatmaps from consecutive frames, which addresses the challenge of inter-class feature similarity. Furthermore, our learning approach is applied to a more lightweight feature extraction network, and treat the feature matching scores as strong cues rather than auxiliary cues, with an appropriate weight calculation to reflect the compatibility between our obtained features and the MOT task. Our tracker, named TCBTrack, achieves state-of-the-art performance on multiple public benchmarks, i.e., MOT17, MOT20, and DanceTrack datasets. Specifically, on the DanceTrack test set, we achieve 56.8 HOTA, 58.1 IDF1 and 92.5 MOTA, making it the best online tracker capable of achieving real-time performance. Comparative evaluations with other trackers prove that our tracker achieves the best balance between speed, robustness and accuracy. Code is available at https://github.com/yfzhang1214/TCBTrack., Comment: A submission to IJCV

Solid Earth tide represents the elastic response of solid Earth to the lunar (solar) gravitational force. The yielding solid Earth due to the force has been thought to be a prolate ellipsoid since the time of Lord Kelvin, yet the ellipsoid's geometry such as semi-major axis's length, semi-minor axis's length, and oblateness remains unresolved. Additionally, the tidal displacement of solid Earth is conventionally resolved through a combination of expanded potential equations and given Earth model. Here we present a geometric model in which both the ellipsoid's geometry and the tidal displacement of solid Earth can be resolved through a rotating ellipse with respect to the Moon (Sun). We test the geometric model using 23-year gravity data from 22 superconducting gravimeter (SG) stations and compare it with the current model recommended by the IERS (International Earth Rotation System) conventions (2010), the average Root Mean Square (RMS) deviation of the gravity change yielded by the geometric model against observation is 6.47 {\mu}Gal (equivalent to 2.07 cm), while that yielded by the current model is 30.77{\mu}Gal (equivalent to 9.85 cm). The geometric model represents a significant advance in understanding and predicting solid Earth tide, and will greatly contribute to many application fields such as geodesy, geophysics, astronomy, and oceanography., Comment: 20 pages, 4 figures, 1 table

During the past few decades, cognitive diagnostics modeling has attracted increasing attention in computational education communities, which is capable of quantifying the learning status and knowledge mastery levels of students. Indeed, the recent advances in neural networks have greatly enhanced the performance of traditional cognitive diagnosis models through learning the deep representations of students and exercises. Nevertheless, existing approaches often suffer from the issue of overconfidence in predicting students' mastery levels, which is primarily caused by the unavoidable noise and sparsity in realistic student-exercise interaction data, severely hindering the educational application of diagnostic feedback. To address this, in this paper, we propose a novel Reliable Cognitive Diagnosis(ReliCD) framework, which can quantify the confidence of the diagnosis feedback and is flexible for different cognitive diagnostic functions. Specifically, we first propose a Bayesian method to explicitly estimate the state uncertainty of different knowledge concepts for students, which enables the confidence quantification of diagnostic feedback. In particular, to account for potential differences, we suggest modeling individual prior distributions for the latent variables of different ability concepts using a pre-trained model. Additionally, we introduce a logical hypothesis for ranking confidence levels. Along this line, we design a novel calibration loss to optimize the confidence parameters by modeling the process of student performance prediction. Finally, extensive experiments on four real-world datasets clearly demonstrate the effectiveness of our ReliCD framework.

With the widespread adoption of mobility-on-demand (MoD) services and the advancements in autonomous vehicle (AV) technology, the research interest into the AVs based MoD (AMoD) services has grown immensely. Often agent-based simulation frameworks are used to study the AMoD services using the trip data of current Taxi or MoD services. For reliable results of AMoD simulations, a realistic city network and travel times play a crucial part. However, many times the researchers do not have access to the actual network state corresponding to the trip data used for AMoD simulations reducing the reliability of results. Therefore, this paper introduces a spatio-temporal optimization strategy for scaling the link-level network travel times using the simulated trip data without additional data sources on the network state. The method is tested on the widely used New York City (NYC) Taxi data and shows that the travel times produced using the scaled network are very close to the recorded travel times in the original data. Additionally, the paper studies the performance differences of AMoD simulation when the scaled network is used. The results indicate that realistic travel times can significantly impact AMoD simulation outcomes.

Mobility-on-Demand (MoD) services have been an active research topic in recent years. Many studies focused on developing control algorithms to supply efficient services. To cope with a large search space to solve the underlying vehicle routing problem, studies usually apply hard time-constraints on pick-up and drop-off while considering static network travel times to reduce computational time. As travel times in real street networks are dynamic and stochastic, assigned routes considered feasible by the control algorithm in one time step might become infeasible in the next. Since once assigned and confirmed, customers should still be part of the solution, damage control is necessary to counteract this effect. In this study, a detailed simulation framework for MoD services is coupled with a microscopic traffic simulation to create dynamic and stochastic travel times, and tested in a case study for Munich, Germany. Results showed that the combination of inaccurate travel time estimation and damage control strategies for infeasible routes deteriorates the performance of MoD services -- hailing and pooling -- significantly. Moreover, customers suffer from unreliable pick-up time and travel time estimations. Allowing re-assignments of initial vehicle schedules according to updated system states helps to restore system efficiency and reliability, but only to a minor extent., Comment: Submitted to 26th IEEE International Conference on Intelligent Transportation Systems ITSC 2023

Urban traffic state estimation is pivotal in furnishing precise and reliable insights into traffic flow characteristics, thereby enabling efficient traffic management. Traditional traffic estimation methodologies have predominantly hinged on labor-intensive and costly techniques such as loop detectors and floating car data. Nevertheless, the relentless progression in autonomous driving technology has catalyzed an increasing interest in capitalizing on the extensive potential of on-board sensor data, giving rise to a novel concept known as "Autonomous Vehicles as a Sensor" (AVaaS). This paper innovatively refines the AVaaS concept by simulating the data collection process. We take real-world sensor attributes into account and employ more accurate estimation techniques based on the on-board sensor data. Such data can facilitate the estimation of high-resolution, link-level traffic states and, more extensively, online cluster- and network-level traffic states. We substantiate the viability of the AVaaS concept through a case study conducted using a real-world traffic simulation in Ingolstadt, Germany. The results attest to the ability of AVaaS in estimating both microscopic (link-level) and macroscopic (cluster- and network-level) traffic states, thereby highlighting the immense potential of the AVaaS concept in effecting precise and reliable traffic state estimation and also further applications., Comment: 15 pages, 11 figures, the 2024 TRB Annual Meeting

The market share of mobility on-demand (MoD) services strongly increased in recent years and is expected to rise even higher once vehicle automation is fully available. These services might reduce space consumption in cities as fewer parking spaces are required if private vehicle trips are replaced. If rides are shared additionally, occupancy related traffic efficiency is increased. Simulations help to identify the actual impact of MoD on a traffic system, evaluate new control algorithms for improved service efficiency and develop guidelines for regulatory measures. This paper presents the open-source agent-based simulation framework FleetPy. FleetPy (written in the programming language "Python") is explicitly developed to model MoD services in a high level of detail. It specially focuses on the modeling of interactions of users with operators while its flexibility allows the integration and embedding of multiple operators in the overall transportation system. Its modular structure ensures the transferabillity of previously developed elements and the selection of an appropriate level of modeling detail. This paper compares existing simulation frameworks for MoD services and highlights exclusive features of FleetPy. The upper level simulation flows are presented, followed by required input data for the simulation and the output data FleetPy produces. Additionally, the modules within FleetPy and high-level descriptions of current implementations are provided. Finally, an example showcase for Manhattan, NYC provides insights into the impacts of different modules for simulation flow, fleet optimization, traveler behavior and network representation.

Immersive video, such as virtual reality (VR) and multi-view videos, is growing in popularity. Its wireless streaming is an instance of general multicast, extending conventional unicast and multicast, whose effective design is still open. This paper investigates the optimization of general rate splitting with linear beamforming for general multicast. Specifically, we consider a multi-carrier single-cell wireless network where a multi-antenna base station (BS) communicates to multiple single-antenna users via general multicast. Linear beamforming is adopted at the BS, and joint decoding is adopted at each user. We consider the maximization of the weighted sum rate, which is a challenging nonconvex problem. Then, we propose an iterative algorithm for the problem to obtain a KKT point using the concave-convex procedure (CCCP). The proposed optimization framework generalizes the existing ones for rate splitting for various types of services. Finally, we numerically show substantial gains of the proposed solutions over existing schemes and reveal the design insights of general rate splitting for general multicast., Comment: 6 pages, 7 figures, to appear in IEEE ICC 2022. arXiv admin note: substantial text overlap with arXiv:2201.07386

This paper investigates adaptive streaming of one or multiple tiled 360 videos from a multi-antenna base station (BS) to one or multiple single-antenna users, respectively, in a multi-carrier wireless system. We aim to maximize the video quality while keeping rebuffering time small via encoding rate adaptation at each group of pictures (GOP) and transmission adaptation at each (transmission) slot. To capture the impact of field-of-view (FoV) prediction, we consider three cases of FoV viewing probability distributions, i.e., perfect, imperfect, and unknown FoV viewing probability distributions, and use the average total utility, worst average total utility, and worst total utility as the respective performance metrics. In the single-user scenario, we optimize the encoding rates of the tiles, encoding rates of the FoVs, and transmission beamforming vectors for all subcarriers to maximize the total utility in each case. In the multi-user scenario, we adopt rate splitting with successive decoding and optimize the encoding rates of the tiles, encoding rates of the FoVs, rates of the common and private messages, and transmission beamforming vectors for all subcarriers to maximize the total utility in each case. Then, we separate the challenging optimization problem into multiple tractable problems in each scenario. In the single-user scenario, we obtain a globally optimal solution of each problem using transformation techniques and the Karush-Kuhn-Tucker (KKT) conditions. In the multi-user scenario, we obtain a KKT point of each problem using the concave-convex procedure (CCCP). Finally, numerical results demonstrate that the proposed solutions achieve notable gains over existing schemes in all three cases. To the best of our knowledge, this is the first work revealing the impact of FoV prediction on the performance of adaptive streaming of tiled 360 videos., Comment: 18 pages, 20 figures, to appear in Trans. Image Process. arXiv admin note: text overlap with arXiv:2009.01753

Adaptive Bit Rate (ABR) decision plays a crucial role for ensuring satisfactory Quality of Experience (QoE) in video streaming applications, in which past network statistics are mainly leveraged for future network bandwidth prediction. However, most algorithms, either rules-based or learning-driven approaches, feed throughput traces or classified traces based on traditional statistics (i.e., mean/standard deviation) to drive ABR decision, leading to compromised performances in specific scenarios. Given the diverse network connections (e.g., WiFi, cellular and wired link) from time to time, this paper thus proposes to learn the ANT (a.k.a., Accurate Network Throughput) model to characterize the full spectrum of network throughput dynamics in the past for deriving the proper network condition associated with a specific cluster of network throughput segments (NTS). Each cluster of NTS is then used to generate a dedicated ABR model, by which we wish to better capture the network dynamics for diverse connections. We have integrated the ANT model with existing reinforcement learning (RL)-based ABR decision engine, where different ABR models are applied to respond to the accurate network sensing for better rate decision. Extensive experiment results show that our approach can significantly improve the user QoE by 65.5% and 31.3% respectively, compared with the state-of-the-art Pensive and Oboe, across a wide range of network scenarios.

The mechanical response of interpenetrating phase composites (IPCs) with stochastic spinodal topologies is investigated experimentally and numerically. Model polymeric systems are fabricated by Polyjet multi-material printing, with the reinforcing phase taking the topology of a spinodal shell, and the remaining volume filled by a softer matrix. We show that spinodal shell IPCs have comparable compressive strength and stiffness to IPCs with two well-established periodic reinforcements, the Schwarz P triply periodic minimal surface (TPMS) and the octet truss-lattice, while exhibiting far less catastrophic failure and greater damage resistance, particularly at high volume fraction of reinforcing phase. The combination of high stiffness and strength and a long flat plateau after yielding makes spinodal shell IPCs a promising candidate for energy absorption and impact protection applications, where the lack of material softening upon large compressive strains can prevent sudden collapse. Importantly, in contrast with all IPCs with periodic reinforcements, spinodal shell IPCs are amenable to scalable manufacturing via self-assembly techniques.

The mechanical response of cellular materials with spinodal topologies is numerically and experimentally investigated. Spinodal microstructures are generated by the numerical solution of the Cahn-Hilliard equation. Two different topologies are investigated: "solid models," where one of the two phases is modeled as a solid material and the remaining volume is void space; and "shell models," where the interface between the two phases is assumed to be a solid shell, with the rest of the volume modeled as void space. In both cases, a wide range of relative densities and spinodal characteristic feature sizes are investigated. The topology and morphology of all the numerically generated models are carefully characterized to extract key geometrical features and ensure that the distribution of curvatures and the aging law are consistent with the physics of spinodal decomposition. Finite element meshes are generated for each model, and the uniaxial compressive stiffness and strength are extracted. We show that while solid spinodal models in the density range of 30-70% are relatively inefficient (i.e., their strength and stiffness exhibit a high-power scaling with relative density), shell spinodal models in the density range of 0.01-1% are exceptionally stiff and strong. Spinodal shell materials are also shown to be remarkably imperfection insensitive. These findings are verified experimentally by in-situ uniaxial compression of polymeric samples printed at the microscale by Direct Laser Writing (DLW). At low relative densities, the strength and stiffness of shell spinodal models outperform those of most lattice materials and approach theoretical bounds for isotropic cellular materials. Most importantly, these materials can be produced by self-assembly techniques over a range of length scales, providing unique scalability.

The problem of action-conditioned image prediction is to predict the expected next frame given the current camera frame the robot observes and an action selected by the robot. We provide the first comparison of two recent popular models, especially for image prediction on cars. Our major finding is that action tiling encoding is the most important factor leading to the remarkable performance of the CDNA model. We present a light-weight model by action tiling encoding which has a single-decoder feedforward architecture same as [action_video_prediction_honglak]. On a real driving dataset, the CDNA model achieves ${0.3986} \times 10^{-3}$ MSE and ${0.9846}$ Structure SIMilarity (SSIM) with a network size of about {\bfseries ${12.6}$ million} parameters. With a small network of fewer than {\bfseries ${1}$ million} parameters, our new model achieves a comparable performance to CDNA at ${0.3613} \times 10^{-3}$ MSE and ${0.9633}$ SSIM. Our model requires less memory, is more computationally efficient and is advantageous to be used inside self-driving vehicles., Comment: 12 pages; 7 figures