Search

This demo presents a novel end-to-end framework that combines on-device large language models (LLMs) with smartphone sensing technologies to achieve context-aware and personalized services. The framework addresses critical limitations of current personalization solutions via cloud LLMs, such as privacy concerns, latency and cost, and limited personal information. To achieve this, we innovatively proposed deploying LLMs on smartphones with multimodal sensor data through context-aware sensing and customized prompt engineering, ensuring privacy and enhancing personalization performance. A case study involving a university student demonstrated the capability of the framework to provide tailored recommendations. In addition, we show that the framework achieves the best trade-off in privacy, performance, latency, cost, battery and energy consumption between on-device and cloud LLMs. To the best of our knowledge, this is the first framework to provide on-device LLMs personalization with smartphone sensing. Future work will incorporate more diverse sensor data and involve extensive user studies to enhance personalization. Our proposed framework has the potential to substantially improve user experiences across domains including healthcare, productivity, and entertainment., Comment: 5 pages, 3 figures, conference demo paper

Reinforcement learning (RL) is an effective method of finding reasoning pathways in incomplete knowledge graphs (KGs). To overcome the challenges of a large action space, a self-supervised pre-training method is proposed to warm up the policy network before the RL training stage. To alleviate the distributional mismatch issue in general self-supervised RL (SSRL), in our supervised learning (SL) stage, the agent selects actions based on the policy network and learns from generated labels; this self-generation of labels is the intuition behind the name self-supervised. With this training framework, the information density of our SL objective is increased and the agent is prevented from getting stuck with the early rewarded paths. Our self-supervised RL (SSRL) method improves the performance of RL by pairing it with the wide coverage achieved by SL during pretraining, since the breadth of the SL objective makes it infeasible to train an agent with that alone. We show that our SSRL model meets or exceeds current state-of-the-art results on all Hits@k and mean reciprocal rank (MRR) metrics on four large benchmark KG datasets. This SSRL method can be used as a plug-in for any RL architecture for a KGR task. We adopt two RL architectures, i.e., MINERVA and MultiHopKG as our baseline RL models and experimentally show that our SSRL model consistently outperforms both baselines on all of these four KG reasoning tasks. Full code for the paper available at https://github.com/owenonline/Knowledge-Graph-Reasoning-with-Self-supervised-Reinforcement-Learning., Comment: 17 pages, 11 figures

We propose and analyze an extended Fourier pseudospectral (eFP) method for the spatial discretization of the Gross-Pitaevskii equation (GPE) with low regularity potential by treating the potential in an extended window for its discrete Fourier transform. The proposed eFP method maintains optimal convergence rates with respect to the regularity of the exact solution even if the potential is of low regularity and enjoys similar computational cost as the standard Fourier pseudospectral method, and thus it is both efficient and accurate. Furthermore, similar to the Fourier spectral/pseudospectral methods, the eFP method can be easily coupled with different popular temporal integrators including finite difference methods, time-splitting methods and exponential-type integrators. Numerical results are presented to validate our optimal error estimates and to demonstrate that they are sharp as well as to show its efficiency in practical computations., Comment: 20 pages, 7 figures

We establish optimal error bounds on time-splitting methods for the nonlinear Schr\"odinger equation with low regularity potential and typical power-type nonlinearity $ f(\rho) = \rho^\sigma $, where $ \rho:=|\psi|^2 $ is the density with $ \psi $ the wave function and $ \sigma > 0 $ the exponent of the nonlinearity. For the first-order Lie-Trotter time-splitting method, optimal $ L^2 $-norm error bound is proved for $L^\infty$-potential and $ \sigma > 0 $, and optimal $H^1$-norm error bound is obtained for $ W^{1, 4} $-potential and $ \sigma \geq 1/2 $. For the second-order Strang time-splitting method, optimal $ L^2 $-norm error bound is established for $H^2$-potential and $ \sigma \geq 1 $, and optimal $H^1$-norm error bound is proved for $H^3$-potential and $ \sigma \geq 3/2 $ (or $\sigma = 1$). Compared to those error estimates of time-splitting methods in the literature, our optimal error bounds either improve the convergence rates under the same regularity assumptions or significantly relax the regularity requirements on potential and nonlinearity for optimal convergence orders. A key ingredient in our proof is to adopt a new technique called \textit{regularity compensation oscillation} (RCO), where low frequency modes are analyzed by phase cancellation, and high frequency modes are estimated by regularity of the solution. Extensive numerical results are reported to confirm our error estimates and to demonstrate that they are sharp., Comment: 34 pages, 8 figures

In-betweening is a technique for generating transitions given initial and target character states. The majority of existing works require multiple (often $>$10) frames as input, which are not always accessible. Our work deals with a focused yet challenging problem: to generate the transition when given exactly two frames (only the first and last). To cope with this challenging scenario, we implement our bi-directional scheme which generates forward and backward transitions from the start and end frames with two adversarial autoregressive networks, and stitches them in the middle of the transition where there is no strict ground truth. The autoregressive networks based on conditional variational autoencoders (CVAE) are optimized by searching for a pair of optimal latent codes that minimize a novel stitching loss between their outputs. Results show that our method achieves higher motion quality and more diverse results than existing methods on both the LaFAN1 and Human3.6m datasets., Comment: 10 pages, 5 figures

We present different regularizations and numerical methods for the nonlinear Schr\"odinger equation with singular nonlinearity (sNLSE) including the regularized Lie-Trotter time-splitting (LTTS) methods and regularized Lawson-type exponential integrator (LTEI) methods. Due to the blowup of the singular nonlinearity, i.e., $f(\rho)=\rho^{\alpha}$ with a fixed exponent $\alpha<0$ goes to infinity when $\rho \to 0^+$ ($\rho = |\psi|^2$ represents the density with $\psi$ being the complex-valued wave function or order parameter), there are significant difficulties in designing accurate and efficient numerical schemes to solve the sNLSE. In order to suppress the round-off error and avoid blowup near $\rho = 0^+$, two types of regularizations for the sNLSE are proposed with a small regularization parameter $0 < \eps \ll 1$. One is based on the local energy regularization (LER) for the sNLSE via regularizing the energy density $F(\rho) = \frac{1}{\alpha+1}\rho^{\alpha+1}$ locally near $\rho = 0^+$ with a polynomial approximation and then obtaining a local energy regularized nonlinear Schr\"odinger equation via energy variation. The other one is the global nonlinearity regularization which directly regularizes the singular nonlinearity $f(\rho)=\rho^{\alpha}$ to avoid blowup near $\rho = 0^+$. For the regularized models, we apply the first-order Lie-Trotter time-splitting method and Lawson-type exponential integrator method for temporal discretization and combine with the Fourier pseudospectral method in space to numerically solve them. Numerical examples are provided to show the convergence of the regularized models to the sNLSE and they suggest that the local energy regularization performs better than directly regularizing the singular nonlinearity globally.

Let ${\mathbf U}^-_q$ be the negative half of the quantum group associated to a Kac-Moody algebra ${\mathfrak g}$, and $\underline{\mathbf U}^-_q$ the quantum group obtained by a folding of ${\mathfrak g}$. Let ${\mathbf A} = {\mathbf Z}[q,q^{-1}]$. McNamara showed that $\underline{\mathbf U}^-_q$ is categorified over a certain extenion ring $\widetilde{\mathbf A}$ of ${\mathbf A}$, by uing the folding theory of KLR algebras. He posed a question whether $\widetilde{\mathbf A}$ coincides with ${\mathbf A}$ or not. In this paper, we give an affirmative answer for this problem., Comment: 38 pages