Search

We report the detection of an extreme flux decrease accompanied by clear dispersion measure (DM) and rotation measure (RM) variations for pulsar B1929+10 during the 110-minute radio observation with the Five-hundred-meter Aperture Spherical radio Telescope (FAST). The radio flux decreases by 2 to 3 orders of magnitude within a rapid time scale of about 20 minutes. Meanwhile, the variations of DM and RM are approximately 0.05 pc cm$^{-3}$ and 0.7 rad m$^{-2}$, respectively. Frequency-dependent analysis of DM indicates an extremely weak chromatic DM feature, which does not notably affect the radiative behavior detected. Moreover, the pulsar timing analysis shows an additional time delay from 100 $\mu$s to 400 $\mu$s in the event. These results are speculated to be due to the eclipse and bend for the radio emission of pulsar B1929+10 by a highly dense outflow from the pulsar. This not only impacts the intrinsic radio emission feature but also affects the pulsar timing behavior. Nevertheless, a plasma lens effect lasting around 20 minutes could also be responsible for the event., Comment: 13 pages, 6 figures. Accepted for publication in ApJL

Machine unlearning, a process enabling pre-trained models to remove the influence of specific training samples, has attracted significant attention in recent years. While extensive research has focused on developing efficient unlearning strategies, the critical aspect of unlearning verification has been largely overlooked. Existing verification methods mainly rely on machine learning attack techniques, such as membership inference attacks (MIAs) or backdoor attacks. However, these methods, not being formally designed for verification purposes, exhibit limitations in robustness and only support a small, predefined subset of samples. Moreover, dependence on prepared sample-level modifications of MIAs or backdoor attacks restricts their applicability in Machine Learning as a Service (MLaaS) environments. To address these limitations, we propose a novel robustness verification scheme without any prior modifications, and can support verification on a much larger set. Our scheme employs an optimization-based method to recover the actual training samples from the model. By comparative analysis of recovered samples extracted pre- and post-unlearning, MLaaS users can verify the unlearning process. This verification scheme, operating exclusively through model parameters, avoids the need for any sample-level modifications prior to model training while supporting verification on a much larger set and maintaining robustness. The effectiveness of our proposed approach is demonstrated through theoretical analysis and experiments involving diverse models on various datasets in different scenarios.

Background: Large language models (LLMs) have seen extraordinary advances with applications in clinical decision support. However, high-quality evidence is urgently needed on the potential and limitation of LLMs in providing accurate clinical decisions based on real-world medical data. Objective: To evaluate quantitatively whether universal state-of-the-art LLMs (ChatGPT and GPT-4) can predict the incidence risk of myocardial infarction (MI) with logical inference, and to further make comparison between various models to assess the performance of LLMs comprehensively. Methods: In this retrospective cohort study, 482,310 participants recruited from 2006 to 2010 were initially included in UK Biobank database and later on resampled into a final cohort of 690 participants. For each participant, tabular data of the risk factors of MI were transformed into standardized textual descriptions for ChatGPT recognition. Responses were generated by asking ChatGPT to select a score ranging from 0 to 10 representing the risk. Chain of Thought (CoT) questioning was used to evaluate whether LLMs make prediction logically. The predictive performance of ChatGPT was compared with published medical indices, traditional machine learning models and other large language models. Conclusions: Current LLMs are not ready to be applied in clinical medicine fields. Future medical LLMs are suggested to be expert in medical domain knowledge to understand both natural languages and quantified medical data, and further make logical inferences.

Learned Image Compression (LIC) models have achieved superior rate-distortion performance than traditional codecs. Existing LIC models use CNN, Transformer, or Mixed CNN-Transformer as basic blocks. However, limited by the shifted window attention, Swin-Transformer-based LIC exhibits a restricted growth of receptive fields, affecting the ability to model large objects for image compression. To address this issue and improve the performance, we incorporate window partition into channel attention for the first time to obtain large receptive fields and capture more global information. Since channel attention hinders local information learning, it is important to extend existing attention mechanisms in Transformer codecs to the space-channel attention to establish multiple receptive fields, being able to capture global correlations with large receptive fields while maintaining detailed characterization of local correlations with small receptive fields. We also incorporate the discrete wavelet transform into our Spatial-Channel Hybrid (SCH) framework for efficient frequency-dependent down-sampling and further enlarging receptive fields. Experiment results demonstrate that our method achieves state-of-the-art performances, reducing BD-rate by 18.54%, 23.98%, 22.33%, and 24.71% on four standard datasets compared to VTM-23.1., Comment: ACCV2024 accepted; camera-ready version

Federated learning is a promising privacy-preserving paradigm for distributed machine learning. In this context, there is sometimes a need for a specialized process called machine unlearning, which is required when the effect of some specific training samples needs to be removed from a learning model due to privacy, security, usability, and/or legislative factors. However, problems arise when current centralized unlearning methods are applied to existing federated learning, in which the server aims to remove all information about a class from the global model. Centralized unlearning usually focuses on simple models or is premised on the ability to access all training data at a central node. However, training data cannot be accessed on the server under the federated learning paradigm, conflicting with the requirements of the centralized unlearning process. Additionally, there are high computation and communication costs associated with accessing clients' data, especially in scenarios involving numerous clients or complex global models. To address these concerns, we propose a more effective and efficient federated unlearning scheme based on the concept of model explanation. Model explanation involves understanding deep networks and individual channel importance, so that this understanding can be used to determine which model channels are critical for classes that need to be unlearned. We select the most influential channels within an already-trained model for the data that need to be unlearned and fine-tune only influential channels to remove the contribution made by those data. In this way, we can simultaneously avoid huge consumption costs and ensure that the unlearned model maintains good performance. Experiments with different training models on various datasets demonstrate the effectiveness of the proposed approach., Comment: Accepted by IEEE Transactions on Big Data

We present the scintillation velocity measurements of FRB~20201124A from the FAST observations, which reveal an annual variation. This annual variation is further supported by changes detected in the scintillation arc as observed from the secondary spectrum. We attribute the annual velocity variation to the presence of a moderately anisotropic scattering screen located at a distance of 0.4$\pm$0.1~kpc from Earth. Our results prove that the scintillation of this FRB is mainly caused by material close to Earth on a Galactic scale. However, scintillation observations of other FRBs may expose their surrounding environment or uncover possible orbital motion if scintillation is caused by materials in their host galaxy., Comment: 4 figures, 1 tables, accepted for publication in ApJL

Machine unlearning is an emerging technology that has come to attract widespread attention. A number of factors, including regulations and laws, privacy, and usability concerns, have resulted in this need to allow a trained model to forget some of its training data. Existing studies of machine unlearning mainly focus on unlearning requests that forget a cluster of instances or all instances from one class. While these approaches are effective in removing instances, they do not scale to scenarios where partial targets within an instance need to be forgotten. For example, one would like to only unlearn a person from all instances that simultaneously contain the person and other targets. Directly migrating instance-level unlearning to target-level unlearning will reduce the performance of the model after the unlearning process, or fail to erase information completely. To address these concerns, we have proposed a more effective and efficient unlearning scheme that focuses on removing partial targets from the model, which we name "target unlearning". Specifically, we first construct an essential graph data structure to describe the relationships between all important parameters that are selected based on the model explanation method. After that, we simultaneously filter parameters that are also important for the remaining targets and use the pruning-based unlearning method, which is a simple but effective solution to remove information about the target that needs to be forgotten. Experiments with different training models on various datasets demonstrate the effectiveness of the proposed approach.

Machine unlearning enables pre-trained models to eliminate the effects of partial training samples. Previous research has mainly focused on proposing efficient unlearning strategies. However, the verification of machine unlearning, or in other words, how to guarantee that a sample has been successfully unlearned, has been overlooked for a long time. Existing verification schemes typically rely on machine learning attack techniques, such as backdoor or membership inference attacks. As these techniques are not formally designed for verification, they are easily bypassed when an untrustworthy MLaaS undergoes rapid fine-tuning to merely meet the verification conditions, rather than executing real unlearning. In this paper, we propose a formal verification scheme, IndirectVerify, to determine whether unlearning requests have been successfully executed. We design influential sample pairs: one referred to as trigger samples and the other as reaction samples. Users send unlearning requests regarding trigger samples and use reaction samples to verify if the unlearning operation has been successfully carried out. We propose a perturbation-based scheme to generate those influential sample pairs. The objective is to perturb only a small fraction of trigger samples, leading to the reclassification of reaction samples. This indirect influence will be used for our verification purposes. In contrast to existing schemes that employ the same samples for all processes, our scheme, IndirectVerify, provides enhanced robustness, making it less susceptible to bypassing processes.

Machine unlearning enables pre-trained models to remove the effect of certain portions of training data. Previous machine unlearning schemes have mainly focused on unlearning a cluster of instances or all instances belonging to a specific class. These types of unlearning might have a significant impact on the model utility; and they may be inadequate for situations where we only need to unlearn features within instances, rather than the whole instances. Due to the different granularity, current unlearning methods can hardly achieve feature-level unlearning. To address the challenges of utility and granularity, we propose a refined granularity unlearning scheme referred to as ``feature unlearning". We first explore two distinct scenarios based on whether the annotation information about the features is given: feature unlearning with known annotations and feature unlearning without annotations. Regarding unlearning with known annotations, we propose an adversarial learning approach to automatically remove effects about features. For unlearning without annotations, we initially enable the output of one model's layer to identify different pattern features using model interpretability techniques. We proceed to filter features from instances based on these outputs with identifying ability. So that we can remove the feature impact based on filtered instances and the fine-tuning process. The effectiveness of our proposed approach is demonstrated through experiments involving diverse models on various datasets in different scenarios.

In current AI era, users may request AI companies to delete their data from the training dataset due to the privacy concerns. As a model owner, retraining a model will consume significant computational resources. Therefore, machine unlearning is a new emerged technology to allow model owner to delete requested training data or a class with little affecting on the model performance. However, for large-scaling complex data, such as image or text data, unlearning a class from a model leads to a inferior performance due to the difficulty to identify the link between classes and model. An inaccurate class deleting may lead to over or under unlearning. In this paper, to accurately defining the unlearning class of complex data, we apply the definition of Concept, rather than an image feature or a token of text data, to represent the semantic information of unlearning class. This new representation can cut the link between the model and the class, leading to a complete erasing of the impact of a class. To analyze the impact of the concept of complex data, we adopt a Post-hoc Concept Bottleneck Model, and Integrated Gradients to precisely identify concepts across different classes. Next, we take advantage of data poisoning with random and targeted labels to propose unlearning methods. We test our methods on both image classification models and large language models (LLMs). The results consistently show that the proposed methods can accurately erase targeted information from models and can largely maintain the performance of the models.

Millisecond pulsars (MSPs) are known for their long-term stability. Using six years of observations from the Neutron Star Interior Composition Explorer (NICER), we have conducted an in-depth analysis of the X-ray timing results for six MSPs: PSRs B1937+21, B1821$-$24, J0437$-$4715, J0030+0451, J0218+4232, and J2124$-$3358. The timing stability parameter $\sigma_z$ has been calculated, revealing remarkable timing precision on the order of $10^{-14}$ for PSRs B1937+21 and J0437$-$4715, and $10^{-13}$ for PSRs B1821$-$24, J0218+4232, and J0030+0451 over a timescale of 1000 days. These findings underscore the feasibility of autonomous in-orbit timekeeping using X-ray observations of MSPs. In addition, the consistency of long-term spin-down noise in the X-ray and radio bands has been investigated by comparison with IPTA radio data.

As one of the paradigm examples to probe into pulsar magnetospheric dynamics, PSR B0943+10 (J0946+0951) manifests representatively, showing mode switch, orthogonal polarization and subpulse drifting, frequently studied below 600 MHz. Here both integrated and single pulses are studied at a high frequency (1.25 GHz) with FAST. The mode switch is studied using a profile decomposition method. A phase space evolution for the pulsar's mode switch shows a strange-attractor-like pattern. The radiative geometry is proposed by fitting polarization position angles with the rotating vector model. The pulsar pulse profile is then mapped to the sparking locations on pulsar surface, and the differences between the main pulse's and the precursor component's radiative processes may explain the X-ray's synchronization with radio mode switch. Detailed single pulse studies on B0943+10's orthogonally polarized radiation are presented, which may support for certain models of radiative transfer of polarized emission. Especially, the difference in OPMs' circular polarization might reflect the cyclotron absorption in pulsar magnetospheres. B0943+10's B and Q modes evolve differently with frequency and have different proportions of orthogonal modes, which indicates possible magnetospheric changes during mode switch. For Q mode pulse profile, the precursor and the main pulse components are orthogonally polarized, and are probably originated from different depths in the magnetosphere. The findings could impact significantly on pulsar electrodynamics and the radiative mechanism related., Comment: The paper has been published by ApJ

Magnetars are neutron stars with extremely strong magnetic fields, frequently powering high-energy activity in X-rays. Pulsed radio emission following some X-ray outbursts have been detected (\citealt{Camilo2006,camilo2007a}), albeit its physical origin is unclear. It has long been speculated that the origin of magnetars' radio signals is different from those from canonical pulsars, although convincing evidence is still lacking. Five months after magnetar SGR 1935+2154's X-ray outburst and its associated Fast Radio Burst (FRB) 20200428, a radio pulsar phase was discovered. Here we report the discovery of X-ray spectral hardening associated with the emergence of periodic radio pulsations from SGR 1935+2154 and a detailed analysis of the properties of the radio pulses. The observations suggest that radio emission originates from the outer magnetosphere of the magnetar, and the surface heating due to the bombardment of inward-going particles from the radio emission region is responsible for the observed X-ray spectral hardening., Comment: 40 pages, 11 figures, 3 tables; Accepted by ApJS, 2024

The megajansky radio burst, FRB 20200428, and other bright radio bursts detected from the Galactic source SGR J1935+2154 suggest that magnetars can make fast radio bursts (FRBs), but the emission site and mechanism of FRB-like bursts are still unidentified. Here we report the emergence of a radio pulsar phase of the magnetar five months after FRB 20200428. 795 pulses were detected in 16.5 hours over 13 days by the Five-hundred-meter Aperture Spherical Radio telescope, with luminosities about eight decades fainter than FRB 20200428. The pulses were emitted in a narrow phase window anti-aligned with the X-ray pulsation profile observed by the X-ray telescopes. The bursts, conversely, appear in random phases. This dichotomy suggests that radio pulses originate from a fixed region within the magnetosphere, but bursts occur in random locations and are possibly associated with explosive events in a dynamically evolving magnetosphere. This picture reconciles the lack of periodicity in cosmological repeating FRBs within the magnetar engine model., Comment: published on Science Advances, the authors' version

The Hot Universe Baryon Surveyor (HUBS) is a proposed space-based X-ray telescope for detecting X-ray emissions from the hot gas content in our universe. With its unprecedented spatially-resolved high-resolution spectroscopy and large field of view, the HUBS mission will be uniquely qualified to measure the physical and chemical properties of the hot gas in the interstellar medium, the circumgalactic medium, the intergalactic medium, and the intracluster medium. These measurements will be valuable for two key scientific goals of HUBS, namely to unravel the AGN and stellar feedback physics that governs the formation and evolution of galaxies, and to probe the baryon budget and multi-phase states from galactic to cosmological scales. In addition to these two goals, the HUBS mission will also help us solve some problems in the fields of galaxy clusters, AGNs, diffuse X-ray backgrounds, supernova remnants, and compact objects. This paper discusses the perspective of advancing these fields using the HUBS telescope., Comment: 52 pages, 22 figures. Accepted for publication in Science China: Physics, Mechanics and Astronomy

Observing and timing a group of millisecond pulsars (MSPs) with high rotational stability enables the direct detection of gravitational waves (GWs). The GW signals can be identified from the spatial correlations encoded in the times-of-arrival of widely spaced pulsar-pairs. The Chinese Pulsar Timing Array (CPTA) is a collaboration aiming at the direct GW detection with observations carried out using Chinese radio telescopes. This short article serves as a `table of contents' for a forthcoming series of papers related to the CPTA Data Release 1 (CPTA DR1) which uses observations from the Five-hundred-meter Aperture Spherical radio Telescope (FAST). Here, after summarizing the time span and accuracy of CPTA DR1, we report the key results of our statistical inference finding a correlated signal with amplitude $\log A_{\rm c}= -14.4 \,^{+1.0}_{-2.8}$ for spectral index in the range of $\alpha\in [-1.8, 1.5]$ assuming a GW background (GWB) induced quadrupolar correlation. The search for the Hellings-Downs (HD) correlation curve is also presented, where some evidence for the HD correlation has been found that a 4.6-$\sigma$ statistical significance is achieved using the discrete frequency method around the frequency of 14 nHz. We expect that the future International Pulsar Timing Array data analysis and the next CPTA data release will be more sensitive to the nHz GWB, which could verify the current results., Comment: 18 pages, 6 figures, submitted to "Research in astronomy and astrophysics" 22nd March 2022

In this paper, we presented the 23.3 years of pulsar timing results of PSR J1456-6413 based on the observation of Parkes 64m radio telescope. We detected two new glitches at MJD 57093(3) and 59060(12) and confirmed its first glitch at MJD 54554(10). Using the "Cholesky" timing analysis method, we have determined its position, proper motion, and two-dimensional transverse velocities from the data segments before and after the second glitch, respectively. Furthermore, we detected exponential recovery behavior after the first glitch, with a recovery time scale of approximately 200 days and a corresponding exponential recovery factor Q of approximately 0.15(2), while no exponential recovery was detected for the other two glitches. More interestingly, we found that the leading component of the integral pulse profile after the second glitch became stronger, while the main component became weaker. Our results will expand the sample of pulsars with magnetosphere fluctuation triggered by the glitch event.

Machine learning has attracted widespread attention and evolved into an enabling technology for a wide range of highly successful applications, such as intelligent computer vision, speech recognition, medical diagnosis, and more. Yet a special need has arisen where, due to privacy, usability, and/or the right to be forgotten, information about some specific samples needs to be removed from a model, called machine unlearning. This emerging technology has drawn significant interest from both academics and industry due to its innovation and practicality. At the same time, this ambitious problem has led to numerous research efforts aimed at confronting its challenges. To the best of our knowledge, no study has analyzed this complex topic or compared the feasibility of existing unlearning solutions in different kinds of scenarios. Accordingly, with this survey, we aim to capture the key concepts of unlearning techniques. The existing solutions are classified and summarized based on their characteristics within an up-to-date and comprehensive review of each category's advantages and limitations. The survey concludes by highlighting some of the outstanding issues with unlearning techniques, along with some feasible directions for new research opportunities.

We report the observations of FRB 20220912A using the Five-hundred-meter Aperture Spherical radio Telescope (FAST). We conducted 17 observations totaling 8.67 hours and detected a total of 1076 bursts with an event rate up to 390 hr$^{-1}$. The cumulative energy distribution can be well described using a broken power-law function with the lower and higher-energy slopes of $-0.38\pm0.02$ and $-2.07\pm0.07$, respectively. We also report the L band ($1-1.5$ GHz) spectral index of the synthetic spectrum of FRB~20220912A bursts, which is $-2.6\pm0.21$. The average rotation measure (RM) value of the bursts from FRB~20220912A is $-0.08\pm5.39\ \rm rad\,m^{-2}$, close to 0 $\rm rad\,m^{-2}$ and maintain relatively stable over two months. Most bursts have nearly 100\% linear polarization. About 45\% of the bursts have circular polarization with SNR $>$ 3, and the highest circular polarization degree can reach 70\%. Our observations suggest that FRB~20220912A is located in a relatively clean local environment with complex circular polarization characteristics. These various behaviors imply that the mechanism of circular polarization of FRBs likely originates from an intrinsic radiation mechanism, such as coherent curvature radiation or inverse Compton scattering inside the magnetosphere of the FRB engine source (e.g. a magnetar)., Comment: 15 pages, 11 figures, 2 tables, submitted to ApJ, comments are welcome!

We present the interstellar scintillation analysis of fast radio burst (FRB) 20220912A during its extremely active episode in 2022 using data from the Five-hundred-meter Aperture Spherical Radio Telescope (FAST). We detect a scintillation arc in the FRB's secondary spectrum, which describes the power in terms of the scattered FRB signals' time delay and Doppler shift. The arc indicates that the scintillation is caused by a highly localized region of the ionized interstellar medium (IISM). Our analysis favors a Milky Way origin for the localized scattering medium but cannot rule out a host galaxy origin. We present our method for detecting the scintillation arc, which can be applied generally to sources with irregularly spaced bursts or pulses. These methods could help shed light on the complex interstellar environment surrounding the FRBs and in our Galaxy., Comment: SCIENCE CHINA Physics, Mechanics & Astronomy , Volume 67, Issue 1: 219512 (2024)

This short note is motivated by an attempt to understand the distinction between the Laplace operator and the hyperbolic Laplacian on the unit ball of $\mathbb{R}^n$, regarding the Lipschitz continuity of the solutions to the corresponding Dirichlet problems. We investigate the Dirichlet problem \begin{equation*} \left\{\begin{array}{ll} \Delta_{\vartheta} u = 0, & \text{ in }\, \mathbb{B}^n,\\ u=\phi, & \text{ on }\, \mathbb{S}^{n-1}, \end{array}\right. \end{equation*} where \[ \Delta_{\vartheta} := (1-|x|^2) \bigg\{ \frac {1-|x|^2} {4} \Delta + \vartheta \sum_{j=1}^n x_{j} \frac {\partial } {\partial x_j} + \vartheta \left( \frac {n}{2}-1- \vartheta \right) I\bigg\}. \] We show that the Lipschitz continuity of boundary data always implies the Lipschitz continuity of the solutions if $\vartheta > 0$, but does not when $\vartheta \leq 0$., Comment: 7 pages

Fully test-time adaptation aims to adapt the network model based on sequential analysis of input samples during the inference stage to address the cross-domain performance degradation problem of deep neural networks. We take inspiration from the biological plausibility learning where the neuron responses are tuned based on a local synapse-change procedure and activated by competitive lateral inhibition rules. Based on these feed-forward learning rules, we design a soft Hebbian learning process which provides an unsupervised and effective mechanism for online adaptation. We observe that the performance of this feed-forward Hebbian learning for fully test-time adaptation can be significantly improved by incorporating a feedback neuro-modulation layer. It is able to fine-tune the neuron responses based on the external feedback generated by the error back-propagation from the top inference layers. This leads to our proposed neuro-modulated Hebbian learning (NHL) method for fully test-time adaptation. With the unsupervised feed-forward soft Hebbian learning being combined with a learned neuro-modulator to capture feedback from external responses, the source model can be effectively adapted during the testing process. Experimental results on benchmark datasets demonstrate that our proposed method can significantly improve the adaptation performance of network models and outperforms existing state-of-the-art methods., Comment: CVPR2023 accepted