Search

Galaxy-scale strong gravitational lenses are valuable objects for a variety of astrophysical and cosmological applications. Strong lensing galaxies are rare, so efficient search methods, such as convolutional neural networks, are often used on large imaging datasets. In this work, we apply a new technique to improve the performance of supervised neural networks by subtracting the central (lensing) galaxy light from both the training and test datasets. We use multiband imaging data from the Hyper Suprime-Cam Subaru Strategic Program (HSC SSP) as our training and test datasets. By subtracting the lensing galaxy light, we increase the contrast of the lensed source compared to the original imaging data. We also apply the light subtraction to non-lenses in order to compare them to the light-subtracted lenses. Residual features resulting from poor light subtraction can adversely affect the performance of networks trained on the subtracted images alone. We find that combining the light-subtracted images with the original gri-band images for training and classification can overcome this and improve the overall classification accuracy. We find the area under the receiver operating characteristic curve can be improved to 0.841 using the combination of the fiducial images and light-subtracted images, compared to 0.808 for the fiducial imaging dataset alone. This may be a promising technique for improving future lens searches using CNNs.

Time-delay cosmography is a powerful technique to constrain cosmological parameters, particularly the Hubble constant ($H_{0}$). The TDCOSMO collaboration is performing an ongoing analysis of lensed quasars to constrain cosmology using this method. In this work, we obtain constraints from the lensed quasar WGD 2038-4008 using new time-delay measurements and previous mass models by TDCOSMO. This is the first TDCOSMO lens to incorporate multiple lens modeling codes and the full time-delay covariance matrix into the cosmological inference. The models are fixed before the time delay is measured, and the analysis is performed blinded with respect to the cosmological parameters to prevent unconscious experimenter bias. We obtain $D_{\Delta t} = 1.68^{+0.40}_{-0.38}$ Gpc using two families of mass models, a power-law describing the total mass distribution, and a composite model of baryons and dark matter, although the composite model is disfavored due to kinematics constraints. In a flat $\Lambda$CDM cosmology, we constrain the Hubble constant to be $H_{0} = 65^{+23}_{-14}\, \rm km\ s^{-1}\,Mpc^{-1}$. The dominant source of uncertainty comes from the time delays, due to the low variability of the quasar. Future long-term monitoring, especially in the era of the Vera C. Rubin Observatory's Legacy Survey of Space and Time, could catch stronger quasar variability and further reduce the uncertainties. This system will be incorporated into an upcoming hierarchical analysis of the entire TDCOSMO sample, and improved time delays and spatially-resolved stellar kinematics could strengthen the constraints from this system in the future., Comment: 8 pages, 5 figures, 3 tables; accepted for publication in Astronomy & Astrophysics

Efficient algorithms are being developed to search for strong gravitational lens systems owing to increasing large imaging surveys. Neural networks have been successfully used to discover galaxy-scale lens systems in imaging surveys such as the Kilo Degree Survey, Hyper-Suprime Cam (HSC) Survey and Dark Energy Survey over the last few years. Thus, it has become imperative to understand how some of these networks compare, their strengths and the role of the training datasets as most of the networks make use of supervised learning algorithms. In this work, we present the first-of-its-kind systematic comparison and benchmarking of networks from four teams that have analysed the HSC Survey data. Each team has designed their training samples and developed neural networks independently but coordinated apriori in reserving specific datasets strictly for test purposes. The test sample consists of mock lenses, real (candidate) lenses and real non-lenses gathered from various sources to benchmark and characterise the performance of each of the network. While each team's network performed much better on their own constructed test samples compared to those from others, all networks performed comparable on the test sample with real (candidate) lenses and non-lenses. We also investigate the impact of swapping the training samples amongst the teams while retaining the same network architecture. We find that this resulted in improved performance for some networks. These results have direct implications on measures to be taken for lens searches with upcoming imaging surveys such as the Rubin-Legacy Survey of Space and Time, Roman and Euclid., Comment: 13 pages, 8 figures

Electronic computers have evolved drastically over the past years with an ever-growing demand for improved performance. However, the transfer of information from memory and high energy consumption have emerged as issues that require solutions. Optical techniques are considered promising solutions to these problems with higher speed than their electronic counterparts and with reduced energy consumption. Here, we use the optical reservoir computing framework we have previously described (Scalable Optical Learning Operator or SOLO) to program the spatial-spectral output of the light after nonlinear propagation in a multimode fiber. The novelty in the current paper is that the system is programmed through an output sampling scheme, similar to that used in hyperspectral imaging in astronomy. Linear and nonlinear computations are performed by light in the multimode fiber and the high dimensional spatial-spectral information at the fiber output is optically programmed before it reaches the camera. We then used a digital computer to classify the programmed output of the multi-mode fiber using a simple, single layer network. When combining front-end programming and the proposed spatial-spectral programming, we were able to achieve 89.9% classification accuracy on the dataset consisting of chest X-ray images from COVID-19 patients. At the same time, we obtained a decrease of 99% in the number of tunable parameters compared to an equivalently performing digital neural network. These results show that the performance of programmed SOLO is comparable with cutting-edge electronic computing platforms, albeit with a much-reduced number of electronic operations.

Federated learning (FL) effectively mitigates the data silo challenge brought about by policies and privacy concerns, implicitly harnessing more data for deep model training. However, traditional centralized FL models grapple with diverse multi-center data, especially in the face of significant data heterogeneity, notably in medical contexts. In the realm of medical image segmentation, the growing imperative to curtail annotation costs has amplified the importance of weakly-supervised techniques which utilize sparse annotations such as points, scribbles, etc. A pragmatic FL paradigm shall accommodate diverse annotation formats across different sites, which research topic remains under-investigated. In such context, we propose a novel personalized FL framework with learnable prompt and aggregation (FedLPPA) to uniformly leverage heterogeneous weak supervision for medical image segmentation. In FedLPPA, a learnable universal knowledge prompt is maintained, complemented by multiple learnable personalized data distribution prompts and prompts representing the supervision sparsity. Integrated with sample features through a dual-attention mechanism, those prompts empower each local task decoder to adeptly adjust to both the local distribution and the supervision form. Concurrently, a dual-decoder strategy, predicated on prompt similarity, is introduced for enhancing the generation of pseudo-labels in weakly-supervised learning, alleviating overfitting and noise accumulation inherent to local data, while an adaptable aggregation method is employed to customize the task decoder on a parameter-wise basis. Extensive experiments on four distinct medical image segmentation tasks involving different modalities underscore the superiority of FedLPPA, with its efficacy closely parallels that of fully supervised centralized training. Our code and data will be available., Comment: 12 pages, 10 figures

We apply a novel model based on convolutional neural networks (CNNs) to identify gravitationally-lensed galaxies in multi-band imaging of the Hyper Suprime Cam Subaru Strategic Program (HSC-SSP) Survey. The trained model is applied to a parent sample of 2 350 061 galaxies selected from the $\sim$ 800 deg$^2$ Wide area of the HSC-SSP Public Data Release 2. The galaxies in HSC Wide are selected based on stringent pre-selection criteria, such as multiband magnitudes, stellar mass, star formation rate, extendedness limit, photometric redshift range, etc. Initially, the CNNs provide a total of 20 241 cutouts with a score greater than 0.9, but this number is subsequently reduced to 1 522 cutouts by removing definite non-lenses for further inspection by human eyes. We discover 43 definite and 269 probable lenses, of which 97 are completely new. In addition, out of 880 potential lenses, we recovered 289 known systems in the literature. We identify 143 candidates from the known systems that had higher confidence in previous searches. Our model can also recover 285 candidate galaxy-scale lenses from the Survey of Gravitationally lensed Objects in HSC Imaging (SuGOHI), where a single foreground galaxy acts as the deflector. Even though group-scale and cluster-scale lens systems were not included in the training, a sample of 32 SuGOHI-c (i.e., group/cluster-scale systems) lens candidates was retrieved. Our discoveries will be useful for ongoing and planned spectroscopic surveys, such as the Subaru Prime Focus Spectrograph project, to measure lens and source redshifts in order to enable detailed lens modelling., Comment: Submitted to MNRAS, 16 pages, 13 figures. Comments welcome

The discovery of the Eye of Horus (EoH), a rare double source-plane lens system ($z_{\rm lens}=$ 0.795; $z_{\rm src}=$ 1.302 and 1.988), has also led to the identification of two high-redshift ($z_{\rm phot}\sim$ 0.8) galaxy clusters in the same field based on the subsequent analysis of the Subaru/Hyper Suprime-Cam (HSC) optical and XMM-Newton X-ray data. The two brightest cluster galaxies (BCGs), one of which is the lensing galaxy of the EoH, are separated by only $\sim$100$"$ ($=$ 0.75 Mpc $<$ $r_{200}$) on the sky, raising the possibility that these two clusters may be physically associated. Here, we present a follow-up optical spectroscopic survey of this EoH field, obtaining 218 secure redshifts using MMT/Binospec. We have confirmed that there indeed exist two massive ($M_{\rm dyn}$ $>$ $10^{14}$ M$_\odot$) clusters of galaxies at $z$ $=$ 0.795 (the main cluster) and at $z=0.769$ (the NE cluster). However, these clusters have a velocity offset of $\sim$4300 km s$^{-1}$, suggesting that this two-cluster system is likely a line-of-sight projection rather than a physically-related association (e.g., a cluster merger). In terms of the properties of cluster-member galaxies, these two $z\sim0.8$ clusters appear well-developed, each harboring an old (age $=$ 3.6-6.0 Gyr) and massive ($M_\mathrm{*}$ $=$ 4.2-9.5 $\times$ $10^{11}$ M$_\odot$) BCG and exhibiting a well-established red sequence (RS). This study underscores the importance of conducting a spectroscopic follow-up for high-redshift cluster candidates because RS-based cluster selections are susceptible to such a projection effect in general., Comment: 13 pages (+56 pages in appendices), 7(+47) figures, 4(+1) tables; to be submitted to ApJ

The arrival of the Vera C. Rubin Observatory's Legacy Survey of Space and Time (LSST), Euclid-Wide and Roman wide area sensitive surveys will herald a new era in strong lens science in which the number of strong lenses known is expected to rise from $\mathcal{O}(10^3)$ to $\mathcal{O}(10^5)$. However, current lens-finding methods still require time-consuming follow-up visual inspection by strong-lens experts to remove false positives which is only set to increase with these surveys. In this work we demonstrate a range of methods to produce calibrated probabilities to help determine the veracity of any given lens candidate. To do this we use the classifications from citizen science and multiple neural networks for galaxies selected from the Hyper Suprime-Cam (HSC) survey. Our methodology is not restricted to particular classifier types and could be applied to any strong lens classifier which produces quantitative scores. Using these calibrated probabilities, we generate an ensemble classifier, combining citizen science and neural network lens finders. We find such an ensemble can provide improved classification over the individual classifiers. We find a false positive rate of $10^{-3}$ can be achieved with a completeness of $46\%$, compared to $34\%$ for the best individual classifier. Given the large number of galaxy-galaxy strong lenses anticipated in LSST, such improvement would still produce significant numbers of false positives, in which case using calibrated probabilities will be essential for population analysis of large populations of lenses., Comment: 14 pages, 9 figures. Accepted for publication in MNRAS

Federated learning (FL) enables multiple sites to collaboratively train powerful deep models without compromising data privacy and security. The statistical heterogeneity (e.g., non-IID data and domain shifts) is a primary obstacle in FL, impairing the generalization performance of the global model. Weakly supervised segmentation, which uses sparsely-grained (i.e., point-, bounding box-, scribble-, block-wise) supervision, is increasingly being paid attention to due to its great potential of reducing annotation costs. However, there may exist label heterogeneity, i.e., different annotation forms across sites. In this paper, we propose a novel personalized FL framework for medical image segmentation, named FedICRA, which uniformly leverages heterogeneous weak supervision via adaptIve Contrastive Representation and Aggregation. Concretely, to facilitate personalized modeling and to avoid confusion, a channel selection based site contrastive representation module is employed to adaptively cluster intra-site embeddings and separate inter-site ones. To effectively integrate the common knowledge from the global model with the unique knowledge from each local model, an adaptive aggregation module is applied for updating and initializing local models at the element level. Additionally, a weakly supervised objective function that leverages a multiscale tree energy loss and a gated CRF loss is employed to generate more precise pseudo-labels and further boost the segmentation performance. Through extensive experiments on two distinct medical image segmentation tasks of different modalities, the proposed FedICRA demonstrates overwhelming performance over other state-of-the-art personalized FL methods. Its performance even approaches that of fully supervised training on centralized data. Our code and data are available at https://github.com/llmir/FedICRA., Comment: 13 pages, 7 figures

We report the discovery of new lensed quasar candidates in the imaging data of the Hyper Suprime-Cam Subaru Strategic Program (HSC-SSP) DR4, covering $1\,310~{\rm deg}^2$ of the sky with seeing of $\approx0.6''$. In addition to two catalogs of MILLIQUAS and AllWISEAGN, which contain confirmed and candidate quasars, we preselect quasar sources using color cuts from the HSC ($grizy$) and unWISE ($W1+W2$) photometric data based on SDSS spectroscopic catalogs. We search for the presence of multiple point sources with similar color through the convolution of the Laplacian of the preselected quasar image cutouts with the Laplacian of the point spread function, resulting in a reduction of lens candidates from $1\,652\,329$ to $121\,511$ ($7.4\%$). After visual binary classification, we grade $6\,199$ ($0.4\%$) potential lenses on a scale of 0 to 3, with 3 indicating a lens and 0 indicating a non-lens. Finally we obtain 162 lens candidates with an average grade of $\geq2$, and among them, we successfully recover 18 known lenses. By fitting the light distribution and removing the known contaminants, we discover that 57 new systems contain at least two point sources and a galaxy in between, including 10 possible quadruply lensed quasars. This new sample of lens candidates exhibits a median separation of $1.26''$ and a magnitude limit of $i\approx22$. Spectroscopic or high-resolution imaging follow up on these newly discovered lensed quasar candidates will further allow their natures to be confirmed., Comment: 25 pages, 14 figures

In recent years, self-supervised monocular depth estimation has drawn much attention since it frees of depth annotations and achieved remarkable results on standard benchmarks. However, most of existing methods only focus on either daytime or nighttime images, thus their performance degrades on the other domain because of the large domain shift between daytime and nighttime images. To address this problem, in this paper we propose a two-branch network named GlocalFuse-Depth for self-supervised depth estimation of all-day images. The daytime and nighttime image in input image pair are fed into the two branches: CNN branch and Transformer branch, respectively, where both fine-grained details and global dependency can be efficiently captured. Besides, a novel fusion module is proposed to fuse multi-dimensional features from the two branches. Extensive experiments demonstrate that GlocalFuse-Depth achieves state-of-the-art results for all-day images on the Oxford RobotCar dataset, which proves the superiority of our method.

Weakly-supervised learning (WSL) has been proposed to alleviate the conflict between data annotation cost and model performance through employing sparsely-grained (i.e., point-, box-, scribble-wise) supervision and has shown promising performance, particularly in the image segmentation field. However, it is still a very challenging task due to the limited supervision, especially when only a small number of labeled samples are available. Additionally, almost all existing WSL segmentation methods are designed for star-convex structures which are very different from curvilinear structures such as vessels and nerves. In this paper, we propose a novel sparsely annotated segmentation framework for curvilinear structures, named YoloCurvSeg. A very essential component of YoloCurvSeg is image synthesis. Specifically, a background generator delivers image backgrounds that closely match the real distributions through inpainting dilated skeletons. The extracted backgrounds are then combined with randomly emulated curves generated by a Space Colonization Algorithm-based foreground generator and through a multilayer patch-wise contrastive learning synthesizer. In this way, a synthetic dataset with both images and curve segmentation labels is obtained, at the cost of only one or a few noisy skeleton annotations. Finally, a segmenter is trained with the generated dataset and possibly an unlabeled dataset. The proposed YoloCurvSeg is evaluated on four publicly available datasets (OCTA500, CORN, DRIVE and CHASEDB1) and the results show that YoloCurvSeg outperforms state-of-the-art WSL segmentation methods by large margins. With only one noisy skeleton annotation (respectively 0.14\%, 0.03\%, 1.40\%, and 0.65\% of the full annotation), YoloCurvSeg achieves more than 97\% of the fully-supervised performance on each dataset. Code and datasets will be released at https://github.com/llmir/YoloCurvSeg., Comment: 20 pages, 15 figures, MEDIA accepted

We conduct a search for galaxy-scale strong gravitational lens systems in Data Release 4 of the Hyper Suprime-Cam Subaru Strategic Program (HSC SSP), consisting of data taken up to the S21A semester. We select 103191 luminous red galaxies from the Baryon Oscillation Spectroscopic Survey (BOSS) sample that have deep multiband imaging from the HSC SSP and use the YattaLens algorithm to automatically identify lens candidates with blue arc-like features. The candidates are visually inspected and graded based on their likelihood of being a lens. We find 8 definite lenses, 28 probable lenses, and 138 possible lenses. The new lens candidates generally have lens redshifts in the range $0.3 \lesssim z_{\mathrm{L}} \lesssim 0.9$, a key intermediate redshift range to study the evolution of galaxy structure. Follow-up spectroscopy will confirm these new lenses and measure source redshifts to enable detailed lens modeling., Comment: Accepted for publication in PASJ; 12 pages, 4 figures, 2 tables