Search

Machine Learning Force Fields (MLFFs) are of great importance for chemistry, physics, materials science, and many other related fields. The Clebsch-Gordan Transform (CG transform) effectively encodes many-body interactions and is thus an important building block for many models of MLFFs. However, the permutation-equivariance requirement of MLFFs limits the design space of CG transform, that is, intensive CG transform has to be conducted for each neighboring edge and the operations should be performed in the same manner for all edges. This constraint results in reduced expressiveness of the model while simultaneously increasing computational demands. To overcome this challenge, we first implement the CG transform layer on the permutation-invariant abstract edges generated from real edge information. We show that this approach allows complete freedom in the design of the layer without compromising the crucial symmetry. Developing on this free design space, we further propose group CG transform with sparse path, abstract edges shuffling, and attention enhancer to form a powerful and efficient CG transform layer. Our method, known as FreeCG, achieves state-of-the-art (SOTA) results in force prediction for MD17, rMD17, MD22, and is well extended to property prediction in QM9 datasets with several improvements greater than 15% and the maximum beyond 20%. The extensive real-world applications showcase high practicality. FreeCG introduces a novel paradigm for carrying out efficient and expressive CG transform in future geometric neural network designs. To demonstrate this, the recent SOTA, QuinNet, is also enhanced under our paradigm. Code will be publicly available., Comment: 25 pages, 8 tables, 11 figures

Image retrieval systems conventionally use a two-stage paradigm, leveraging global features for initial retrieval and local features for reranking. However, the scalability of this method is often limited due to the significant storage and computation cost incurred by local feature matching in the reranking stage. In this paper, we present SuperGlobal, a novel approach that exclusively employs global features for both stages, improving efficiency without sacrificing accuracy. SuperGlobal introduces key enhancements to the retrieval system, specifically focusing on the global feature extraction and reranking processes. For extraction, we identify sub-optimal performance when the widely-used ArcFace loss and Generalized Mean (GeM) pooling methods are combined and propose several new modules to improve GeM pooling. In the reranking stage, we introduce a novel method to update the global features of the query and top-ranked images by only considering feature refinement with a small set of images, thus being very compute and memory efficient. Our experiments demonstrate substantial improvements compared to the state of the art in standard benchmarks. Notably, on the Revisited Oxford+1M Hard dataset, our single-stage results improve by 7.1%, while our two-stage gain reaches 3.7% with a strong 64,865x speedup. Our two-stage system surpasses the current single-stage state-of-the-art by 16.3%, offering a scalable, accurate alternative for high-performing image retrieval systems with minimal time overhead. Code: https://github.com/ShihaoShao-GH/SuperGlobal., Comment: ICCV23 camera-ready + appendix

This paper presents the 1st place solution for the Google Universal Images Embedding Competition on Kaggle. The highlighted part of our solution is based on 1) A novel way to conduct training and fine-tuning; 2) The idea of a better ensemble in the pool of models that make embedding; 3) The potential trade-off between fine-tuning on high-resolution and overlapping patches; 4) The potential factors to work for the dynamic margin. Our solution reaches 0.728 in the private leader board, which achieve 1st place in Google Universal Images Embedding Competition., Comment: 4 pages, Kaggle Competition, ECCV workshop

Deep neural networks (DNN) such as Multi-Layer Perception (MLP) and Convolutional Neural Networks (CNN) represent one of the most established deep learning algorithms. Given the tremendous effects of the number of hidden layers on network architecture and performance, it is very important to choose the number of hidden layers but still a serious challenge. More importantly, the current network architectures can only process the information from the last layer of the feature extractor, which greatly limited us to further improve its performance. Here we presented a layer-stress deep learning framework (x-NN) which implemented automatic and wise depth decision on shallow or deep feature map in a deep network through firstly designing enough number of layers and then trading off them by Multi-Head Attention Block. The x-NN can make use of features from various depth layers through attention allocation and then help to make final decision as well. As a result, x-NN showed outstanding prediction ability in the Alzheimer's Disease Classification Technique Challenge PRCV 2021, in which it won the top laurel and outperformed all other AI models. Moreover, the performance of x-NN was verified by one more AD neuroimaging dataset and other AI tasks.

Over the past few years, microRNAs (miRNAs) have emerged as a new prominent class of gene regulatory factors that negatively regulate expression of approximately one-third of the genes in animal genomes at post-transcriptional level. However, it is still unclear why some genes are regulated by miRNAs but others are not, i.e. what principles govern miRNA regulation in animal genomes. In this study, we systematically analyzed the relationship between transcription factors (TFs) and miRNAs in gene regulation. We found that the genes with more TF-binding sites have a higher probability of being targeted by miRNAs and have more miRNA-binding sites on average. This observation reveals that the genes with higher cis-regulation complexity are more coordinately regulated by TFs at the transcriptional level and by miRNAs at the post-transcriptional level. This is a potentially novel discovery of mechanism for coordinated regulation of gene expression. Gene ontology analysis further demonstrated that such coordinated regulation is more popular in the developmental genes., Comment: supplementary data available at http://www.bri.nrc.ca/wang

MicroRNAs (miRNAs) are endogenous 22-nucleotide RNAs, which suppress gene expression by selectively binding to the 3-noncoding region of specific message RNAs through base-pairing. Given the diversity and abundance of miRNA targets, miRNAs appear to functionally interact with various components of many cellular networks. By analyzing the interactions between miRNAs and a human cellular signaling network, we found that miRNAs predominantly target positive regulatory motifs, highly connected scaffolds and most downstream network components such as signaling transcription factors, but less frequently target negative regulatory motifs, common components of basic cellular machines and most upstream network components such as ligands. In addition, when an adaptor has potential to recruit more downstream components, these components are more frequently targeted by miRNAs. This work uncovers the principles of miRNA regulation of signal transduction networks and implies a potential function of miRNAs for facilitating robust transitions of cellular response to extracellular signals and maintaining cellular homeostasis.