Search

A fast non-negative latent factor (FNLF) model for a high-dimensional and sparse (HiDS) matrix adopts a Single Latent Factor-dependent, Non-negative, Multiplicative and Momentum-incorporated Update (SLF-NM2U) algorithm, which enables its fast convergence. It is crucial to achieve a rigorously theoretical proof regarding its fast convergence, which has not been provided in prior research. Aiming at addressing this critical issue, this work theoretically proves that with an appropriately chosen momentum coefficient, SLF-NM2U enables the fast convergence of an FNLF model in both continuous and discrete time cases. Empirical analysis of HiDS matrices generated by representative industrial applications provides empirical evidences for the theoretical proof. Hence, this study represents an important milestone in the field of HiDS matrix analysis.

This work proposes a scalable gamma non-negative matrix network (SGNMN), which uses a Poisson randomized Gamma factor analysis to obtain the neurons of the first layer of a network. These neurons obey Gamma distribution whose shape parameter infers the neurons of the next layer of the network and their related weights. Upsampling the connection weights follows a Dirichlet distribution. Downsampling hidden units obey Gamma distribution. This work performs up-down sampling on each layer to learn the parameters of SGNMN. Experimental results indicate that the width and depth of SGNMN are closely related, and a reasonable network structure for accurately detecting brain fatigue through functional near-infrared spectroscopy can be obtained by considering network width, depth, and parameters.

Online streaming feature selection (OSFS) has attracted extensive attention during the past decades. Current approaches commonly assume that the feature space of fixed data instances dynamically increases without any missing data. However, this assumption does not always hold in many real applications. Motivated by this observation, this study aims to implement online feature selection from sparse streaming features, i.e., features flow in one by one with missing data as instance count remains fixed. To do so, this study proposes a latent-factor-analysis-based online sparse-streaming-feature selection algorithm (LOSSA). Its main idea is to apply latent factor analysis to pre-estimate missing data in sparse streaming features before conducting feature selection, thereby addressing the missing data issue effectively and efficiently. Theoretical and empirical studies indicate that LOSSA can significantly improve the quality of OSFS when missing data are encountered in target instances.

This work investigates direction control and path following of a 3-D snake-like robot. In order to control such robots accurately, this work researches the relationships between its phase offsets of pitch joints and directions. A new direction control method is proposed for the robot based on these relationships. An adaptive path-following algorithm based on the line-of-sight guidance law is proposed and combined with the direction control method to steer the robot to move forward and along desired paths. Simulation and experimental results are presented to demonstrate the performances of the proposed 3-D model and control methods. They well outperform the classical and commonly used path-following method.

A non-negative latent factor (NLF) model with a single latent factor-dependent, non-negative and multiplicative update (SLF-NMU) algorithm is frequently adopted to extract useful knowledge from non-negative data represented by high-dimensional and sparse (HiDS) matrices arising from various service applications. However, its convergence rate is rather slow. To address this issue, this study proposes a Generalized Nesterov's acceleration-incorporated, Non-negative and Adaptive Latent Factor (GNALF) model. It results from a) incorporating a generalized Nesterov's accelerated gradient (NAG) method into an SLF-NMU algorithm, thereby achieving an NAG-incorporated and element-oriented non-negative (NEN) algorithm to perform efficient parameter update; and b) making its regularization and acceleration hyper-parameters self-adaptive via incorporating the principle of a particle swarm optimization algorithm into the training process, thereby implementing a highly adaptive and practical model. Empirical studies on six large sparse matrices from different recommendation service applications show that a GNALF model achieves very high convergence rate without the need of hyper-parameter tuning, making its computational efficiency significantly higher than state-of-the-art models. Meanwhile, such efficiency gain does not result in accuracy loss, since its prediction accuracy is comparable with its peers. Hence, it can better serve practical service applications with real-time demands.

Todays large-scale parallel workflows are often processed on heterogeneous distributed computing platforms. From an economic perspective, computing resource providers should minimize the cost while offering high service quality. It has become well-organized that energy consumption accounts for a large part of a computing systems total cost, and timeliness and reliability are two important service indicators. This article studies the problem of scheduling a parallel workflow that minimizes the system energy consumption under the constraints of response time and reliability. We first mathematically formulate this problem as a Non-linear Mixed Integer Programming problem. Since this problem is hard to solve directly, we present some highly-efficient heuristic solutions. Specifically, we first develop an algorithm that minimizes the schedule length while meeting reliability requirement, on top of which we propose a processor-merging algorithm and a slack time reclamation algorithm using a dynamic voltage frequency scaling (DVFS) technique to reduce energy consumption. The processor-merging algorithm tries to turn off some energy-inefficient processors such that energy consumption can be minimized. The DVFS technique is applied to scale down the processor frequency at both processor and task levels to reduce energy consumption. Experimental results on two real-life workflows and extensive synthetic parallel workflows demonstrate their effectiveness.

A growing number of organizations are hosting their software applications in distributed data centers (DCs) in the cloud, for faster response time and higher energy efficiency. The dramatic increase of user tasks, however, poses a significant challenge on DC providers to retain users' expectations on both aspects. To tackle this challenge, this work first formulates the problem into a constrained biobjective optimization problem. A biobjective algorithm, named simulated-annealing-based adaptive differential evolution (SADE), is presented to simultaneously reduce both the response time of tasks and energy cost. Meanwhile, a method of minimal Manhattan distance is adopted to search for a final knee, for achieving a good balance between response time minimization and energy cost reduction. Experimental results on real-life datasets, i.e., the electricity prices and tasks collected from a Google cluster trace, have proved that SADE yields less task response time and lower energy cost compared with state-of-the-art algorithms.

Particle swarm optimizer (PSO) and mobile robot swarm are two typical swarm techniques. Many applications emerge separately along both of them while the similarity between them is rarely considered. When a solution space is a certain region in reality, a robot swarm can replace a particle swarm to explore the optimal solution by performing PSO. In this way, a mobile robot swarm should be able to efficiently explore an area just like the particle swarm and uninterruptedly work even under the shortage of robots or in the case of unexpected failure of robots. Furthermore, the moving distances of robots are highly constrained because energy and time can be costly. Inspired by such requirements, this article proposes a moving-distance-minimized PSO (MPSO) for a mobile robot swarm to minimize the total moving distance of its robots while performing optimization. The distances between the current robot positions and the particle ones in the next generation are utilized to derive paths for robots such that the total distance that robots move is minimized, hence minimizing the energy and time for a robot swarm to locate the optima. Experiments on 28 CEC2013 benchmark functions show the advantage of the proposed method over the standard PSO. By adopting the given algorithm, the moving distance can be reduced by more than 66% and the makespan can be reduced by nearly 70% while offering the same optimization effects.

A colored traveling salesman problem (CTSP) as a generalization of the well-known multiple traveling salesman problem utilizes colors to distinguish the accessibility of individual cities to salesmen. This work formulates a precedence-constrained CTSP (PCTSP) over hypergraphs with asymmetric city distances. It is capable of modeling the problems with operations or activities constrained to precedence relationships in many applications. Two types of precedence constraints are taken into account, i.e., 1) among individual cities and 2) among city clusters. An augmented variable neighborhood search (VNS) called POPMUSIC-based VNS (PVNS) is proposed as a main framework for solving PCTSP. It harnesses a partial optimization metaheuristic under special intensification conditions to prepare candidate sets. Moreover, a topological sort-based greedy algorithm is developed to obtain a feasible solution at the initialization phase. Next, mutation and multi-insertion of constraint-preserving exchanges are combined to produce different neighborhoods of the current solution. Two kinds of constraint-preserving k -exchange are adopted to serve as a strong local search means. Extensive experiments are conducted on 34 cases. For the sake of comparison, Lin-Kernighan heuristic, two genetic algorithms and three VNS methods are adapted to PCTSP and fine-tuned by using an automatic algorithm configurator-irace package. The experimental results show that PVNS outperforms them in terms of both search ability and convergence rate. In addition, the study of four PVNS variants each lacking an important operator reveals that all operators play significant roles in PVNS.

A colored traveling salesman problem (CTSP) is a generalization of the well-known multiple traveling salesman problem. In it, each city has one to multiple colors and allows a salesman in the same color to visit exactly once. This work presents for the first time a CTSP whose edge weights among the cities change over time. It can be applied to dynamic routing problems arising in logistic distribution systems with various goods accessibilities to different types of vehicles. A non-linear integer mathematical program is constructed. A Variable Neighborhood Search (VNS) algorithm with a direct-route encoding and random initialization is then presented to solve it. To increase the convergence rate and population diversity of VNS, it is further combined with two-stage greedy initialization and an appropriate population immigrant scheme to perform the population search in a dynamic environment. Then, off-line performance evaluation and Wilcoxon test of the proposed algorithms are performed. The results show that their solution quality is improved by 30% ~ 60% over the basic VNS's. They can track the environmental changes of CTSP-VEW more rapidly and effectively. In the end, a case study with a practical scenario is conducted.

The relationship between flight performance and multi-physiological parameters under different flight operating patterns is unknown. This work proposes a Stacked Gaussian Process Network (SGPN) to reveal it. SGPN is a multi-layer network model formed by recursion from a regular Gaussian process and random disturbance. This work constructs an auxiliary variable strategy with the induced points to improve its learning efficiency, thus leading to a sparse SGPN model. In it, a Gaussian process acts as an activation function of each node, but the entire model is no longer a Gaussian process and thus very challenging to solve it. This work presents its solution via variational approximate inference. Experimental results of pilot flight performance evaluation show that the proposed model has stronger learning and generalization ability than its seven competitive peers. It is able to approximate non-linear coupling relationship between multi-physiological parameters and flight height differences.

Although spatial information of images usually enhance the robustness of the Fuzzy C-Means (FCM) algorithm, it greatly increases the computational costs for image segmentation. To achieve a sound trade-off between the segmentation performance and the speed of clustering, we come up with a Kullback-Leibler (KL) divergence-based FCM algorithm by incorporating a tight wavelet frame transform and a morphological reconstruction operation. To enhance FCM's robustness, an observed image is first filtered by using the morphological reconstruction. A tight wavelet frame system is employed to decompose the observed and filtered images so as to form their feature sets. Considering these feature sets as data of clustering, an modified FCM algorithm is proposed, which introduces a KL divergence term in the partition matrix into its objective function. The KL divergence term aims to make membership degrees of each image pixel closer to those of its neighbors, which brings that the membership partition becomes more suitable and the parameter setting of FCM becomes simplified. On the basis of the obtained partition matrix and prototypes, the segmented feature set is reconstructed by minimizing the inverse process of the modified objective function. To modify abnormal features produced in the reconstruction process, each reconstructed feature is reassigned to the closest prototype. As a result, the segmentation accuracy of KL divergence-based FCM is further improved. What's more, the segmented image is reconstructed by using a tight wavelet frame reconstruction operation. Finally, supporting experiments coping with synthetic, medical and color images are reported. Experimental results exhibit that the proposed algorithm works well and comes with better segmentation performance than other comparative algorithms. Moreover, the proposed algorithm requires less time than most of the FCM-related algorithms., Comment: This paper has been withdrawn by the author due to a crucial definition error of objective function

Stochastic point location deals with the problem of finding a target point on a real line through a learning mechanism (LM) with the stochastic environment (SE) offering directional information. The SE can be further categorized into an informative or deceptive one, according to whether p is above 0.5 or not, where p is the probability of providing a correct suggestion of a direction to LM. Several attempts have been made for LM to work in both types of environments, but none of them considers a dynamically changing environment where p varies with time. A dynamic dual environment involves fierce changes that frequently cause its environment to switch from an informative one to a deceptive one, or vice versa. This article presents a novel weak estimator-based adaptive step search solution, to enable LM to track the target in a dynamic dual environment, with the help of a weak estimator. The experimental results show that the proposed solution is feasible and efficient.

Accurate estimation of network capacity is very important for Vehicular Infrastructure-based NETwork (VINET) in an urban scene that may involve greatly dynamic typology and complex driving conditions. The node mobility, network behavior, and network scale of a VINET are different from those of a wireless network, and, therefore, the existing capacity estimation methods of wireless networks cannot be used to estimate VINET capacity. In addition, most existing studies on VINET capacity only derive asymptotic descriptions when the number of nodes is large enough. In this work, a novel approach is proposed for the modeling and calculating VINET capacity. More specifically, we first analyze communication characteristics in a VINET, and introduce two transmission modes, i.e., a vehicle-based mode and a Road Side Unit (RSU)-based one. Then, we propose a probability-based transmission mode selecting strategy with which vehicle nodes can choose either transmission mode independently and such choice is probabilistic. Next, we analyze the characteristics of an RSU-based mode, divide a VINET into a number of communities according to the position and communication range of RSUs, and derive the capacity contributed by an RSU-based mode. Then, we calculate the capacity contributed by a vehicle-based mode based on fluid mechanics. Finally, the VINET capacity can be calculated. The proposed VINET capacity estimation approach is validated to be consistent with simulation results.