Search

The qualities of new data used in the sequential learning phase of the online sequential extreme learning machine algorithm (OS-ELM) have a significant impact on the performance of OS-ELM. This paper proposes a novel data filter mechanism for OS-ELM from the perspective of fuzziness and a fuzziness-based online sequential extreme learning machine algorithm (FOS-ELM). In FOS-ELM, when new data arrive, a fuzzy classifier first picks out the meaningful data according to the fuzziness of each sample. Specifically, the new samples with high-output fuzziness are selected and then used in sequential learning. The experimental results on eight binary classification problems and three multiclass classification problems have shown that FOS-ELM updated by the new samples with high-output fuzziness has better generalization performance than OS-ELM. Since the unimportant data are discarded before sequential learning, FOS-ELM can save more memory and have higher computational efficiency. In addition, FOS-ELM can handle data one-by-one or chunk-by-chunk with fixed or varying sizes. The relationship between the fuzziness of new samples and the model performance is also studied in this paper, which is expected to provide some useful guidelines for improving the generalization ability of online sequential learning algorithms. [ABSTRACT FROM AUTHOR]

In this paper, a hybrid sunflower-teaching learning-based optimization (SFO-TLBO) algorithm has been proposed, integrating two well-known algorithms, namely sunflower optimization, and teaching–learning-based optimization. The proposed hybrid SFO-TLBO algorithm has been incorporated based on the ratio of the fitness value of the search agent and the average fitness value of the population. The SFO has more tendency of global exploration but has a problem of slow convergence speed. On the other hand, the convergence of the TLBO algorithm is fast, but it may get stuck in local optima. In this work, we have hybridized SFO with TLBO to take advantage of both the algorithms and also to balance the trade-off between exploitation and exploration. The proposed hybrid SFO-TLBO has been first applied to nineteen test benchmark functions. The outcomes have been compared with twelve state-of-the-art algorithms. In seventeen benchmark test functions, better performance has been achieved by the proposed hybrid SFO-TLBO. Also, the proposed hybrid SFO-TLBO algorithm has been used to solve an Internet of Vehicles (IoV) optimization problem and performance has been compared with fifteen state-of-the-art algorithms. In solving the IoV problem, hybrid SFO-TLBO has been achieved better performance in comparison with all fifteen considered algorithms which showcases the applicability of hybrid SFO-TLBO algorithm in resolving large-scale, real-world problems. In addition, for feature selection problems, a binary version of hybrid SFO-TLBO has been proposed, in which a wrapper approach is used to decide an optimal subset of features with a k-nearest neighbor classifier. The proposed binary method also determines an optimal value of k for the k-nearest neighbor classifier. The binary hybrid SFO-TLBO algorithm has been applied to the QSAR biodegradation dataset for classification, and for evidencing its efficiency, its performance has been compared with the other state-of-the-art algorithms. The results of the proposed approach are quite encouraging, and an average accuracy of 89.10% has been achieved. [ABSTRACT FROM AUTHOR]

This paper introduces an electromagnetism-like (EM) approach for solving the problem of parameter tuning in the support vector machine (SVM). The proposed method is used to tune binary SVM classifiers in single and multiple kernel mode. The internal kernel structure is based on linear and radial basis functions (RBF). An appropriate encoding scheme of EM enables easy transformation of real-valued EM points directly to real-valued parameter combinations. Estimations of the generalization error based on the cross-validation and validation set error are used as objective functions. The efficient local search procedure uses variable size interval movement in order to improve the convergence of the method. The quality of the proposed method is tested on four collections of testing benchmarks through five separate experiments. The first three collections consist of small-size to medium-size classification data sets with up to 60 features and 1,300 training vectors, while the fourth collection is formed of large heterogeneous data sets with up to 1,554 features and 2,186 training vectors. The obtained results indicate that EM outperforms the comparison algorithms in 10 out of 13 instances from the first collection, 5 out of 5 instances from the second, and 13 out of 15 instances from the third collection. The last two experiments, conducted on the fourth collection, show that the proposed method outperforms 14 successful methods in 3 out of 5 data sets where RBF multiple kernel learning is used, and behaves competitively in cases when linear kernels are used. [ABSTRACT FROM AUTHOR]