1. Optimization of parallel SVM algorithm for big data.
- Author
-
Xue, Rui and Cai, Yan
- Subjects
- *
PARALLEL algorithms , *OPTIMIZATION algorithms , *BIG data , *PARTICLE swarm optimization , *SUPPORT vector machines , *DATA mining , *NOISE control - Abstract
Parallel Support Vector Machine (SVM) based on big data has achieved some results in data mining, but due to the complexity of the data itself and a large amount of noisy data, its execution efficiency and classification accuracy in the big data environment are very low. In order to eliminate noise, a noise reduction method based on Noise Cleaning (NC) strategy was proposed, and redundant training samples in big data environments were deleted; Introduce an improved Artificial Fish Swarm Algorithm (IAFSA) to obtain the final Parallel SVM algorithm using mutual information and artificial fish swarm algorithm based on MapReduce (MIAFSA-PSVM) classification model. The results indicate that when compared to CMI-PSVM, the execution time of MIAFSA-PSVM algorithm is higher on the NDC dataset with the largest data size, The SVM parameter optimization algorithm based on MapReduce and cuckoo search (CSSVM-MR) and the particle swarm optimization based parallel support vector machine ensemble algorithm (PSO-PSVM) decreased by 40.1%, 79.3%, and 51.7%, respectively. This indicates that GIESVM-MR and MIAFSA-PSVM have strong adaptability to big data environments and high classification accuracy. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF