Search

Your search keyword '"Shen, Ruimin"' showing total 364 results
Start Over Author "Shen, Ruimin"
364 results on '"Shen, Ruimin"'

2. Lamarckian Platform: Pushing the Boundaries of Evolutionary Reinforcement Learning towards Asynchronous Commercial Games

Author

Bai, Hui, Shen, Ruimin, Lin, Yue, Xu, Botian, and Cheng, Ran

Subjects
Computer Science - Machine Learning, Computer Science - Artificial Intelligence, Computer Science - Neural and Evolutionary Computing
Abstract

Despite the emerging progress of integrating evolutionary computation into reinforcement learning, the absence of a high-performance platform endowing composability and massive parallelism causes non-trivial difficulties for research and applications related to asynchronous commercial games. Here we introduce Lamarckian - an open-source platform featuring support for evolutionary reinforcement learning scalable to distributed computing resources. To improve the training speed and data efficiency, Lamarckian adopts optimized communication methods and an asynchronous evolutionary reinforcement learning workflow. To meet the demand for an asynchronous interface by commercial games and various methods, Lamarckian tailors an asynchronous Markov Decision Process interface and designs an object-oriented software architecture with decoupled modules. In comparison with the state-of-the-art RLlib, we empirically demonstrate the unique advantages of Lamarckian on benchmark tests with up to 6000 CPU cores: i) both the sampling efficiency and training speed are doubled when running PPO on Google football game; ii) the training speed is 13 times faster when running PBT+PPO on Pong game. Moreover, we also present two use cases: i) how Lamarckian is applied to generating behavior-diverse game AI; ii) how Lamarckian is applied to game balancing tests for an asynchronous commercial game.

Published
2022

9. Diverse Behavior Is What Game AI Needs: Generating Varied Human-Like Playing Styles Using Evolutionary Multi-Objective Deep Reinforcement Learning

Author

Shen, Ruimin, Zheng, Yan, Hao, Jianye, Chen, Yinfeng, and Fan, Changjie

Subjects
Computer Science - Machine Learning, Statistics - Machine Learning
Abstract

this paper has been withdrawn, Comment: 1. there is some discrepancy between some contributors with respect to the order of the authors; 2. the paper is rather "raw" - significant effort and improvement in terms of the paper's language and structure are needed to make it ready for publication

Published
2019

11. Efficient Two-Dimensional Sparse Coding Using Tensor-Linear Combination

Author

Jiang, Fei, Liu, Xiao-Yang, Lu, Hongtao, and Shen, Ruimin

Subjects
Computer Science - Computer Vision and Pattern Recognition
Abstract

Sparse coding (SC) is an automatic feature extraction and selection technique that is widely used in unsupervised learning. However, conventional SC vectorizes the input images, which breaks apart the local proximity of pixels and destructs the elementary object structures of images. In this paper, we propose a novel two-dimensional sparse coding (2DSC) scheme that represents the input images as the tensor-linear combinations under a novel algebraic framework. 2DSC learns much more concise dictionaries because it uses the circular convolution operator, since the shifted versions of atoms learned by conventional SC are treated as the same ones. We apply 2DSC to natural images and demonstrate that 2DSC returns meaningful dictionaries for large patches. Moreover, for mutli-spectral images denoising, the proposed 2DSC reduces computational costs with competitive performance in comparison with the state-of-the-art algorithms.

Published
2017

12. Graph Regularized Tensor Sparse Coding for Image Representation

Author

Jiang, Fei, Liu, Xiao-Yang, Lu, Hongtao, and Shen, Ruimin

Subjects
Computer Science - Computer Vision and Pattern Recognition
Abstract

Sparse coding (SC) is an unsupervised learning scheme that has received an increasing amount of interests in recent years. However, conventional SC vectorizes the input images, which destructs the intrinsic spatial structures of the images. In this paper, we propose a novel graph regularized tensor sparse coding (GTSC) for image representation. GTSC preserves the local proximity of elementary structures in the image by adopting the newly proposed tubal-tensor representation. Simultaneously, it considers the intrinsic geometric properties by imposing graph regularization that has been successfully applied to uncover the geometric distribution for the image data. Moreover, the returned sparse representations by GTSC have better physical explanations as the key operation (i.e., circular convolution) in the tubal-tensor model preserves the shifting invariance property. Experimental results on image clustering demonstrate the effectiveness of the proposed scheme.

Published
2017

14. Fast and Accurate Hand-Raising Gesture Detection in Classroom

Author

Liu, Tao, Jiang, Fei, Shen, Ruimin, Filipe, Joaquim, Editorial Board Member, Ghosh, Ashish, Editorial Board Member, Prates, Raquel Oliveira, Editorial Board Member, Zhou, Lizhu, Editorial Board Member, Yang, Haiqin, editor, Pasupa, Kitsuchart, editor, Leung, Andrew Chi-Sing, editor, Kwok, James T., editor, Chan, Jonathan H., editor, and King, Irwin, editor

Published
2020
Full Text
View/download PDF

15. Facial Action Units Intensity Estimation via Graph Relation Network

Author

Wang, Ce, Jiang, Fei, Shen, Ruimin, Goos, Gerhard, Founding Editor, Hartmanis, Juris, Founding Editor, Bertino, Elisa, Editorial Board Member, Gao, Wen, Editorial Board Member, Steffen, Bernhard, Editorial Board Member, Woeginger, Gerhard, Editorial Board Member, Yung, Moti, Editorial Board Member, Yang, Haiqin, editor, Pasupa, Kitsuchart, editor, Leung, Andrew Chi-Sing, editor, Kwok, James T., editor, Chan, Jonathan H., editor, and King, Irwin, editor

Published
2020
Full Text
View/download PDF

16. An Effective Yawn Behavior Detection Method in Classroom

Author

Wang, Zexian, Jiang, Fei, Shen, Ruimin, Goos, Gerhard, Founding Editor, Hartmanis, Juris, Founding Editor, Bertino, Elisa, Editorial Board Member, Gao, Wen, Editorial Board Member, Steffen, Bernhard, Editorial Board Member, Woeginger, Gerhard, Editorial Board Member, Yung, Moti, Editorial Board Member, Gedeon, Tom, editor, Wong, Kok Wai, editor, and Lee, Minho, editor

Published
2019
Full Text
View/download PDF

18. Sparse Group Restricted Boltzmann Machines

Author

Luo, Heng, Shen, Ruimin, and Niu, Cahngyong

Subjects
Statistics - Machine Learning
Abstract

Since learning is typically very slow in Boltzmann machines, there is a need to restrict connections within hidden layers. However, the resulting states of hidden units exhibit statistical dependencies. Based on this observation, we propose using $l_1/l_2$ regularization upon the activation possibilities of hidden units in restricted Boltzmann machines to capture the loacal dependencies among hidden units. This regularization not only encourages hidden units of many groups to be inactive given observed data but also makes hidden units within a group compete with each other for modeling observed data. Thus, the $l_1/l_2$ regularization on RBMs yields sparsity at both the group and the hidden unit levels. We call RBMs trained with the regularizer \emph{sparse group} RBMs. The proposed sparse group RBMs are applied to three tasks: modeling patches of natural images, modeling handwritten digits and pretaining a deep networks for a classification task. Furthermore, we illustrate the regularizer can also be applied to deep Boltzmann machines, which lead to sparse group deep Boltzmann machines. When adapted to the MNIST data set, a two-layer sparse group Boltzmann machine achieves an error rate of $0.84\%$, which is, to our knowledge, the best published result on the permutation-invariant version of the MNIST task.

Published
2010

20. Multi-object Detection Based on Deep Learning in Real Classrooms

Author

Shao, Benchi, Jiang, Fei, Shen, Ruimin, Hutchison, David, Series Editor, Kanade, Takeo, Series Editor, Kittler, Josef, Series Editor, Kleinberg, Jon M., Series Editor, Mattern, Friedemann, Series Editor, Mitchell, John C., Series Editor, Naor, Moni, Series Editor, Pandu Rangan, C., Series Editor, Steffen, Bernhard, Series Editor, Terzopoulos, Demetri, Series Editor, Tygar, Doug, Series Editor, Weikum, Gerhard, Series Editor, Geng, Xin, editor, and Kang, Byeong-Ho, editor

Published
2018
Full Text
View/download PDF

23. Highly Occluded Face Detection: An Improved R-FCN Approach

Author

Liu, Lin, Jiang, Fei, Shen, Ruimin, Hutchison, David, Series editor, Kanade, Takeo, Series editor, Kittler, Josef, Series editor, Kleinberg, Jon M., Series editor, Mattern, Friedemann, Series editor, Mitchell, John C., Series editor, Naor, Moni, Series editor, Pandu Rangan, C., Series editor, Steffen, Bernhard, Series editor, Terzopoulos, Demetri, Series editor, Tygar, Doug, Series editor, Weikum, Gerhard, Series editor, Liu, Derong, editor, Xie, Shengli, editor, Li, Yuanqing, editor, Zhao, Dongbin, editor, and El-Alfy, El-Sayed M., editor

Published
2017
Full Text
View/download PDF

24. Structure-Preserved Face Cartoonization

Author

Gao, Chenhao, Sheng, Bin, Shen, Ruimin, Hutchison, David, Series editor, Kanade, Takeo, Series editor, Kittler, Josef, Series editor, Kleinberg, Jon M., Series editor, Mattern, Friedemann, Series editor, Mitchell, John C., Series editor, Naor, Moni, Series editor, Pandu Rangan, C., Series editor, Steffen, Bernhard, Series editor, Terzopoulos, Demetri, Series editor, Tygar, Doug, Series editor, Weikum, Gerhard, Series editor, Liu, Derong, editor, Xie, Shengli, editor, Li, Yuanqing, editor, Zhao, Dongbin, editor, and El-Alfy, El-Sayed M., editor

Published
2017
Full Text
View/download PDF

25. Region-Based Face Alignment with Convolution Neural Network Cascade

Author

Zhang, Yu, Jiang, Fei, Shen, Ruimin, Hutchison, David, Series editor, Kanade, Takeo, Series editor, Kittler, Josef, Series editor, Kleinberg, Jon M., Series editor, Mattern, Friedemann, Series editor, Mitchell, John C., Series editor, Naor, Moni, Series editor, Pandu Rangan, C., Series editor, Steffen, Bernhard, Series editor, Terzopoulos, Demetri, Series editor, Tygar, Doug, Series editor, Weikum, Gerhard, Series editor, Liu, Derong, editor, Xie, Shengli, editor, Li, Yuanqing, editor, Zhao, Dongbin, editor, and El-Alfy, El-Sayed M., editor

Published
2017
Full Text
View/download PDF

38. Personalized Course Generation Based on Layered Recommendation Systems

Author

Tan, Xiaohong, Shen, Ruimin, Hutchison, David, Series editor, Kanade, Takeo, Series editor, Kittler, Josef, Series editor, Kleinberg, Jon M., Series editor, Kobsa, Alfred, Series editor, Mattern, Friedemann, Series editor, Mitchell, John C., Series editor, Naor, Moni, Series editor, Nierstrasz, Oscar, Series editor, Pandu Rangan, C., Series editor, Steffen, Bernhard, Series editor, Terzopoulos, Demetri, Series editor, Tygar, Doug, Series editor, Weikum, Gerhard, Series editor, Popescu, Elvira, editor, Lau, Rynson W. H., editor, Pata, Kai, editor, Leung, Howard, editor, and Laanpere, Mart, editor

Published
2014
Full Text
View/download PDF

39. A Comparative Study on Evolutionary Algorithms for Many-Objective Optimization

Author

Li, Miqing, Yang, Shengxiang, Liu, Xiaohui, Shen, Ruimin, Hutchison, David, editor, Kanade, Takeo, editor, Kittler, Josef, editor, Kleinberg, Jon M., editor, Mattern, Friedemann, editor, Mitchell, John C., editor, Naor, Moni, editor, Nierstrasz, Oscar, editor, Pandu Rangan, C., editor, Steffen, Bernhard, editor, Sudan, Madhu, editor, Terzopoulos, Demetri, editor, Tygar, Doug, editor, Vardi, Moshe Y., editor, Weikum, Gerhard, editor, Purshouse, Robin C., editor, Fleming, Peter J., editor, Fonseca, Carlos M., editor, Greco, Salvatore, editor, and Shaw, Jane, editor

Published
2013
Full Text
View/download PDF

42. Requirements of Chinese Teachers for Online Student Tracking and a Comparison to Their Western Counterparts

Author

Tan, Xiaohong, Ullrich, Carsten, Scheuer, Oliver, Melis, Erica, Shen, Ruimin, Hutchison, David, Series editor, Kanade, Takeo, Series editor, Kittler, Josef, Series editor, Kleinberg, Jon M., Series editor, Mattern, Friedemann, Series editor, Mitchell, John C., Series editor, Naor, Moni, Series editor, Nierstrasz, Oscar, Series editor, Pandu Rangan, C., Series editor, Steffen, Bernhard, Series editor, Sudan, Madhu, Series editor, Terzopoulos, Demetri, Series editor, Tygar, Doug, Series editor, Vardi, Moshe Y., Series editor, Weikum, Gerhard, Series editor, Luo, Xiangfeng, editor, Cao, Yiwei, editor, Yang, Bo, editor, Liu, Jianxun, editor, and Ye, Feiyue, editor

Published
2011
Full Text
View/download PDF

45. Cross-Cultural Multimedia Language Learning: Case Study and Analysis

Author

Ullrich, Carsten, Borau, Kerstin, Grant, Scott, Jackson, Daniel, Shen, Ruimin, Hutchison, David, Series editor, Kanade, Takeo, Series editor, Kittler, Josef, Series editor, Kleinberg, Jon M., Series editor, Mattern, Friedemann, Series editor, Mitchell, John C., Series editor, Naor, Moni, Series editor, Nierstrasz, Oscar, Series editor, Pandu Rangan, C., Series editor, Steffen, Bernhard, Series editor, Sudan, Madhu, Series editor, Terzopoulos, Demetri, Series editor, Tygar, Doug, Series editor, Vardi, Moshe Y., Series editor, Weikum, Gerhard, Series editor, Luo, Xiangfeng, editor, Spaniol, Marc, editor, Wang, Lizhe, editor, Li, Qing, editor, Nejdl, Wolfgang, editor, and Zhang, Wu, editor

Published
2010
Full Text
View/download PDF

46. An Effort to Boost Building an Attentive Service Environment for the Participants in Smart Classrooms

Author

Gu, Hongliang, Shen, Ruimin, Hutchison, David, Series editor, Kanade, Takeo, Series editor, Kittler, Josef, Series editor, Kleinberg, Jon M., Series editor, Mattern, Friedemann, Series editor, Mitchell, John C., Series editor, Naor, Moni, Series editor, Nierstrasz, Oscar, Series editor, Pandu Rangan, C., Series editor, Steffen, Bernhard, Series editor, Sudan, Madhu, Series editor, Terzopoulos, Demetri, Series editor, Tygar, Doug, Series editor, Vardi, Moshe Y., Series editor, Weikum, Gerhard, Series editor, Luo, Xiangfeng, editor, Spaniol, Marc, editor, Wang, Lizhe, editor, Li, Qing, editor, Nejdl, Wolfgang, editor, and Zhang, Wu, editor

Published
2010
Full Text
View/download PDF

47. Not Yet Ready for Everyone: An Experience Report about a Personal Learning Environment for Language Learning

Author

Ullrich, Carsten, Shen, Ruimin, Gillet, Denis, Hutchison, David, Series editor, Kanade, Takeo, Series editor, Kittler, Josef, Series editor, Kleinberg, Jon M., Series editor, Mattern, Friedemann, Series editor, Mitchell, John C., Series editor, Naor, Moni, Series editor, Nierstrasz, Oscar, Series editor, Pandu Rangan, C., Series editor, Steffen, Bernhard, Series editor, Sudan, Madhu, Series editor, Terzopoulos, Demetri, Series editor, Tygar, Doug, Series editor, Vardi, Moshe Y., Series editor, Weikum, Gerhard, Series editor, Luo, Xiangfeng, editor, Spaniol, Marc, editor, Wang, Lizhe, editor, Li, Qing, editor, Nejdl, Wolfgang, editor, and Zhang, Wu, editor

Published
2010
Full Text
View/download PDF

48. Enhancing Diversity for Average Ranking Method in Evolutionary Many-Objective Optimization

Author

Li, Miqing, Zheng, Jinhua, Li, Ke, Yuan, Qizhao, Shen, Ruimin, Hutchison, David, editor, Kanade, Takeo, editor, Kittler, Josef, editor, Kleinberg, Jon M., editor, Mattern, Friedemann, editor, Mitchell, John C., editor, Naor, Moni, editor, Nierstrasz, Oscar, editor, Pandu Rangan, C., editor, Steffen, Bernhard, editor, Sudan, Madhu, editor, Terzopoulos, Demetri, editor, Tygar, Doug, editor, Vardi, Moshe Y., editor, Weikum, Gerhard, editor, Schaefer, Robert, editor, Cotta, Carlos, editor, Kołodziej, Joanna, editor, and Rudolph, Günter, editor

Published
2010
Full Text
View/download PDF

49. A Sound-Directed Cameraman Accommodating Unfettered-Speaking in e-Learning Classrooms

Author

Gu, Hongliang, Shen, Ruimin, Chen, Zeyu, Hutchison, David, editor, Kanade, Takeo, editor, Kittler, Josef, editor, Kleinberg, Jon M., editor, Mattern, Friedemann, editor, Mitchell, John C., editor, Naor, Moni, editor, Nierstrasz, Oscar, editor, Pandu Rangan, C., editor, Steffen, Bernhard, editor, Sudan, Madhu, editor, Terzopoulos, Demetri, editor, Tygar, Doug, editor, Vardi, Moshe Y., editor, Weikum, Gerhard, editor, Muneesawang, Paisarn, editor, Wu, Feng, editor, Kumazawa, Itsuo, editor, Roeksabutr, Athikom, editor, Liao, Mark, editor, and Tang, Xiaoou, editor

Published
2009
Full Text
View/download PDF

50. Microblogging for Language Learning: Using Twitter to Train Communicative and Cultural Competence

Author

Borau, Kerstin, Ullrich, Carsten, Feng, Jinjin, Shen, Ruimin, Hutchison, David, Series editor, Kanade, Takeo, Series editor, Kittler, Josef, Series editor, Kleinberg, Jon M., Series editor, Mattern, Friedemann, Series editor, Mitchell, John C., Series editor, Naor, Moni, Series editor, Nierstrasz, Oscar, Series editor, Pandu Rangan, C., Series editor, Steffen, Bernhard, Series editor, Sudan, Madhu, Series editor, Terzopoulos, Demetri, Series editor, Tygar, Doug, Series editor, Vardi, Moshe Y., Series editor, Weikum, Gerhard, Series editor, Spaniol, Marc, editor, Li, Qing, editor, Klamma, Ralf, editor, and Lau, Rynson W. H., editor

Published
2009
Full Text
View/download PDF

Catalog

Books, media, physical & digital resources
See catalog results