1. 다중 DNN 모델 벤치마킹을 위한 MLPerf.
- Author
-
이승재 and 김명선
- Abstract
Hardware and software technologies are being developed to efficiently run various deep learning models from embedded systems to servers. Moreover, multiple deep learning models compete for system resources such as CPU and memory to meet the diverse needs of users and improve recognition accuracy. MLPerf was developed to objectively evaluate these deep learning model execution devices. However, the current MLPerf executes DNN models in a serialized manner, which does not reflect the real-world environment where multiple DNN models are running. In this paper, we improve MLPerf to enable the simultaneous execution needs of multiple DNNs through multi-threading-based query parallelization, and to enable multiple DNN models to be executed on the target system similar to the real environment. The experimental results show that the query processing performance is about two times higher than the existing one, which is similar to the actual execution environment. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF