An Efficient Approach of GPU-accelerated Stochastic Gradient Descent Method for Matrix Factorization

Feng Li,
Yunming Ye,
Xutao Li,

Abstract


Matrix Factorization (MF) is a very effective tool for Collaborative Filtering (CF) in recommender systems. As a popular solver, Stochastic Gradient Descent (SGD) is widely utilized to find MF solutions for CF. However, SGD solver often suffers from a very slow optimization process, due to its large computation burden. How to speed up it becomes a very important research topic. One of the main techniques to the problem is partitioning the matrix to factorize into blocks and calculate the factorization parallelly with these blocks. In this paper, we would like to use the most modern computation resource Graphics Processing Unit (GPU) to speed up the partition-based computation. Though there are some studies on partition-based SGD with GPUs, due to the sparsity of matrices in real-life scenarios, these methods produce too many blank blocks, which will waste the GPU computing resources. In this paper, we propose a new method, which can avoid the problem and make use of GPUs more efficiently to speed up the SGD based MF solver.


Citation Format:
Feng Li, Yunming Ye, Xutao Li, "An Efficient Approach of GPU-accelerated Stochastic Gradient Descent Method for Matrix Factorization," Journal of Internet Technology, vol. 20, no. 4 , pp. 1087-1097, Jul. 2019.

Full Text:

PDF

Refbacks

  • There are currently no refbacks.





Published by Executive Committee, Taiwan Academic Network, Ministry of Education, Taipei, Taiwan, R.O.C
JIT Editorial Office, Library and Information Center, National Dong Hwa University
No. 1, Sec. 2, Da Hsueh Rd. Shoufeng, Hualien 97401, Taiwan, R.O.C.
Tel: +886-3-931-7017  E-mail: jit.editorial@gmail.com