[1]王全民,苗雨,何明,等. 基于矩阵分解的协同过滤算法的并行化研究[J].计算机技术与发展,2015,25(02):55-59.
　ANG Quan-min,MIAO Yu,HE Ming,et al. Parallelized Research on Collaborative Filtering Algorithm Based on Matrix Factorization[J].,2015,25(02):55-59.
点击复制

 基于矩阵分解的协同过滤算法的并行化研究()
分享到：

《计算机技术与发展》[ISSN:1006-6977/CN:61-1281/TN]

卷:
25
期数:
2015年02期
页码:
55-59
栏目:
智能、算法、系统工程
出版日期:
2015-02-10

文章信息/Info

Title:
 Parallelized Research on Collaborative Filtering Algorithm Based on Matrix Factorization
文章编号:
1673-629X（2015)02-0001-04
作者:
 王全民; 苗雨; 何明; 郑爽
 北京工业大学 计算机学院
Author(s):
 ANG Quan-min; MIAO Yu; HE Ming; ZHENG Shuang
关键词:
 ; ALS算法; 协同过滤; Hadoop; 迭代式MapReduce
Keywords:
 ; alternating least squares; collaborative filtering; Hadoop; iterative MapReduce
分类号:
TP301.6
文献标志码:
A
摘要:
 基于矩阵分解的协同过滤算法是近几年提出的一种协同过滤推荐技术，但其每项预测评分的计算都要综合大量评分数据，同时在计算时还需要存储庞大的特征矩阵，用单一节点来进行推荐将会遇到计算时间和计算资源的瓶颈。通过对现有的基于ALS(最小二乘法)的协同过滤算法在Hadoop上并行化实现的原理和特点进行深入的研究，得到了传统的迭代式算法在Hadoop上运算效率不高的原因。根据迭代式MapReduce思想，提出了循环感知任务调度算法、缓存静态数据、任务循环控制、迭代终止条件检测等方法。通过在Netflix数据集上的实验表明，迭代式MapReduce思想提高了基于ALS的协同过滤算法的并行化计算的效率。
Abstract:
 Collaborative filtering algorithm based on matrix factorization is a collaborative filtering recommendation technique proposed in recent years. In the process of recommendation each prediction depends on the collaboration of the whole known rating set and the feature matrices need huge storage. So the recommendation with only one node will meet the bottleneck of time and resource. Through in-depth study on the principle and feature of current parallel implementation of a collaborative filtering algorithm based on ALS ( Alternating-Least-Squares) ,get the reason why the computing efficiency of the implementation of traditional iterative algorithm on Hadoop is very low. According to the idea of iterative MapReduce,some methods such as loop-aware scheduling algorithm,static data caching,job loop controlling,fixed point detecting are proposed. The experiment on Netflix data set shows that the iterative MapReduce has improved the parallel computing efficiency of collaborative filtering algorithm based on ALS.

相似文献/References:

[1]张志宏,吴庆波,邵立松,等.基于飞腾平台TOE协议栈的设计与实现[J].计算机技术与发展,2014,24(07):1.
　ZHANG Zhi-hong,WU Qing-bo,SHAO Li-song,et al. Design and Implementation of TCP/IP Offload Engine Protocol Stack Based on FT Platform[J].,2014,24(02):1.
[2]梁文快,李毅. 改进的基因表达算法对航班优化排序问题研究[J].计算机技术与发展,2014,24(07):5.
　LIANG Wen-kuai,LI Yi. Research on Optimization of Flight Scheduling Problem Based on Improved Gene Expression Algorithm[J].,2014,24(02):5.
[3]黄静,王枫,谢志新,等. EAST文档管理系统的设计与实现[J].计算机技术与发展,2014,24(07):13.
　HUANG Jing,WANG Feng,XIE Zhi-xin,et al. Design and Implementation of EAST Document Management System[J].,2014,24(02):13.
[4]侯善江[],张代远[][][]. 基于样条权函数神经网络P2P流量识别方法[J].计算机技术与发展,2014,24(07):21.
　HOU Shan-jiang[],ZHANG Dai-yuan[][][]. P2P Traffic Identification Based on Spline Weight Function Neural Network[J].,2014,24(02):21.
[5]李璨,耿国华,李康,等. 一种基于三维模型的文物碎片线图生成方法[J].计算机技术与发展,2014,24(07):25.
　LI Can,GENG Guo-hua,LI Kang,et al. A Method of Obtaining Cultural Debris’ s Line Chart Based on Three-dimensional Model[J].,2014,24(02):25.
[6]翁鹤,皮德常. 混沌RBF神经网络异常检测算法[J].计算机技术与发展,2014,24(07):29.
　WENG He,PI De-chang. Chaotic RBF Neural Network Anomaly Detection Algorithm[J].,2014,24(02):29.
[7]刘茜[],荆晓远[],李文倩[],等. 基于流形学习的正交稀疏保留投影[J].计算机技术与发展,2014,24(07):34.
　LIU Qian[],JING Xiao-yuan[,LI Wen-qian[],et al. Orthogonal Sparsity Preserving Projections Based on Manifold Learning[J].,2014,24(02):34.
[8]尚福华,李想,巩淼. 基于模糊框架-产生式知识表示及推理研究[J].计算机技术与发展,2014,24(07):38.
　SHANG Fu-hua,LI Xiang,GONG Miao. Research on Knowledge Representation and Inference Based on Fuzzy Framework-production[J].,2014,24(02):38.
[9]叶偲,李良福,肖樟树. 一种去除运动目标重影的图像镶嵌方法研究[J].计算机技术与发展,2014,24(07):43.
　YE Si,LI Liang-fu,XIAO Zhang-shu. Research of an Image Mosaic Method for Removing Ghost of Moving Targets[J].,2014,24(02):43.
[10]余松平[][],蔡志平[],吴建进[],等. GSM-R信令监测选择录音系统设计与实现[J].计算机技术与发展,2014,24(07):47.
　YU Song-ping[][],CAI Zhi-ping[] WU Jian-jin[],GU Feng-zhi[]. Design and Implementation of an Optional Voice Recording System Based on GSM-R Signaling Monitoring[J].,2014,24(02):47.

更新日期/Last Update: 2015-04-28