[1]王梅,朱信忠,赵建民,等.基于 Hadoop 的海量图像检索系统[J].计算机技术与发展,2013,(01):204-207.
 WANG Mei,ZHU Xin-zhong,ZHAO Jian-min,et al.Massive Images Retrieval System Based on Hadoop[J].,2013,(01):204-207.
点击复制

基于 Hadoop 的海量图像检索系统()
分享到:

《计算机技术与发展》[ISSN:1006-6977/CN:61-1281/TN]

卷:
期数:
2013年01期
页码:
204-207
栏目:
应用开发研究
出版日期:
1900-01-01

文章信息/Info

Title:
Massive Images Retrieval System Based on Hadoop
文章编号:
1673-629X(2013)01-0204-04
作者:
王梅朱信忠赵建民黄彩锋
浙江师范大学 数理与信息工程学院
Author(s):
WANG MeiZHU Xin-zhongZHAO Jian-minHUANG Cai-feng
关键词:
HadoopMapReduce分布式计算图像检索
Keywords:
HadoopMapReducedistributed computingimage retrieval
文献标志码:
A
摘要:
在传统图像检索系统中,由于采用单节点架构,面对海量图像数据检索时存在检索速度慢、并发性差等问题.文中提出了一种基于 Hadoop 的图像检索方法,将图像检索技术与 MapReduce 框架相结合,图像特征库存储于分布式文件系统 HDFS 中,计算节点采用基于 Hadoop 的分布式存储调度算法,增强对多数据的并发处理能力,同时对计算后的数据进行压缩处理.实验表明,该方法在处理大数据图像检索时,与单节点检索系统相比,能够有效降低检索时间,提高检索速度
Abstract:
In a traditional single-node architecture image retrieval system,facing the problems of slow retrieval speed,poor concurrency etc when retrieved massive image data,proposed an image retrieval method based on the Hadoop,combining image retrieval technology with MapReduce frame,image feature database stored in the distributed file system HDFS,computing nodes using the scheduling algo-rithm based on Hadoop distributed storage,enhanced concurrent processing capability for multiple data,at the same time compressed the calculated data. Test and experiment results show that,the method in dealing with large data retrieval,compared with the single-node re-trieval system,can effectively reduce the search time,improve the retrieval speed

相似文献/References:

[1]李玲娟 张敏.云计算环境下关联规则挖掘算法的研究[J].计算机技术与发展,2011,(02):43.
 LI Ling-juan,ZHANG Min.Research on Algorithms of Mining Association Rule under Cloud Computing Environment[J].,2011,(01):43.
[2]贺瑶,王文庆,薛飞.基于云计算的海量数据挖掘研究[J].计算机技术与发展,2013,(02):69.
[3]舒琰,向阳,张骐,等.基于PageRank的微博排名MapReduce算法研究[J].计算机技术与发展,2013,(02):73.
 SHU Yan,XIANG Yang,ZHANG Qi,et al.Research on MapReduce Algorithm of Micro Blog Ranking Based on PageRank[J].,2013,(01):73.
[4]王晓军,孙惠.基于MapReduce的多路连接优化方法研究[J].计算机技术与发展,2013,(06):59.
 WANG Xiao-jun,SUN Hui.Research of Optimizing Multiway Joins Based on MapReduce[J].,2013,(01):59.
[5]吕婉琪,钟诚,唐印浒,等.Hadoop分布式架构下大数据集的并行挖掘[J].计算机技术与发展,2014,24(01):22.
 L Wan-qi,ZHONG Cheng,TANG Yin-hu,et al.Parallel Mining of Large Dataset in Hadoop Distributed Computing Framework[J].,2014,24(01):22.
[6]王晓军,邹亮亮. Hadoop迭代优化技术的研究[J].计算机技术与发展,2014,24(09):98.
 WANG Xiao-jun,ZOU Liang-liang. Research on Optimizing Iterative Technology of Hadoop[J].,2014,24(01):98.
[7]徐源吾[][],王珣[][]. 基于Hadoop的智能家居信息处理平台[J].计算机技术与发展,2014,24(09):183.
 XU Yuan-wu[] [],WANG Xun[][]. nformation Processing Platform of Smart Home Based on Hadoop[J].,2014,24(01):183.
[8]王添,姜麟,米允龙. 海量数据下不完备信息系统的知识约简算法[J].计算机技术与发展,2015,25(01):137.
 WANG Tian,JIANG Lin,MI Yun-long. Knowledge Reduction Algorithms of Incomplete Information System in Massive Datasets[J].,2015,25(01):137.
[9]王全民,苗雨,何明,等. 基于矩阵分解的协同过滤算法的并行化研究[J].计算机技术与发展,2015,25(02):55.
 ANG Quan-min,MIAO Yu,HE Ming,et al. Parallelized Research on Collaborative Filtering Algorithm Based on Matrix Factorization[J].,2015,25(01):55.
[10]方木云,刘洪彬,谢恩文. Hadoop下基于边聚类的重叠社区发现算法研究[J].计算机技术与发展,2015,25(03):58.
 FANG Mu-yun,LIU Hong-bin,XIE En-wen. Research on Overlapping Communities Detecting Algorithm Using Hadoop Based on Edge Clustering[J].,2015,25(01):58.
[11]李远方 邓世昆 闻玉彪 韩月阳.Hadoop-MapReduce下的PageRank矩阵分块算法[J].计算机技术与发展,2011,(08):6.
 LI Yuan-fang,DENG Shi-kun,WEN Yu-biao,et al.PageRank Matrix Partitioned Algorithm Using Hadoop-MapReduce[J].,2011,(01):6.
[12]李远方 贾时银 邓世昆 韩月阳.基于树结构的MapReduce模型[J].计算机技术与发展,2011,(08):149.
 LI Yuan-fang,JIA Shi-yin,DENG Shi-kun,et al.MapReduce Model Based on Tree Structure[J].,2011,(01):149.
[13]朱贤军,李敬兆.无加密模式下对云数据的隐私保密[J].计算机技术与发展,2013,(06):216.
 ZHU Xian-jun,LI Jing-zhao.Cloud Data Privacy under None Encryption[J].,2013,(01):216.
[14]周婷,张君瑛,罗成.基于Hadoop的K-means聚类算法的实现[J].计算机技术与发展,2013,(07):18.
 ZHOU Ting[],ZHANG Jun-ying[],LUO Cheng[].Realization of K-means Clustering Algorithm Based on Hadoop[J].,2013,(01):18.
[15]孙媛,黄刚. 基于Hadoop平台的C4.5算法的分析与研究[J].计算机技术与发展,2014,24(11):83.
 SUN Yuan,HUANG Gang. Analysis and Study of C4 . 5 Algorithm Based on Hadoop Platform[J].,2014,24(01):83.
[16]秦军[],童毅[],戴新华[],等. 基于MapReduce数据密集型负载调度策略研究[J].计算机技术与发展,2015,25(04):48.
 QIN Jun[],TONG Yi[],DAI Xin-hua[],et al. Research on Scheduling Strategy of Data Intensive Workloads Based on MapReduce[J].,2015,25(01):48.
[17]李程,曹菡,师军. 基于MapReduce的混合推荐算法及应用[J].计算机技术与发展,2016,26(04):74.
 LI Cheng,CAO Han,SHI Jun. Hybrid Recommendation Algorithm Based on MapReduce and Its Application[J].,2016,26(01):74.
[18]范素娟[],田军锋[]. 基于Hadoop的云计算平台研究与实现[J].计算机技术与发展,2016,26(07):127.
 FAN Su-juan[],TIAN Jun-feng[]. Research and Implementation of Cloud Computing Platform Based on Hadoop[J].,2016,26(01):127.
[19]姚经纬[],杨福军[]. Redis分布式缓存技术在Hadoop平台上的应用[J].计算机技术与发展,2017,27(06):146.
 YAO Jing-wei[],YANG Fu-jun[]. Application of Redis Distributed Caching Technology in Hadoop Framework[J].,2017,27(01):146.
[20]马婉贞,钱育蓉. 基于标签匹配的协同过滤推荐算法研究[J].计算机技术与发展,2017,27(07):25.
 MA Wan-zhen,QIAN Yu-rong. Investigation on Collaborative Filtering Recommendation Algorithm with Tag Matching[J].,2017,27(01):25.

更新日期/Last Update: 1900-01-01