面向空间大数据的分布式存储策略-《计算机技术与发展》

文章信息/Info

作者:: 唐桂文¹; 韩嘉福²; 李洪省²; 1. 北京市西城经济科学大学,北京 100035;2. 中国科学院地理科学与资源研究所,北京 100101

Author(s):: TANG Gui-wen¹; HAN Jia-fu²; LI Hong-sheng²; 1. Beijing Xicheng College of Economic Science,Beijing 100035,China;2. Institute of Geographic Sciencesand Natural Resources Research,CAS,Beijing 100101,China

Keywords:: spatial big data; iSCSI network storage technology; distributed file system; distributed database

摘要:: 云计算、物联网、互联网等的发展使社会进入了大数据时代,空间大数据是大数据的主体数据集之一,在国民经济和社会各领域应用广泛。空间大数据要发挥价值就需要在数据共享上做出突破,因此将空间大数据进行有效存储和管理是数据共享及利用所目前面临的问题。通过分析比较目前大数据存储的主要技术,提出了一种基于 iSCSI 技术的分布式数据库和分布式文件系统相结合的空间大数据存储策略。采用 iSCSI 技术构建分布式 Oracel RAC,完成对空间大数据中的矢量数据、影像和其他数据索引的存储。结合工作实践将这种存储策略应用到空间大数据管理中,验证了该策略的可靠性和可行性,对空间大数据的管理及应用有一定的参考价值。

Abstract:: With the development of cloud computing,Internet of things and Internet,the society has entered the era of big data. As one of the main data sets of big data,spatial big data is widely used in various fields of national economy and society. In order to give full playto the value of spatial big data,it is necessary to make a breakthrough in data sharing. Therefore,the effective storage and management ofspatial big data is a problem currently faced by data sharing and utilization. By analyzing and comparing the main technologies of big data storage,we propose a spatial big data storage strategy based on iSCSI technology and distributed file system. The distributed OracelRAC is built by iSCSI technology to complete the storage of vector data,image and other data indexes in spatial big data. Combined withwork practice,this storage strategy is applied to the management of spatial big data to verify its reliability and feasibility,which has certain reference for the management and application of spatial big data