一种适用于 AETA 的日志系统的设计与实现-《计算机技术与发展》

文章信息/Info

作者:: 周康生¹ ; 张兴¹ ; 王新安¹ ; 雍珊珊¹ ; 李柏杭¹ ; 张丹²; 1. 北京大学深圳研究生院地震监测预测技术研究中心,广东深圳 518055; 2. 武汉大学计算机学院,湖北武汉 430072

Author(s):: ZHOU Kang-sheng¹ ; ZHANG Xing¹ ; WANG Xin-an¹ ; YONG Shan-shan¹ ; LI Bo-hang¹ ; ZHANG Dan²; 1. Earthquake Monitoring and Prediction Technology Research Center,Peking University Shenzhen Graduate School,Shenzhen 518055,China; 2. School of Computer Science,Wuhan University,Wuhan 430072,China

Keywords:: seismic monitoring and prediction; log system; high concurrent processing; batch processing; system operation and maintenance

摘要:: 多分量地震监测预测系统 AETA 已经在中国四川、云南、河北、广东、西藏、台湾等地区布设 250 余套。目前,单台服务器平均每天需要接收并处理 100 万条以上的日志。海量的日志数据如果不加以规范化处理,将对服务器的并发处理能力提出挑战,并且会极大地增加系统运维工作的难度。基于多分量地震监测预测系统 AETA,设计了一套日志系统,从日志数据采集层和日志数据汇集层协同设计,有效地降低了日志数据给服务器集群带来的并发请求,并提高了服务器集群的高并发处理能力,保证了服务的稳定运行。采用批处理技术对日志类型和日志内容进行统计分析,使得运维人员可以快速了解各台站设备的运行情况。设计了一个网页对日志相关内容进行展示,运维人员能够在界面友好的网页完成对日志的查询操作。

Abstract:: Multi-component seismic monitoring and prediction system AETA has been deployed in more than 250 sets in Sichuan,Yunnan,Hebei,Guangdong,Tibet and Taiwan. Currently,a single server needs to receive and process more than 1 million logs per day on average. If the massive log data is not standardized,it will challenge the concurrent processing capability of the server and greatly increase the difficulty of operation and maintenance. Based on AETA,a log system is designed from the log data collection layer and the log data collection layer to effectively reduce the concurrent requests brought by the log data to the server cluster and improve the servercluster. Concurrent processing capability ensures stable operation of the service. The batch analysis technology is used to perform statistical analysis on the log types and log contents,so that O&M personnel can quickly understand the running status of each station device. A web page is designed to display the log related content,so that the operation and maintenance personnel can complete the query operation of the log on the friendly webpage.