一种通用的文本日志类信息分析评估模型-《计算机技术与发展》

文章信息/Info

作者:: 邵瑛1 ; 徐斌2; 1. 上海电子信息职业技术学院电子技术与工程学院,上海 201411;
2. 上海诺基亚贝尔固网事业部,上海 201206

Author(s):: SHAO Ying1 ; XU Bin2; 1. School of Electronic Technology and Engineering,Shanghai Technical Institute of Electronics and Information,Shanghai 201411,China;
2. Fix Network Business Group Nokia Shanghai Bell,Shanghai摇 201206,China

Keywords:: A common text log analysis and evaluation model is proposed for the analysis and evaluation of text log information such assystem operation log and command line text output. The model includes analysis model; evaluation model and template visualizationm

摘要:: 文中就文本日志类信息譬如系统运行日志、命令行文本输出等信息的分析评估提出了一种通用的文本日志类分析评估模型。该模型包含分析模型、评估模型和模板化可视化方法。分析模型和评估模型均采用配置驱动的方式对文本信息进行分析和评估,分析模型中设计了相等、正则、SQL 条件规则,评估模型设计了百分比、计数和平均值策略,可满足不同的分析和评估需求。在可视化化上,基于 ECharts 和 Datatables,模型对它们进行二次封装,根据需求通过配置 SQL 命令及相关显示属性实现快速可视化。相对于目前流行的 ELK 等开源技术,本模型只需要重新配置分析则、评估规则,不需要对分析和评估部分进行二次开发就可以实现日志的分析和评估。基于提出的分析和评估模型,采用 Spring Boot / SpringCloud 微服务框架实现了一套 PON 网络健康检查系统,该系统在全球多个 PON 网络评估服务中得到了很好的应用,极大地提高了服务效率。

Abstract:: A common text log analysis and evaluation model is proposed for the analysis and evaluation of text log information such as system operation log and command line text output. The model includes analysis model, evaluation model and template visualization method. Both the analysis model and the evaluation model use configuration driven method to analyze and evaluate the text information.In the analysis model, equality, regularization and SQL condition rules are designed. In the evaluation model, percentage, count and average strategies are designed. They can meet different analysis and evaluation needs. In visualization,the model encapsulates Echartsand Datatables. Data can be quickly visualized by configuring SQL commands and related display attributes. Compared with the current popular open source technologies such as ELK etc,this model only needs to reconfigure the analysis rules and evaluation rules,not need tore-develop analysis / evaluation code. Based on the proposed analysis and evaluation model,one health check system for PON network has been developed by using Spring boot / Spring Cloud microservice framework,and it has been used in many evaluation services, this system greatly improved service efficiency.