[1]张文龙,张 洁.基于 A3C 的有序充电算法[J].计算机技术与发展,2023,33(01):173-177.[doi:10. 3969 / j. issn. 1673-629X. 2023. 01. 026]
　ZHANG Wen-long,ZHANG Jie.Orderly Charging Algorithm Based on A3C[J].,2023,33(01):173-177.[doi:10. 3969 / j. issn. 1673-629X. 2023. 01. 026]
点击复制

基于 A3C 的有序充电算法()
分享到：

《计算机技术与发展》[ISSN:1006-6977/CN:61-1281/TN]

卷:
33
期数:
2023年01期
页码:
173-177
栏目:
人工智能
出版日期:
2023-01-10

文章信息/Info

Title:
Orderly Charging Algorithm Based on A3C
文章编号:
1673-629X(2023)01-0173-05
作者:
张文龙; 张 洁
南京邮电大学 计算机学院,江苏 南京 210023
Author(s):
ZHANG Wen-long; ZHANG Jie
School of Computer Science,Nanjing University of Posts and Telecommunications,Nanjing 210023,China
关键词:
有序充电; 数据驱动; 强化学习; 深度学习; A3C
Keywords:
orderly charging; data-driven; reinforcement learning; deep learning; A3C
分类号:
TP391. 9
DOI:
10. 3969 / j. issn. 1673-629X. 2023. 01. 026
摘要:
由于电动汽车的日益普及,其充电问题已成为电力系统的新的用电挑战。 实际生活中,充电站一般都被认为是电动汽车有序充电行为的调度主体。 为解决传统模型驱动的充电算法无法应用于电动汽车随机进站的问题,提出将数据驱动的无模型深度强化学习算法 A3C( Asynchronous Advantage Actor-critic,异步演员评论家算法) 应用于有序充电。 该算法利用特征函数来近似模型所需要的价值函数和策略函数,解决因随机进站而引起的空间维度变化的问题。 通过需求响应机制关联充电费用和需求,实现两者的动态调度。 为避免因为经验回放而导致的数据相关性过强,利用多线程实现模型与多个环境进行互动,提高了模型的收敛性。 最后以某地区充电站实测数据为例进行仿真分析。 结果表明,该算法在只基于历史充电数据的情况下能优化充电行为,较大程度地抑制充电负荷方差,实现削峰填谷,同时在满足用户需求的基础上提高充电站收益。
Abstract:
Due to the increasing popularity of electric vehicles ( EV) ,the charging problem has been a new challenge of electrical system.In particular,charging stations are always considered as an important role who schedule the orderly charging behavior of EV. In order tosolve the problem that conventional model - driven charging algorithms cannot be applied to the situation where electric EV enter thestation randomly,propose to apply a data-driven model-free reinforcement learning algorithms A3C ( Asynchronous Advantage Actor-critic) for orderly charging. The algorithm deal with the varying state spaces caused by random EV arrivals by approximating the statefunction and policy function with feature function. The demand response mechanism 　is applied to associate the charging price with thecharging demands and dynamic scheduling them. To avoid the strong correlation caused by experience replay,multiprocessing is used toimplement the effect that the model interact with multiple environments through which can improve the convergence of the algorithm.Finally,the simulation analysis is conducted by the measured data of charging stations in a certain area. The results show that thepurposed algorithm can optimize the charging behavior even the only known is the previous charging data, reduce the charging loadvariance greatly and realize the peak load shifting of the grid. Beside satisfy the EVs demand,it can also increase charging station’s profits.

相似文献/References:

[1]朱菊 王志坚 杨雪.基于数据驱动的软件自动化测试框架[J].计算机技术与发展,2006,(05):68.
　ZHU Ju,WANG Zhi-jian,YANG Xue.A Software Automation Test Frameworks Based on Data- Driven Automation Methodology[J].,2006,(01):68.
[2]梁宗保,胡怡然,张凯.桥梁健康监测信息的数据驱动处理方法研究[J].计算机技术与发展,2013,(10):258.
　LIANG Zong-bao[],HU Yi-ran[],ZHANG Kai[].Research of Data Drive Processing Method of Bridge Health Monitoring Information[J].,2013,(01):258.
[3]黄承宁,李 娟,陈嘉政.基于图神经网络的医疗物资智能调度研究优化[J].计算机技术与发展,2021,31(09):202.[doi:10. 3969 / j. issn. 1673-629X. 2021. 09. 034]
　HUANG Cheng-ning,LI Juan,CHEN Jia-zheng.Research and Optimization of Medical Material Intelligent Scheduling Based on Graph Neural Network[J].,2021,31(01):202.[doi:10. 3969 / j. issn. 1673-629X. 2021. 09. 034]
[4]陈孟婷,付晓薇*,樊 洋,等.基于因果分解的 SOFC 系统故障根源诊断方法[J].计算机技术与发展,2021,31(10):168.[doi:10. 3969 / j. issn. 1673-629X. 2021. 10. 028]
　CHEN Meng-ting,FU Xiao-wei*,FAN Yang,et al.Root Cause Diagnosis of SOFC System Based on Causality Decomposition[J].,2021,31(01):168.[doi:10. 3969 / j. issn. 1673-629X. 2021. 10. 028]

更新日期/Last Update: 2023-01-10