Intelligent decision-making algorithm based on bounded FART-Q
-
摘要: 针对模糊自适应共振理论(ART)应用于智能决策时存在的问题,提出了约束边长的模糊ART算法.将有边长约束的模糊ART与Q学习结合,构建了约束边长FART-Q(Fuzzy ART-Q learning)智能决策网络.传统的模糊ART只根据输入向量与权值向量的模糊相似度进行分类,在用于智能决策中的状态分类时,不能考虑状态变量的物理含义,存在分类不合理的问题.针对这一问题,提出了对模糊ART的共振条件加入边长约束的改进算法,使得分类时可根据状态变量的物理含义确定分类的边长约束,同时能够减少分类数量.雷区导航仿真实验表明,约束边长FART-Q能快速做出合理决策.改进的模糊ART算法能够使分类更为合理,既能提高决策的成功率,又可以减小决策的运算时间.Abstract: Fuzzy adaptive resonance theory (ART) with bounded side length was proposed to address the problem emerged while applying fuzzy ART to intelligent decision-making. Integrating the modified fuzzy ART and Q learning algorithm, bounded fuzzy ART-Q learning (FART-Q) intelligent decision-making network was built. The original fuzzy ART might make unreasonable classifications only according to the fuzzy similarity between input vector and weight vector, without considering the physical meaning of the state variables. To solve this problem, a modified algorithm was proposed, strengthening the resonance condition of fuzzy ART with bounded side length. The improvement made it possible both to limit the side length according to the physical meaning of the state variables and to reduce the number of categories. The minefield navigation simulation was conducted to verify the availability and effectiveness of bounded FART-Q. Compared with the original fuzzy ART, the modified algorithm is able to make classifications more reasonably with higher success rate and less operation time.
-
[1] 祝世虎,董朝阳,张金鹏,等.基于神经网络与专家系统的智能决策支持系统[J].电光与控制,2006,13(1):8-11.Zhu S H,Dong C Y,Zhang J P,et al.An intelligent decision-making system based on neural networks and expert system[J].Electronics Optics and Control,2006,13(1):8-11(in Chinese). [2] 魏强,周德云.基于专家系统的无人战斗机智能决策系统[J].火力与指挥控制,2007,32(2):5-7.Wei Q,Zhou D Y.Research on UCAV' s intelligent decision-making system based on expert system[J].Fire Control and Command Control,2007,32(2):5-7(in Chinese). [3] 马耀飞,龚光红,彭晓源.基于强化学习的航空兵认知行为模型[J].北京航空航天大学学报,2010,36(4):379-383.Ma Y F,Gong G H,Peng X Y.Cognition behavior model for air combat based on reinforcement learning[J].Journal of Beijing University of Aeronautics and Astronautics,2010,36(4):379-383(in Chinese). [4] 杨兴,朱大奇,桑庆兵.专家系统研究现状与展望[J].计算机应用研究,2007,24(5):4-9.Yang X,Zhu D Q,Sang Q B.Research and prospect of expert system[J].Application Research of Computers,2007,24(5):4-9(in Chinese). [5] Ueda H,Naraki T,Hanada N,et al.Fuzzy Q-learning with the modified fuzzy ART neural network[J].Web Intelligence and Agent Systems,2007,5(3):331-341. [6] 彭小萍.自适应共振理论原理与应用研究[D].北京:北京化工大学,2012.Peng X P.The study on adaptive resonance theory principles and applications[D].Beijing:Beijing University of Chemical Technology,2012(in Chinese). [7] Carpenter G A,Grossberg S,Rosen D B.Fuzzy ART:fast stable learning and categorization of analog patterns by an adaptive resonance system[J].Neural Networks,1991,4(6):759-771. [8] Hsieh S,Su C L,Liaw J.Fuzzy ART for the document clustering by using evolutionary computation[J].WSEAS Transactions on Computers,2010,9(9):1032-1041. [9] Song X H,Hopke P K,Bruns M A,et al.A fuzzy adaptive resonance theory-supervised predictive mapping neural network applied to the classification of multivariate chemical data[J].Chemometrics and Intelligent Laboratory Systems,1998,41(2):161-170. [10] Li Y Y,Parker L E.Classification with missing data in a wireless sensor network[C]//Southeastcon,2008.Piscataway,NJ:IEEE,2008:533-538. [11] Ediriweera D D,Marshall I W.Advances in computational algorithms and data analysis[M].Netherlands:Springer,2009:293-304. [12] Araujo R.Prune-able fuzzy ART neural architecture for robot map learning and navigation in dynamic environments[J].Neural Networks,IEEE Transactions on Neural Networks,2006,17(5):1235-1249. [13] Tan A H.FALCON:a fusion architecture for learning,cognition and navigation[C]//2004 IEEE International Joint Conference on Neural Networks.Piscataway,NJ:IEEE,2004,4:3297-3302. [14] Teng T H,Tan A H.Knowledge-based exploration for reinforcement learning in self-organizing neural networks[C]//Proceedings of the 2012 IEEE/WIC/ACM International Joint Conferences on Web Intelligence and Intelligent Agent Technology,Volume 02.Washington,D C:IEEE Computer Society,2012:332-339. [15] Teng T H,Tan A H,Teow L N.Adaptive computer-generated forces for simulator-based training[J].Expert Systems with Applications,2013,40(18):7341-7353
点击查看大图
计量
- 文章访问数: 936
- HTML全文浏览量: 174
- PDF下载量: 491
- 被引次数: 0