关键词: 诊断策略, 马尔可夫决策过程(MDP), 故障检测, 策略迭代算法, 策略优化

Abstract: Aiming at the problem that by the traditional method, it is difficult to get the global optimal diagnostic strategy of the complicated test system in fault detection for ignoring the uncertainty factors in the test execution and lacking of the long cycle optimization mechanism, a new diagnostic strategy building method based on Markov decision processes (MDP) is proposed. The process of fault detection and isolation is expressed as a Markov process; the unlimited discount model of the utility integrated criterion function is structured through the discount factor and objective weights; the global optimal diagnostic strategy is obtained with the policy iteration algorithm. The example shows that the test uncertainty factors are well considered, stable optimal strategy of overall situation can be achieved by this method, and the fast fault detection and isolation in the engineering practice can be guided effectively as well.

Key words: diagnostic strategy, Markov decision processes (MDP), fault detection, policy iteration algorithm, strategy optimization