一种在复杂环境中支持容错的高性能规约框架

doi:10.13700/j.bh.1001-5965.2017.0786

北京航空航天大学学报 ›› 2018, Vol. 44 ›› Issue (10): 2115-2124.doi: 10.13700/j.bh.1001-5965.2017.0786

一种在复杂环境中支持容错的高性能规约框架

李超¹, 赵长海², 晏海华¹, 刘超¹, 文佳敏², 王增波²

1. 北京航空航天大学计算机学院, 北京 100083;
2. 中国石油集团东方地球物理勘探有限责任公司物探技术研究中心, 北京 100088

收稿日期:2017-12-21 修回日期:2018-03-16 出版日期:2018-10-20 发布日期:2018-10-29
通讯作者: 晏海华,E-mail:yhh@buaa.edu.cn E-mail:yhh@buaa.edu.cn
作者简介:李超,男,博士研究生。主要研究方向:高性能计算;晏海华,男,硕士,副教授。主要研究方向:软件工程和高性能计算。
基金资助:
国家自然科学基金（61672073）；中国石油天然气集团公司科学研究与技术开发项目（2016E-1001）

A fault tolerant high-performance reduction framework in complex environment

LI Chao¹, ZHAO Changhai², YAN Haihua¹, LIU Chao¹, WEN Jiamin², WANG Zengbo²

1. School of Computer Science and Engineering, Beijing University of Aeronautics and Astronautics, Beijing 100083, China;
2. Research Center of Geophysical Exploration, BGP INC., China National Petroleum Corporation, Beijing 100088, China

Received:2017-12-21 Revised:2018-03-16 Online:2018-10-20 Published:2018-10-29

摘要/Abstract

摘要： 规约是并行应用最常用的集合通信操作之一，现存规约算法存在2方面主要问题。第一，不适应复杂环境，当计算环境出现干扰时，规约效率显著降低。第二，不支持容错，当节点发生故障时，规约被迫中断。针对上述问题，提出一种基于任务并行的高性能分布式规约框架。首先，该框架将规约拆分为一系列独立的计算任务，使用任务调度器以保证就绪任务被优先调度到具有较高性能的节点上执行，从而有效避免了慢节点对整体性能的影响。其次，该框架基于规约数据的可靠性存储和故障侦听机制，以任务为粒度，可在应用不退出的前提下实现故障恢复。在复杂环境中的实验结果表明，分布式规约框架具有高可靠性，与现有规约算法相比，规约性能最高提升了2.2倍，并发规约性能最高提升了4倍。

关键词: 规约, 集合通信, 复杂环境, 干扰, 容错, 并行计算

Abstract: Reduction is one of the most commonly used collective communication operations for parallel applications. There are two problems for the existing reduction algorithms:First, they cannot adapt to complex environment. When interferences appear in computing environment, the efficiency of reduction degrades significantly. Second, they are not fault tolerant. The reduction operation is interrupted when a node failure occurs. To solve these problems, this paper proposes a task-based parallel high-performance distributed reduction framework. Firstly, each reduction operation is divided into a series of independent computing tasks. The task scheduler is adopted to guarantee that ready tasks will take precedence in execution and each task will be scheduled to the computing node with better performance. Thus, the side effect of slow nodes on the whole efficiency can be reduced. Secondly, based on the reliability storage for reduction data and fault detecting mechanism, fault tolerance can be implemented in tasks without stopping the application. The experimental results in complex environment show that the distributed reduction framework promises high availability and, compared with the existing reduction algorithm, the reduction performance and concurrent reduction performance of distributed reduction framework are improved by 2.2 times and 4 times, respectively.

Key words: reduction, collective communication, complex environment, interference, fault tolerance, parallel computing

中图分类号:

TP301.6

李超, 赵长海, 晏海华, 刘超, 文佳敏, 王增波. 一种在复杂环境中支持容错的高性能规约框架[J]. 北京航空航天大学学报, 2018, 44(10): 2115-2124.

LI Chao, ZHAO Changhai, YAN Haihua, LIU Chao, WEN Jiamin, WANG Zengbo. A fault tolerant high-performance reduction framework in complex environment[J]. JOURNAL OF BEIJING UNIVERSITY OF AERONAUTICS AND A, 2018, 44(10): 2115-2124.

参考文献

[1] GROPP W,LUSK E,DOSS N,et al.A high-performance,portable implementation of the MPI message passing interface standard[J].Parallel Computing,1996,22(6):789-828.
[2] RABENSEIFNER R.Automatic MPI counter profiling of all users:First results on a CRAY T3E 900-512[C]//Proceedings of the Message Passing Interface Developer's and User's Conference.Piscataway,NJ:IEEE Press,1999:77-85
[3] CHAN W E,HEIMLICH F M,PURAKAYASTHA A,et al.On optimizing collective communication[C]//Proceedings of the IEEE International Conference on Cluster Computing.Piscataway,NJ:IEEE Press,2004:145-155.
[4] GROPP W,LUSK E.Users guide for mpich,a portable implementation of MPI[J].Office of Scientific & Technical Information Technical Reports,1996,1996(17):2096-2097.
[5] THAKUR R,RABENSEIFNER R,GROPP W.Optimization of collective communication operations in MPICH[J].International Journal of High Performance Computing Applications,2005,19(1):49-66.
[6] HUSBANDS P,HOE J C.MPI-StarT:Delivering network performance to numerical applications[C]//Proceedings of the ACM/IEEE Conference on Supercomputing.Piscataway,NJ:IEEE Press,1998:1-15.
[7] VADHIYAR S S,FAGG E G,DONGARRA J.Automatically tuned collective communications[C]//Proceedings of the ACM/IEEE Conference on Supercomputing.Piscataway,NJ:IEEE Press,2000:3-13.
[8] GONG Y,HE B,ZHONG J.An overview of CMPI:Network performance aware MPI in the cloud[J].ACM SIGPLAN Notices,2012,47(8):297-298.
[9] GONG Y,HE B,ZHONG J.Network performance aware MPI collective communication operations in the cloud[J].IEEE Transactions on Parallel and Distributed Systems,2015,26(11):3079-3089.
[10] MAKPAISIT P,ICHIKAWA K,UTHAYOPAS P,et al.MPI_reduce algorithm for open flow-enabled network[C]//Proceedings of the IEEE International Symposium on Communications and Information Technologies.Piscataway,NJ:IEEE Press,2015:261-264.
[11] HASANOV K,LASTOVETSKY A.Hierarchical optimization of MPI reduce algorithms[J].Lecture Notes in Computer Science,2015,9251:21-34.
[12] KIELMANN T,HOFMAN R F H,BAl H E,et al.MagPIe:MPI's collective communication operations for clustered wide area systems[J].ACM SIGPLAN Notices,1999,34(8):131-140.
[13] HEIEN E,KONDO D,GAINARU A,et al.Modeling and tolerating heterogeneous failures in large parallel systems[C]//Proceedings of International Conference for High Performance Computing,Networking,Storage and Analysis.Piscataway,NJ:IEEE Press,2001:1-11.
[14] SCHROEDER B,GIBSON G.Understanding failures in petascale computers[C]//Journal of Physics:Conference Series.Philadelphia,PA:IOP Publishing,2007:12-22.
[15] ELNOZAHY E,ALVISI L,WANG Y,et al.A survey of rollback-recovery protocols in message-passing systems[J].ACM Computing Surveys(CSUR),2002,34(3):375-408.
[16] BRONEVETSKY G,MARQUES D,PINGALI K,et al.C3:A system for automating application-level checkpointing of MPI Programs[J].Lecture Notes in Computer Science,2003,2958:357-373.
[17] FAGG E G,DONGARRA J.FT-MPI:Fault tolerant MPI,supporting dynamic applications in a dynamic world[M].Berlin:Springer,2000:346-353.
[18] HURSEY J,GRAHAM R L.Analyzing fault aware collective performance in a process fault tolerant MPI[J].Parallel Computing,2012,38(1):15-25.
[19] WANG R,YAO E,CHEN M,et al.Building algorithmically nonstop fault tolerant MPI programs[C]//Proceedings of IEEE International Conference on High Performance Computing (HiPC).Piscataway,NJ:IEEE Press,2011:1-9.
[20] CHEN Z,DONGARRA J.Algorithm-based fault tolerance for fail-stop failures[J].IEEE Transactions on Parallel and Distributed Systems,2008,19(12):1628-1641.
[21] GORLATCH S.Send-receive considered harmful:Myths and realities of message passing[J].ACM Transactions on Programming Languages & Systems,2004,26(1):47-56.
[22] LI C,ZHAO C,YAN H,et al.Event-driven fault tolerance for building nonstop active message programs[C]//Proceedings of IEEE International Conference on High Performance Computing.Piscataway,NJ:IEEE Press,2013:382-390.
[23] LI C,WANG Y,ZHAO C,et al.Parallel Kirchhoff pre-stack depth migration on large high performance clusters[M].Berlin:Springer,2015:251-266.

一种在复杂环境中支持容错的高性能规约框架

A fault tolerant high-performance reduction framework in complex environment

PDF (PC)

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

本文评价

[1]	宋波, 李威, 廉国选. 基于CUDA的超声二维声场EFIT仿真[J]. 北京航空航天大学学报, 2019, 45(7): 1322-1328.
[2]	匡晓霖, 徐金全, 黄春蓉, 李嘉科, 郭宏. 六相永磁同步电机驱动控制方式[J]. 北京航空航天大学学报, 2019, 45(7): 1361-1369.
[3]	郭嗣, 郭宏, 徐金全. 六相永磁容错轮毂电机多物理场综合设计方法[J]. 北京航空航天大学学报, 2019, 45(3): 520-528.
[4]	李磊, 高永明, 吴止锾, 张学波. 卫星姿态控制系统执行器微小故障检测方法[J]. 北京航空航天大学学报, 2019, 45(3): 529-537.
[5]	梁小辉, 王青, 董朝阳. 基于切换系统的变体飞行器鲁棒自适应控制[J]. 北京航空航天大学学报, 2019, 45(3): 538-545.
[6]	史绍琨, 赵久奋, 崇阳, 杨奇松, 尤浩. 带落角约束的新型二阶滑模三维制导律[J]. 北京航空航天大学学报, 2019, 45(3): 614-623.
[7]	李宏刚, 高哈尔·达吾力, 王帅, 余贵珍, 王朋成. 考虑临近车道行人对交通流影响的改进跟驰模型[J]. 北京航空航天大学学报, 2019, 45(2): 422-428.
[8]	王博, 谢军伟, 张晶, 葛佳昂. 基于SD-LCMV算法的FDA平台外干扰抑制[J]. 北京航空航天大学学报, 2019, 45(11): 2247-2256.
[9]	郝新红, 杜涵宇, 陈齐乐. 调频引信粗糙面目标与干扰信号识别[J]. 北京航空航天大学学报, 2019, 45(10): 1946-1955.
[10]	张冬, 陈勇, 胡孟权, 付向恒. 边条/鸭翼对前掠翼和后掠翼气动特性的影响[J]. 北京航空航天大学学报, 2019, 45(10): 2058-2068.
[11]	吴靖, 蔡国飙, 贺碧蛟. 氢氧发动机真空羽流干扰试验研究[J]. 北京航空航天大学学报, 2019, 45(1): 44-49.
[12]	张泓湜, 蒋伯峰. 基于空间隔离的低轨卫星系统频谱共享方法[J]. 北京航空航天大学学报, 2018, 44(9): 1909-1917.
[13]	王国宏, 白杰, 孙殿星. 速度欺骗干扰下的机动目标跟踪技术[J]. 北京航空航天大学学报, 2018, 44(7): 1359-1370.
[14]	王国宏, 白杰, 张翔宇, 孙殿星. 基于FRFT域特征差异的压制干扰检测与分类算法[J]. 北京航空航天大学学报, 2018, 44(6): 1124-1132.
[15]	李欣, 王春阳, 原慧, 金珊珊. 基于干扰重构和峭度最大化的SMSP干扰抑制方法[J]. 北京航空航天大学学报, 2018, 44(6): 1176-1184.