| Citation: | BAO Junpeng, YANG Ke, ZHOU Jinget al. Node level parallel and optimization method of satellite time serial data mining[J]. Journal of Beijing University of Aeronautics and Astronautics, 2018, 44(12): 2470-2478. doi: 10.13700/j.bh.1001-5965.2018.0334(in Chinese)
|
Intelligent satellite technology requires more and more data mining operations for satellite time series data. Usually, satellite data amount is very big that needs a lot of computation, so it will take a very long time to complete the computation in serial program. The satellite anomaly process multi-features analysis procedure is such a typical representation, which performs many common data mining operations, including windows segmentation, computation of vector similarity, feature extraction, Fourier transformation, and cluster-ing. The paper discusses several speed-up and parallel optimization strategies for a time series data mining procedure on a typical heterogeneous computing node with multi-cores CPUs and GPUs, including vector optimization, multi-process parallelization, and GPU computation. We test and compare these optimization strategies in different usage conditions. The experiment results show that the combined use of them can achieve obvious efficiency improvement for different task.
| [1] |
CASELLA G, FIENBERG S, OLKIN I.Time series analysis and its applications:With R examples[J].Publications of the American Statistical Association, 2006, 97(458):656-657. http://d.old.wanfangdata.com.cn/NSTLQK/NSTL_QKJJ0231076500/
|
| [2] |
LI H, YANG L, GUO C.Improved piecewise vector quantized approximation based on normalized time subsequences[J].Measurement, 2013, 46(9):3429-3439. doi: 10.1016/j.measurement.2013.05.012
|
| [3] |
WANG J, LI H, HUANG J, et al.Association rules mining based analysis of consequential alarm sequences in chemical processes[J].Journal of Loss Prevention in the Process Industries, 2016, 41:178-185. doi: 10.1016/j.jlp.2016.03.022
|
| [4] |
LI H.Distance measure with improved lower bound for multivariate time series[J].Physica A:Statistical Mechanics and Its Applications, 2017, 468:622-637. doi: 10.1016/j.physa.2016.10.062
|
| [5] |
MATTIOLI G, ANABLE J, VROTSOU K.Car dependent practices:Findings from a sequence pattern mining study of UK time use data[J].Transportation Research Part A:Policy and Practice, 2016, 89:56-72. doi: 10.1016/j.tra.2016.04.010
|
| [6] |
DENG W, WANG G, XU J.Piecewise two-dimensional normal cloud representation for time-series data mining[J].Information Sciences, 2016, 374(C):32-50. http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=e57ddb6e2e16ddd06c306b4103a1f153
|
| [7] |
GUAN X, SUN G, YI X, et al.A novel data association algorithm for unequal length fluctuant sequence[J].Procedia Engineering, 2015, 99:1190-1202. doi: 10.1016/j.proeng.2014.12.648
|
| [8] |
SUN Z Y, TSAI M C, TSAI H P.Mining uncertain sequence data on hadoop platform[C]//Pacific-Asia Conference on Know-ledge Discovery and Data Mining.Berlin: Springer, 2014: 204-215.
|
| [9] |
LAM H T, MORCHEN F, FRADKIN D, et al.Mining compressing sequential patterns[J].Statistical Analysis and Data Mining, 2014, 7(1):34-52. doi: 10.1002/sam.11192
|
| [10] |
GONG X Y, FONG S, WONG R K, et al.Discovering sub-pa-tterns from time series using a normalized cross-match algorithm[J].The Journal of Supercomputing, 2016, 72(10):1-18.
|
| [11] |
JEYABHARATHI J, SHANTHI D.An efficient mining for app-roximate frequent items in protein sequence database[J].Journal of Emerging Technologies in Web Intelligence, 2014, 6(3):324-330.
|
| [12] |
巨涛, 朱正东, 董小社.异构众核系统及其编程模型与性能优化技术研究综述[J].电子学报, 2015, 43(1):111-119. doi: 10.3969/j.issn.0372-2112.2015.01.018
JU T, ZHU Z D, DONG X S.The feature, programming model and performance optimization strategy of heterogeneous many-core systems:A review[J].Acta Electronica Sinica, 2015, 43(1):111-119(in Chinese). doi: 10.3969/j.issn.0372-2112.2015.01.018
|
| [13] |
戴春娥, 陈维斌, 傅顺开, 等.通过GPU加速数据挖掘的研究进展和实践[J].计算机工程与应用, 2015, 51(16):109-116. doi: 10.3778/j.issn.1002-8331.1411-0027
DAI C E, CHEN W B, FU S K, et al.Research progress and practice of accelerating data mining based on GPU[J].Computer Engineering and Applications, 2015, 51(16):109-116(in Chinese). doi: 10.3778/j.issn.1002-8331.1411-0027
|
| [14] |
CAVUOTI S, GAROFALO M, BRESCIA M, et al.Astrophysical data mining with GPU.A case study:Genetic classification of globular clusters[J].New Astronomy, 2014, 26(1):12-22. http://d.old.wanfangdata.com.cn/OAPaper/oai_arXiv.org_1304.0597
|
| [15] |
顾文恺.基于GPU的脉冲压缩并行化研究[J].航空计算技术, 2017, 47(2):121-124. doi: 10.3969/j.issn.1671-654X.2017.02.030
GU W K.Study on parallel pulse compression based on GPU[J].Aeronautical Computing Technology, 2017, 47(2):121-124(in Chinese). doi: 10.3969/j.issn.1671-654X.2017.02.030
|
| [16] |
SCHALKWIJK J, JONKER H J J, SIEBESMA A P, et al.Weather forecasting using GPU-based large-eddy simulations[J].Bulletin of the American Meteorological Society, 2015, 96(5):715-723. doi: 10.1175/BAMS-D-14-00114.1
|
| [17] |
VACONDIO R, MIGNOSA P, PAGANI S.3D SPH numerical simulation of the wave generated by the vajont rockslide[J].Advances in Water Resources, 2013, 59(11):146-156. http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=c765c71c68366f110dce11e73298f152
|
| [18] |
黄曦, 陈伟, 张建奇.基于GPU的实时红外场景仿真系统研究[J].航空兵器, 2015(6):49-54. doi: 10.3969/j.issn.1673-5048.2015.06.012
HUANG X, CHEN W, ZHANG J Q.Study on real-time infrared scene simulation system based on GPU[J].Aviation Weapon, 2015(6):49-54(in Chinese). doi: 10.3969/j.issn.1673-5048.2015.06.012
|
| [19] |
SU X, WANG X, JING G, et al.GPU-Meta-Storms:Computing the structure similarities among massive amount of microbial community samples using GPU[J].Bioinformatics, 2014, 30(7):1031-1033. doi: 10.1093/bioinformatics/btt736
|
| [20] |
刘志文.并行算法设计与性能优化[M].北京:机械工业出版社, 2015:162.
LIU Z W.Parallel computing and performance optimization[M].Beijing:China Machine Press, 2015:162(in Chinese).
|
Figures(11) / Tables(2)
Copyright © Journal of Beijing University of Aeronautics and Astronautics
Address: Editorial Department of Journal of Beijing University of Aeronautics and Astronautics, 37 Xueyuan Road, Haidian District, Beijing Post Code: 100191 Email: jbuaa@buaa.edu.cn
Supported by:
Beijing Renhe Information Technology Co., Ltd.
DownLoad:
