基于实验的自适应随机测试效率分析

殷永峰; 肖鹏; 张弛; 刘斌

doi:10.13700/j.bh.1001-5965.2013.0265

基于实验的自适应随机测试效率分析

doi: 10.13700/j.bh.1001-5965.2013.0265

北京航空航天大学可靠性与系统工程学院, 北京 100191

基金项目: 航空科学基金资助项目（20095551025）；中央高校基本科研业务费专项资金资助项目（YWF-11-03-Q-114）

详细信息

中图分类号: TP311
计量
- 文章访问数: 1583
- HTML全文浏览量: 155
- PDF下载量: 736
- 被引次数: 0
出版历程
- 收稿日期: 2013-05-17
- 网络出版日期: 2014-03-20

Analysis of adaptive random testing efficiency based on the experiment

School of Reliability and System Engineering, Beijing University of Aeronautics and Astronautics, Beijing 100191, china

摘要

摘要: 自适应随机测试通过自适应算法对随机测试进行加强，从而提高软件失效检测能力.现有研究过多强调了其在F-度量上的优势，而较少考虑输入域的诸多因素对自适应随机测试效率的影响.选取3类典型自适应随机测试算法和随机测试算法，分析被测软件失效区域紧致程度、维度对算法的影响，并选取自适应随机算法中测试效果最佳的固定候选集算法在非数值条件下与随机算法比对.结果表明，自适应随机测试受输入域的诸多因素影响，适用性有限，实际测试中对测试效率的提升效果并不明显.
- 软件测试 /
- 随机测试 /
- 自适应随机测试 /
- 失效区域
Abstract: Adaptive random testing (ART) had been proposed as an enhancement of random testing with some algorithms, thus the ability of failure detection was improved. However, previous studies emphasised on the advantages of F-measure a lot but rarely considered the real testing environment. Three typical adaptive random testing algorithms and random testing algorithm were selected, and the impact of the compactness of failure regions, dimensions on the efficiency of ART was analyzed. Then fixed size candidate set (FSCS), which was the best ART algorithm, was compared with random testing in the non-numeric conditions. The results show that the range of application of ART is limited by many factors of input domain. And in real test, the enhancement of test efficiency is not obvious.
- software testing /
- random testing /
- adaptive random testing /
- failure detection

HTML全文

参考文献(20)

[1]	Yin Y F,Liu B,Li Z,et al.The integrated application based on real-time extended UML and improved formal method in real-time embedded software testing[J].Journal of Networks,2010, 5(12):1410-1416
[2]	Markos Z,Tsoukalas,Joe W,et al.On some reliability estimation problems in random and partition testing[J].IEEE Transactions on Software Engineering,1993,19(7):688-697
[3]	Chan F T,Chen T Y,Mak I K,et al.Proportional sampling strategy:guidelines for software testing practitioners[J].Information and Software Technology,1996,38(12):775-782
[4]	Chen T Y,Leung H,Mak I K.Adaptive random testing[C]//Proceedings of the 9th Asian Computing Science Conference.Heidelberg:Springer-Verlag,2004:320-329
[5]	Liu H,Kuo F C,Chen T Y.Comparison of adaptive random testing and random testing under various testing and debugging scenarios[J].Practice and Experience,2012,42(8):1055-1074
[6]	Sun Bo,Dong Y W,Ye H.On enhancing adaptive random testing for AADL model[C]//Proceedings of IEEE 9th International Conference on Ubiquitous Intelligence and Computing and IEEE 9th International Conference on Autonomic and Trusted Computing.Washington DC:IEEE Computer Society,2012: 455-461
[7]	Arcuri A,Briand L.Adaptive random testing:an illusion of effectiveness[C]//Proceedings of the 2011 International Symposium on Software Testing and Analysis.New York:ACM,2011:265-275
[8]	Chen T Y,Eddy G,Merkel R,et al.Adaptive random testing through dynamic partitioning[C]//Proceedings of the 4th International Conference on Quality Software.Piscataway,NJ:IEEE Computer Society,2004:79-86
[9]	Chen T Y,Huang D H,Zhou Z Q.On adaptive random testing through iterative partitioning[J].Journal of Information Science and Engineering,2011,27(4):1449-1472
[10]	Chan K P,Chen T Y,Towey D P.Restricted random testing:adaptive random testing by exclusion[J].International Journal of Software Engineering and Knowledge Engineering,2005, 16(4):553-584
[11]	Mayer J.Lattice-based adaptive random testing[C]//Proceedings of the 20th IEEE/ACM International Conference on Automated Software Engineering.New York:ACM,2005:333-336
[12]	Mayer J,Schneckenburger C.Adaptive random testing with enlarged input domain[C]//Proceedings of the Sixth International Conference on Quality Software.Piscataway,NJ:IEEE,2006:251-258
[13]	Chen T Y,Kuo F C,Liu H.Enhancing adaptive random testing through partitioning by edge and centre[C]//Proceedings of the 2007 Australian Software Engineering Conference.Piscataway,NJ:IEEE Computer Society,2007:265-273
[14]	Geng J X,Zhang J M.A new method to solve the"boundary effect"of adaptive random testing[C]//Proceedings of the 2010 International Conference on Educational and Information Technology.Piscataway,NJ:IEEE Computer Society,2010,1:298-302
[15]	Ciupa I,Leitner A,Oriol M,et al.Object distance and its application to adaptive random testing of object-oriented programs[C]//Proceedings of the First International Workshop on Random Testing.New York:ACM,2006:55-63
[16]	Ciupa I,Leitner A.ARTOO:adaptive random testing for object-oriented software[C]//Proceedings of the 30th International Conference on Software Engineering.Piscataway,NJ:IEEE Computer Society,2008:71-80
[17]	Chen T Y,Huang D H.Adaptive random testing by localization[C]//Proceedings of the 11th Asia-Pacific Software Engineering Conference.Piscataway,NJ:IEEE Computer Society,2004:293-298
[18]	Shin S H,Park S K,Choi K H,et al.Normalized adaptive random test for integration tests[C]//Proceedings of International Computer Software and Applications Conference.Piscataway,NJ:IEEE Computer Society,2010:335-340
[19]	Zhou Z Q.Using coverage information to guide test case selection in adaptive random testing[C]//Proceedings of International Computer Software and Applications Conference.Piscataway,NJ:IEEE Computer Society,2010:208-213
[20]	Arcuri A,Iqbal M Z,Briand L.Black-box system testing of real-time embedded systems using random and search-based testing[C]//Lecture Notes in Computer Science:Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics.Heidelberg:Springer Verlag,2010:95-110