基于非参数假设检验的程序缺陷定位方法

叶钢; 李重文; 余丹; 马世龙

基于非参数假设检验的程序缺陷定位方法

北京航空航天大学计算机学院, 北京 100191

基金项目: 国家自然科学基金资助项目(61003016);软件开发环境国家重点实验室自主研究课题资助项目(SKLSDE-2011ZX-09)

详细信息

中图分类号: TP 311.52
计量
- 文章访问数: 2114
- HTML全文浏览量: 215
- PDF下载量: 533
- 被引次数: 0
出版历程
- 收稿日期: 2011-03-26
- 网络出版日期: 2012-08-30

Fault localization based on non-parametric hypothesis testing model

School of Computer Science and Technology, Beijing University of Aeronautics and Astronautics, Beijing 100191, China

摘要

摘要: 调查了西门子测试集中的程序失败用例的规模和谓词评估偏差的分布.结果表明,中心极限定理的前提和参数假设检验的假设条件无法得到普遍满足.所以,已有的基于参数假设检验的方法存在潜在的问题.针对这一现象,提出了基于非参数假设检验定位程序缺陷的方法.实验结果表明,该方法在非正态分布的样本集上仍具有较好的适用性,且在缺陷定位效率上优于已有的基于程序谓词的缺陷定位技术.同时比较了基于2种常用的非参数假设检验模型的缺陷定位方法的效率.一种方法基于Kolmogorov-Smirnov检验,另一种方法基于Cramér-von-Mises准则.比较结果表明,在西门子测试集上,基于Kolmogorov-Smirnov检验的方法在缺陷定位效率上优于基于Cramér-von-Mises准则的方法.
- 软件测试 /
- 缺陷定位 /
- 统计学方法
Abstract: The size of failed runs and the distributions of the evaluation biases on the Siemens suite were investigated. The empirical results show that the precondition for the central limit theorem and the assumption on feature spectra forming normal distributions are not well-supported by empirical data. Thus, the previous method based on parametric hypothesis testing has a potential problem. New approaches based on non-parametric hypothesis testing models were proposed. The empirical results on the Siemens suite indicate that these approaches can outperform existing predicate-based statistical fault localization techniques, especially on non-normal distributions. The effectiveness comparison between two methods based on two popular non-parametric hypothesis testing models was also investigated. One method was based on the Kolmogorov-Smirnov test and the other was based on Cram閞-von-Mises criterion. The comparison results show that the method based on the Kolmogorov-Smirnov test consistently outperforms that based on the Cram閞-von-Mises criterion in the task of fault localization.
- software testing /
- fault localization /
- statistical methods

HTML全文

参考文献(16)

[1]	Ernst M D,Cockrell J,Griswold W G,et al.Dynamically discovering likely program invariants to support program evolution[J].IEEE Transactions on Software Engineering,2001,27(2):99-123
[2]	Hangal S,Lam M S.Tracking down software bugs using automatic anomaly detection //Proceedings of the 24th International Conference on Software Engineering.Orlando:ACM,2002:291-301
[3]	Wong W E,Qi Y,Zhao L,et al.Effective fault localization using code coverage //Proceedings of the 31st Annual International Computer Software and Application Conference.Beijing:IEEE Computer Society,2007:449-456
[4]	Li W,Harrold M J,Görg C.Detecting user-visible failures in AJAX web applications by analyzing users-interaction behaviors //Proceedings of the 25th IEEE/ACM International Conference on Automated Software Engineering.Antwerp,Belgium:ACM,2010:55-158
[5]	Park S,Vuduc R W,Harrold M J.Falcon:fault localization in concurrent programs //Proceedings of the 32nd ACM/IEEE International Conference on Software Engineering.Cape Town,South Africa:ACM,2010:245-254
[6]	Kim M,Sinha S,Görg C,et al.Automated bug neighborhood analysis for identifying incomplete bug fixes //Proceedings of the 3rd International Conference on Software Testing.Paris:IEEE Computer Society,2010:383-392
[7]	Santelices R A,Harrold M J,Orso A.Precisely detecting runtime change interactions for evolving software //Proceedings of the 3rd International Conference on Software Testing.Paris:IEEE Computer Society,2010:429-438
[8]	Liu C,Han J.Failure proximity:a fault localization-based approach //Proceedings of the 14th ACM SIGSOFT International Symposium on Foundations of Software Engineering.Portland,Oregon:ACM,2006:46-56
[9]	Liu C,Fei L,Yan X,et al.Statistical debugging:a hypothesis testing-based approach[J].IEEE Transactions on Software Engineering,2006,32(10):831-848
[10]	Liblit B,Aiken A,Zheng A X,et al.Bug isolation via remote program sampling //Proceedings of the 2003 ACM SIGPLAN Conference on Programming Language Design and Implementation.San Diego,California:ACM,2003:141-154
[11]	Liblit B,Naik M,Zheng A X,et al.Scalable statistical bug isolation //Proceedings of the 2005 ACM SIGPLAN Conference on Programming Language Design and Implementation.Chicago:ACM,2005:15-26
[12]	Zhang Z,Chan W K,Tse T H,et al.Is non-parametric hypothesis testing model robust for statistical fault localization [J].Information and Software Technology,2009,51(11):1573-1585
[13]	Hutchins M,Foster H,Goradia T,et al.Experiments of the effectiveness of dataflow-and controlflow-based test adequacy criteria //Proceedings of the 16th International Conference on Software Engineering.Sorrento:IEEE Computer Society/ACM Press,1994:191-200
[14]	Zwillinger D,Kokoska S.Standard probability and statistics tables and formulae[M].Boca Raton:Chapman and Hall/CRC,2000:341-343
[15]	Anderson T W.On the distribution of the two-sample cram閞 von mises criterion[J].The Annals of Mathematical Statistics,1962,33(3):1148-1159
[16]	Do H,Elbaum S,Rothermel G.Supporting controlled experimentation with testing techniques:an infrastructure and its potential impact[J].Empirical Software Engineering,2005,10(4):405-435