测试有效性对软件可靠性验证测试量的影响

李秋英; 李海峰; 王健

测试有效性对软件可靠性验证测试量的影响

北京航空航天大学可靠性与系统工程学院, 北京 100191

基金项目: 国防科技工业技术基础科研项目(Z132010B001)

详细信息

作者简介:
李秋英(1973－),女,黑龙江大庆人,讲师,li_qiuying@buaa.edu.cn.

中图分类号: TP 311
计量
- 文章访问数: 3721
- HTML全文浏览量: 226
- PDF下载量: 1217
- 被引次数: 0
出版历程
- 收稿日期: 2010-10-11
- 网络出版日期: 2011-03-31

Effects of software test efficiency on software reliability demonstration testing effort

School of Reliability and Systems Engineering, Beijing University of Aeronautics and Astronautics, Beijing 100191, China

摘要

摘要: 针对传统软件可靠性验证测试方法均不考虑软件测试性可能会对验证测试用例数量产生影响的现状,提出一种引入测试有效性对软件可靠性验证测试最小量进行改进的方法.分析了软件测试性的定义及其对软件可靠性测试集合的影响,提出软件测试有效性的概念.比较了考虑测试有效性前后软件可靠性验证测试集合在数量上的差异,证明经典统计方法和无先验知识的Bayesian统计推断方法确定的均为假定测试有效性为零情况下的保守估计.提出结合测试有效性的验证测试量的量化表示模型和验证测试方案的改进方法,基于统计故障注入的原理,提出测试有效性的定量评估方法,最后通过示例给出定量评估过程和方法.
- 软件可靠性 /
- 验证 /
- 测试 /
- 有效性 /
- 影响 /
- 评估
Abstract: To solve the problem that in the traditional software reliability demonstration testing(SRDT), software testability was not considered as one of the possible influence factors on test effort, a method which introduced test efficiency to improve the quantity model of minimal sample size in SRDT was put forward. The definition of software testability and its effect on software reliability test suite were analyzed. The concept of test efficiency was proposed. The difference between the numbers of test cases with different test efficiency and whether efficiency is considered were compared. It was demonstrated in detail that the traditional method and the Bayesian method with no prior knowledge are all the conditions where the test efficiency equaled to zero, so both the methods gave the most conservative value. The improved method combined with the test efficiency was recommended. Based on the principle of statistical fault injection, the quantitative estimation method of test efficiency was proposed and the process and the estimation method were shown by a case study.
- software reliability /
- demonstrations /
- testing /
- efficiency /
- effects /
- estimation

HTML全文

参考文献(1)

[1] 李秋英,姜梦岑.软件可靠性验证测试最小测试量的必要条件[J].北京航空航天大学学报,2010,36(2): 239-243 Li Qiuying,Jiang Mengcen.Analysis of necessary condition for minimal software reliability demonstration test suite[J].Journal of Beijing University of Aeronautics and Astronautics,2010,36(2): 239-243(in Chinese) [2] 覃志东,雷航,桑楠,等.连续执行软件可靠性验证测试方法[J].计算机科学,2005,32(6): 202-207 Qin Zhidong,Lei Hang,Sang Nan,et al.Reliability demonstration testing method for continuous execution software [J].Computer Science,2005,32(6): 202-207(in Chinese) [3] Andy P,Wassim M,Yolanda M.Estimation of software reliability by stratified sampling[J].ACM Transactions on Software Engineering and Methodology,1999,8(3):263-283 [4] Cukic B.Accelerated testing for software reliability assessment //Biljanovic P.21st Annual International Conference MIPRO-98.Washington DC:IEEE Com Soc,1998:124-129 [5] Alam S,Chen H,Ehrlich WK,et al.Assessing software reliability performance under highly critical but infrequent event occurrences //Philip G.8th ISSRE.Los Alamitos: IEEE Comp Soc,1997:294-303 [6] Hecht M,Hecht H.Use of importance sampling and related techniques to measure very high reliability software //Joel S.Aerospace Conference Proceedings.Montana: IEEE Aerospace and Electronics Systems Soc,2000:533-546 [7] Tang D,Hecht M,Miller J.MEADEP and its applications in evaluating dependability for air traffic control systems //Schueppert.Proceedings of the Annual Reliability and Maintainability Symposium Anaheim.Washington DC: IEEE Reliability Society,1998:19-22 [8] 颜炯,王戟,陈火旺.基于重要度抽样的软件统计测试加速[J].计算机工程与科学,2005,27(3):64-66 Yan Jiong,Wang Ji,Chen Huowang.Software statistical test acceleration based on importance sampling [J].Computer Engineering and Science,2005,27(3):64-66(in Chinese) [9] IEEE SA 610.12-1990 IEEE standard glossary of software engineering terminology,[S] [10] ISO／IEC9126-91 Software engineering-product quality[S] [11] Hamlet D,Voas J.Faults on its sleeve:amplifying software reliability testing //Thomas O.1993 ACM SGSOFT.Cambridge: ACM Society,1993:89-98 [12] Chen W,Untch R H,Rothermel G.Can fault-exposure-potential estimates improve the fault detection abilities of test suites [J].Journal of Software Testing,Verification,and Reliability,2002,4(2):197-218 [13] 赵亮,王建民,孙家广.软件易测性和软件可靠性关系研究[J].计算机学报,2007,30(6):986-991 Zhao Liang,Wang Jianmin,Sun Jiaguang.Study on the relationship between software testability and reliability[J].Chinese Journal of Computers,2007,30(6): 986-991(in Chinese) [14] Miller K W,Morell L J,Noonan R E.Estimating the probability of failure when testing reveals no failures[J].IEEE Transactions on Software Engineering,1992,18(1):33-43 [15] Kuball S,Hughes G,May J,et al.The effectiveness of statistical testing when applied to logic systems[J].Safety Science,2004,42(5):369-383 [16] Kuball S,May J.Test-adequacy and statistical testing combining different properties of a test-set //Stephanie K.15th ISSRE.Washington DC: IEEE Com Soc,2004:161-172 [17] 覃志东,雷航,桑楠,等.安全关键软件可靠性验证测试方法研究[J].航空学报,2005,26(3): 334-339 Qin Zhidong,Lei Hang,Sang Nan,et al.Study on the feliability demonstration testing method for safety critical software[J].Acta Aeronautica et Astronautica Sinica,2005,26(3):334-339(in Chinese) [18] Woodward M R,Halewood K.From weak to strong,dead or alive,an analysis of some mutation testing issues //2nd Workshop on Software Testing,Verification and Analysis.Washington DC: IEEE Com Soc,1988:152-158 [19] Agrawal H,Demillo R,Hathaway B,et al.Design of mutant operators for the C programming language. SERC-TR-41-P,2006 [20] 赵性颂,顾斌.变异测试在嵌入式软件中的应用[J].微计算机信息,2009,25(11-2):87-88 Zhao Xingsong,Gu Bin.The application of mutation testing in embedded software [J].Microcomputer Information,2009,25(11-2):87-88(in Chinese) [21] Lyu M R.Handbook of software reliability engineering [M].New York: McGraw Hill,1996 [22] 杨为民,盛一兴.系统可靠性数字仿真[M].北京:北京航空航天大学出版社,1990: 52-54 Yang Weimin,Sheng Yixing.System reliability digital simulation[M].Bejing: Beijing University of Aeronautics and Astronautics Press,1990: 52-54(in Chinese) [23] GB/T 4087.2-1983 数据的统计处理和解释[S] GB/T 4087.2-1983 Statistical interpretation of data[S](in Chinese) [24] GB 4087.3-85 数据的统计处理和解释二项分布可靠度单侧置信下限[S] GB 4087.3-85 Statistical interpretation of data One-sided reliability confidence lower limit[S](in Chinese) [25] Kececioglu D.Reliability and life testing handbook[M].NJ: Prentice Hall,Englewood Cliffs,1993:722-724

施引文献

资源附件(0)

访问统计