Volume 37 Issue 3
Mar.  2011
Turn off MathJax
Article Contents
Li Qiuying, Li Haifeng, Wang Jianet al. Effects of software test efficiency on software reliability demonstration testing effort[J]. Journal of Beijing University of Aeronautics and Astronautics, 2011, 37(3): 325-330. (in Chinese)
Citation: Li Qiuying, Li Haifeng, Wang Jianet al. Effects of software test efficiency on software reliability demonstration testing effort[J]. Journal of Beijing University of Aeronautics and Astronautics, 2011, 37(3): 325-330. (in Chinese)

Effects of software test efficiency on software reliability demonstration testing effort

  • Received Date: 11 Oct 2010
  • Publish Date: 31 Mar 2011
  • To solve the problem that in the traditional software reliability demonstration testing(SRDT), software testability was not considered as one of the possible influence factors on test effort, a method which introduced test efficiency to improve the quantity model of minimal sample size in SRDT was put forward. The definition of software testability and its effect on software reliability test suite were analyzed. The concept of test efficiency was proposed. The difference between the numbers of test cases with different test efficiency and whether efficiency is considered were compared. It was demonstrated in detail that the traditional method and the Bayesian method with no prior knowledge are all the conditions where the test efficiency equaled to zero, so both the methods gave the most conservative value. The improved method combined with the test efficiency was recommended. Based on the principle of statistical fault injection, the quantitative estimation method of test efficiency was proposed and the process and the estimation method were shown by a case study.

     

  • loading
  • [1] 李秋英,姜梦岑.软件可靠性验证测试最小测试量的必要条件[J].北京航空航天大学学报,2010,36(2): 239-243 Li Qiuying,Jiang Mengcen.Analysis of necessary condition for minimal software reliability demonstration test suite[J].Journal of Beijing University of Aeronautics and Astronautics,2010,36(2): 239-243(in Chinese) [2] 覃志东,雷航,桑楠,等.连续执行软件可靠性验证测试方法[J].计算机科学,2005,32(6): 202-207 Qin Zhidong,Lei Hang,Sang Nan,et al.Reliability demonstration testing method for continuous execution software [J].Computer Science,2005,32(6): 202-207(in Chinese) [3] Andy P,Wassim M,Yolanda M.Estimation of software reliability by stratified sampling[J].ACM Transactions on Software Engineering and Methodology,1999,8(3):263-283 [4] Cukic B.Accelerated testing for software reliability assessment //Biljanovic P.21st Annual International Conference MIPRO-98.Washington DC:IEEE Com Soc,1998:124-129 [5] Alam S,Chen H,Ehrlich WK,et al.Assessing software reliability performance under highly critical but infrequent event occurrences //Philip G.8th ISSRE.Los Alamitos: IEEE Comp Soc,1997:294-303 [6] Hecht M,Hecht H.Use of importance sampling and related techniques to measure very high reliability software //Joel S.Aerospace Conference Proceedings.Montana: IEEE Aerospace and Electronics Systems Soc,2000:533-546 [7] Tang D,Hecht M,Miller J.MEADEP and its applications in evaluating dependability for air traffic control systems //Schueppert.Proceedings of the Annual Reliability and Maintainability Symposium Anaheim.Washington DC: IEEE Reliability Society,1998:19-22 [8] 颜炯,王戟,陈火旺.基于重要度抽样的软件统计测试加速[J].计算机工程与科学,2005,27(3):64-66 Yan Jiong,Wang Ji,Chen Huowang.Software statistical test acceleration based on importance sampling [J].Computer Engineering and Science,2005,27(3):64-66(in Chinese) [9] IEEE SA 610.12-1990 IEEE standard glossary of software engineering terminology,[S] [10] ISO/IEC9126-91 Software engineering-product quality[S] [11] Hamlet D,Voas J.Faults on its sleeve:amplifying software reliability testing //Thomas O.1993 ACM SGSOFT.Cambridge: ACM Society,1993:89-98 [12] Chen W,Untch R H,Rothermel G.Can fault-exposure-potential estimates improve the fault detection abilities of test suites [J].Journal of Software Testing,Verification,and Reliability,2002,4(2):197-218 [13] 赵亮,王建民,孙家广.软件易测性和软件可靠性关系研究[J].计算机学报,2007,30(6):986-991 Zhao Liang,Wang Jianmin,Sun Jiaguang.Study on the relationship between software testability and reliability[J].Chinese Journal of Computers,2007,30(6): 986-991(in Chinese) [14] Miller K W,Morell L J,Noonan R E.Estimating the probability of failure when testing reveals no failures[J].IEEE Transactions on Software Engineering,1992,18(1):33-43 [15] Kuball S,Hughes G,May J,et al.The effectiveness of statistical testing when applied to logic systems[J].Safety Science,2004,42(5):369-383 [16] Kuball S,May J.Test-adequacy and statistical testing combining different properties of a test-set //Stephanie K.15th ISSRE.Washington DC: IEEE Com Soc,2004:161-172 [17] 覃志东,雷航,桑楠,等.安全关键软件可靠性验证测试方法研究[J].航空学报,2005,26(3): 334-339 Qin Zhidong,Lei Hang,Sang Nan,et al.Study on the feliability demonstration testing method for safety critical software[J].Acta Aeronautica et Astronautica Sinica,2005,26(3):334-339(in Chinese) [18] Woodward M R,Halewood K.From weak to strong,dead or alive,an analysis of some mutation testing issues //2nd Workshop on Software Testing,Verification and Analysis.Washington DC: IEEE Com Soc,1988:152-158 [19] Agrawal H,Demillo R,Hathaway B,et al.Design of mutant operators for the C programming language. SERC-TR-41-P,2006 [20] 赵性颂,顾斌.变异测试在嵌入式软件中的应用[J].微计算机信息,2009,25(11-2):87-88 Zhao Xingsong,Gu Bin.The application of mutation testing in embedded software [J].Microcomputer Information,2009,25(11-2):87-88(in Chinese) [21] Lyu M R.Handbook of software reliability engineering [M].New York: McGraw Hill,1996 [22] 杨为民,盛一兴.系统可靠性数字仿真[M].北京:北京航空航天大学出版社,1990: 52-54 Yang Weimin,Sheng Yixing.System reliability digital simulation[M].Bejing: Beijing University of Aeronautics and Astronautics Press,1990: 52-54(in Chinese) [23] GB/T 4087.2-1983 数据的统计处理和解释[S] GB/T 4087.2-1983 Statistical interpretation of data[S](in Chinese) [24] GB 4087.3-85 数据的统计处理和解释二项分布可靠度单侧置信下限[S] GB 4087.3-85 Statistical interpretation of data One-sided reliability confidence lower limit[S](in Chinese) [25] Kececioglu D.Reliability and life testing handbook[M].NJ: Prentice Hall,Englewood Cliffs,1993:722-724
  • 加载中

Catalog

    通讯作者: 陈斌, bchen63@163.com
    • 1. 

      沈阳化工大学材料科学与工程学院 沈阳 110142

    1. 本站搜索
    2. 百度学术搜索
    3. 万方数据库搜索
    4. CNKI搜索

    Article Metrics

    Article views(3797) PDF downloads(1219) Cited by()
    Proportional views
    Related

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return