Li Ji, Wang Lei. Method for precisely detecting buffer overflow vulnerabilities in C programs[J]. Journal of Beijing University of Aeronautics and Astronautics, 2008, 34(03): 319-322. (in Chinese)
Citation: Li Qiuying, Li Haifeng, Wang Jianet al. Effects of software test efficiency on software reliability demonstration testing effort[J]. Journal of Beijing University of Aeronautics and Astronautics, 2011, 37(3): 325-330. (in Chinese)

Effects of software test efficiency on software reliability demonstration testing effort

  • Received Date: 11 Oct 2010
  • Publish Date: 31 Mar 2011
  • To solve the problem that in the traditional software reliability demonstration testing(SRDT), software testability was not considered as one of the possible influence factors on test effort, a method which introduced test efficiency to improve the quantity model of minimal sample size in SRDT was put forward. The definition of software testability and its effect on software reliability test suite were analyzed. The concept of test efficiency was proposed. The difference between the numbers of test cases with different test efficiency and whether efficiency is considered were compared. It was demonstrated in detail that the traditional method and the Bayesian method with no prior knowledge are all the conditions where the test efficiency equaled to zero, so both the methods gave the most conservative value. The improved method combined with the test efficiency was recommended. Based on the principle of statistical fault injection, the quantitative estimation method of test efficiency was proposed and the process and the estimation method were shown by a case study.

     

  • [1] 李秋英,姜梦岑.软件可靠性验证测试最小测试量的必要条件[J].北京航空航天大学学报,2010,36(2): 239-243 Li Qiuying,Jiang Mengcen.Analysis of necessary condition for minimal software reliability demonstration test suite[J].Journal of Beijing University of Aeronautics and Astronautics,2010,36(2): 239-243(in Chinese) [2] 覃志东,雷航,桑楠,等.连续执行软件可靠性验证测试方法[J].计算机科学,2005,32(6): 202-207 Qin Zhidong,Lei Hang,Sang Nan,et al.Reliability demonstration testing method for continuous execution software [J].Computer Science,2005,32(6): 202-207(in Chinese) [3] Andy P,Wassim M,Yolanda M.Estimation of software reliability by stratified sampling[J].ACM Transactions on Software Engineering and Methodology,1999,8(3):263-283 [4] Cukic B.Accelerated testing for software reliability assessment //Biljanovic P.21st Annual International Conference MIPRO-98.Washington DC:IEEE Com Soc,1998:124-129 [5] Alam S,Chen H,Ehrlich WK,et al.Assessing software reliability performance under highly critical but infrequent event occurrences //Philip G.8th ISSRE.Los Alamitos: IEEE Comp Soc,1997:294-303 [6] Hecht M,Hecht H.Use of importance sampling and related techniques to measure very high reliability software //Joel S.Aerospace Conference Proceedings.Montana: IEEE Aerospace and Electronics Systems Soc,2000:533-546 [7] Tang D,Hecht M,Miller J.MEADEP and its applications in evaluating dependability for air traffic control systems //Schueppert.Proceedings of the Annual Reliability and Maintainability Symposium Anaheim.Washington DC: IEEE Reliability Society,1998:19-22 [8] 颜炯,王戟,陈火旺.基于重要度抽样的软件统计测试加速[J].计算机工程与科学,2005,27(3):64-66 Yan Jiong,Wang Ji,Chen Huowang.Software statistical test acceleration based on importance sampling [J].Computer Engineering and Science,2005,27(3):64-66(in Chinese) [9] IEEE SA 610.12-1990 IEEE standard glossary of software engineering terminology,[S] [10] ISO/IEC9126-91 Software engineering-product quality[S] [11] Hamlet D,Voas J.Faults on its sleeve:amplifying software reliability testing //Thomas O.1993 ACM SGSOFT.Cambridge: ACM Society,1993:89-98 [12] Chen W,Untch R H,Rothermel G.Can fault-exposure-potential estimates improve the fault detection abilities of test suites [J].Journal of Software Testing,Verification,and Reliability,2002,4(2):197-218 [13] 赵亮,王建民,孙家广.软件易测性和软件可靠性关系研究[J].计算机学报,2007,30(6):986-991 Zhao Liang,Wang Jianmin,Sun Jiaguang.Study on the relationship between software testability and reliability[J].Chinese Journal of Computers,2007,30(6): 986-991(in Chinese) [14] Miller K W,Morell L J,Noonan R E.Estimating the probability of failure when testing reveals no failures[J].IEEE Transactions on Software Engineering,1992,18(1):33-43 [15] Kuball S,Hughes G,May J,et al.The effectiveness of statistical testing when applied to logic systems[J].Safety Science,2004,42(5):369-383 [16] Kuball S,May J.Test-adequacy and statistical testing combining different properties of a test-set //Stephanie K.15th ISSRE.Washington DC: IEEE Com Soc,2004:161-172 [17] 覃志东,雷航,桑楠,等.安全关键软件可靠性验证测试方法研究[J].航空学报,2005,26(3): 334-339 Qin Zhidong,Lei Hang,Sang Nan,et al.Study on the feliability demonstration testing method for safety critical software[J].Acta Aeronautica et Astronautica Sinica,2005,26(3):334-339(in Chinese) [18] Woodward M R,Halewood K.From weak to strong,dead or alive,an analysis of some mutation testing issues //2nd Workshop on Software Testing,Verification and Analysis.Washington DC: IEEE Com Soc,1988:152-158 [19] Agrawal H,Demillo R,Hathaway B,et al.Design of mutant operators for the C programming language. SERC-TR-41-P,2006 [20] 赵性颂,顾斌.变异测试在嵌入式软件中的应用[J].微计算机信息,2009,25(11-2):87-88 Zhao Xingsong,Gu Bin.The application of mutation testing in embedded software [J].Microcomputer Information,2009,25(11-2):87-88(in Chinese) [21] Lyu M R.Handbook of software reliability engineering [M].New York: McGraw Hill,1996 [22] 杨为民,盛一兴.系统可靠性数字仿真[M].北京:北京航空航天大学出版社,1990: 52-54 Yang Weimin,Sheng Yixing.System reliability digital simulation[M].Bejing: Beijing University of Aeronautics and Astronautics Press,1990: 52-54(in Chinese) [23] GB/T 4087.2-1983 数据的统计处理和解释[S] GB/T 4087.2-1983 Statistical interpretation of data[S](in Chinese) [24] GB 4087.3-85 数据的统计处理和解释二项分布可靠度单侧置信下限[S] GB 4087.3-85 Statistical interpretation of data One-sided reliability confidence lower limit[S](in Chinese) [25] Kececioglu D.Reliability and life testing handbook[M].NJ: Prentice Hall,Englewood Cliffs,1993:722-724
  • Relative Articles

    [1]LI Longhui, YU Kaikai, XU Jinglei. Study on the Effect of Shock Strength Distribution on the Global Stability of Shock Wave/Boundary Layer Interaction[J]. Journal of Beijing University of Aeronautics and Astronautics. doi: 10.13700/j.bh.1001-5965.2024.0847
    [2]MA J,LI R Y,ZHANG Q Y,et al. Network time reliability evaluation method based on uncertainty theory[J]. Journal of Beijing University of Aeronautics and Astronautics,2025,51(4):1267-1276 (in Chinese). doi: 10.13700/j.bh.1001-5965.2023.0191.
    [3]CHEN Xueqi, FENG Shoukun, DENG Wangqun, SONG Ziyu, YANG Hai, LIU Wenkui, HONG Jie. Effect of compression state on stiffness and dynamic characteristics of end tooth-tie rod rotor[J]. Journal of Beijing University of Aeronautics and Astronautics. doi: 10.13700/j.bh.1001-5965.2024.0687
    [4]TANG X H,DOU Y R. Design and verification of airworthiness compliance of equivalent endurance test cycle of turbofan engine[J]. Journal of Beijing University of Aeronautics and Astronautics,2025,51(1):133-140 (in Chinese). doi: 10.13700/j.bh.1001-5965.2022.0953.
    [5]ZHAO Jianyin, JIANG Jingwei, SUN Yuan, WEI Shuntao. Storage reliability assessment based on multivariate degradation failure and sudden failure Competition[J]. Journal of Beijing University of Aeronautics and Astronautics. doi: 10.13700/j.bh.1001-5965.2024.0601
    [6]LI Y,ZHANG X X,SUN F Q,et al. Belief reliability modeling for assembly accuracy of spaceborne SAR antenna deployable mechanism[J]. Journal of Beijing University of Aeronautics and Astronautics,2024,50(1):134-143 (in Chinese). doi: 10.13700/j.bh.1001-5965.2022.0234.
    [7]Cao Yueyao, Xue Tao, He Shanshan, Ai Jianliang, Dong Yiqun. Calculation of Beyond Visual Range Air Combat All-Domain Fire Field and Application of Situation Threat Assessment and Assisted Decision Making[J]. Journal of Beijing University of Aeronautics and Astronautics. doi: 10.13700/j.bh.1001-5965.2024.0399
    [8]CHEN N T,MAN Y Z,LI J H. Risk assessment method for civil aircraft approach and landing at high plateau based on QAR data[J]. Journal of Beijing University of Aeronautics and Astronautics,2024,50(1):77-85 (in Chinese). doi: 10.13700/j.bh.1001-5965.2022.0186.
    [9]WANG X L,ZHAO J N,WANG J. Resilience assessment and recovery of airport departure flights under severe weather[J]. Journal of Beijing University of Aeronautics and Astronautics,2024,50(1):110-121 (in Chinese). doi: 10.13700/j.bh.1001-5965.2022.0193.
    [10]JIA Bao-hui, TAN Chu-yi, GAO Yuan, WANG Yu-xin. Health assessment of landing gear hydraulic retraction/extension system based on GRNN[J]. Journal of Beijing University of Aeronautics and Astronautics. doi: 10.13700/j.bh.1001-5965.2023.0708
    [11]HU Gengshuo, JIAO Jian, HU Langxiao, JING Yongfeng. Reliability modeling and evaluation method of IMA under dynamic reconfiguration[J]. Journal of Beijing University of Aeronautics and Astronautics. doi: 10.13700/j.bh.1001-5965.2024.0188
    [12]TIAN Gui-shuang, WANG Shao-ping, SHI Jian. Reliability model and lifetime prediction for train traction system considering multiple dependent components[J]. Journal of Beijing University of Aeronautics and Astronautics. doi: 10.13700/j.bh.1001-5965.2023.0797
    [13]LU X H,CAI J,ZHANG Z G,et al. Adequacy and suitability of airworthiness clause of bird strike based on bird situation in China[J]. Journal of Beijing University of Aeronautics and Astronautics,2024,50(9):2810-2818 (in Chinese). doi: 10.13700/j.bh.1001-5965.2022.0726.
    [14]ZHANG Z,WANG P,ZHOU H Y. Reliability analysis of nozzle adjustment mechanism with interval distribution parameters[J]. Journal of Beijing University of Aeronautics and Astronautics,2023,49(12):3377-3385 (in Chinese). doi: 10.13700/j.bh.1001-5965.2022.0089.
    [15]LEI J Y,LEI Q N,LI H B,et al. A mesh parameterization method and life reliability-based optimization for turbine blade[J]. Journal of Beijing University of Aeronautics and Astronautics,2023,49(10):2651-2659 (in Chinese). doi: 10.13700/j.bh.1001-5965.2021.0708.
    [16]CHANG Z M,LI L Y. Double-loop surrogate model for time-dependent reliability analysis based on NARX and Kriging models[J]. Journal of Beijing University of Aeronautics and Astronautics,2023,49(7):1802-1812 (in Chinese). doi: 10.13700/j.bh.1001-5965.2021.0541.
    [17]WANG Y D,SUN Y F,LEI D Y,et al. Thermal oxidation reliability and structure optimization of thin film thermocouple[J]. Journal of Beijing University of Aeronautics and Astronautics,2023,49(4):943-948 (in Chinese). doi: 10.13700/j.bh.1001-5965.2021.0318.
    [18]WU X C,HONG L. Importance evaluation of JTC compensation capacitor based on reliability truth table[J]. Journal of Beijing University of Aeronautics and Astronautics,2023,49(10):2579-2586 (in Chinese). doi: 10.13700/j.bh.1001-5965.2021.0767.
    [19]ZHU Qi-tao, LI Hong-shuang. A mixed reliability analysis method based on direct probability integral[J]. Journal of Beijing University of Aeronautics and Astronautics. doi: 10.13700/j.bh.1001-5965.2023.0498
    [20]GUO Tai, QIAN Xin, GONG Qi, REN Wenming, YANG Shuanbao, XU Qinggang. Methodology for model based verification requirements capturing and application in civil aircraft development[J]. Journal of Beijing University of Aeronautics and Astronautics, 2022, 48(10): 1933-1942. doi: 10.13700/j.bh.1001-5965.2021.0047
  • 加载中

Catalog

    通讯作者: 陈斌, bchen63@163.com
    • 1. 

      沈阳化工大学材料科学与工程学院 沈阳 110142

    1. 本站搜索
    2. 百度学术搜索
    3. 万方数据库搜索
    4. CNKI搜索

    Article Metrics

    Article views(3856) PDF downloads(1220) Cited by()
    Proportional views
    Related

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return