Yin Xingyu, Wu Zhilei, Zhu Ziqianget al. Solution of Euler Equations on the Two Dimentional Unstructured Grids[J]. Journal of Beijing University of Aeronautics and Astronautics, 1998, 24(1): 35-38. (in Chinese)
Citation: Li Qiuying, Li Haifeng, Wang Jianet al. Effects of software test efficiency on software reliability demonstration testing effort[J]. Journal of Beijing University of Aeronautics and Astronautics, 2011, 37(3): 325-330. (in Chinese)

Effects of software test efficiency on software reliability demonstration testing effort

  • Received Date: 11 Oct 2010
  • Publish Date: 31 Mar 2011
  • To solve the problem that in the traditional software reliability demonstration testing(SRDT), software testability was not considered as one of the possible influence factors on test effort, a method which introduced test efficiency to improve the quantity model of minimal sample size in SRDT was put forward. The definition of software testability and its effect on software reliability test suite were analyzed. The concept of test efficiency was proposed. The difference between the numbers of test cases with different test efficiency and whether efficiency is considered were compared. It was demonstrated in detail that the traditional method and the Bayesian method with no prior knowledge are all the conditions where the test efficiency equaled to zero, so both the methods gave the most conservative value. The improved method combined with the test efficiency was recommended. Based on the principle of statistical fault injection, the quantitative estimation method of test efficiency was proposed and the process and the estimation method were shown by a case study.

     

  • [1] 李秋英,姜梦岑.软件可靠性验证测试最小测试量的必要条件[J].北京航空航天大学学报,2010,36(2): 239-243 Li Qiuying,Jiang Mengcen.Analysis of necessary condition for minimal software reliability demonstration test suite[J].Journal of Beijing University of Aeronautics and Astronautics,2010,36(2): 239-243(in Chinese) [2] 覃志东,雷航,桑楠,等.连续执行软件可靠性验证测试方法[J].计算机科学,2005,32(6): 202-207 Qin Zhidong,Lei Hang,Sang Nan,et al.Reliability demonstration testing method for continuous execution software [J].Computer Science,2005,32(6): 202-207(in Chinese) [3] Andy P,Wassim M,Yolanda M.Estimation of software reliability by stratified sampling[J].ACM Transactions on Software Engineering and Methodology,1999,8(3):263-283 [4] Cukic B.Accelerated testing for software reliability assessment //Biljanovic P.21st Annual International Conference MIPRO-98.Washington DC:IEEE Com Soc,1998:124-129 [5] Alam S,Chen H,Ehrlich WK,et al.Assessing software reliability performance under highly critical but infrequent event occurrences //Philip G.8th ISSRE.Los Alamitos: IEEE Comp Soc,1997:294-303 [6] Hecht M,Hecht H.Use of importance sampling and related techniques to measure very high reliability software //Joel S.Aerospace Conference Proceedings.Montana: IEEE Aerospace and Electronics Systems Soc,2000:533-546 [7] Tang D,Hecht M,Miller J.MEADEP and its applications in evaluating dependability for air traffic control systems //Schueppert.Proceedings of the Annual Reliability and Maintainability Symposium Anaheim.Washington DC: IEEE Reliability Society,1998:19-22 [8] 颜炯,王戟,陈火旺.基于重要度抽样的软件统计测试加速[J].计算机工程与科学,2005,27(3):64-66 Yan Jiong,Wang Ji,Chen Huowang.Software statistical test acceleration based on importance sampling [J].Computer Engineering and Science,2005,27(3):64-66(in Chinese) [9] IEEE SA 610.12-1990 IEEE standard glossary of software engineering terminology,[S] [10] ISO/IEC9126-91 Software engineering-product quality[S] [11] Hamlet D,Voas J.Faults on its sleeve:amplifying software reliability testing //Thomas O.1993 ACM SGSOFT.Cambridge: ACM Society,1993:89-98 [12] Chen W,Untch R H,Rothermel G.Can fault-exposure-potential estimates improve the fault detection abilities of test suites [J].Journal of Software Testing,Verification,and Reliability,2002,4(2):197-218 [13] 赵亮,王建民,孙家广.软件易测性和软件可靠性关系研究[J].计算机学报,2007,30(6):986-991 Zhao Liang,Wang Jianmin,Sun Jiaguang.Study on the relationship between software testability and reliability[J].Chinese Journal of Computers,2007,30(6): 986-991(in Chinese) [14] Miller K W,Morell L J,Noonan R E.Estimating the probability of failure when testing reveals no failures[J].IEEE Transactions on Software Engineering,1992,18(1):33-43 [15] Kuball S,Hughes G,May J,et al.The effectiveness of statistical testing when applied to logic systems[J].Safety Science,2004,42(5):369-383 [16] Kuball S,May J.Test-adequacy and statistical testing combining different properties of a test-set //Stephanie K.15th ISSRE.Washington DC: IEEE Com Soc,2004:161-172 [17] 覃志东,雷航,桑楠,等.安全关键软件可靠性验证测试方法研究[J].航空学报,2005,26(3): 334-339 Qin Zhidong,Lei Hang,Sang Nan,et al.Study on the feliability demonstration testing method for safety critical software[J].Acta Aeronautica et Astronautica Sinica,2005,26(3):334-339(in Chinese) [18] Woodward M R,Halewood K.From weak to strong,dead or alive,an analysis of some mutation testing issues //2nd Workshop on Software Testing,Verification and Analysis.Washington DC: IEEE Com Soc,1988:152-158 [19] Agrawal H,Demillo R,Hathaway B,et al.Design of mutant operators for the C programming language. SERC-TR-41-P,2006 [20] 赵性颂,顾斌.变异测试在嵌入式软件中的应用[J].微计算机信息,2009,25(11-2):87-88 Zhao Xingsong,Gu Bin.The application of mutation testing in embedded software [J].Microcomputer Information,2009,25(11-2):87-88(in Chinese) [21] Lyu M R.Handbook of software reliability engineering [M].New York: McGraw Hill,1996 [22] 杨为民,盛一兴.系统可靠性数字仿真[M].北京:北京航空航天大学出版社,1990: 52-54 Yang Weimin,Sheng Yixing.System reliability digital simulation[M].Bejing: Beijing University of Aeronautics and Astronautics Press,1990: 52-54(in Chinese) [23] GB/T 4087.2-1983 数据的统计处理和解释[S] GB/T 4087.2-1983 Statistical interpretation of data[S](in Chinese) [24] GB 4087.3-85 数据的统计处理和解释二项分布可靠度单侧置信下限[S] GB 4087.3-85 Statistical interpretation of data One-sided reliability confidence lower limit[S](in Chinese) [25] Kececioglu D.Reliability and life testing handbook[M].NJ: Prentice Hall,Englewood Cliffs,1993:722-724
  • Relative Articles

    [1]LI Huan, CUI Pengcheng, JIA Hongyin, GONG Xiaoquan, WU Xiaojun. Numerical Simulation of TSTO Interstage Separation Considering Constraint Force[J]. Journal of Beijing University of Aeronautics and Astronautics. doi: 10.13700/j.bh.1001-5965.2024.0839
    [2]FU Yangaoxiao, MEI Jie, DING Mingsong, CHEN Jianqiang, JIANG Tao, DONG Weizhong. Numerical simulation of jet interaction heating on reusable launch vehicle[J]. Journal of Beijing University of Aeronautics and Astronautics. doi: 10.13700/j.bh.1001-5965.2025.0053
    [3]WU H,ZHENG Y G,LIU M,et al. Overall design method of ground test equipment for engine dynamic air bleed of aircraft environmental control system[J]. Journal of Beijing University of Aeronautics and Astronautics,2025,51(2):573-583 (in Chinese). doi: 10.13700/j.bh.1001-5965.2023.0014.
    [4]CHEN Xi, XIE Shuguo, WEI Mengyuan, LI Yuanyuan. Simulation modeling methodology for broadband conducted immunity quantization of analog and analog-digital hybrid chips[J]. Journal of Beijing University of Aeronautics and Astronautics. doi: 10.13700/j.bh.1001-5965.2024.0193
    [5]ZOU L,WU W N,LIU J,et al. Numerical simulation of flow around two tandem wavy conical cylinders at subcritical Reynolds number[J]. Journal of Beijing University of Aeronautics and Astronautics,2024,50(3):706-715 (in Chinese). doi: 10.13700/j.bh.1001-5965.2022.0285.
    [6]ZHANG Xin-ze, LI Qin, WENG Yi-hui, YOU Yan-cheng. Numerical analysis and flow state prediction of double wedge steady/unsteady flow at different Ma、Re[J]. Journal of Beijing University of Aeronautics and Astronautics. doi: 10.13700/j.bh.1001-5965.2023.0758
    [7]HE Yan-tong, DENG Tian. Numerical Study of low-pressure modeling of bio-jet fuel combustion[J]. Journal of Beijing University of Aeronautics and Astronautics. doi: 10.13700/j.bh.1001-5965.2023.0826
    [8]XIAO L F,ZHOU L W,LI X D. Numerical simulation of deformed airfoil modal after blast shock wave[J]. Journal of Beijing University of Aeronautics and Astronautics,2024,50(1):341-349 (in Chinese). doi: 10.13700/j.bh.1001-5965.2022.0244.
    [9]CUI Y P,LI Z H,ZHENG G L. Computing convex hull of a generic polygon with simulation of progressive support for an elastic line[J]. Journal of Beijing University of Aeronautics and Astronautics,2024,50(1):216-223 (in Chinese). doi: 10.13700/j.bh.1001-5965.2022.0246.
    [10]CHENG G Y,CHEN S. Terminal operation resilience analysis based on discrete event simulation[J]. Journal of Beijing University of Aeronautics and Astronautics,2024,50(11):3310-3318 (in Chinese). doi: 10.13700/j.bh.1001-5965.2022.0825.
    [11]LIU X L,LI J K. Iterative learning control of electric load simulator of aircraft steering gear[J]. Journal of Beijing University of Aeronautics and Astronautics,2024,50(9):2727-2738 (in Chinese). doi: 10.13700/j.bh.1001-5965.2022.0711.
    [12]XING Yufeng, WANG Yuzhu, LI Yuting, ZHANG Huimin. Wilson-ρ method and analytical solution of the analog system[J]. Journal of Beijing University of Aeronautics and Astronautics. doi: 10.13700/j.bh.1001-5965.2024.0382
    [13]WANG Zhen, ZHONG Wei, WANG Tong-guang, LI Xu-dong, ZHANG Hong-ying. Numerical simulation of unsteady aerodynamic characteristics of parafoil airfoil[J]. Journal of Beijing University of Aeronautics and Astronautics. doi: 10.13700/j.bh.1001-5965.2023.0184
    [14]ZHANG P H,TANG Y,TANG J,et al. Simulation of cavity flow at high Mach number based on adaptive unstructured hybrid mesh[J]. Journal of Beijing University of Aeronautics and Astronautics,2023,49(6):1311-1318 (in Chinese). doi: 10.13700/j.bh.1001-5965.2021.0424.
    [15]HAN Y F,HU X S,GAO Y,et al. Comparison of turbulence models for unsteady flow simulation in a long and narrow cabin[J]. Journal of Beijing University of Aeronautics and Astronautics,2023,49(4):957-964 (in Chinese). doi: 10.13700/j.bh.1001-5965.2021.0335.
    [16]ZHANG Pei-hong, JIA Hong-yin, ZHAO Jiao, WU Xiao-jun, ZHOU Gui-yu, ZHANG Yao-bing. Numerical simulation research on opposing jet interaction characteristics of rocket inverse flight[J]. Journal of Beijing University of Aeronautics and Astronautics. doi: 10.13700/j.bh.1001-5965.2023.0710
    [17]ZHANG Pei-hong, ZHOU Gui-yu, SHEN Ying-ying, TANG Jing, ZHAO Wei, JIA Hong-yin. Research on simulation of parallel separation characteristics using NNW-FlowStar software[J]. Journal of Beijing University of Aeronautics and Astronautics. doi: 10.13700/j.bh.1001-5965.2023.0275
    [18]MENG Q L,ZHAO Z M,CHEN X G,et al. Thermal vacuum test study of mechanically pumped two-phase loop for space remote sensor[J]. Journal of Beijing University of Aeronautics and Astronautics,2023,49(3):559-568 (in Chinese). doi: 10.13700/j.bh.1001-5965.2021.0270.
    [19]SHANG S F,YANG X N,YANG Y,et al. Secondary electron multiplication of aluminum under strong vacuum electromagnetic field[J]. Journal of Beijing University of Aeronautics and Astronautics,2023,49(7):1606-1613 (in Chinese). doi: 10.13700/j.bh.1001-5965.2021.0514.
    [20]GUO Qi, SHEN Xiaobin, LIN Guiping, ZHANG Shijuan. Numerical simulation of icing on aircraft rotating surfaces[J]. Journal of Beijing University of Aeronautics and Astronautics, 2022, 48(11): 2259-2269. doi: 10.13700/j.bh.1001-5965.2021.0081
  • 加载中

Catalog

    通讯作者: 陈斌, bchen63@163.com
    • 1. 

      沈阳化工大学材料科学与工程学院 沈阳 110142

    1. 本站搜索
    2. 百度学术搜索
    3. 万方数据库搜索
    4. CNKI搜索

    Article Metrics

    Article views(3828) PDF downloads(1219) Cited by()
    Proportional views
    Related

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return