Peng Kemao, Shen Gongzhang, Wen Chuanyuanet al. Design of Integrated Flight/Vectored Nozzle Control System at Take-Off[J]. Journal of Beijing University of Aeronautics and Astronautics, 1998, 24(3): 283-286. (in Chinese)
Citation: Li Qiuying, Li Haifeng, Wang Jianet al. Effects of software test efficiency on software reliability demonstration testing effort[J]. Journal of Beijing University of Aeronautics and Astronautics, 2011, 37(3): 325-330. (in Chinese)

Effects of software test efficiency on software reliability demonstration testing effort

  • Received Date: 11 Oct 2010
  • Publish Date: 31 Mar 2011
  • To solve the problem that in the traditional software reliability demonstration testing(SRDT), software testability was not considered as one of the possible influence factors on test effort, a method which introduced test efficiency to improve the quantity model of minimal sample size in SRDT was put forward. The definition of software testability and its effect on software reliability test suite were analyzed. The concept of test efficiency was proposed. The difference between the numbers of test cases with different test efficiency and whether efficiency is considered were compared. It was demonstrated in detail that the traditional method and the Bayesian method with no prior knowledge are all the conditions where the test efficiency equaled to zero, so both the methods gave the most conservative value. The improved method combined with the test efficiency was recommended. Based on the principle of statistical fault injection, the quantitative estimation method of test efficiency was proposed and the process and the estimation method were shown by a case study.

     

  • [1] 李秋英,姜梦岑.软件可靠性验证测试最小测试量的必要条件[J].北京航空航天大学学报,2010,36(2): 239-243 Li Qiuying,Jiang Mengcen.Analysis of necessary condition for minimal software reliability demonstration test suite[J].Journal of Beijing University of Aeronautics and Astronautics,2010,36(2): 239-243(in Chinese) [2] 覃志东,雷航,桑楠,等.连续执行软件可靠性验证测试方法[J].计算机科学,2005,32(6): 202-207 Qin Zhidong,Lei Hang,Sang Nan,et al.Reliability demonstration testing method for continuous execution software [J].Computer Science,2005,32(6): 202-207(in Chinese) [3] Andy P,Wassim M,Yolanda M.Estimation of software reliability by stratified sampling[J].ACM Transactions on Software Engineering and Methodology,1999,8(3):263-283 [4] Cukic B.Accelerated testing for software reliability assessment //Biljanovic P.21st Annual International Conference MIPRO-98.Washington DC:IEEE Com Soc,1998:124-129 [5] Alam S,Chen H,Ehrlich WK,et al.Assessing software reliability performance under highly critical but infrequent event occurrences //Philip G.8th ISSRE.Los Alamitos: IEEE Comp Soc,1997:294-303 [6] Hecht M,Hecht H.Use of importance sampling and related techniques to measure very high reliability software //Joel S.Aerospace Conference Proceedings.Montana: IEEE Aerospace and Electronics Systems Soc,2000:533-546 [7] Tang D,Hecht M,Miller J.MEADEP and its applications in evaluating dependability for air traffic control systems //Schueppert.Proceedings of the Annual Reliability and Maintainability Symposium Anaheim.Washington DC: IEEE Reliability Society,1998:19-22 [8] 颜炯,王戟,陈火旺.基于重要度抽样的软件统计测试加速[J].计算机工程与科学,2005,27(3):64-66 Yan Jiong,Wang Ji,Chen Huowang.Software statistical test acceleration based on importance sampling [J].Computer Engineering and Science,2005,27(3):64-66(in Chinese) [9] IEEE SA 610.12-1990 IEEE standard glossary of software engineering terminology,[S] [10] ISO/IEC9126-91 Software engineering-product quality[S] [11] Hamlet D,Voas J.Faults on its sleeve:amplifying software reliability testing //Thomas O.1993 ACM SGSOFT.Cambridge: ACM Society,1993:89-98 [12] Chen W,Untch R H,Rothermel G.Can fault-exposure-potential estimates improve the fault detection abilities of test suites [J].Journal of Software Testing,Verification,and Reliability,2002,4(2):197-218 [13] 赵亮,王建民,孙家广.软件易测性和软件可靠性关系研究[J].计算机学报,2007,30(6):986-991 Zhao Liang,Wang Jianmin,Sun Jiaguang.Study on the relationship between software testability and reliability[J].Chinese Journal of Computers,2007,30(6): 986-991(in Chinese) [14] Miller K W,Morell L J,Noonan R E.Estimating the probability of failure when testing reveals no failures[J].IEEE Transactions on Software Engineering,1992,18(1):33-43 [15] Kuball S,Hughes G,May J,et al.The effectiveness of statistical testing when applied to logic systems[J].Safety Science,2004,42(5):369-383 [16] Kuball S,May J.Test-adequacy and statistical testing combining different properties of a test-set //Stephanie K.15th ISSRE.Washington DC: IEEE Com Soc,2004:161-172 [17] 覃志东,雷航,桑楠,等.安全关键软件可靠性验证测试方法研究[J].航空学报,2005,26(3): 334-339 Qin Zhidong,Lei Hang,Sang Nan,et al.Study on the feliability demonstration testing method for safety critical software[J].Acta Aeronautica et Astronautica Sinica,2005,26(3):334-339(in Chinese) [18] Woodward M R,Halewood K.From weak to strong,dead or alive,an analysis of some mutation testing issues //2nd Workshop on Software Testing,Verification and Analysis.Washington DC: IEEE Com Soc,1988:152-158 [19] Agrawal H,Demillo R,Hathaway B,et al.Design of mutant operators for the C programming language. SERC-TR-41-P,2006 [20] 赵性颂,顾斌.变异测试在嵌入式软件中的应用[J].微计算机信息,2009,25(11-2):87-88 Zhao Xingsong,Gu Bin.The application of mutation testing in embedded software [J].Microcomputer Information,2009,25(11-2):87-88(in Chinese) [21] Lyu M R.Handbook of software reliability engineering [M].New York: McGraw Hill,1996 [22] 杨为民,盛一兴.系统可靠性数字仿真[M].北京:北京航空航天大学出版社,1990: 52-54 Yang Weimin,Sheng Yixing.System reliability digital simulation[M].Bejing: Beijing University of Aeronautics and Astronautics Press,1990: 52-54(in Chinese) [23] GB/T 4087.2-1983 数据的统计处理和解释[S] GB/T 4087.2-1983 Statistical interpretation of data[S](in Chinese) [24] GB 4087.3-85 数据的统计处理和解释二项分布可靠度单侧置信下限[S] GB 4087.3-85 Statistical interpretation of data One-sided reliability confidence lower limit[S](in Chinese) [25] Kececioglu D.Reliability and life testing handbook[M].NJ: Prentice Hall,Englewood Cliffs,1993:722-724
  • Relative Articles

    [1]WANG Shiqi, LU Hui, ZHANG Yuxuan. Hexagonal grid sampling method for low-dimensional decision boundary identification[J]. Journal of Beijing University of Aeronautics and Astronautics. doi: 10.13700/j.bh.1001-5965.2024.0526
    [2]ZHANG Y L,MA Z Z,SHI L,et al. Multi-agent coverage control based on communication connectivity maintenance constraints[J]. Journal of Beijing University of Aeronautics and Astronautics,2024,50(2):519-528 (in Chinese). doi: 10.13700/j.bh.1001-5965.2022.0340.
    [3]GUO Wenjuan, LI Qiang, ZHOU Ling. A CFD grid uncertainty analysis method for hypersonic aircraft[J]. Journal of Beijing University of Aeronautics and Astronautics. doi: 10.13700/j.bh.1001-5965.2024.0099
    [4]GE Wenqing, LI Detong, SONG Yadong, TAN Cao, LI Bo. Displacement sensorlesscontrol of electromagnetic linear actuator based on improved sliding mode observer[J]. Journal of Beijing University of Aeronautics and Astronautics. doi: 10.13700/j.bh.1001-5965.2024.0291
    [5]WANG J H,TIAN Y R,YU N Z. Air gap flux-oriented vector control techniques of wind power synchronous motor[J]. Journal of Beijing University of Aeronautics and Astronautics,2024,50(5):1639-1645 (in Chinese). doi: 10.13700/j.bh.1001-5965.2022.0463.
    [6]ZHAO Hong-jia, ZHANG Duo-na, LU Yuan-yao, DING Wen-rui. Intelligent Recognition of Electromagnetic Signal Modulation with Embedded Domain Knowledge[J]. Journal of Beijing University of Aeronautics and Astronautics. doi: 10.13700/j.bh.1001-5965.2023.0746
    [7]XING Na, DI Hao-tian, YIN Wen-jie, HAN Ya-jun, ZHOU Yang. Path planning for agents based on adaptive polymorphic ant colony optimization[J]. Journal of Beijing University of Aeronautics and Astronautics. doi: 10.13700/j.bh.1001-5965.2023.0432
    [8]FU J W,WANG C. Configuration and multibody separation scheme of compact missile swarm[J]. Journal of Beijing University of Aeronautics and Astronautics,2023,49(7):1630-1638 (in Chinese). doi: 10.13700/j.bh.1001-5965.2021.0508.
    [9]HU J,GENG H,WANG D S,et al. Characteristic analysis and diagnosis of double charged ions of continuous variable-thrust ion thruster[J]. Journal of Beijing University of Aeronautics and Astronautics,2023,49(12):3303-3310 (in Chinese). doi: 10.13700/j.bh.1001-5965.2022.0078.
    [10]LEI J Y,LEI Q N,LI H B,et al. A mesh parameterization method and life reliability-based optimization for turbine blade[J]. Journal of Beijing University of Aeronautics and Astronautics,2023,49(10):2651-2659 (in Chinese). doi: 10.13700/j.bh.1001-5965.2021.0708.
    [11]ZHANG P H,TANG Y,TANG J,et al. Simulation of cavity flow at high Mach number based on adaptive unstructured hybrid mesh[J]. Journal of Beijing University of Aeronautics and Astronautics,2023,49(6):1311-1318 (in Chinese). doi: 10.13700/j.bh.1001-5965.2021.0424.
    [12]ZHU Z H,XIAO T H,XU Y N,et al. Adjoint-based adaptive Cartesian mesh refinement for sonic boom prediction[J]. Journal of Beijing University of Aeronautics and Astronautics,2023,49(9):2432-2441 (in Chinese). doi: 10.13700/j.bh.1001-5965.2021.0689.
    [13]FAN Z W,YU X Q,DAI Y L. Trade-off for top-level requirements of commercial aircraft using comprehensive evaluation and optimization[J]. Journal of Beijing University of Aeronautics and Astronautics,2023,49(9):2415-2422 (in Chinese). doi: 10.13700/j.bh.1001-5965.2021.0670.
    [14]YANG Xiang-gang, GAO Yong-xin, WANG Zhong-ming, LI Yi-wen, YAO Cheng. Effect of plasma excitation on aerodynamic characteristics of airfoil on Mars[J]. Journal of Beijing University of Aeronautics and Astronautics. doi: 10.13700/j.bh.1001-5965.2023.0312
    [15]WU Xin, WU Youli, NIU Deqing, CAI Yuxuan, XU Yang, CHEN Bian. Application of data cube association mining in infrared anti-jamming[J]. Journal of Beijing University of Aeronautics and Astronautics, 2022, 48(11): 2304-2313. doi: 10.13700/j.bh.1001-5965.2021.0096
    [16]GONG Xiaoquan, WU Xiaojun, TANG Jing, LI Ming, ZHANG Jian. Application of r-grid adaptive for shock capturing in discontinuous Galerkin finite element method[J]. Journal of Beijing University of Aeronautics and Astronautics, 2022, 48(10): 1889-1898. doi: 10.13700/j.bh.1001-5965.2021.0046
    [17]QIAN Depei, LUAN Zhongzhi, LIU Yi. From grid to "East-west Computing Transfer" : Constructing national computing infrastructure[J]. Journal of Beijing University of Aeronautics and Astronautics, 2022, 48(9): 1561-1574. doi: 10.13700/j.bh.1001-5965.2022.0715
    [18]LYU Mengyuan, ZHAI Li, HU Guixing. Conducted electromagnetic interference of wireless charging system with bilateral LCC of electric vehicle[J]. Journal of Beijing University of Aeronautics and Astronautics, 2022, 48(10): 2079-2086. doi: 10.13700/j.bh.1001-5965.2021.0191
    [19]XU Lijun, LIU Fulu, DING Yiqing, LI Zhengyong, XIE Yuedong. Residual thickness detection of pipeline based on electromagnetic ultrasonic shear wave[J]. Journal of Beijing University of Aeronautics and Astronautics, 2022, 48(9): 1767-1773. doi: 10.13700/j.bh.1001-5965.2022.0301
    [20]SU Donglin, CUI Shuo, BAI Jiangfei, LI Yaoyao. Fast prediction method for radiated and scattered coupled fields in complex electromagnetic environment[J]. Journal of Beijing University of Aeronautics and Astronautics, 2022, 48(9): 1553-1560. doi: 10.13700/j.bh.1001-5965.2022.0705
  • Cited by

    Periodical cited type(2)

    1. 周晓猛,蔡金乐,郭一博,廖云龙. 商用锂离子电池快充降解及热失控特性研究. 中国民航大学学报. 2025(01): 27-32 .
    2. 卫寿平,孙杰,李吉刚,周添,陈静,党胜男,唐娜,张帆. 锂离子电池热失控气体产物检测及分析技术研究进展. 储能科学与技术. 2024(11): 4155-4176 .

    Other cited types(0)

  • 加载中

Catalog

    通讯作者: 陈斌, bchen63@163.com
    • 1. 

      沈阳化工大学材料科学与工程学院 沈阳 110142

    1. 本站搜索
    2. 百度学术搜索
    3. 万方数据库搜索
    4. CNKI搜索

    Article Metrics

    Article views(3828) PDF downloads(1219) Cited by(2)
    Proportional views
    Related

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return