噪声环境下告警冗余设计对装甲车乘员响应绩效的影响

周孙夏; 刘双; 完颜笑如; 冯传宴; 王一行; 解芳

doi:10.13700/j.bh.1001-5965.2023.0712

噪声环境下告警冗余设计对装甲车乘员响应绩效的影响

doi: 10.13700/j.bh.1001-5965.2023.0712

1.
北京航空航天大学航空科学与工程学院，北京 100191
2.
中国北方车辆研究所，北京 100072

基金项目:

国家自然科学基金委员会与中国民用航空局联合基金(U1733118)；国家自然科学基金(71301005)

详细信息

通讯作者:
E-mail：wanyanxiaoru@buaa.edu.cn

中图分类号: TJ810.2
计量
- 文章访问数: 529
- HTML全文浏览量: 224
- PDF下载量: 43
- 被引次数: 0
出版历程
- 收稿日期: 2023-11-01
- 录用日期: 2023-12-20
- 网络出版日期: 2023-12-27
- 整期出版日期: 2026-01-31

Influences of multimodal redundant alarm design on reaction performance of armored vehicle crew under noise environment

1.
School of Aeronautic Science and Engineering，Beihang University，Beijing 100191，China
2.
China North Vehicle Research Institute，Beijing 100072，China

Funds:

National Natural Science Foundation of China and the Civil Aviation Administration of China (U1733118); National Natural Science Foundation of China (71301005)

More Information

Corresponding author: E-mail：wanyanxiaoru@buaa.edu.cn

摘要

摘要:
为探究不同噪声环境下多模态告警冗余设计对装甲车乘员响应绩效的影响，招募24名被试，开展了基于某新型高保真装甲车半实物仿真平台的模拟驾驶实验。采用2种噪声环境（高噪声、低噪声）×3种告警冗余设计（视觉通道冗余设计、听觉通道冗余设计、视听双通道冗余设计）条件下的双因素被试内设计，测量了被试的告警响应操作绩效、眼动指标及NASA-TLX量表得分。实验结果显示，在听觉通道冗余设计和视听双通道冗余设计条件下，乘员对于告警信息的响应错误率和反应时均显著低于视觉通道冗余设计条件；在不同告警冗余设计下，低噪声环境下乘员对于告警信息的响应错误率显著低于高噪声环境条件，但二者反应时之间并无明显差异；对于告警响应操作绩效、眼动指标和NASA-TLX量表得分，噪声条件和告警设计模式之间的交互效应均不显著。研究表明：对于装甲车告警信息设计，与采用视觉通道冗余设计模式相比，采用增加了听觉通道冗余提示的多模态告警模式（包括听觉通道冗余设计模式和视听双通道冗余设计模式），可以显著提高乘员对于告警信息的响应操作绩效；而在听觉通道冗余设计条件下继续叠加视觉通道冗余设计，即采用视听双通道冗余设计模式，却未带来进一步的响应操作绩效增益；低噪声作业环境对于改善乘员的响应操作绩效具有积极作用。
- 装甲车辆 /
- 多模态告警 /
- 噪声环境 /
- 任务绩效 /
- 乘员 /
- 人机工效
Abstract:
In order to investigate the effect of different multimodal redundant alarm design on the reaction performance of armored vehicle occupants under a noisy environment, 24 participants were recruited and subjected to simulation driving experiments utilizing a new type of high-fidelity armored vehicle semi physical simulation platform. Three alarm redundancies were tested: visual channel, auditory channel, and audio-visual dual channel designs, across high and low noise conditions. The findings demonstrate that, in comparison to the visual channel redundancies, drivers' response error rate and reaction time to warnings are substantially reduced in the auditory channel redundancies and audio-visual dual channel redundancies. The response error is generally lower in low noise environments than in high noise environments, although response time remains consistent across noise conditions. The interaction between noise conditions and alarm design does not significantly affect alarm response performance, eye movement indicators, or subjective workload scores. Comparing the multimodal alarm with redundant auditory prompts to the visual-only redundancy, the study finds that the former significantly enhances drivers' reaction to warning information. However, the combination of auditory and visual redundancy does not yield further performance improvements. A low noise environment positively influences response performance enhancement.
- armored vehicle /
- multimodal warning /
- noise environment /
- task performance /
- occupant /
- ergonomics

HTML全文

图 1 装甲车半实物仿真平台与人机交互数据采集系统

Figure 1. Armored vehicle semi-physical simulation platform and human-machine interactive data acquisition system

下载: 全尺寸图片幻灯片

图 2 不同实验条件下告警响应错误率结果

Figure 2. Results of reaction error rate under different experiment conditions

下载: 全尺寸图片幻灯片

图 3 不同实验条件下的告警响应反应时结果

Figure 3. Results of reaction time under different experiment conditions

下载: 全尺寸图片幻灯片

图 4 不同实验条件下平均注视时长结果

Figure 4. Average duration of fixations under different experiment conditions

下载: 全尺寸图片幻灯片

图 5 不同实验条件下平均扫视幅度结果

Figure 5. Average amplitude of saccades under different experiment conditions

下载: 全尺寸图片幻灯片

表 1 实验变量及拉丁方设计

Table 1. Experimental variables and Latin square design

被试编号	噪声条件	告警模式
1	高	视觉	听觉	视听
1	低	听觉	视听	视觉
2	低	视听	视觉	听觉
2	高	视觉	听觉	视听
3	高	听觉	视听	视觉
3	低	视听	视觉	听觉
4	低	视觉	听觉	视听
4	高	听觉	视听	视觉
5	高	视听	视觉	听觉
5	低	视觉	听觉	视听
6	低	听觉	视听	视觉
6	高	视听	视觉	听觉

下载: 导出CSV

表 2 不同实验条件下的NASA-TLX量表结果

Table 2. Results of NASA-TLX subscale ratings under different experiment conditions

实验条件	总得分	脑力需求	体力需求	时间需求	工作绩效	努力程度	挫败感
视觉通道冗余-低噪声	40.38(±18.59)	9.04(±4.40)	7.29(±3.84)	8.25(±4.26)	7.79(±4.56)	9.92(±5.09)	6.88(±3.98)
听觉通道冗余-低噪声	39.35(±18.05)	8.08(±3.99)	7.42(±3.40)	8.25(±4.32)	8.04(±4.29)	9.67(±4.72)	6.38(±4.75)
视听双通道冗余-低噪声	40.55(±17.16)	8.38(±3.66)	7.13(±3.80)	7.92(±3.74)	8.29(±4.30)	9.58(±4.47)	7.38(±4.73)
视觉通道冗余-高噪声	40.33(±19.09)	8.58(±4.62)	8.38(±4.83)	8.58(±4.61)	7.08(±3.87)	10.46(±5.42)	6.83(±4.59)
听觉通道冗余-高噪声	40.04(±16.94)	8.33(±4.23)	7.17(±3.81)	9.29(±4.80)	6.88(±4.88)	10.71(±5.20)	6.13(±3.66)
视听双通道冗余-高噪声	40.16(±17.36)	8.67(±4.70)	8.04(±4.26)	8.63(±4.21)	6.96(±4.51)	10.21(±4.55)	6.83(±4.79)
注：表中数值形式为均值（均方差）。

下载: 导出CSV

参考文献(34)

[1]	傅斌贺, 刘维平, 聂俊峰, 等. 考虑认知行为差异的乘员信息作业绩效研究[J]. 兵工学报, 2019, 40(3): 659-665. FU B H, LIU W P, NIE J F, et al. Research on crew’s information operation performance with the difference of cognitive behavior[J]. Acta Armamentarii, 2019, 40(3): 659-665(in Chinese).
[2]	WILLIAMS K W. A summary of unmanned aircraft accident/incident data: human factors implications, DOT/FAA/AM-04/24[R]. Oklahoma City: Federal Aviation Administration, 2004.
[3]	LEDEZMA A, ZAMORA V, SIPELE Ó, et al. Implementing a gaze tracking algorithm for improving advanced driver assistance systems[J]. Electronics, 2021, 10(12): 1480.
[4]	SARTER N B. Multimodal information presentation: design guidance and research challenges[J]. International Journal of Industrial Ergonomics, 2006, 36(5): 439-445.
[5]	孙晓东, 金晓萍, 解芳, 等. 多模态告警和认知负荷对装甲车辆乘员反应的影响[J]. 兵工学报, 2023, 44(4): 972-981. SUN X D, JIN X P, XIE F, et al. Effects of multimodal warning and cognitive load on the response of armored vehicle occupants[J]. Acta Armamentarii, 2023, 44(4): 972-981(in Chinese).
[6]	NAUJOKS F, KIESEL A, NEUKUM A. Cooperative warning systems: the impact of false and unnecessary alarms on drivers’ compliance[J]. Accident Analysis & Prevention, 2016, 97: 162-175.
[7]	LUNDQVIST L M, ERIKSSON L. Age, cognitive load, and multimodal effects on driver response to directional warning[J]. Applied Ergonomics, 2019, 76: 147-154.
[8]	MA J, LI J T, HUANG H W. Evaluation of multimodal and multi-staged alerting strategies for forward collision warning systems[J]. Sensors, 2022, 22(3): 1189.
[9]	SPENCE C. Crossmodal spatial attention[J]. Annals of the New York Academy of Sciences, 2010, 1191(1): 182-200.
[10]	WANG Y W, WU B H, MA S, et al. Effect of mapping characteristic on audiovisual warning: evidence from a simulated driving study[J]. Applied Ergonomics, 2022, 99: 103638.
[11]	EDWORTHY J. The design and implementation of non-verbal auditory warnings[J]. Applied Ergonomics, 1994, 25(4): 202-210.
[12]	ŠABIĆ E, CHEN J, MACDONALD J A. Toward a better understanding of in-vehicle auditory warnings and background noise[J]. Human Factors, 2021, 63(2): 312-335.
[13]	KARUNARATHNE B, WANG T Y, SO R H Y, et al. Adversarial relationship between combined medial olivocochlear (MOC) and middle-ear-muscle (MEM) reflexes and alarm-in-noise detection thresholds under negative signal-to-noise ratios (SNRs)[J]. Hearing Research, 2018, 367: 124-128.
[14]	ANDERSON S, PARBERY-CLARK A, WHITE-SCHWOCH T, et al. Auditory brainstem response to complex sounds predicts self-reported speech-in-noise performance[J]. Journal of Speech, Language, and Hearing Research, 2013, 56(1): 31-43.
[15]	D’AGOSTINO A R, BROWN J, FILLMORE M T. Redundant visual signals reduce the intensity of alcohol impairment[J]. Drug and Alcohol Dependence, 2020, 209: 107945.
[16]	黄琏, 刘雨发, 张松岩, 等. 装甲车辆人-机-环境系统总体设计要求: GJB 1835—1993[S]. 北京: 总参谋部装甲兵部, 1993. HUANG L, LIU Y F, ZHANG S Y, et al. Overall design requirements for armored vehicle man-machine-environment system: GJB 1835—1993[S]. Beijing: Armored Division of the General Staff Department, 1993(in Chinese).
[17]	冯传宴, 完颜笑如, 陈浩, 等. 基于多资源负荷理论的情境意识模型与应用[J]. 北京航空航天大学学报, 2018, 44(7): 1438-1446. FENG C Y, WANYAN X R, CHEN H, et al. Situation awareness model based on multi-resource load theory and its application[J]. Journal of Beijing University of Aeronautics and Astronautics, 2018, 44(7): 1438-1446(in Chinese).
[18]	刘维平, 聂俊峰, 解芳, 等. 面向装甲车辆乘员信息处理作业的脑力负荷预测模型[J]. 装甲兵工程学院学报, 2017(1): 40-45. LIU W P, NIE J F, XIE F, et al. Predictive mental workload model for armored vehicle crew’s information processing task[J]. Journal of Academy of Armored Force Engineering, 2017(1): 40-45(in Chinese).
[19]	刘双, 完颜笑如, 庄达民, 等. 基于注意资源分配的情境意识模型[J]. 北京航空航天大学学报, 2014, 40(8): 1066-1072. LIU S, WANYAN X R, ZHUANG D M, et al. Situational awareness model based on attention allocation[J]. Journal of Beijing University of Aeronautics and Astronautics, 2014, 40(8): 1066-1072(in Chinese).
[20]	AHLSTROM U, FRIEDMAN-BERG F J. Using eye movement activity as a correlate of cognitive workload[J]. International Journal of Industrial Ergonomics, 2006, 36(7): 623-636.
[21]	冯传宴, 完颜笑如, 刘双, 等. 负荷条件下注意力分配策略对情境意识的影响[J]. 航空学报, 2020, 41(3): 123307. FENG C Y, WANYAN X R, LIU S, et al. Influence of different attention allocation strategies under workloads on situation awareness[J]. Acta Aeronautica et Astronautica Sinica, 2020, 41(3): 123307(in Chinese).
[22]	CARDONA G, QUEVEDO N. Blinking and driving: the influence of saccades and cognitive workload[J]. Current Eye Research, 2014, 39(3): 239-244.
[23]	郭司南, 完颜笑如, 刘双, 等. 智能化设计与信息加工通道复杂度对装甲车乘员脑力负荷的影响[J]. 兵工学报, 2021, 42(2): 234-241. GUO S N, WANYAN X R, LIU S, et al. Influences of intelligent design and information processing modality complexity on occupant mental workload[J]. Acta Armamentarii, 2021, 42(2): 234-241(in Chinese).
[24]	BIONDI F, STRAYER D L, ROSSI R, et al. Advanced driver assistance systems: using multimodal redundant warnings to enhance road safety[J]. Applied Ergonomics, 2017, 58: 238-244.
[25]	GEITNER C, BIONDI F, SKRYPCHUK L, et al. The comparison of auditory, tactile, and multimodal warnings for the effective communication of unexpected events during an automated driving scenario[J]. Transportation Research Part F: Traffic Psychology and Behaviour, 2019, 65: 23-33.
[26]	BLISS J P, ACTON S A. Alarm mistrust in automobiles: how collision alarm reliability affects driving[J]. Applied Ergonomics, 2003, 34(6): 499-509.
[27]	CHANCEY E T, BLISS J P, PROAPS A B, et al. The role of trust as a mediator between system characteristics and response behaviors[J]. Human Factors, 2015, 57(6): 947-958.
[28]	BELZ S M, ROBINSON G S, CASALI J G. A new class of auditory warning signals for complex systems: auditory icons[J]. Human Factors, 1999, 41(4): 608-618.
[29]	OHTSUKA R, JIANWANG, CHIHARA T, et al. Estimation of mental workload during motorcycle operation[J]. Procedia Manufacturing, 2015, 3: 5313-5318.
[30]	GIRARD S, PELLAND M, LEPORE F, et al. Impact of the spatial congruence of redundant targets on within-modal and cross-modal integration[J]. Experimental Brain Research, 2013, 224(2): 275-285.
[31]	HAAS E C, VAN ERP J B F. Multimodal warnings to enhance risk communication and safety[J]. Safety Science, 2014, 61: 29-35.
[32]	MURATA A, KURODA T, KARWOWSKI W. Effects of auditory and tactile warning on response to visual hazards under a noisy environment[J]. Applied Ergonomics, 2017, 60: 58-67.
[33]	WIXTED J T. The forgotten history of signal detection theory[J]. Journal of Experimental Psychology Learning, Memory, and Cognition, 2020, 46(2): 201-233.
[34]	MURPHY D R, CRAIK F I M, LI K Z H, et al. Comparing the effects of aging and background noise on short-term memory performance[J]. Psychology and Aging, 2000, 15(2): 323-334.