北京航空航天大学学报 ›› 2015, Vol. 41 ›› Issue (6): 1087-1094.doi: 10.13700/j.bh.1001-5965.2014.0532

• 论文 • 上一篇    下一篇

基于视频虚拟化身的远程视频协作

刘思奇, 喻纯, 史元春   

  1. 清华大学 计算机科学与技术系, 北京 100084
  • 收稿日期:2014-04-28 出版日期:2015-06-20 发布日期:2015-07-30
  • 通讯作者: 喻纯(1984—),男,湖北荆州人,助理研究员,yc2pcg@gmail.com,主要研究方向为人机交互. E-mail:yc2pcg@gmail.com
  • 作者简介:刘思奇(1991—),男,辽宁抚顺人,硕士研究生,lsqgonna@gmail.com
  • 基金资助:
    国家科技支撑计划(2012BHA2503); 国家科技重大专项(2013ZX01039001-002)

Video avatar-based remote video collaboration

LIU Siqi, YU Chun, SHI Yuanchun   

  1. Department of Computer Science and Technology, Tsinghua University, Beijing 100084, China
  • Received:2014-04-28 Online:2015-06-20 Published:2015-07-30

摘要: 现有的远程视频通信系统往往局限于如何实时、准确地传递足量的信息,却忽略了远程通信双方的交互需求;此外,传统的视频通信基于二维信息,并未对双方的三维信息充分加以利用.因此,在视频通信中融入3D技术,可以使得远程交互更加自然、高效,增强通信沉浸感.本文着眼于远程视频协作中的交互层面,提出了远程视频协作系统的"沉浸式"设计目标,据此设计并实现了一种新型的、基于视频虚拟化身的远程视频协作系统.具体而言,系统使用Creative Senz3D深度摄像头,通过背景分割技术提取通信者的前景图像以作为虚拟化身,再将不同通信者的虚拟化身置于共同的虚拟场景之中,并在系统中加入手势的辅助控制,设计了人物之间、人物与虚拟场景之间的自然的、"沉浸式"的交互方式,拓展了远程通信的交互协作模式.最后通过用户实验表明,本文设计的基于视频虚拟化身的远程视频协作模式,可以有效地提升远程通信协作的沉浸感.

关键词: 视频虚拟化身, 视频协作, 沉浸式, 手势控制, 虚拟现实

Abstract: Most existing remote video communication systems are confined to how to accurately deliver adequate information in real time, but lose sight of communicators' interaction demands. Meanwhile, traditional 2D-based video communications cannot make full use of people's 3D information, which shows great potential for video communication to achieve immersive, natural and efficient interactions with 3D technique. To enhance the immersion sense and expand interaction modes in video collaboration, the design goal for ‘immersive' video communication systems was proposed and a novel, avatar-based remote video collaboration system was designed and implemented. Specifically, using Creative Senz3D depth camera, the proposed system extracted people's foreground images through background segmentation as their video avatars, and located the avatars together in a common virtual scenario. Natural and immersive interactions among people and between people and virtual scenes were also well designed, which expanded modes of interaction and collaboration in video communication. Finally, a user study was conducted and the result indicates that the proposed video avatar-based remote video cooperation mode can effectively enhance people's sense of immersion in telecommunication.

Key words: video avatar, video collaboration, immersive, gesture control, virtual reality

中图分类号: 


版权所有 © 《北京航空航天大学学报》编辑部
通讯地址:北京市海淀区学院路37号 北京航空航天大学学报编辑部 邮编:100191 E-mail:jbuaa@buaa.edu.cn
本系统由北京玛格泰克科技发展有限公司设计开发