基于视频虚拟化身的远程视频协作

刘思奇; 喻纯; 史元春

doi:10.13700/j.bh.1001-5965.2014.0532

基于视频虚拟化身的远程视频协作

doi: 10.13700/j.bh.1001-5965.2014.0532

清华大学计算机科学与技术系, 北京 100084

基金项目: 国家科技支撑计划(2012BHA2503); 国家科技重大专项(2013ZX01039001-002)

详细信息

作者简介:
刘思奇(1991—),男,辽宁抚顺人,硕士研究生,lsqgonna@gmail.com

通讯作者:
喻纯(1984—),男,湖北荆州人,助理研究员,yc2pcg@gmail.com,主要研究方向为人机交互.

中图分类号: TP391
计量
- 文章访问数: 1118
- HTML全文浏览量: 178
- PDF下载量: 555
- 被引次数: 0
出版历程
- 收稿日期: 2014-04-28
- 网络出版日期: 2015-06-20

Video avatar-based remote video collaboration

Department of Computer Science and Technology, Tsinghua University, Beijing 100084, China

摘要

摘要: 现有的远程视频通信系统往往局限于如何实时、准确地传递足量的信息,却忽略了远程通信双方的交互需求;此外,传统的视频通信基于二维信息,并未对双方的三维信息充分加以利用.因此,在视频通信中融入3D技术,可以使得远程交互更加自然、高效,增强通信沉浸感.本文着眼于远程视频协作中的交互层面,提出了远程视频协作系统的"沉浸式"设计目标,据此设计并实现了一种新型的、基于视频虚拟化身的远程视频协作系统.具体而言,系统使用Creative Senz3D深度摄像头,通过背景分割技术提取通信者的前景图像以作为虚拟化身,再将不同通信者的虚拟化身置于共同的虚拟场景之中,并在系统中加入手势的辅助控制,设计了人物之间、人物与虚拟场景之间的自然的、"沉浸式"的交互方式,拓展了远程通信的交互协作模式.最后通过用户实验表明,本文设计的基于视频虚拟化身的远程视频协作模式,可以有效地提升远程通信协作的沉浸感.
- 视频虚拟化身 /
- 视频协作 /
- 沉浸式 /
- 手势控制 /
- 虚拟现实
Abstract: Most existing remote video communication systems are confined to how to accurately deliver adequate information in real time, but lose sight of communicators' interaction demands. Meanwhile, traditional 2D-based video communications cannot make full use of people's 3D information, which shows great potential for video communication to achieve immersive, natural and efficient interactions with 3D technique. To enhance the immersion sense and expand interaction modes in video collaboration, the design goal for ‘immersive' video communication systems was proposed and a novel, avatar-based remote video collaboration system was designed and implemented. Specifically, using Creative Senz3D depth camera, the proposed system extracted people's foreground images through background segmentation as their video avatars, and located the avatars together in a common virtual scenario. Natural and immersive interactions among people and between people and virtual scenes were also well designed, which expanded modes of interaction and collaboration in video communication. Finally, a user study was conducted and the result indicates that the proposed video avatar-based remote video cooperation mode can effectively enhance people's sense of immersion in telecommunication.
- video avatar /
- video collaboration /
- immersive /
- gesture control /
- virtual reality

HTML全文

参考文献(17)

[1]	Isaacs E A, Tang J C.What video can and cannot do for collaboration:A case study[J].Multimedia Systems, 1994, 2(2):63-73.
[2]	Tang J C, Isaacs E A.Why do users like video [J].Computer Supported Cooperative Work(CSCW), 1992, 1(3):163-196.
[3]	Nechvatal J.Immersive ideals/critical distances[M].Saarbrücken:LAP Lambert Academic Publishing, 2009:26-136.
[4]	Tang J C, Wei C, Kawal R.Social telepresence bakeoff:Skype group video calling, google+ hangouts, and microsoft avatar kinect[C]//Proceedings of the ACM 2012 Conference on Computer Supported Cooperative Work Companion.New York:ACM, 2012:37-40.
[5]	Steuer J.Defining virtual reality:Dimensions determining tele-presence[J].Journal of Communication, 1992, 42(4):73-93.
[6]	孙立峰, 李放, 钟玉琢, 等.基于多视点视频的虚拟会议显示与合成[J].电子学报, 2004, 33(2):193-196. Sun L F, Li F, Zhong Y Z, et al.Multiview video based virtual teleconferencing synthesizing[J].Acta Electronica Sinica, 2004, 33(2):193-196(in Chinese).
[7]	Kim K, Bolton J, Girouard A, et al.Telehuman:Effects of 3D perspective on gaze and pose estimation with a life-size cylindrical telepresence pod[C]//Proceedings of the SIGCHI Conference on Human Factors in Computing Systems.New York:ACM, 2012:2531-2540.
[8]	Boyle M, Greenberg S.The language of privacy:Learning from video media space analysis and design[J].ACM Transactions on Computer Human Interaction(TOCHI), 2005, 12(2):328-370.
[9]	Leigh J, Johnson A E, Vasilakis C A, et al.Multi-perspective collaborative design in persistent networked virtual environments[C]//Proceedings of the IEEE Virtual Reality Annual International Symposium.Piscataway, NJ:IEEE Press, 1996:253-260, 271-272.
[10]	Junuzovic S, Inkpen K, Tang J, et al.To see or not to see:A study comparing four-way avatar, video, and audio conferencing for work[C]//Proceedings of the 17th ACM International Conference on Supporting Group Work.New York:ACM, 2012:31-34.
[11]	Han J, Smith B.CU-SeeMe VR immersive desktop teleconferencing[C]//Proceedings of the Fourth ACM International Conference on Multimedia.New York:ACM, 1997:199-207.
[12]	Lee S Y, Kim I J, Ahn S C, et al.Toward immersive telecommunication:3D video avatar with physical interacttion[C]//Proceedings of the 2005 International Conference on Augmented tele-existence.New York:ACM, 2005:56-61.
[13]	Ogi T, Yamada T, Tamagawa K, et al.Immersive telecommunication using stereo video avatar[C]// Proceedings of the IEEE Virtual Reality Annual International Symposium.Piscataway, NJ:IEEE Press, 2001:45-51.
[14]	Insley J A, Sandin D J, DeFanti T A.Using video to create avators in virtual reality[C]//ACM SIGGRAPH 97 Visual Proceedings:The Art and Interdisciplinary Programs of SIGGRAPH'97.New York:ACM, 1997:128.
[15]	Porter T, Duff T.Compositing digital images[C]//ACM Siggraph Computer Graphics.New York:ACM, 1984, 18(3):253-259.
[16]	Forrest A R.On the rendering of surfaces[C]//Proceedings of the 6th Annual Conference on Computer Graphics and Interactive Techniques.New York:ACM, 1979, 13(2):253-259.
[17]	Yura S, Usaka T, Sakamura K.Video avatar:Embedded video for collaborative virtual environment[C]//IEEE International Conference on Multimedia Computing and Systems.Piscataway, NJ:IEEE Press, 1999, 2:433-438.