Design of content-based video retrieval system using MPEG-7
-
摘要: 设计了符合多媒体内容描述接口协议MPEG-7(Multimedia Content Description Interface)标准的电影视频检索系统SupEye,包括特征提取、数据存储以及特征检索3部分.特征提取负责提取视频特征与摘要,通过分析电影视频特点,给出了视频结构分析及摘要提取的假设、流程及算法.数据存储负责视频与特征数据的存储,考虑到用户检索历史对检索性能的影响,将MPEG-7多媒体特征描述文件分为视频特征描述文件与用户接口描述文件两类.特征检索构建了一个用于多视频特征检索的3层体系结构(表示层、逻辑层和事务层)并给出了检索结果融合流程.SupEye系统在分析MPEG-7标准的基础上解决了视频特征与用户检索特征的分离、样例查询中的特征分析以及多模态查询的结果融合问题.Abstract: A content-based film video retrieval system named SupEye using MPEG-7(multimedia content description interface) was designed, which consisted of three parts: feature extraction, data storage and feature retrieval. The part of feature extraction took charge of the extraction of video features and video abstraction, in which assumptions and algorithms of video structure analysis and video abstraction were described on the basis of analysis on film video features. Data storage focused on the storage of video and feature data, in which multimedia content description files were divided into video features description and user interface description to improve retrieval performance through the usage of users′ retrieval features. The part of feature retrieval proposed a three-layered framework for multi-feature video retrieval which was composed of presentation, logic and transaction layer. On the basis of the analysis of MPEG-7, SupEye separates video features from user retrieval features and resolves the problems of feature analysis in sample query and the fusion of multi-feature query.
-
Key words:
- content-based retrieval /
- video content analysis /
- MPEG-7 /
- feature extraction
-
[1] ISO/IEC JTC1/SC29/WG11N6828, MPEG-7 Overview (version 10)[S] [2] Dimitrova N, Zhang Hongjiang, Shahraray B, et al. Applications of video-content analysis and retrieval[J]. IEEE MultiMedia, 2002, 9 (3):42-55 [3] Lienhart R. Comparison of automatic shot boundary detection algorithms Yeung, Minerva M, Yeo, et al. Proceedings of the SPIE. San Jose CA:Storage and Retrieval for Image and Video Databases VII, 1998:290-301 [4] 林通,张宏江, 封举富, 等. 镜头内容分析及其在视频检索中的应用[J]. 软件学报,2002,13(8):1577-1585 Lin Tong, Zhang Hongjiang, Feng Jufu, et al. Shot content analysis for video retrieval applications[J]. Journal of Software, 2002, 13(4):1577-1585 (in Chinese) [5] Rainer Lienhart, Silvia Pfeiffer, Wolfgang Effelsberg. Video abstracting[J]. Communications of the ACM, 1997, 40(6):55-62 [6] Narasimha R, Savakis A, Rao R M, et al. Key frame extraction using MPEG-7 motion descriptors Matthews M B. Systems and Computers. California:Pacific Grove, 2003:1575-1579 [7] ISO/IEC JTC1/SC29/WG11/M6156, MPEG-7 Multimedia Description Schemes WD (Version 3.1)[S] [8] ISO/IEC JTC1/SC29/WG11/M6156, MPEG-7 Multimedia Description Schemes XM (Version 3.1)[S] [9] Dunlop M D, McDonald K. Supporting different search strategies in a video query interface Karen Milligan. Content-Based Multimedia Information Access. Paris:Kluwer Academic Publish, 2000:21-31 -
点击查看大图
计量
- 文章访问数: 2842
- HTML全文浏览量: 71
- PDF下载量: 920
- 被引次数: 0
下载:
