一种XML相似重复数据的清理方法研究

北京航空航天大学学报 ›› 2004, Vol. 30 ›› Issue (09): 835-838.

一种XML相似重复数据的清理方法研究

陈伟, 丁秋林

南京航空航天大学计算机应用研究所, 南京 210016

收稿日期:2003-06-02 出版日期:2004-09-30 发布日期:2010-09-21
作者简介:陈伟 (1976-),男,山东单县人,博士生, chenweich@tom.com.

Study on an XML approximately duplicated data cleaning method

Chen Wei, Ding Qiulin

Computer Application Institute, Nanjing University of Aeronautics and Astronautics, Nanjing 210016, China

Received:2003-06-02 Online:2004-09-30 Published:2010-09-21

摘要/Abstract

摘要： 针对半结构化数据XML在数据清理中的重要性,研究了如何清理XML相似重复数据,主要工作有:提出一种有效的XML相似重复数据清理方法,该方法具有较强的适应性,任何XML相似检测算法都适用于此;给出一种基于树编辑距离的相似检测算法,该算法能有效地检测XML相似重复数据;采用树编辑距离的上下限优化基于树编辑距离的相似检测算法,避免了不必要的树编辑距离计算,降低了相似检测计算的复杂度,提高了运算效率.此工作为研究XML相似重复数据清理打下基础.

Abstract: Aiming at the importance of semi-structured data XML in data cleaning, how to clean XML approximately duplicated data was studied. An efficient XML approximately duplicated data cleaning method was proposed. This method is adaptive, because any other approximately detecting algorithm can be used in it. An efficient approximately detecting algorithm based on tree edit distance was presented. This algorithm can detect approximately duplicated data efficiently. The lower and upper bounds of tree edit distance were used to optimize the approximately duplicated data detecting algorithm. The improved algorithm can avoid computing the tree edit distance that is not needed between a pair of XML data, and reduce the approximate computation complexity. So, foundations are built for researching XML approximately duplicated data cleaning.

中图分类号:

TP 31152

陈伟, 丁秋林. 一种XML相似重复数据的清理方法研究[J]. 北京航空航天大学学报, 2004, 30(09): 835-838.

Chen Wei, Ding Qiulin. Study on an XML approximately duplicated data cleaning method[J]. JOURNAL OF BEIJING UNIVERSITY OF AERONAUTICS AND A, 2004, 30(09): 835-838.