A Scalable Approach to Integrating Heterogeneous Aggregate Views of Distributed Databases

Research output: Contribution to journalArticle

16 Citations (Scopus)

Abstract

Aggregate views are commonly used for summarizing information held in very large databases such as those encountered in data warehousing, large scale transaction management, and statistical databases. Such applications often involve distributed databases that have developed independently and therefore may exhibit incompatibility, heterogeneity, and data inconsistency. We are here concerned with the integration of aggregates that have heterogeneous classification schemes where local ontologies, in the form of such classification schemes, may be mapped onto a common ontology. In previous work, we have developed a method for the integration of such aggregates; the method previously developed is efficient, but cannot handle innate data inconsistencies that are likely to arise when a large number of databases are being integrated. In this paper, we develop an approach that can handle data inconsistencies and is thus inherently much more scalable. In our new approach, we first construct a dynamic shared ontology by analyzing the correspondence graph that relates the heterogeneous classification schemes; the aggregates are then derived by minimization of the Kullback-Leibler information divergence using the EM (Expectation-Maximization) algorithm. Thus, we may assess whether global queries on such aggregates are answerable, partially answerable, or unanswerable in advance of computing the aggregates themselves.
Original languageEnglish
Pages (from-to)232-236
JournalIEEE Transactions on Knowledge and Data Engineering
Volume15
Issue number1
DOIs
Publication statusPublished - 1 Jan 2003

Fingerprint Dive into the research topics of 'A Scalable Approach to Integrating Heterogeneous Aggregate Views of Distributed Databases'. Together they form a unique fingerprint.

  • Cite this