Welcome to D
SIGMOD 2003
PODS 2003
SIGMOD-RECOR
ADBIS
CIDR 2003
CIKM 2003
DASFAA 2003
Data Enginee
DEBS
DMKD 2003
DOLAP 2003
DPDJ 2003
ER
GIS 2003
Hypertext 20
ICDE 2003
ICDM 2003
ICDT 2003
JCDL 2003
KRDB 2003
MIR 2003
MIS 2003
MMDB 2003
RIDE 2003
SBBD 2003
SIGIR 2003
SIGIR-FORUM
SIGKDD 2003
SIGKDD-EXP
SSDBM 2003
TIME 2003
TODS
VLDB 2003
<<< = VLDB'03 Pape>>>
 = Plenary Talk
VLDB Journal
WIDM 2003

BHUNT: Automatic Discovery of Fuzzy Algebraic Constraints in Relational Data


Paul Brown and Peter J. Haas

  View Paper (PDF)  

Return to Aggregation, Prediction & Constraints (Session B8)


Abstract

We present the BHUNT scheme for automatically discovering algebraic constraints between pairs of columns in relational data. The constraints may be "fuzzy" in that they hold for most, but not all, of the records, and the columns may be in the same table or different tables. Such constraints are of interest in the context of both data mining and query optimization, and the BHUNT methodology can potentially be adapted to discover fuzzy functional dependencies and other use- ful relationships. BHUNT first identifies candidate sets of column value pairs that are likely to satisfy an alge- braic constraint. This discovery process exploits both system catalog information and data samples, and em- ploys pruning heuristics to control processing costs. For each candidate, BHUNT constructs algebraic con- straints by applying statistical histogramming, segmen- tation, or clustering techniques to samples of column values. Using results from the theory of tolerance inter- vals, the sample sizes can be chosen to control the num- ber of "exception" records that fail to satisfy the discov- ered constraints. In query-optimization mode, BHUNT can automatically partition the data into normal and ex- ception records. During subsequent query processing, queries can be modified to incorporate the constraints; the optimizer uses the constraints to identify new, more efficient access paths. The results are then combined with the results of executing the original query against the (small) set of exception records. Experiments on a very large database using a prototype implementation of BHUNT show reductions in table accesses of up to two orders of magnitude, leading to speedups in query processing by up to a factor of 6.8.


©2004 Association for Computing Machinery