Welcome to D
SIGMOD 2003
<<< = SIGMOD'03 Pa>>>
PODS 2003
SIGMOD-RECOR
ADBIS
CIDR 2003
CIKM 2003
DASFAA 2003
Data Enginee
DEBS
DMKD 2003
DOLAP 2003
DPDJ 2003
ER
GIS 2003
Hypertext 20
ICDE 2003
ICDM 2003
ICDT 2003
JCDL 2003
KRDB 2003
MIR 2003
MIS 2003
MMDB 2003
RIDE 2003
SBBD 2003
SIGIR 2003
SIGIR-FORUM
SIGKDD 2003
SIGKDD-EXP
SSDBM 2003
TIME 2003
TODS
VLDB 2003
VLDB Journal
WIDM 2003

Contorting High Dimensional Data for Efficient Main Memory Processing


Bin Cui, Beng Chin Ooi, Jianwen Su, and Kian-Lee Tan

  View Paper (PDF)  

Return to Spatial and Nearest Neighbor Queries


Abstract

In this paper, we present a novel index structure, called delta- tree, to speed up processing of high-dimensional K-nearest neighbor (KNN) queries in main memory environment. The delta-tree is a multi-level structure where each level represents the data space at different dimensionalities: the number of dimensions increases towards the leaf level which contains the data at their full dimensions. The remaining dimensions are obtained using Principal Component Analysis, which has the desirable property that the first few dimensions capture most of the information in the dataset. Each level of the tree serves to prune the search space more efficiently as the reduced dimensions can better exploit the small cache line size. Moreover, the distance computation on lower dimensionality is less expensive. We also propose an extension, called delta+- tree, that globally clusters the data space and then further partitions clusters into small regions to reduce the search space. We conducted extensive experiments to evaluate the proposed structures against existing techniques on different kinds of datasets. Our results show that the delta+-tree is superior in most cases.

BIBTEX


@inproceedings       {DBLP:conf/sigmod/CuiOTS03,
  author    = {Bin Cui and
                Beng Chin Ooi and
                Jianwen Su and
                Kian-Lee Tan},
   booktitle = {SIGMOD Conference},
   title     = {Contorting High Dimensional Data for Efficient Main Memory Processing.},
   pages     = {479-490},
   year      = {2003},
   url       = {db/conf/sigmod/sigmod2003.html#CuiOTS03},
   ee        = {http://www.acm.org/sigmod/sigmod03/eproceedings/papers/r17p05.pdf},
   crossref  = {conf/sigmod/2003},
   bibsource = {DBLP, http://dblp.uni-trier.de} 
}



©2004 Association for Computing Machinery