 |
|
|
TOPAZ: a Cost-Based, Rule-Driven, Multi-Phase Parallelizer |
Full Paper (PDF)
|
Currently the key problems of query optimization are extensibility imposedby object-relational technology, as well as query complexity caused by forthcoming applications, such as OLAP.
We propose a generic approach to parallelization, called TOPAZ.
Different forms of parallelism are exploited to obtain maximum speedup combined with lowest resource consumption.
The necessary abstractions w.r.t. operator characteristics and system architecture are provided by rules that are used by a cost-based, top-down search engine.
A multi-phase pruning based on a global analysis of the plan efficiently guides the search process, thus considerably reducing complexity and achieving optimization performance.
Since TOPAZ solely relies on the widespread concepts of iterators and datarivers common to (parallel) execution models, it fits as an enabling technology into most state-of-the-art (object-) relational systems.
|
References, where available, link to the DBLP on the World Wide Web.
[BJ+96]Giannis Bozas, Michael Jaedicke, Andreas Listl, Bernhard Mitschang, Angelika Reiser, Stephan Zimmermann:
On Transforming a Sequential SQL-DBMS into a Parallel One: First Results and Experiences of the MIDAS Project.
Euro-Par, Vol. II 1996: 881-886[BF+95]Chaitanya K. Baru, Gilles Fecteau, Ambuj Goyal, Hui-I Hsiao, Anant Jhingran, Sriram Padmanabhan, George P. Copeland, Walter G. Wilson:
DB2 Parallel Edition.
IBM Systems Journal 34(2): 292-322(1995)[BF97]Carrie Ballinger, Ron Fryer:
Born To Be Parallel: Why Parallel Origins Give Teradata an Enduring Performance Edge.
Data Engineering Bulletin 20(2): 3-12(1997)[BFV96]Luc Bouganim, Daniela Florescu, Patrick Valduriez:
Dynamic Load Balancing in Hierarchical Parallel Database Systems.
VLDB 1996: 436-447[Ce96]Pedro Celis:
The Query Optimizer in Tandem's new ServerWare SQL Product.
VLDB 1996: 592[CJ97]Alexander Clausnitzer, Michael Jaedicke, Bernhard Mitschang, Clara Nippl, Angelika Reiser, Stephan Zimmermann:
On the Application of Parallel Database Technology for Large Scale Document Management Systems.
IDEAS 1997: 388-396[De+90]David J. DeWitt, Shahram Ghandeharizadeh, Donovan A. Schneider, Allan Bricker, Hui-I Hsiao, Rick Rasmussen:
The Gamma Database Machine Project.
TKDE 2(1): 44-62(1990)[DG92]David J. DeWitt, Jim Gray:
Parallel Database Systems: The Future of High Performance Database Systems.
CACM 35(6): 85-98(1992)[GHK92]Sumit Ganguly, Waqar Hasan, Ravi Krishnamurthy:
Query Optimization for Parallel Execution.
SIGMOD Conference 1992: 9-18[GI97]Minos N. Garofalakis, Yannis E. Ioannidis:
Parallel Query Scheduling and Optimization with Time- and Space-Shared Resources.
VLDB 1997: 296-305[Gra94]Goetz Graefe:
Volcano - An Extensible and Parallel Query Evaluation System.
TKDE 6(1): 120-135(1994)[Gra95]Goetz Graefe:
The Cascades Framework for Query Optimization.
Data Engineering Bulletin 18(3): 19-29(1995)[Gra96]Goetz Graefe:
Relational Engine and Query Processing in Microsoft SQL Server.
ICDE 1996: 160-161[Gr95]...
[GB+96]Jim Gray, Adam Bosworth, Andrew Layman, Hamid Pirahesh:
Data Cube: A Relational Aggregation Operator Generalizing Group-By, Cross-Tab, and Sub-Total.
ICDE 1996: 152-159[GGS96]Sumit Ganguly, Akshay Goel, Abraham Silberschatz:
Efficient and Acurate Cost Models for Parallel Query Optimization.
PODS 1996: 172-181[Ha95]...
[HK+97]Laura M. Haas, Donald Kossmann, Edward L. Wimmers, Jun Yang:
Optimizing Queries Across Diverse Data Sources.
VLDB 1997: 276-285[HS93]Wei Hong, Michael Stonebraker:
Optimization of Parallel Query Execution Plans in XPRS.
Distributed and Parallel Databases 1(1): 9-32(1993)[JMP97]Anant Jhingran, Timothy Malkemus, Sriram Padmanabhan:
Query Optimization in DB2 Parallel Edition.
Data Engineering Bulletin 20(2): 27-34(1997)[JM98]Michael Jaedicke, Bernhard Mitschang:
On Parallel Processing of Aggregate and Scalar Functions in Object-Relational DBMS.
SIGMOD Conference 1998: 379-389[KD96]...
[Lo88]Guy M. Lohman:
Grammar-like Functional Rules for Representing Query Optimization Alternatives.
SIGMOD Conference 1988: 18-27[LC+93]Ming-Ling Lo, Ming-Syan Chen, Chinya V. Ravishankar, Philip S. Yu:
On Optimal Processor Allocation to Support Pipelined Hash Joins.
SIGMOD Conference 1993: 69-78[LST91]Hongjun Lu, Ming-Chien Shan, Kian-Lee Tan:
Optimization of Multi-Way Join Queries for Parallel Execution.
VLDB 1991: 549-560[LVZ93]Rosana S. G. Lanzelotte, Patrick Valduriez, Mohamed Zaït:
On the Effectiveness of Optimization Search Strategies for Parallel Execution Spaces.
VLDB 1993: 493-504[MB+96]William J. McKenna, Louis Burger, Chi Hoang, Melissa Truong:
EROC: A Toolkit for Building NEATO Query Optimizers.
VLDB 1996: 111-121[MD95]Manish Mehta, David J. DeWitt:
Managing Intra-operator Parallelism in Parallel Database Systems.
VLDB 1995: 382-394[NJM97]...
[NM98]...
[Or98]...
[OL90]Kiyoshi Ono, Guy M. Lohman:
Measuring the Complexity of Join Enumeration in Query Optimization.
VLDB 1990: 314-325[ON+95]Fatma Ozcan, Sena Nural, Pinar Koksal, Mehmet Altinel, Asuman Dogac:
A Region Based Query Optimizer Through Cascades Query Optimizer Framework.
Data Engineering Bulletin 18(3): 30-40(1995)[PGK97]Arjan Pellenkoft, César A. Galindo-Legaria, Martin L. Kersten:
The Complexity of Transformation-Based Join Enumeration.
VLDB 1997: 306-315[Sch97]...
[SD90]Donovan A. Schneider, David J. DeWitt:
Tradeoffs in Processing Complex Join Queries via Hashing in Multiprocessor Database Machines.
VLDB 1990: 469-480[SM+98]...
[STY93]Eugene J. Shekita, Honesty C. Young, Kian-Lee Tan:
Multi-Join Optimization for Symmetric Multiprocessors.
VLDB 1993: 479-492[SM96]Michael Stonebraker, Dorothy Moore:
Object-Relational DBMSs: The Next Great Wave.
Morgan Kaufmann 1996, ISBN 1-55860-397-2
[TD93]Joachim Thomas, Stefan Deßloch:
A Plan-Operator Concept for Client-Based Knowledge Progressing.
VLDB 1993: 555-566[TPC95]...
[WFA95]Annita N. Wilschut, Jan Flokstra, Peter M. G. Apers:
Parallel Evaluation of Multi-Join Queries.
SIGMOD Conference 1995: 115-126[Zou97]Chendong Zou:
XPS: A High Performance Parallel Database Server.
Data Engineering Bulletin 20(2): 21-26(1997)[ZZS93]Mikal Ziane, Mohamed Zaït, P. Borla-Salamet:
Parallel Query Processing with Zigzag Trees.
VLDB Journal 2(3): 277-301(1993)
|
@inproceedings{DBLP:conf/vldb/NipplM98,
author = {Clara Nippl and
Bernhard Mitschang},
editor = {Ashish Gupta and
Oded Shmueli and
Jennifer Widom},
title = {TOPAZ: a Cost-Based, Rule-Driven, Multi-Phase Parallelizer},
booktitle = {VLDB'98, Proceedings of 24rd International Conference on Very
Large Data Bases, August 24-27, 1998, New York City, New York,
USA},
publisher = {Morgan Kaufmann},
year = {1998},
isbn = {1-55860-566-5},
pages = {251-262},
crossref = {DBLP:conf/vldb/98},
bibsource = {DBLP, http://dblp.uni-trier.de}
}
|
DBLP: Copyright ©1999 by Michael Ley (ley@uni-trier.de).
|
|
