Plan-Per-Tuple Optimization Solution - Parallel Execution of Expensive User-Defined Functions
Felipe Carino, William O'Connell
Full Paper (PDF)

Abstract
Object-Relational database systems allow users to define new user-defined types and functions. This presents new optimizer and run-time challenges to the database systemon shared-nothing architectures. In this paper, we describe a new strategy we are exploring for the NCR Teradata Multimedia Database System; our focus is directing research for realapplications we are seeing. In doing so, we will briefly describe optimizer challenges particularly related to predicate use of large multimedia objects, such as video/audio clips, images, and text documents. The motivation for this work is based on database tuning [SD96] for diverse queries related to multimedia objects. Most notably, expensive and/or high variant user defined functions [Hel98].

Our approach is referred to as plan-per-tuple. The primary focus being on large objects used as predicate-based terms when a non co-located join is involved in the query. But can also be applicable in non co-located join scenarios also. The execution engine can choose from among N! resource optimization strategies; where N represents system manageable resources. In our case, the N resources are: (i) interconnect saturation levels, (ii)available physical memory, (iii) CPU utilization, and (iv) available disk spool space percentages. However, this technique can be applied to any system resources being managed. The optimizer search space does not include these N! resource optimizationstrategies per'se, these are execution engine run-time optimization strategies. When the optimizer identifies expensive, or more importantly a high variant, user- defined function in the predicate (via collected statistics), then the optimizer can generate plans that incorporate plan-per-tuple optimization for that particular compiled query. When executing the plan, a different execution strategy can be used per tuple; the available execution choices do not necessarily equal N! Wedescribe when such an overhead for run-time selection is acceptable.


References

References, where available, link to the DBLP on the World Wide Web.

[Car98]
...
[CG94]
Richard L. Cole, Goetz Graefe: Optimization of Dynamic Query Evaluation Plans. SIGMOD Conference 1994: 150-160
[CK92]
...
[CSI94]
...
[CSK95]
...
[CS98]
...
[CS96]
Surajit Chaudhuri, Kyuseok Shim: Optimization of Queries with User-defined Predicates. VLDB 1996: 87-98
[Fre87]
Johann Christoph Freytag: A Rule-Based View of Query Optimization. SIGMOD Conference 1987: 173-180
[HS93]
Joseph M. Hellerstein, Michael Stonebraker: Predicate Migration: Optimizing Queries with Expensive Predicates. SIGMOD Conference 1993: 267-276
[Hel98]
...
[MBH+96]
William J. McKenna, Louis Burger, Chi Hoang, Melissa Truong: EROC: A Toolkit for Building NEATO Query Optimizers. VLDB 1996: 111-121
[OIS+96]
W. O'Connell, Ion Tim Ieong, D. Schrader, C. Watson, G. Au, Alexandros Biliris, S. Choo, P. Colin, G. Linderman, Euthimios Panagos, J. Wang, T. Walters: A Content-Based Multimedia Server for Massively Parallel Architectures. SIGMOD Conf. 1996: 68-78
[PHH92]
Hamid Pirahesh, Joseph M. Hellerstein, Waqar Hasan: Extensible/Rule Based Query Rewrite Optimization in Starburst. SIGMOD Conference 1992: 39-48
[SAC+79]
Patricia G. Selinger, Morton M. Astrahan, Donald D. Chamberlin, Raymond A. Lorie, Thomas G. Price: Access Path Selection in a Relational Database Management System. SIGMOD Conference 1979: 23-34
[SG96]
Surajit Chaudhuri, Luis Gravano: Optimizing Queries over Multimedia Repositories. SIGMOD Conf. 1996: 91-102
[SD96]
Dennis Shasha: Database Tuning - A Principled Approach. Prentice-Hall 1992, ISBN 1-13-205246-6
Contents
[Sto96]
Michael Stonebraker, Dorothy Moore: Object-Relational DBMSs: The Next Great Wave. Morgan Kaufmann 1996, ISBN 1-55860-397-2
[WCP93]
Andrew Witkowski, Felipe Cariño, Pekka Kostamaa: NCR 3700 - The Next-Generation Industrial Database Computer. VLDB 1993: 230-243
BIBTEX

@inproceedings{DBLP:conf/vldb/CarinoO98,
author = {Felipe Cari{\~n}o and
William O'Connell},
editor = {Ashish Gupta and
Oded Shmueli and
Jennifer Widom},
title = {Plan-Per-Tuple Optimization Solution - Parallel Execution of
Expensive User-Defined Functions},
booktitle = {VLDB'98, Proceedings of 24rd International Conference on Very
Large Data Bases, August 24-27, 1998, New York City, New York,
USA},
publisher = {Morgan Kaufmann},
year = {1998},
isbn = {1-55860-566-5},
pages = {690-695},
crossref = {DBLP:conf/vldb/98},
bibsource = {DBLP, http://dblp.uni-trier.de}
}


DBLP: Copyright ©1999 by Michael Ley (ley@uni-trier.de).