Synchronizing a Database to Improve Freshness Junghoo Cho and Hector Garcia-Molina   View Paper (PDF)   Return to Research Sessions Abstract In this paper we study how to refresh a local copy of an autonomous data source to maintain the copy up-to-date. As the size of the data grows, it becomes more difficult to maintain the copy "fresh," making it crucial to synchronize the copy effectively. We define two freshness metrics, change models of the underlying data, and synchronization policies. We analytically study how effective the various policies are. We also experimentally verify our analysis, based on data collected from 270 web sites for more than 4 months, and we show that our new policy improves the "freshness" very significantly compared to current policies in use. References Note: References link to DBLP on the Web. [1] Google. http://www.google.com [2] Soumen Chakrabarti , Martin van den Berg , Byron Dom : Focused Crawling: A New Approach to Topic-Specific Web Resource Discovery. WWW8 / Computer Networks 31(11-16) : 1623-1640(1999) [3] ... [4] ... [5] Junghoo Cho , Hector Garcia-Molina , Lawrence Page : Efficient Crawling Through URL Ordering. WWW7 / Computer Networks 30(1-7) : 161-172(1998) [6] ... [7] Joachim Hammer , Hector Garcia-Molina , Jennifer Widom , Wilburt Labio , Yue Zhuge : The Stanford Data Warehousing Project. Data Engineering Bulletin 18(2) : 41-48(1995) [8] Venky Harinarayan , Anand Rajaraman , Jeffrey D. Ullman : Implementing Data Cubes Efficiently. SIGMOD Conf. 1996 : 205-216 [9] ... [10] Sergey Brin , Lawrence Page : The Anatomy of a Large-Scale Hypertextual Web Search Engine. WWW7 / Computer Networks 30(1-7) : 107-117(1998) [11] ... [12] ... [13] Yue Zhuge , Hector Garcia-Molina , Joachim Hammer , Jennifer Widom : View Maintenance in a Warehousing Environment. SIGMOD Conference 1995 : 316-327 BIBTEX @inproceedings{DBLP:conf/sigmod/ChoG00,   author    = {Junghoo Cho and                 Hector Garcia-Molina},    editor    = {Weidong Chen and                 Jeffrey F. Naughton and                 Philip A. Bernstein},    title     = {Synchronizing a Database to Improve Freshness},    booktitle = {Proceedings of the 2000 ACM SIGMOD International Conference on                 Management of Data, May 16-18, 2000, Dallas, Texas, USA},    journal   = {SIGMOD Record},    publisher = {ACM},    volume    = {29},    number    = {2},    year      = {2000},    isbn      = {1-58113-218-2},    pages     = {117-128},    crossref  = {DBLP:conf/sigmod/2000},    bibsource = {DBLP, http://dblp.uni-trier.de} } }, DiSC'01 Copyright ©2002 ACM Inc.