1. Bigtable: a distributed storage system for structured data
- Author
-
Chang, Fay, Dean, Jeffrey, Ghemawat, Sanjay, Hsieh, Wilson C., Wallach, Deborah A., Burrows, Mike, Chandra, Tushar, Fikes, Andrew, and Gruber, Robert E.
- Subjects
Distributed database ,Information services industry ,Company business management ,Company systems management ,Google Inc. -- Information management ,Distributed databases -- Management ,Electronic data processing -- Methods ,Information services -- Information management ,Information services industry -- Information management - Abstract
Bigtable is a distributed storage system for managing structured data that is designed to scale to a very large size: petabytes of data across thousands of commodity servers. Many projects at Google store data in Bigtable, including web indexing, Google Earth, and Google Finance. These applications place very different demands on Bigtable, both in terms of data size (from URLs to web pages to satellite imagery) and latency requirements (from backend bulk processing to real-time data serving). Despite these varied demands, Bigtable has successfully provided a flexible, high-performance solution for all of these Google products. In this article, we describe the simple data model provided by Bigtable, which gives clients dynamic control over data layout and format, and we describe the design and implementation of Bigtable. Categories and Subject Descriptors: C.2.4 [Computer Communication Networks]: Distributed Systems--distributed databases General Terms: Design Additional Key Words and Phrases: Large-Scale Distributed Storage
- Published
- 2008