Database Reference
In-Depth Information
Chapter 7
Emerging Database Systems in
Support of Scientific Data
Per Svensson,
1
Peter Boncz,
2
Milena Ivanova,
2
Martin Kersten,
2
Niels Nes,
2
and Doron Rotem
3
1
Swedish Defence Research Agency, Stockholm, Sweden
2
Centrum Wiskunde & Informatica (CWI), The National Research Institute
for Mathematics and Computer Science, The Netherlands
3
Lawrence Berkeley National Laboratory, Berkeley, California
Contents
7.1
Introduction to Vertical Databases
..................................
236
7.1.1
Basic Concepts
................................................
236
7.1.2
Design Rules and User Needs
.................................
237
7.1.3
Architectural Opportunities
..................................
240
7.2
Architectural Principles of Vertical Databases
......................
241
7.2.1
Transposed Files and the Decomposed Storage Model
.......
241
7.2.2
The Impact of Modern Processor Architectures
.............
243
7.2.3
Vectorization and the Data-Flow Execution Model
.........
245
7.2.4
Data Compression
............................................
247
7.2.5
Buffering Techniques for Accessing Metadata
................
250
7.2.6
Querying Compressed, Fully Transposed Files
...............
251
7.2.7
Compression-Aware Optimizations
for the Equi-Join Operator
...................................
252
..............................
7.2.8
Two Recent Benchmark Studies
253
7.2.9
Scalability
.....................................................
253
7.3
Two Contemporary Vertical Database Systems:
MonetDB and C-Store
...............................................
254
7.3.1
MonetDB
......................................................
254
7.3.2
C-Store
.......................................................
255
7.4
The Architecture and Evolution of MonetDB
.......................
256
7.4.1
Design Principles
..............................................
256
7.4.2
The Binary Association Table Algebra
......................
257
235
