Data Management

Fast Updates on Read-Optimized Databases Using Multi-Core CPUs

Date Added: Sep 2011
Format: PDF

Read-optimized columnar databases use differential updates to handle writes by maintaining a separate write-optimized delta partition which is periodically merged with the read-optimized and compressed main partition. This merge process introduces significant overheads and unacceptable downtimes in update intensive systems, aspiring to combine transactional and analytical workloads into one system. In the first part of the paper, the authors report data analyses of 12 SAP Business Suite customer systems. In the second half, they present an optimized merge process reducing the merge overhead of current systems by a factor of 30. Their linear-time merge algorithm exploits the underlying high compute and bandwidth resources of modern multi-core CPUs with architecture-aware optimizations and efficient parallelization.