shihwenhsu / tlbtree Goto Github PK

Implementation of the paper "TLBtree: A Read/Write-Optimized Tree Index for Non-Volatile Memory (ICDE'21)" and paper "Two Birds with One Stone: Boosting Both Search and Write Performance for Tree Indices on Persistent Memory (TECS'21)".

TLBtree is a read/write-optimized persistent index for NVM-only Memory System. It is composed of a read-optimized top layer and a NVM-friendly write-optimized down layer. The top layer is read frequently, so we adpot a less-mutable and cache-friendly design; The down layer is write frequently and should be carefully guarded by persistent instructions (e.g. clwb and sfence), so we employ a structure with low persistent cost on real NVM enviroment.

Our idea is motivated by the observation that B+-tree-like range indices tend to absorb 99% of writes in the bottom 2-3 levels, while reads are evenly distributed in each level. According to the observation, we propose a Two Layer Persistent Index (TLPI) achitecture first. TLPI divides a pesistent tree index into two layers, so it enables to put together specific optimizations which may be too complicated to coexist in an individual index. TLBtree is a tailored instance of TLPI, you can also add new read optimizations into the top layer and write optimizations to the down layer, for further performance potential.

We test our project on ubuntu LTS 2020.

1. This project depends on libpmemobj from PMDK. Install it using command

   sudo apt-get install make
   sudo apt-get install libpmemobj-dev

2. Make sure you are avaliable with Optane memory (or you can use volatile memory to simulate pmem device on latest ubuntu version). The project assumes that your pmem device is mounted at address /mnt/pmem and you have write permission to it.

   (a). Avaiable to real Optane DC Memory, configure it in this way.

   (b). Not avaiable to Optane, try simluate it with DRAM following this link.

1. Configure your PMEM file address and file size threshold in include/tlbtree.h

2. Compile the program with following commands (the same in Single or Concurrent)

   mkdir build
   cd build; cmake ..
   make

3. Play with TLBtree using provided test modules:

   (a). generate data with datagen (type datagen -h if needed)

   (b). populate the TLBtree with some inital key value pairs

   (c). doing CUID operations with main

Currently TLBtree supports only 8-byte integer key and payload