Giter VIP home page Giter VIP logo

mlstorage's Introduction

MLstorage (Machine Learning based Storage)

This project aims to support a solid state hybrid drive(SSHD) with an intelligent cache module, which controls storage policy based on estimated IO access pattern.

Build

  • enter kmod directory and just make
    • The kernel module will be built against a current kernel version.
    • If you try to build with another version, please define KSRC environment variable
  • If build succeeds, kmod/mlstor.ko will be generated.

Run

  • A MLstorage control script is provided as script/mlstorctl.sh.
  • Prepare two partitions or devices for HDD and NVMe
    • Assumes /dev/sdb4 and /dev/nvme0n1p1
    • root permission required
  • create MLstorage device
    • Usage: mlstorctl -c -b <backing device> -C <cache device> <mlstor name>
    • eg) `script/mlstorctl -c -b /dev/sdb4 -C /dev/nvme01n1p1 mlstor_test
  • create file system(ext4) on a MLstorage
    • mkfs.ext4 /dev/mapper/mlstor_test
    • mkdir /data.mlstor
    • mount /dev/mapper/mlstor /data/.mlstor
  • Run benchmarks
    • We provide useful fio(Flexible I/O) scripts
    • cd fio
    • ./runfio.sh -t mlstor_test -o output_mlstor.txt
    • cat output_mlstor.txt

This project has been supported by ICT Research and Development Program of MSIP/IITP(Developing System Software Technologies for Emerging New Memory That Adaptively Learn Workload Characteristics) under Grant 2019-0-00074.

mlstorage's People

Contributors

cezanne avatar jung794 avatar osmania999 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.