[feature] Extend to support zfs about open-local HOT 6 OPEN

Thx for your issue~ And I believe open-local will get more attention if zfs is included. By the way, not only lvm is covered, we are also preparing to integrate spdk.

I am not familiar with zfs, I see that LVM and zfs have many similar features, like storage pool, snapshot, etc. Does zfs can restrict use of volume capacity, similar to a logical volume in LVM?

from open-local.

@TheBeatles1994 Absolutely, features wise, zfs is far more completed and advanced than LVM. In ZFS, your can create dataset(vol with fs ready) or zvol (plain block device can used as raw disk), both can be set quota on them. In short, nothing is missing in ZFS if it is available in lvm. LVM is like a poor-man solution of ZFS. If given enough resource, zfs perform far more better than LVM. Most important thing is that zfs ensure your data integrity, no silent bit rot could happen. Keep your data safe and last for a very long time. This is very important for large dataset in big datacenter. And it is why zfs is choosen for most of HPC system.

But, there is always a "But" when something looks so good :), zfs demand more resource, a lot more than LVM. This don't have to be a block for open-local to support ZFS, because if openlocal could support both LVM and ZFS, then it can server both low-end and high end use case, and user have options to choose depend on their available resource, therefore make open local get much wider users base.

from open-local.

I did my research and ZFS is so powerful as you said. I believe open-local can integrate this well. And it would be very grateful if you can help with this feature, we need more great contributors like you~

from open-local.

@TheBeatles1994
Sure, I love to help. I can even bring some more ones to join us :)
Being the project establisher, you has the best overall knowledge of the project, especially its architecture. Maybe you could initiate some architecture work first, I then help with adding ZFS blocks or review to start with, what do you think?

for zfs go binding, we could consider https://github.com/mistifyio/go-zfs or https://pkg.go.dev/github.com/bicomsystems/go-libzfs, the second can be too complicated and might have licensing issue. However, we could always swap as needed in the future.

from open-local.

Maybe you could initiate some architecture work first, I then help with adding ZFS blocks or review to start with, what do you think?

Of course, I can do this~ The project needs to do more abstraction to support more local storage types.

from open-local.

@TheBeatles1994 looking forward to seeing that is coming soon!

from open-local.