Topic: distributed-file-system Goto Github

👇 Here are 130 public repositories matching this topic...

abbyssoul / libstyxe
distributed-file-system,Implementation of 9P parser and message writer.
User: abbyssoul
9p2000 9p plan9 styx protocol distributed distributed-file-system 9pfs 9p2000u

adobe / s3-filesystem
distributed-file-system,An implementation of the Hadoop FileSystem contract backed by AWS S3 and DynamoDB
Organization: adobe
hadoop distributed-file-system s3

asher256 / puppet-lizardfs
distributed-file-system,Puppet module for LizardFS (highly-available and scalable open source distributed file system)
User: asher256
puppet-lizardfs lizardfs keepalived high-availability dfs distributed-file-system

b4rti / entropy
distributed-file-system,Distributed Docker Volume System
User: b4rti
docker docker-swarm filesystem distributed-file-system fuse golang conteiner volume volume-plugin docker-plugin

bdfd-learningground / coursera_modern-big-data-analysis-with-sql-specialization_op
distributed-file-system,Quizzes & Assignment Solutions for Modern Big Data Analysis with SQL Specialization on Coursera. Also included a few resources on side that I found helpful.
Organization: bdfd-learningground
Home Page: https://www.coursera.org/specializations/cloudera-big-data-analysis-sql
sql spark hive impala cloud-storage data-analysis big-data database dbms data-warehouse

ceph / ceph
distributed-file-system,Ceph is a distributed object, block, and file storage platform
Organization: ceph
Home Page: https://ceph.io
storage software-defined-storage distributed-storage s3 block-storage distributed-file-system object-store nfs highly-available iscsi

chaitanya100100 / google-file-system
distributed-file-system,A python implementation of Google File System
User: chaitanya100100
google-file-system gfs grpc distributed-file-system

chengdedeng / yfs
distributed-file-system,:house:超精简分布式对象存储
User: chengdedeng
Home Page: https://github.com/chengdedeng/yfs
jdk8 raft-java object-storage atomix distributed-file-system maven

cholcombe973 / rusix
distributed-file-system,Distributed filesystem in Rust
User: cholcombe973
rust distributed-file-system

codenoid / sdfs
distributed-file-system,a Connector |> Distributed File System based on Symlinking (that fit author need)
User: codenoid
distributed-systems distributed-file-system

cubefs / cubefs
distributed-file-system,cloud-native file store
Organization: cubefs
Home Page: https://cubefs.io
distributed-storage cncf kubernetes cloud-storage erasure-coding hybrid-cloud ai-native-storage object-storage cloud-native-storage distributed-file-system

deric / puppet-beegfs
distributed-file-system,Manage BeeGFS parallel system installations.
User: deric
puppet beegfs distributed-file-system storage

fangpin / minidfs
distributed-file-system,Simple version of Distributed File System on multiple threads
User: fangpin
distributed distributed-file-system file-system minidfs

foreverbell / yfs
distributed-file-system,Yet Another File System (yfs) based on Paxos algorithm.
User: foreverbell
Home Page: https://pdos.csail.mit.edu/archive/6.824-2012/labs/index.html
distributed-file-system

freakmaxi / kertish-dfs
distributed-file-system,Kertish-dfs is a simple distributed storage platform, implements file storage on a single distributed computer cluster, and provides interfaces for file/folder handling. Kertish-dfs aims primarily for completely distributed operation without a single point of failure, scalable to the exabyte level.
User: freakmaxi
distributed-storage distributed-file-system distributed-file-storage dfs data-farm scalable

happyfish100 / fastdfs
distributed-file-system,FastDFS is an open source high performance distributed file system (DFS). It's major functions include: file storing, file syncing and file accessing, and design for high capacity and load balance. Wechat/Weixin public account (Chinese Language): fastdfs
User: happyfish100
distributed-file-system distributed-file-storage storage-servers

hegongshan / file-system
distributed-file-system,File System Book
User: hegongshan
Home Page: https://www.hegongshan.com/file-system/
distributed-file-system file-system kernel-file-system storage-benchmark user-space-file-system

hegongshan / file-system-paper
distributed-file-system,Must-read Papers for File System (FS)
User: hegongshan
distributed-file-system file-system local-file-system ceph kernel-file-system user-space-file-system crash-consistency fragmentation metadata-management many-core-scalability

hexilee / tifs
distributed-file-system,A distributed POSIX filesystem based on TiKV, with partition tolerance and strict consistency.
User: hexilee
filesystem distributed-systems fuse tifs tikv distributed-file-system posix-compatible

hordiales / hdfs-streaming
distributed-file-system,HTML5 video streaming servlet from Hadoop Distributed File System
User: hordiales
hadoop video-streaming distributed-file-system storage video-storage html5 html5-video-player

ibm / ipfsfb
distributed-file-system,InterPlanetary File System for Business (IPFSfB) is an enterprise blockchain storage network based on InterPlanetary File System.
Organization: ibm
Home Page: https://developer.ibm.com/patterns/build-first-private-blockchain-network-interplanetary-file-system
blockchain ipfs cryptography p2p protocol distributed-file-system networking

james-qiuhaoran / distributed-computing-platform-mapreduce
distributed-file-system,This repository contains a simple Hadoop-like (MapReduce) distributed computing platform implemented in Java. It is extended from a course project at UIUC awarded the best Java version implementation and it's open-sourced for reference.
User: james-qiuhaoran
mapreduce hadoop hadoop-mapreduce distributed-computing distributed-file-system membership-management failure-detection distributed-systems cloud-computing cloud-computing-applications

kfrancischen / galaxy
distributed-file-system,Simple distributed file system based on gRPC
User: kfrancischen
distributed-file-system rpc glog pybind11 bazel rapidjson grpc-cpp protobuf abseil prometheus

ks-amit / distributed-database
distributed-file-system,A travel agency app with a distributed database implemented from scratch!
User: ks-amit
gfs distributed-systems distributed-database distributed-storage distributed-file-system python bulma bulma-css django-rest-framework django

last-saiyan / distributed-fs
distributed-file-system,Distributed file system based on GFS paper
User: last-saiyan
gfs distributed-systems distributed-file-system hdfs golang

leil-io / saunafs
distributed-file-system,SaunaFS is a free-and open source, distributed POSIX file system inspired by Google File System.
Organization: leil-io
Home Page: https://saunafs.com
archiving distributed-file-system distributed-storage fault-tolerance high-availability high-performance high-performance-computing self-healing self-hosted

leo-project / leofs
distributed-file-system,The LeoFS Storage System
Organization: leo-project
Home Page: https://leo-project.net/leofs/
leofs erlang distributed-storage distributed-file-system s3-storage s3 nfs-server nfs datalake

lmco / chaordicledger
distributed-file-system,The ChaordicLedger is the implementation of a design for a combination of Distributed Ledger Technology (DLT) and a Distributed File System (DFS) to create a secure, enterprise-grade platform for storing interlinked project artifacts.
Organization: lmco
distributed-file-system distributed-storage distributed-ledger-technology blockchain-technology ipfs-blockchain obsidian smart-contract business-intelligence software-supply-chain digital-transformation

moosefs / moosefs
distributed-file-system,MooseFS – Open Source, Petabyte, Fault-Tolerant, Highly Performing, Scalable Network Distributed File System (Software-Defined Storage)
Organization: moosefs
Home Page: https://moosefs.com
big-data clustering distributed-computing distributed-file-system distributed-storage ditributed-systems file-system filesystem fuse hadoop high-availability moosefs petabyte posix posix-compliant scalability snapshot software-defined-storage storage storage-tiering

mrcirca / zabbix-glusterfs
distributed-file-system,Monitoring GlusterFS Discovery storage with Zabbix 3.4
User: mrcirca
zabbix-templates glusterfs gluster zabbix-script zabbix-discovery-script monitoring distributed-file-system

pasalab / dfs-perf
distributed-file-system,A general performance test framework for Distributed File System
Organization: pasalab
distributed-file-system performance-testing

pitchpoint-solutions / sfs
distributed-file-system,The legacy distributed object storage server developed by PitchPoint Solutions can store billions of large and small files using minimal resources. Object data is stored in replicated volumes implemented like Facebooks Haystack Object Store. Object metadata which essentially maps an object name to a volume position is stored in an elasticsearch index. (Development by PitchPoint Solutions has been discontinued)
Organization: pitchpoint-solutions
distributed-storage distributed-systems vertx rxjava elasticsearch openstack-swift distributed-file-system object-storage java

prithvianilk / rdfs
distributed-file-system,An attempt to make a reliable, distributed file system inspired by HDFS
User: prithvianilk
distributed-file-system hadoop-hdfs

putdotio / efes
distributed-file-system,A distributed filesystem evolved from MogileFS
Organization: putdotio
distributed-file-system mogilefs

radogost / ucz-dfs
distributed-file-system,A distributed file system written in Rust.
User: radogost
rust distributed-systems hdfs filesystem distributed-file-system

rajatgarg149 / bigdata-essentials-hdfs-spark-rdd
distributed-file-system,
User: rajatgarg149
big-data big-data-essentials coursera coursera-big-data yandex-big-data spark mapreduce apache-spark hadoop hadoop-mapreduce

richardschneider / net-ipfs-engine
distributed-file-system,IPFS Core API implementation in .Net
User: richardschneider
ipfs distributed-file-system pubsub peer-to-peer

roma-glushko / awesome-distributed-system-projects
distributed-file-system,🚀 List of distributed system projects for inspiration and learning to build distributed services from real world examples
User: roma-glushko
distributed-systems distributed-database distributed-file-system distributed-lock highly-reliable-systems golang java cpp erlang

seaweedfs / seaweedfs
distributed-file-system,SeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files! Blob store has O(1) disk seek, cloud tiering. Filer supports Cloud Drive, cross-DC active-active replication, Kubernetes, POSIX FUSE mount, S3 API, S3 Gateway, Hadoop, WebDAV, encryption, Erasure Coding.
Organization: seaweedfs
distributed-storage distributed-systems s3 hdfs fuse distributed-file-system hadoop-hdfs posix tiered-file-system kubernetes

shubhamsawantsjsu / distributed-file-storage-system
distributed-file-system,An open-source, scalable, decentralized, robust, heterogeneous file storage solution which is fault tolerant, replicated, distributed and lets you upload, download, and see the catalog of other cluster with low latency and LRU cache capabilities.
User: shubhamsawantsjsu
distributed-file-system python3 grpc-python protobuf3 heartbeat-service raft-consensus-algorithm consensus-algorithm lru-cache proxy-server multithreading

sjqzhang / go-fastdfs
distributed-file-system,go-fastdfs 是一个简单的分布式文件系统(私有云存储)，具有无中心、高性能，高可靠，免维护等优点，支持断点续传，分块上传，小文件合并，自动同步，自动修复。Go-fastdfs is a simple distributed file system (private cloud storage), with no center, high performance, high reliability, maintenance free and other advantages, support breakpoint continuation, block upload, small file merge, automatic synchronization, automatic repair.(similar fastdfs).
User: sjqzhang
Home Page: https://gitee.com/sjqzhang/go-fastdfs
storage-servers distributed-file-storage distributed-file-system godfs file-system go-fastdfs fastdfs breakpoint-resume small-file-merge tus fileserver sync rsync go storage cloudnative cloud-storage filesystem oss object-storage-service

strumentiresistenti / magmafs
distributed-file-system,Experimental distributed filesystem for Linux
User: strumentiresistenti
Home Page: http://www.magmafs.net
linux filesystem distributed distributed-file-system

syncfree / antidote-fs
distributed-file-system,A file system backed by AntidoteDB.
Organization: syncfree
filesystem distributed-file-system crdt

teimurjan / go-p2p
distributed-file-system,Peer-to-peer local network
User: teimurjan
golang go peer-to-peer distributed-file-system

unixjunkie / daft
distributed-file-system,DAFT Allows File Transfers
User: unixjunkie
distributed-file-system cryptography cli ocaml-program user-space

wenbinzhu / filestack
distributed-file-system,A Distributed File System
User: wenbinzhu
distributed-file-system rpc-library client-server

wenweihu86 / distkv
distributed-file-system,Distributed KV Storage System based on Raft and RocksDB, can be use to store small files, like images.
User: wenweihu86
distributed-file-storage distributed-file-system distributed-kv distributed-storage haystack raft rocksdb

wenweihu86 / raft-java
distributed-file-system,Raft Java implementation which is simple and easy to understand.
User: wenweihu86
raft raft-protocol raft-consensus-algorithm distributed-storage distributed-file-system raft-java raft-algorithm raft-consensus

weswu8 / bloblib
distributed-file-system,The core library for blobfs and blobfs-win project, this tool can help you mount the Azure Blob storage as the local disk driver, no matter it is a Linux system or a Windows system.
User: weswu8
azure blob fuse winfsp nfs samba pageblob blockblob appendblob cloud

williamx1 / cse-2021
distributed-file-system,A distributed file system similar to Google File System (GFS).
User: williamx1
distributed-file-system gfs mapreduce raft rpc