Comments (8)
Yup - that's absolutely in the works. I just haven't sat down to implement the protocol yet (it's fairly involved) =)
I'll keep this issue open until I do. Thanks for the poke!
from hdfs.
very interested in this as well, I appreciate the work.
from hdfs.
@mindscratch thanks for the bump =) If you're interested on living on the edge, I think the tests are passing in the PR I referenced above (#12). It doesn't support failing over if a datanode dies, though.
from hdfs.
Hey, are you progressing on write supports? I am taking a HDFS-based distributed computing framework in golang, so i am eager to using your writing function instead of webREST interfaces.
BTW, the write-support branch is valid or not? Can i use it for my project?
from hdfs.
Hey Andrew,
I Haven't made any progress recently, but if you check out the linked
branch the interfaces are there, and they work. The missing bits are
failover and comprehensive testing, but you could still develop against the
branch.
Sorry about the trouble!
On Tue, May 26, 2015, 17:34 Andrew Lee [email protected] wrote:
Hey, are you progressing on write supports? I am taking a HDFS-based
distributed computing framework in golang, so i am eager to using your
writing function instead of webREST interfaces.—
Reply to this email directly or view it on GitHub
#5 (comment).
from hdfs.
Hey @colinmarc,
Thanks for the library and cli tools! It feels blazingly fast compared to using the standard hdfs cli or loading a jvm in general :)
I see you wrote put support and I would like to use it. Since there is no support for datanode failover, what happens when a node does fail? Is there any kind of panic/error returned or do we currently just keep going like nothing happened?
Cheers,
-Tim
from hdfs.
@imoverclocked If the test failures are any indication, I think you'll get some (byzantine) errors. Hopefully not a panic.
from hdfs.
Closed in #12
from hdfs.
Related Issues (20)
- Is it thread-safe that NamenodeConnection?
- could not find "github.com/colinmarc/hdfs/v2/protocol/hadoop_common" "github.com/colinmarc/hdfs/v2/security"
- support UserGroupInformation
- EC not working properly HOT 1
- Allow setting CreateFlag when creating files
- Namenodes not been filtered by fs.defaultFS
- the dns_canonicalize_hostname value not being respected
- panic: mkdir /demo: read tcp 192.168.10.1:57318->192.168.10.102:9870: wsarecv: An established connection was aborted by the software in your host machine.
- how to do setQuota
- Empty file after CopyToRemote HOT 1
- Readme suggestion: also show memory usage advantage HOT 2
- Why the return of func Read() with a FileReader is not consistent?
- Downloading the encrypted file HOT 2
- Libhdfs.so bindings for hdfs-go? HOT 1
- hadoop3 - write: broken pipe
- An error is reported when reading a file in the HAR package
- Support of hadoop delegation tokens with HADOOP_TOKEN_FILE_LOCATION env
- no available namenodes: SASL handshake: wrong Token ID. Expected 0504, was 607d HOT 1
- How can I Remove file into Trash instead of removing files permanently?
- Walk on empty directory will return io.EOF error HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from hdfs.