Giter VIP home page Giter VIP logo

Comments (8)

colinmarc avatar colinmarc commented on July 28, 2024

Yup - that's absolutely in the works. I just haven't sat down to implement the protocol yet (it's fairly involved) =)

I'll keep this issue open until I do. Thanks for the poke!

from hdfs.

mindscratch avatar mindscratch commented on July 28, 2024

very interested in this as well, I appreciate the work.

from hdfs.

colinmarc avatar colinmarc commented on July 28, 2024

@mindscratch thanks for the bump =) If you're interested on living on the edge, I think the tests are passing in the PR I referenced above (#12). It doesn't support failing over if a datanode dies, though.

from hdfs.

andrewlee302 avatar andrewlee302 commented on July 28, 2024

Hey, are you progressing on write supports? I am taking a HDFS-based distributed computing framework in golang, so i am eager to using your writing function instead of webREST interfaces.
BTW, the write-support branch is valid or not? Can i use it for my project?

from hdfs.

colinmarc avatar colinmarc commented on July 28, 2024

Hey Andrew,

I Haven't made any progress recently, but if you check out the linked
branch the interfaces are there, and they work. The missing bits are
failover and comprehensive testing, but you could still develop against the
branch.

Sorry about the trouble!

On Tue, May 26, 2015, 17:34 Andrew Lee [email protected] wrote:

Hey, are you progressing on write supports? I am taking a HDFS-based
distributed computing framework in golang, so i am eager to using your
writing function instead of webREST interfaces.


Reply to this email directly or view it on GitHub
#5 (comment).

from hdfs.

imoverclocked avatar imoverclocked commented on July 28, 2024

Hey @colinmarc,

Thanks for the library and cli tools! It feels blazingly fast compared to using the standard hdfs cli or loading a jvm in general :)

I see you wrote put support and I would like to use it. Since there is no support for datanode failover, what happens when a node does fail? Is there any kind of panic/error returned or do we currently just keep going like nothing happened?

Cheers,
-Tim

from hdfs.

colinmarc avatar colinmarc commented on July 28, 2024

@imoverclocked If the test failures are any indication, I think you'll get some (byzantine) errors. Hopefully not a panic.

from hdfs.

colinmarc avatar colinmarc commented on July 28, 2024

Closed in #12

from hdfs.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.