Giter VIP home page Giter VIP logo

fs-hdfs's Introduction

datafusion-contrib

fs-hdfs's People

Contributors

kyotoyaho avatar ted-jiang avatar yahonanjing avatar yjshen avatar

Stargazers

 avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar

fs-hdfs's Issues

Allow setting of path

I am currently receiving the error:

error while loading shared libraries: libjvm.so: cannot open shared object file: No such file or directory

I understand I can manually set an LD_LIBRARY_PATH to prevent that, however this is burdensome for developers. I would much prefer to:

    if env::var("LD_LIBRARY_PATH").is_err() {
        if let Ok(path) = which("java") {
            let lib = path.canonicalize().unwrap().parent().unwrap().parent().unwrap().join("lib").join("server");
            println!("lib={}", lib.display());
            env::set_var("LD_LIBRARY_PATH", lib);
        }
    }

But even when I call that code as the first line of my test, I see I get the error before my code gets hit. Is it possible fs-hdfs3 is trying to load libraries in a lazy_static block or something? Is there another option for me to make this zero-setup for the devs on my team?

Thanks!

File append not working

The following exception is thrown when appending contents to an existing file:
Cannot write into a non-OutputStream object! 04:16:57 [WARN] Failed to create delta commit 1 attempts. Error: Parquet { source: External(Custom { kind: Other, error: "HadoopFileSystem: Generic error with msg: Fail to write contents to file XXXXX" }) }

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.