Giter VIP home page Giter VIP logo

Comments (4)

CAM-Gerlach avatar CAM-Gerlach commented on August 27, 2024

Since on_bad_lines was only added in Pandas 1.3.0, released a few months ago (and thus using it now will break our existing installs running Pandas <1.3.0) and the legacy error_bad_lines parameter won't be dropped until Pandas 2.0 which looks to be almost a year-ish away at least, its probably best to defer this change until then, and at least a minor version of Sindri. If it is sufficiently annoying in the logs, we can silence it with

# Use `on_bad_lines="skip"` instead of `error_bad_lines` for Pandas >=1.3.0
warnings.catch_warnings():
    warnings.filterwarnings(
        action="ignore",
        category=DeprecationWarning,
        module="pandas*"
    status_data = pd.concat(
        (pd.read_csv(file, error_bad_lines=False) for file in files_to_load),
        ignore_index=True, sort=False)
)

from sindri.

pbitzer avatar pbitzer commented on August 27, 2024

It's pretty annoying in the logs, since this occurs a lot. I'm good with deferring, and instead just catching this warning.

from sindri.

CAM-Gerlach avatar CAM-Gerlach commented on August 27, 2024

I've fixed this for good in v0.3.0a1, and will backport the warning suppression to v0.2.11.

from sindri.

CAM-Gerlach avatar CAM-Gerlach commented on August 27, 2024

Fixed by #16

from sindri.

Related Issues (10)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.