Comments (8)
Hey @Hakan439, thanks for raising this issue! Could you tell me the output of running nvidia-smi
in your terminal?
from cudf.
from cudf.
@Hakan439 Since you say the core runs on pycharm, can you confirm if terminal you are getting the error and pycharm are using the same environment?
You could run which python
and share the output of terminal and pycharm.
from cudf.
from cudf.
Somehow now gpu seems to be enabled but it DOES run very slow. In the sample code above, I reduced the amount of rows in dataframe to 1000 for the test. in cpu dataframe it took 0.12 seconds however in gpu, in 8 seconds. mine running as as eGPU btw I no not know whether it makes a difference or not. What am I missing?
from cudf.
In the pycharm console output I see a different environment from everything else, gputest
vs bbx_gpu_env
. Not sure if that is significant or intentional. Good to know that it is running now, though. What do you mean by "eGPU"? Regarding performance, what does your data look like? How many columns does it have? Do you observe similar issues if you have a single column?
from cudf.
In the pycharm console output I see a different environment from everything else,
gputest
vsbbx_gpu_env
. Not sure if that is significant or intentional. Good to know that it is running now, though. What do you mean by "eGPU"? Regarding performance, what does your data look like? How many columns does it have? Do you observe similar issues if you have a single column?
I tried with several virtual environments. The initial env was gputest. In mu single column benchmark, it rans slow. In my original python code, When I try to run it via cudf, it gives the error in the first message
from cudf.
I have a python code which calculates lots of numbers for varios custom dataclass objects
If cudf is working now but it is still slow, it is possible that your code is using custom dataclasses in a way that cudf simply doesn't support and so you end up falling back to running everything on the CPU. The relative slowdown you mentioned (0.12 vs 8 seconds) is pretty huge though. Have you tried running your code through the cudf.pandas profiler?
from cudf.
Related Issues (20)
- [FEA] Full coverage of datetime methods in cudf-polars
- [FEA] Run polars test suite in cudf-polars CI, and keep track of pass rates
- [FEA] Accelerate cupy array creation from DataFrame.values HOT 4
- [FEA] Support batch construction of strings columns HOT 1
- [FEA] Have `cudf::make_empty_column(cudf::type_id::STRING)` return a column with a child column of empty offsets HOT 3
- [PERF] looping through dataframe is 100x slower than when running without cudf HOT 3
- [BUG] cuDF and Pandas return different results for ... HOT 4
- [FEA] HOT 1
- [FEA] Adjust libcudf to not load cuFile by default
- [FEA] Add support for `cudf.DataFrame.aggregate`
- [BUG] Series.value_counts hangs with over 1B rows of input HOT 6
- [FEA] Support duplicate column labels in cudf.DataFrame HOT 1
- [FEA] Add CI job to validate that `cudf.pandas` can be imported for all supported minor versions of pandas
- [BUG] result indices in `group_argmin` was not initialized to -1 as comment says
- [FEA] Add support for manual switching from CPU to GPU in `cudf.pandas` HOT 1
- [BUG]: `cudf.concat([empty DataFrame, empty DataFrame])` does not resolve axis types
- [BUG] Consider disabling managed memory in cudf.pandas on WSL2 HOT 4
- [BUG]cannot pip install on linux (Ubuntu) HOT 4
- [BUG] Dask cov operation is broken
- [FEA] Enable pow (and other Unary Ops) for cudf_polars
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from cudf.