Comments (3)
Hey @mbkupfer thanks for your suggestion. I think option 1 is better that we will add one line saying how many rows are displayed, but probably will not count the total rows in this dataframe since it needs another call to count()
, which might not be efficient. Option 2 might make users confused because pandas' head is to return n rows, instead of print n rows.
from snowpark-python.
We had to solve this in https://github.com/ibis-project/ibis and it's not particularly bad. You don't need two calls: you can execute a limit with N+1
rows where N
is the number of rows to show and the check whether the number of returned rows is greater than N
.
Ibis has great snowflake support, so if anyone is interested in a DataFrame API with a nice indicator of "more rows" check it out!
from snowpark-python.
@cpcloud I'll take a look at the project. Thanks for sharing.
from snowpark-python.
Related Issues (20)
- SNOW-925456: session.write_pandas() behavior inconsistent with underlying snowflake.connector.pandas_tools.write_pandas()
- SNOW-928615: Custom packages don't work for latest versions HOT 1
- SNOW-928897: Calling SPROC throws error module has no attribute HOT 2
- SNOW-940613: Snowpark dataframe join fails with Invalid identifier when using dataframe alias HOT 1
- SNOW-944048: Support Polars with a to_polars method HOT 4
- SNOW-944062: Implementation and functionality of `pivot` differs from PySpark and is not user-friendly HOT 3
- SNOW-952961: Wrong documentation for daydiff function HOT 1
- SNOW-960172: Add `map_dict` functionality HOT 1
- SNOW-969175: Decimals with precision greater than 18 are returned as object type when using the to_pandas method
- SNOW-977836: The withColumnRenamed fucntion fails to rename a column if the snowpark dataframe has multiple columns with same name but with different case style HOT 2
- SNOW-992587: Unable to select metadata columns HOT 2
- SNOW-997694: Allow DataFrame object to be used as a subquery in filter operations
- SNOW-1000455: Incorrect return type hint in DataFrameNaFunctions class
- SNOW-1006168: Snowpark function `array_agg` converts data types to string HOT 1
- SNOW-1018951: save_as_table fails when writing DataFrame returned from stored procedure HOT 2
- SNOW-1021381: Deprecation warning for pkg_resources
- SNOW-1026241: Null value in integer column raises exception when executing .to_pandas() in version 1.12.0 HOT 1
- SNOW-1045584: Pylint (3.0.3) throws errors when using the `dataframe.collect()` method HOT 1
- SNOW-1055426: Typing breaks on pyright due to improper alias definitions
- SNOW-1058504: Python 3.12 support HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from snowpark-python.