Comments (3)
I'm reading the code and I don't see where it could be loading the results of the SQL query into memory, unless SQLAlchemy or your MariaDB driver is doing it. The code is very simple:
csvkit/csvkit/utilities/sql2csv.py
Lines 72 to 80 in f1ee8ff
from csvkit.
What's the memory consumption when you just run the SQL query directly on MariaDB?
from csvkit.
Closing as no response to assist with reproducing the issue.
from csvkit.
Related Issues (20)
- csvjoin question or issue HOT 1
- Performant way of knowing in which column(s) a value (string or number) appears HOT 2
- csvsql (only) emits lot's of warnings on STDERR HOT 2
- add --json option to csvstats with frequency details HOT 3
- Add "Values are unique" to --csv HOT 3
- csvstack does not accept -z argument => csv.field_size_limit HOT 4
- Would like to be able to force the type of columns in csv file when using csvsql HOT 1
- Specify which in-memory SQL database is created when querying CSV files directly HOT 1
- csvsql UPDATE query not working? HOT 2
- Support zstandard-compressed (.zst) CSV files HOT 3
- BadZipFile when using -f xlsx --write-sheets - on STDIN HOT 1
- Test and document support for DuckDB HOT 5
- 'gbk' codec can't encode character '\xc1' HOT 2
- Apologies if i asked in wrong place HOT 3
- csvsql: add an option to not show the name of the selected columns HOT 1
- csvlook: consider passing max_rows argument to agate.table.from_csv HOT 1
- add more options from csvlook to csvpy HOT 3
- csvformat: add command-line option for output in ASV, i.e. ascii unit separator HOT 2
- csvstack is column agnostic and corrupts output HOT 2
- Include man pages in PyPI package tarballs? HOT 4
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from csvkit.