datafusion-contrib / datafusion-c Goto Github PK
View Code? Open in Web Editor NEWC language bindings for DataFusion
Home Page: https://datafusion-contrib.github.io/datafusion-c/latest/
License: Apache License 2.0
C language bindings for DataFusion
Home Page: https://datafusion-contrib.github.io/datafusion-c/latest/
License: Apache License 2.0
#8 557.9 g++ -I. -I/usr/local/share/gems/gems/glib2-4.2.0/ext/glib2/../../lib -I/usr/local/share/gems/gems/glib2-4.2.0/ext/glib2 -I/usr/include -I/usr/include/ruby/backward -I/usr/include -I. -I/usr/local/share/gems/gems/extpp-0.1.1/include -I./.gem.20230911-6322-l56nvn -I/usr/lib64/ruby/vendor_ruby -I/usr/include/glib-2.0 -I/usr/lib64/glib-2.0/include -fPIC -O2 -g -pipe -fexceptions -fstack-protector-strong -grecord-gcc-switches -specs\=/usr/lib/rpm/redhat/redhat-hardened-cc1 -specs\=/usr/lib/rpm/redhat/redhat-annobin-cc1 -mtune\=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection -std\=gnu\+\+17 -Wall -Wp,-D_FORTIFY_SOURCE\=2 -Wp,-D_GLIBCXX_ASSERTIONS -m64 -o arrow.o -c arrow.cpp
#8 557.9 g++ -I. -I/usr/local/share/gems/gems/glib2-4.2.0/ext/glib2/../../lib -I/usr/local/share/gems/gems/glib2-4.2.0/ext/glib2 -I/usr/include -I/usr/include/ruby/backward -I/usr/include -I. -I/usr/local/share/gems/gems/extpp-0.1.1/include -I./.gem.20230911-6322-l56nvn -I/usr/lib64/ruby/vendor_ruby -I/usr/include/glib-2.0 -I/usr/lib64/glib-2.0/include -fPIC -O2 -g -pipe -fexceptions -fstack-protector-strong -grecord-gcc-switches -specs\=/usr/lib/rpm/redhat/redhat-hardened-cc1 -specs\=/usr/lib/rpm/redhat/redhat-annobin-cc1 -mtune\=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection -std\=gnu\+\+17 -Wall -Wp,-D_FORTIFY_SOURCE\=2 -Wp,-D_GLIBCXX_ASSERTIONS -m64 -o converters.o -c converters.cpp
#8 557.9 In file included from /usr/include/arrow-glib/arrow-glib.hpp:29,
#8 557.9 from red-arrow.hpp:32,
#8 557.9 from arrow.cpp:20:
#8 557.9 /usr/include/arrow-glib/compute.hpp:23:10: fatal error: arrow/acero/exec_plan.h: No such file or directory
#8 557.9 #include <arrow/acero/exec_plan.h>
#8 557.9 ^~~~~~~~~~~~~~~~~~~~~~~~~
#8 557.9 In file included from /usr/include/arrow-glib/arrow-glib.hpp:29,
#8 557.9 from red-arrow.hpp:32,
#8 557.9 from converters.hpp:20,
#8 557.9 from converters.cpp:20:
#8 557.9 /usr/include/arrow-glib/compute.hpp:23:10: fatal error: arrow/acero/exec_plan.h: No such file or directory
#8 557.9 #include <arrow/acero/exec_plan.h>
#8 557.9 ^~~~~~~~~~~~~~~~~~~~~~~~~
Oh...
We already have the release document: https://datafusion-contrib.github.io/datafusion-c/latest/developer/release.html
dev/release/README.md
is duplicated.
pip3 install --upgrade meson
...
error: externally-managed-environment
× This environment is externally managed
╰─> To install Python packages system-wide, try apt install
python3-xyz, where xyz is the package you are trying to
install.
If you wish to install a non-Debian-packaged Python package,
create a virtual environment using python3 -m venv path/to/venv.
Then use path/to/venv/bin/python and path/to/venv/bin/pip. Make
sure you have python3-full installed.
If you wish to install a non-Debian packaged Python application,
it may be easiest to use pipx install xyz, which will manage a
virtual environment for you. Make sure you have pipx installed.
See /usr/share/doc/python3.11/README.venv for more information.
note: If you believe this is a mistake, please contact your Python installation or OS distribution provider. You can override this, at the risk of breaking your Python installation or OS, by passing --break-system-packages.
hint: See PEP 668 for the detailed specification.
We can use some caches for the followings to improve CI speed:
error: casting raw pointers to the same type and constness is unnecessary (`*mut capi::DFArrowArray` -> `*mut capi::DFArrowArray`)
Error: --> src/capi.rs:651:21
|
651 | (*c_abi_record_batch as *mut DFArrowArray) as *mut FFI_ArrowArray,
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ help: try: `*c_abi_record_batch`
|
= help: for further information visit https://rust-lang.github.io/rust-clippy/master/index.html#unnecessary_cast
= note: `-D clippy::unnecessary-cast` implied by `-D clippy::all`
We need some scripts to release a new version.
We can use INPUT
in Doxyfile
to specify built datafusion.h
.
Like Apache Arrow C++.
We can reuse build system in apache/arrow: https://github.com/apache/arrow/blob/master/dev/tasks/linux-packages/package-task.rb
It's for apache/arrow#33672.
AFAIK there is no bindings for saving a data frame as a parquet file. (is that correct?)
Step 5/8 : RUN sed -i'' -e 's/main$/main contrib non-free/g' /etc/apt/sources.list
---> Running in ef794518e89e
sed: can't read /etc/apt/sources.list: No such file or directory
Here are features provided by implementing a normal GLib bindings library on the current C API:
datafusion.h
Like Apache Arrow C++.
We can reuse build system in apache/arrow: https://github.com/apache/arrow/blob/master/dev/tasks/linux-packages/package-task.rb
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.