Comments (3)
Yes! @chanwutk has already taken this on as a project. Some of the required tasks include:
- Serialize Arquero verbs + expressions to an AST. This is already provided by the internal
query(...).toAST()
method! - Analyze verbs, segment into SQL queries / sub-queries, likely using a SQL-specific intermediate representation / AST format.
- Analyze verbs + expressions to identify unsupported operations (or perform more complex transforms for operations that don't have a clean one-to-one mapping). Note this may be DB-specific in terms of what functions, aggregate functions, etc. are supported by a particular target engine.
- Generate SQL query code for the target DB engine.
In addition, Arquero could provide a convenient API for issuing queries and marshaling query results to return Arquero tables. The arquero-worker package suggests one model and starting point for this.
from arquero.
Awesome. I think @tmostak would be very excited to hear this.
from arquero.
As we don't plan to support SQL output in the core Arquero package, I'm going to close out this issue. Feedback or requests regarding Arquero query serialization (Query.toJSON()
, Query.toAST()
, etc.) should be raised in new issues. SQL translation is being explored by @chanwutk and others in the arquero-sql repository.
from arquero.
Related Issues (20)
- Include an option to treat Arrow binary columns as String
- Interpolate missing values
- arquero op.first_value function issue HOT 2
- table.print() should return table to enable chaining HOT 2
- Citation for academic paper HOT 2
- Nuxt 2.0 build failing due to apache-arrow exports HOT 6
- Add op functions to work with Map and Set objects HOT 1
- `fromCSV` fails with uncaught TypeError on CSV with headers only HOT 1
- Join ignores empty string as suffix
- Table expressions do not support underscores as numeric separators in numeric literals
- CSV parse functions don't get run on null values
- Failing during production build: minification problem? HOT 10
- Verb to drop columns by name? HOT 2
- derive can not handle string? HOT 2
- Table concatenation results in empty table
- Problems getting Arquero to find it's types in Typescript HOT 5
- array_agg and undefined/none values HOT 3
- fromArrow -> Unrecognized type: "undefined"
- COUNTIF-like aggregate function
- NextJS swcMinify is breaking arquero
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from arquero.