Comments (3)
timsehn
commented on May 19, 2024
Agreed. This is high on our list. Since you asked we'll spec it out this
week and give you a date.
…On Sat, May 23, 2020 at 8:34 PM Adam ***@***.***> wrote:
Hello,
Has there been any implementations leveraging Go's concurrency
capabilities?
I'm quite sure it wouldn't be hard to implement read-only parallel queries
with sync.mutexes if it hasn't been done yet
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
<#111>, or
unsubscribe
<https://github.com/notifications/unsubscribe-auth/ABJAR3E5PMBRQMGNDWOHR2LRTCIVJANCNFSM4NIW2KBA>
.
from go-mysql-server.
zachmu
commented on May 19, 2024
This is already possible, but hasn't been tested to our satisfaction yet. We could help in this effort if you have a use case that requires parallel execution.
When constructing an engine, use the WithParallelism method on the AnalyzerBuilder:
https://github.com/liquidata-inc/go-mysql-server/blob/master/sql/analyzer/analyzer.go#L51
It parallelizes on partitions, so if your data source can be partitioned it should be possible to run each query in parallel on each partition (up to some max) simultaneously. But like I said: we don't have full faith in the implementation yet, and could use help proving it works.
from go-mysql-server.
zachmu
commented on May 19, 2024
We now have a convincing proof of concept that parallel execution works in dolt. Let us know if you try it out and find any issues.
from go-mysql-server.
Related Issues (20)
- GolangCI does not work
- UPDATE statements are Noop HOT 4
- any plan to build new release? HOT 1
- go mod tidy error HOT 2
- add create table comment on table clause to table spec HOT 1
- Can't turn on multiStatements when using memory driver HOT 2
- Does it support `Functional Key Parts` index ? HOT 2
- Server error message compatibility when doing INSERT HOT 3
- Foreign key constraints break auto-incrementing ids in memory mode HOT 3
- Panic when executing sql statements from external command line tool after startup HOT 7
- Self-referencing foreign key constraint breaks auto-incrementing ids in memory mode HOT 2
- Potential regression: number cast to JSON no longer read as float HOT 2
- Running multiple migrations in a transaction HOT 2
- Primary key column order changes column order on insert HOT 1
- Consistent usage of variables in the example
- MemoryDB: Deleting rows silently fails if there are multiple CASCADING constraints pointing to the same parent HOT 1
- MemoryDB: UPDATE succeeds but is not reflected in subsequent SELECT
- Feature request: persistent database store HOT 1
- Any Benchmarks available HOT 1
- Parser support for `PARTITION BY` HOT 6
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from go-mysql-server.