A simple project for parallel running sql against multiple TiDB clusters
- Start multiple TiDB clusters or MySQL servers. I started several MySQL servers on my 2017 MBP 13 inch. They are totally enough for testing.
- Create TiDB configruation file. Refer to config/tidb-clusters.json
- Create some sql files with same file prefix and postfix. e.g.
sql-0.sql sql-1.sql.
[
{
"host": "127.0.0.1",
"port": 3306,
"user": "root",
"password": "root",
"database": "interview"
},
{
"host": "127.0.0.1",
"port": 3307,
"user": "root",
"password": "root",
"database": "interview"
},
{
"host": "127.0.0.1",
"port": 3308,
"user": "root",
"password": "root",
"database": "interview"
}
]go install github.com/cyliu0/tistA test tool for parallel running sql against multiple TiDB clusters.
Usage:
tist [flags]
Flags:
-c, --client-number int number of client (default 3)
-h, --help help for tist
-p, --sql-file-prefix string prefix for SQL files (default "./config/sql")
-s, --sql-file-suffix string suffix for SQL files (default "sql")
-t, --tidb-config string TiDB clusters JSON file (default "./config/tidb-clusters.json")
-v, --verbose verbose output
$ ./tist -c 3 -p ./config/sql -s sql -t ./config/tidb-clusters.json
INFO[2019-05-21T16:52:50+08:00] ClientID: 0, SQL Num: 10
INFO[2019-05-21T16:52:50+08:00] ClientID: 1, SQL Num: 10
INFO[2019-05-21T16:52:50+08:00] ClientID: 2, SQL Num: 10
INFO[2019-05-21T16:52:50+08:00] Total SQL Num: 30
INFO[2019-05-21T16:54:15+08:00] Working on No.1000 permutation
INFO[2019-05-21T16:55:53+08:00] Working on No.2000 permutation
INFO[2019-05-21T16:56:24+08:00] SQL Num: 30, Permutation Num: 2286, Time Duration: 3m34.237561496s
$ ./tist -c 2 -p ./config/new-sql -t test.json -v
INFO[2019-05-21T18:09:14+08:00] ClientID: 0, SQL Num: 1
INFO[2019-05-21T18:09:14+08:00] ClientID: 1, SQL Num: 5
INFO[2019-05-21T18:09:14+08:00] Total SQL Num: 6
DEBU[2019-05-21T18:09:14+08:00] Get iterator: 0
DEBU[2019-05-21T18:09:14+08:00] worker ID: 0 sending SQL with iterator ID: 0
DEBU[2019-05-21T18:09:14+08:00] Get iterator: 1
DEBU[2019-05-21T18:09:14+08:00] worker ID: 0 sending SQL with iterator ID: 1
DEBU[2019-05-21T18:09:14+08:00] Get iterator: 2
DEBU[2019-05-21T18:09:14+08:00] Iterator ID 0 execution finished with TiDB ID: 0
DEBU[2019-05-21T18:09:14+08:00] worker ID: 0 sending SQL with iterator ID: 2
DEBU[2019-05-21T18:09:14+08:00] Get iterator: 3
DEBU[2019-05-21T18:09:14+08:00] Iterator ID 1 execution finished with TiDB ID: 0
DEBU[2019-05-21T18:09:14+08:00] worker ID: 0 sending SQL with iterator ID: 3
DEBU[2019-05-21T18:09:14+08:00] Get iterator: 4
DEBU[2019-05-21T18:09:14+08:00] Iterator ID 2 execution finished with TiDB ID: 0
DEBU[2019-05-21T18:09:14+08:00] worker ID: 0 sending SQL with iterator ID: 4
DEBU[2019-05-21T18:09:14+08:00] Get iterator: 5
DEBU[2019-05-21T18:09:14+08:00] Iterator ID 3 execution finished with TiDB ID: 0
DEBU[2019-05-21T18:09:14+08:00] worker ID: 0 sending SQL with iterator ID: 5
DEBU[2019-05-21T18:09:15+08:00] Iterator ID 4 execution finished with TiDB ID: 0
DEBU[2019-05-21T18:09:15+08:00] Iterator ID 5 execution finished with TiDB ID: 0
INFO[2019-05-21T18:09:15+08:00] SQL Num: 6, Permutation Num: 6, Time Duration: 512.00856ms
React
Typescript
Django
Laravel
Facebook
Microsoft
Google
Alibaba
D3
Tencent