Comments (3)
, (num % 1000) + 1)
Bad locality of num
values
You better find some value
, so result of function intDiv(num, value)
will return reasonable amount of partitions
from clickhouse.
afaiu, the difference comes from the fact that we load all the marks for the given part regardless of how many granules we're going to read. thus when you had small parts and filtered all of them except one it worked better.
the supposed solution is to increase mark cache size. you also may increase index granularity, but it doesn't scale.
Any suggestions on splitting single parts into multiple
more granular partitioning or you could try keep parts size limited with max_bytes_to_merge_at_max_space_in_pool
from clickhouse.
, (num % 1000) + 1)
Bad locality of
num
valuesYou better find some
value
, so result of functionintDiv(num, value)
will return reasonable amount of partitions
Actually my table has only one value for num = 0
. So it has only 1 partition per month. This is why original query should look at 1 partition only.
from clickhouse.
Related Issues (20)
- async_insert_busy_timeout_ms is not respected HOT 1
- Is https supported in external http authenticator? HOT 4
- Possible deadlock in `StorageKafka`
- Test 01119_session_log is flaky HOT 1
- Test `03221_mutation_analyzer_skip_part` has failed
- Progress column value of system.view_refreshes greater than 1
- Logical error: 'Cannot replace literals'
- Conditional functions with different Decimal scales HOT 1
- Enable "uncompressed cache" to boost ClickHouse performance HOT 5
- Lightweight DELETE on cluster table not exits bug
- getSettingOrNull / getSettingOrDefault
- Replicas keep turning inactive & read-only HOT 7
- Why sorting order affects `OSReadChars` significantly HOT 1
- Parquet query failed with `In` decimal column filter
- ATTACH PART can't attach broken parts after failed upgrade
- MODIFY COLUMN ... ALIAS to column with CODEC leads to load failure HOT 1
- Context has expired in BACKUP query, `03032_async_backup_restore` HOT 6
- Inconsistent/incorrect treatment of backslashes in bound query params
- [Umbrella] New JSON type improvements HOT 8
- Error occurred while reading data from an Iceberg table on S3. HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from clickhouse.