[IDEA] Use ClickHouse feature `External Data for Query Processing` for data fetching about graphite-clickhouse HOT 5 CLOSED

I would suggest to try another way first. You can send series list as attached file as described here https://clickhouse.yandex/docs/en/single/#external-data-for-query-processing . I want to try it for a long time but there is not enough time

Usually it is enough to increase this parameter through the settings

[clickhouse]
url = "http://graphite:qwerty@localhost:8123/?max_query_size=2097152&max_ast_elements=1000000&readonly=2&log_queries=1"

from graphite-clickhouse.

AFAIK, it's forbidden to change settings for users with readonly=1 in CH. So, if anybody does have real readonly user, it won't work

UPD: I've tested and max_query_size=2097152 surprisingly works for user with readonly=1

UPD2: No, with readonly=1 it's indeed impossible:
{"error": "clickhouse response status 500: Code: 164, e.displayText() = DB::Exception: Cannot modify 'max_query_size' setting in readonly mode (version 19.13.3.26 (official build))\n"}

from graphite-clickhouse.

Thank you for the suggestion of using external tables, I'll try to implement it.

from graphite-clickhouse.

I think this issue could also be solved when #22 get's resolved. Or at least this issue might become irrelevant.

from graphite-clickhouse.

PoC is ready in the PR, you are very welcome to try it out

from graphite-clickhouse.