Comments (8)
Hey mate. I think best way to solve your issue is to set up a Kafka in the middle. Unfortunately Clickhouse-go doesn't support HTTP endpoint so I can't provide that option in dnsmonster
just yet, but when that happens you'll have another option to solve data replication. There's no easy way to achieve your requirement without messing up the whole design.
from dnsmonster.
Hi !!!
Is there any way that we mention only one click-house IP in dnsmonster and click-house or zookeeper can manage the replication itself and replicate the data to other node.
Because if we mention multiple values and IP, then what is the need of click-house replication, we can do that in standalone mode.
So if you have any other way, just mention one IP of click-house in dnsmonster and let click-house manage the data replication itself.
Thanks !!!
from dnsmonster.
Hi !!
Actually I was saying this because we configure dnsmonster and clickhouse on different VMs means a different VM for both.
I want to keep dnsmonster separate from clickhouse so that the load is less and there is less chance of server down.
That's why I want this kind of configuration.
by the way thanks for your reply and please let me know if you have any other options in dnsmonster.
Thanks!!!
from dnsmonster.
Oh right I think I get your point. If you want to put dnsmonster and ClickHouse in different VMs, that's totally fine. use the option --clickhouseAddress=
and point it to the IP address of your ClickHouse VM and it should all work fine. Hopefully this answers your question.
from dnsmonster.
yes I know this and I am using it also but our question comes again at the same place that if node with given clickhouse Ip goes down then my replication will stop and if we give multiple values ββthen clickhouse replication What is the requirement of .
Simply I want that if the IP of the clickhouse node given in dnsmonster is down, then dnsmonster itself will continue the replication through another node in clickhouse replication mode.
from dnsmonster.
If you're looking into setting the strategy of multiple ClickHouse endpoints (load balance, fail-over etc), I'm afraid that's not easily doable with the current native protocol. Hopefully with the addition of ClickHouse on HTTP (which is on the horizon) we can enable this feature. Take a look at this article for more info.
from dnsmonster.
YA !!! I know it's not that easy. But we are trying to achieve this requirement in some way.
from dnsmonster.
from dnsmonster.
Related Issues (20)
- higher precision timestamps in clickhouse HOT 2
- dnsmonser not sending all packets from pcap to clickhouse HOT 11
- dnsmonser not sending packets from live interface to clickhouse HOT 2
- SrcIP and DstIP in DNS_LOG table IPv4 addresses are incorrect HOT 3
- Question around pcap file behaviour HOT 12
- Potentially inaccurate packet count when reading from pcap file HOT 6
- Compilation failed on MacOS M1 HOT 1
- PCAP to JSON workflow - Split/maximum packets per output file?
- File output supporting compression HOT 2
- support for Parquet format output HOT 1
- (Illegal type DateTime64(3) [ while pushing to view default.DNS_PROTOCOL] Latest Version(v0.9.7) DNS-Monster Showing Error while send data to Click-House HOT 9
- How to do Multiple ClickHouse Ip address entry into Dnsmonster configuration file HOT 2
- how to make dns-monster listen multiple ports HOT 2
- Clickhouse Cloud HOT 3
- Decrypting DoT / DoH sessions via passive DNS approach itself HOT 1
- Clickhouse flushing algo HOT 2
- Clickhouse schema weirdness HOT 2
- Save dnstap `identity` as server name HOT 6
- Warning Error While logging data on DNStap socket to Click-House HOT 3
- Not logged all data from Interface Device HOT 5
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
π Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. πππ
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google β€οΈ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from dnsmonster.