Comments (9)
I have to admit I see that problematic as well. Understand the reasoning but not happy with it.
- If the CLI does override something, it should tell.
- If you specify a log.dir(s) value in /etc/kafka/server.properties and it does not get used you are ... surprised.
- It is not clear to me at the moment which server.properties is going to be used. My current assumption is that the /etc/kafka/server.properties is copied to the CONFLUENT_CURRENT subdirectory and all has to be changed there.
- In production but even in docker you want to have a stable service, meaning you operate a single cluster. Not 10 people create and destroy constantly. No mention on how this is envisioned.
- A solution might be to provide a systemctl script. This is missing anyhow and could include all that is done when having a stable/not-changing system.
- confluent start should have the option to enable/disable components. I never want to use the rest proxy but all others. So I either have to start all individually or the rest proxy gets started as well.
from confluent-cli.
We just hit the same when installing CP from RPM. What is the current word for running multi-node deployment (e.g. zookeeper) using the platform CLI? or is it unsupported for that (very common) case?
from confluent-cli.
Placing data in /tmp is very smart idea guys. Especialy for RHEL-based distros... with tmpwatch turned on by default :)
Keep up a good work!
from confluent-cli.
+1 I hit similar problem, with connect-distributed.properties not being read from where I expected it to be.
from confluent-cli.
There's a different cause for each of your observations.
Re: 1) one of the few overrides that CLI will do without requiring user's input is to overwrite the location of data directories. This is for instance dataDir
for zookeeper and log.dirs
for Kafka broker.
This was done to enable containerization of each deployment as well as to locate all the data of a Confluent CLI run in one place. It allows a user to have multiple, even concurrent, runs if ports are set appropriately. But most importantly it makes the CLI more robust, because an accidental change in the config won't result in confluent destroy
deleting data that potentially is not supposed to delete. A confluent cli run is supposed to control everything that is under the ${CONFLUENT_CURRENT}/confluent.current directory (CONFLUENT_CURRENT defaults to $TMPDIR if unset).
Re: 2) it made sense for the worker properties to have AvroConverter
as default converter for keys and values. Currently, to do that with minimal changes, we had to load worker properties from ./etc/schema-registry/connect-avro-distributed.properties
which I admit is not the first place somebody looks for Connect properties. Such a properties file that integrates with schema-registry can't go to ./etc/kafka
by merging it to AK. But we can think of ways to put a symlink in a more intuitive place in the Confluent platform packages.
from confluent-cli.
I agree:
- If the CLI does override something, it should tell.
- What is the current word for running multi-node? see #46 ...what about the zookeeper myid file?
from confluent-cli.
@v-g-ustinov so long as you understand that Confluent CLI is currently just for development and not at all recommended for production then this does make sense.
from confluent-cli.
@hjespers unfortunately the Quickstart guides on the fail to mention this. So it is easy to miss.
A nice big warning, 'Not suitable for production use', would solve this.
from confluent-cli.
Totally agree @owenrh
from confluent-cli.
Related Issues (20)
- confluent connect fail to start
- confluent status does not report the status of Zookeeper started by zookeeper-server-start
- Confluent CLI and Java 11 HOT 3
- Is this repository deprecated? HOT 1
- ERROR [main] found topic=_confluent-controlcenter
- Confluent CLI can't support arm64 HOT 2
- uent HOT 1
- Filing issues for the new proprietary Confluent CLI HOT 2
- Invoking "confluent local services start" fails (requires Java version 1.8 or 1.11) with OpenJDK 14.0.2 HOT 1
- Printed to "failed to start". But is UP. It's not Down. HOT 4
- Error: macOS version >= 10.13 is required using Big Sur HOT 5
- Kafka service goes down and never up again.
- Doesn't support M1 Mac HOT 6
- Getting available versions S3 hangs on no connectivity HOT 2
- confluent local services start exit status 1
- Unable to start confluent on my local HOT 2
- Invalid connector class. Check the connector configuration file. -- More details needed HOT 2
- Error creating a api-key to my ksqldb resource
- Error changing environments
- Misleading error output when not logged in HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from confluent-cli.