Comments (22)
Same issue here.
Someone knows what can be done??
from terraform-provider-kafka.
@Aransh what Kafka version are you using?
from terraform-provider-kafka.
I'm actually using RedPanda (a Kafka-compatible broker), was probably relevant to mention π
.
I tried asking their team if there's any solid answer to your question (as in, is there some internal kafka version used), this is their response:
I would just say youβre using Redpanda π
Looking at the change log, this could either be something to do with Sarama v1.40.1 versus v1.42.1, or the Net.Proxy changes theyβve added.
v0.5.4...v0.6.0
from terraform-provider-kafka.
Hi @Aransh , I have the same problem. Can you please share your solution if you found something?
from terraform-provider-kafka.
@arkadiusjonczek no solution yet except using the old provider version.
Waiting to see if @Mongey has any possible solution
from terraform-provider-kafka.
We're hitting the same issue with AWS Managed Kafka (MSK). Different versions of MSK. I'll ask my colleague to provided details.
from terraform-provider-kafka.
@Mongey After upgrading to 0.6.0 version Getting this error
12:57:20 Error: kafka: client has run out of available brokers to talk to: 3 errors occurred:
12:57:20 * EOF
12:57:20 * EOF
12:57:20 * EOF
12:57:20
12:57:20
12:57:20 with kafka_topic.topics["devopstest.topic.empty2.config"],
12:57:20 on main.tf line 1, in resource "kafka_topic" "topics":
12:57:20 1: resource "kafka_topic" "topics" {
TLS Brokers
AWS MSK Kafka version - 2.2.1
Terraform version: 1.5.7
Note: Same code is working for 0.5.4 version
from terraform-provider-kafka.
@Mongey @errm Is this being worked on please?
Also, as it was already suggested, documentation update would be great improvement.
Thank you.
from terraform-provider-kafka.
@Mongey @errm After upgrading provider version to 0.7.0 also. Still getting the error for TLS communication brokers which was occured for 0.6.0 version also.
with 0.5.4 version able to create to topics.
Error: kafka: client has run out of available brokers to talk to: 3 errors occurred:
from terraform-provider-kafka.
Hi Team, Any update?
from terraform-provider-kafka.
@EliranTurgeman / @srikanth520 / @yermulnik / @Aransh Can you please provide examples of your configuration, along with details of the Kafka service, and versions you're using.
from terraform-provider-kafka.
@Mongey Please see #383 (comment) β @srikanth520 and I are on the same team.
Please let us know what additional details you'd like us to provide.
from terraform-provider-kafka.
@yermulnik There is no terraform config provided.
from terraform-provider-kafka.
Ouch, I just double checked and couldn't reproduce the issue (currently we're at v0.7.1
of Kafka provider). As in I was able to connect to both Anon TLS and AWS-IAM clusters w/o issues.
Even tried downgrading to v0.6.0
and still have no issues with Anon TLS cluster π€
I'll talk to @srikanth520 to see whether I might be missing something from his setup. Will keep you posted.
UPD: I re-read through the history of our internal ticket and it looks like the issue was with MSK cluster of 2.2.1
version, while there were no issues with clusters with version 3.5.1
. Recently we finished off upgrading all of our MSK clusters to 3.5.1
, so we're not anymore able to confirm the issue π€·π»
from terraform-provider-kafka.
@Mongey I can try and help with that.
As I mentioned here - #383 (comment), we are using redpanda (which works with this provider up to version 0.5.4).
Relevant terraform files are pretty standard:
provider:
provider "kafka" {
bootstrap_servers = ["<broker-1>:31092,<broker-2>:31092,<broker-3>:31092"]
sasl_mechanism = "scram-sha512"
sasl_username = <username>
sasl_password = <password>
}
example topic:
resource "kafka_topic" "main" {
config = {
"cleanup.policy" = "delete"
"max.message.bytes" = "2097164"
"retention.ms" = "86400000"
"segment.ms" = "82800000"
}
name = "<topic-name>"
partitions = 6
replication_factor = 3
}
And on apply, after approving the plan:
kafka_topic.main["<topic-name>"]: Creating...
kafka_topic.main["<topic-name>"]: Still creating... [10s elapsed]
β·
β Error: kafka: client has run out of available brokers to talk to: 3 errors occurred:
β * EOF
β * EOF
β * EOF
from terraform-provider-kafka.
@Aransh I have just tried with red panda serverless and cannot reproduce.
from terraform-provider-kafka.
@Mongey Hmmm... that's odd, we've had this issue reproduced by 3 of our teams in several different redpanda deployments...
We are using self-hosted redpanda, does serverless tell you the redpanda version? (our main environment uses v24.1.1)
from terraform-provider-kafka.
I'm having the same issue with my self-hosted redpanda broker. In the redpanda logs I see the following error:
kafka - connection_context.cc:362 - Error while processing request from 10.244.0.84:55402 - Unsupported version 9 for metadata API.
Maybe that is related?
from terraform-provider-kafka.
I'm having the same issue with my self-hosted redpanda broker. In the redpanda logs I see the following error:
kafka - connection_context.cc:362 - Error while processing request from 10.244.0.84:55402 - Unsupported version 9 for metadata API.
Maybe that is related?
Maybe try setting kafka_version
in the provider config to something lower than the default (2.7.0
)
from terraform-provider-kafka.
Maybe try setting
kafka_version
in the provider config to something lower than the default (2.7.0
)
Already tried that, no dice...
from terraform-provider-kafka.
kafka_version = "2.1.0"
works for me with Redpanda 24.1.
from terraform-provider-kafka.
Related Issues (20)
- Import of Scram Credential Resource
- password changes in scram credentials not detected HOT 1
- AWS MSK fresh cluster first apply fails because SASLS SCRAM secrets association is delayed
- Enable the GSSAPI SASL mechanism for kerberos-based authentication
- Add support for oauthbearer as the sasl mechanism HOT 6
- Unable to use aws-iam with Apache Kafka version 2.5.1 HOT 1
- Terraform Plan takes a long time waiting for topics (intermittent)
- Ho do I use a PKCS12 keystore for MSK authentication?
- Version 0.7.0 does error on aim auth in comparison to 0.6.0 HOT 6
- Version 0.7.0 and 0.6.0 not working for kafka TLS brokers to create topics
- Version 0.7.0 and 0.6.0 not working for kafka TLS brokers to create topics
- Using this provider with multiple AWS Kafka clusters in the same AWS account HOT 1
- Provider wants to replace existing kafka_acls when a new entry/ creating new resource is being added. HOT 7
- `terraform plan` returns unexpected diff if brokers have cluster-wide default config HOT 1
- Overrides for Topic Placement Policy HOT 1
- Kafka Compatibility Query HOT 2
- Kafka Broker Issue HOT 1
- Provider Cannot Assume Role From EKS HOT 2
- Empty Summary: This is always a bug in the provider and should be reported to the provider developers
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
π Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. πππ
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google β€οΈ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from terraform-provider-kafka.