Comments (7)
This was 8 years ago so no, I no longer have the command ;)
from librdkafka.
Hi,
no, I havent seen this one before.
Some questions:
- Does it happen on each execution of your program?
- Does it rely on a certain number or set of brokers?
- Is it reproducible with the rdkafka_example program?
- Are you linking your program statically? I found this: https://sourceware.org/bugzilla/show_bug.cgi?id=10652
from librdkafka.
Hi Magnus,
To answer your questions:
Yes - happens every time
No - doesn't matter the number
No - doesn't happen on the example program, or even my own sample program
Yes - I think this is almost certainly the problem. I have a binary
which does a dlopen on a shared library that I wrote. That shared library
is statically linked to librdkafka.a. Based on the link you sent, I
wasn't sure if a final solution was found? From your reading, does it
mean I have to change how you build librdkafka.a to link in pthread?
On Fri, Dec 27, 2013 at 2:35 AM, Magnus Edenhill
[email protected]:
Hi,
no, I havent seen this one before.
Some questions:
- Does it happen on each execution of your program?
- Does it rely on a certain number or set of brokers?
- Is it reproducible with the rdkafka_example program?
- Are you linking your program statically? I found this:
https://sourceware.org/bugzilla/show_bug.cgi?id=10652—
Reply to this email directly or view it on GitHubhttps://github.com//issues/34#issuecomment-31250326
.
from librdkafka.
From what I understand you may link your program statically with librdkafka, but you need to link it dynamically with pthreads.
Can you try that?
from librdkafka.
Success! (Although it feels weird to make my single threaded binary link
with pthread just 'in case' one of the .so's I dlopen happens to use
threads, but I think I can deal with that :) )
On Fri, Dec 27, 2013 at 6:14 AM, Magnus Edenhill
[email protected]:
From what I understand you may link your program statically with
librdkafka, but you need to link it dynamically with pthreads.
Can you try that?—
Reply to this email directly or view it on GitHubhttps://github.com//issues/34#issuecomment-31256767
.
from librdkafka.
Thing is that librdkafka is threaded (one thread per rd_kafka_t + one thread for each broker), and each broker thread will try to resolve its broker address using getaddrinfo(), and thats where it fails :)
from librdkafka.
Success! (Although it feels weird to make my single threaded binary link with pthread just 'in case' one of the .so's I dlopen happens to use threads, but I think I can deal with that :) )
On Fri, Dec 27, 2013 at 6:14 AM, Magnus Edenhill [email protected]:
From what I understand you may link your program statically with
librdkafka, but you need to link it dynamically with pthreads.
Can you try that?
—
Reply to this email directly or view it on GitHubhttps://github.com//issues/34#issuecomment-31256767
.
Hi, can I know the command to statically link the librdkafka that you have success on?
Thanks.
from librdkafka.
Related Issues (20)
- Offset cannot be set for KafkaConsumer HOT 2
- Error handling question "treat any error that has neither retriable, abortable, or fatal set, as a fatal error" HOT 1
- rd_kafka_commit_transaction failed, but messages were delivered to topics HOT 1
- I am unable to get producer. HOT 2
- Unable to check for updates HOT 6
- The lib can't work on windows. HOT 2
- `rd_kafka_offsets_store` with `rd_kafka_commit` does not preserve metadata on `NULL` HOT 1
- Question regardless blocked signals in threads HOT 6
- Onprem SQL to AWS Confluent Cloud Kafka "Not selecting any broker for cluster connection" HOT 1
- producer continually refreshing client metadata after broker disconnection HOT 8
- APIVERSION_QUERY timeout in first connection with TLSv1.3 kafka broker
- mklove/modules/configure.base: line 2126: source: configure.self: file not found on windows HOT 3
- Consumer initialization hangs HOT 1
- rd_kafka_metadata can cause a UNKNOWN_TOPIC_OR_PART message HOT 10
- Expose `rd_kafka_global_init` to prevent forking issues on macOS HOT 7
- librdkafka cannot be built with LLD linker HOT 2
- Upgrade CMake minimum version
- Issue with Confluent Kafka Python and MSK: "metadata information unknown" HOT 1
- Message is 'stuck' when the network cable is unplugged
- adminClient describeConsumerGroups leads to python: rdkafka_queue.h:1052: rd_kafka_enq_once_del_source_return: Assertion `eonce->refcnt > 0' failed. HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from librdkafka.