hjespers / node-red-contrib-confluent Goto Github PK
View Code? Open in Web Editor NEWNode-Red modules for Apache Kafka publish/subscribe via Confluent REST Proxy
License: MIT License
Node-Red modules for Apache Kafka publish/subscribe via Confluent REST Proxy
License: MIT License
I create a inbound node, set my REST URL and always takes down my node-red
I am getting below error
[confluent] Error in our kafka input stream
{ Error
at Object. (/Users/abhishek.y.hingu/.node-red/node_modules/kafka-rest/lib/client.js:201:22)
at Module._compile (module.js:570:32)
at Object.Module._extensions..js (module.js:579:10)
at Module.load (module.js:487:32)
at tryModuleLoad (module.js:446:12)
at Function.Module._load (module.js:438:3)
at Module.require (module.js:497:17)
at require (internal/module.js:20:19)
at Object. (/Users/abhishek.y.hingu/.node-red/node_modules/kafka-rest/index.js:18:14)
at Module._compile (module.js:570:32)
at Object.Module._extensions..js (module.js:579:10)
at Module.load (module.js:487:32)
at tryModuleLoad (module.js:446:12)
at Function.Module._load (module.js:438:3)
at Module.require (module.js:497:17)
at require (internal/module.js:20:19)
name: 'APIError',
status: 500,
message: 'Internal Server Error',
data: { error_code: 500, message: 'Internal Server Error' } }
my node-red workflow
[{"id":"a25f37fe.658048","type":"debug","z":"7d647e6b.eab55","name":"","active":true,"console":"true","complete":"true","x":688,"y":408,"wires":[]},{"id":"910816c7.72b648","type":"confluent out","z":"7d647e6b.eab55","name":"","topic":"testp","key":"","partition":"","proxy":"4295c61d.b1aae8","x":636,"y":331,"wires":[[]]},{"id":"1ac8918b.37d99e","type":"inject","z":"7d647e6b.eab55","name":"","topic":"","payload":"","payloadType":"date","repeat":"1","crontab":"","once":true,"x":472,"y":345,"wires":[["910816c7.72b648"]]},{"id":"42ac37ac.30fea8","type":"confluent in","z":"7d647e6b.eab55","name":"","topic":"testp","cgroup":"node-red-confluent","autocommit":true,"proxy":"4295c61d.b1aae8","x":501,"y":399,"wires":[["a25f37fe.658048"]]},{"id":"4295c61d.b1aae8","type":"rest-proxy","z":"","proxy":"http://localhost:8082","clientid":""}]
I would like to add support for AVRO but the existing Confluent node.js wrapper on the REST Proxy has a bug that doesn't allow new schemas to be properly registered. I might be able to get this to work for schemas that are registered "out-of-band" though.
Both HTTP and HTTPS are supported by confluentinc/kafka-rest-node so I should add a checkbox for SSL/TLS encryption from the client to the REST Proxy.
enhance the existing metadata node to include broker lists, topic lists. and partition meta-data (all of which are supported by the confluent node.js wrapper in the REST Proxy.
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.