Comments (10)
有什么问题,可以在github上提
from jlogstash.
- Kafka10:
encoding: "utf-8"
codec: "plain"
topics: "yunyun"
groupId: "test2"
bootstrapServers: "...:9092"
consumerSettings: {zookeeper.connect: "...:2181",auto.commit.interval.ms: "1000",auto.offset.reset: "smallest"}
我使用这个配置去采集kafka的数据无法采集到,也没有任何报错,我在后台服务器是可以使用命令生产和消费的,能帮忙看下配置是否正确吗,kafka的版本的是1.0.0,由于隐私性,IP我用”*"代替了
from jlogstash.
另一个kafka的input插件采集成功了,但是二者的配置参数似乎有比较大的区别
from jlogstash.
input插件选择tcp,启动无报错,配置如下:
- Tcp:
codec: "plain"
prot: 52192
host: "127.0.0.1"
encoding: "utf8"
bufSize: 30
maxLineLength: 10
当我模拟往端口发送数据的时候一直提示那个连接失败,但是我用别的代码模拟tcp的server和client的时候能发送和接收数据,我是菜鸟,刚刚接触,可能问题比较多,希望不要被骂
from jlogstash.
Kafka10 这个参数配置后面会加下,现在的是kafka09版本的
from jlogstash.
你要是报错,发下报错信息,不让我没法给你排查问题
from jlogstash.
也就是说目前kafka10没办法消费,是么
from jlogstash.
kafka10 可以消费的,我是说github上的kafka配置说明是09版本的,现在已经加上kafka10的配置说明了
from jlogstash.
好的,谢谢,我改下配置看看是否能消费到
from jlogstash.
@yangsishu 请问配置文件中 OUTPUT 里面的 if 语句应该如何写?
from jlogstash.
Related Issues (20)
- Cannot run program "gpg.exe": CreateProcess error=2, The system cannot find the file specified HOT 5
- 找不到或无法加载主类 com.dtstack.jlogstash.JlogstashMain HOT 2
- jdbc配置多表
- jdbc的input插件中怎样配置增量读取?
- fileter的grok正则解析如何配置 HOT 1
- 启动脚本无法加载到log,不知道是哪里的错误,请帮忙看下 HOT 12
- 能否像logstash一样,多个配置文件自动合并,并在一个进程下启动 HOT 2
- 配置文件里边能写if判断语句么? HOT 1
- 高可用实现了吗?,数据分布式增量读取 HOT 2
- 反射input插件 kafka10时,报错 HOT 1
- 老哥 kafka10的pom里面jlogstash是不是打包时也去掉 HOT 1
- 关于日志滚动 HOT 1
- 老哥 代码是删除了吗? HOT 1
- 连接kafka10报错 jlogstash start error:null,启动不了 HOT 2
- jlogstash可以在k8s容器中运行吗?尝试过做成镜像在k8s上运行,遇到报Java heap space,但非容器正常。如果容器化部署,有相关的部署说明吗?谢谢 HOT 2
- 6.0.1版Jlogstash, 执行JlogstashMain不会触发filter grok规则。 HOT 3
- 对elasticsearch支持
- 配置文件的读取是需要解压处理吗
- outputs为es的时候,丢数据问题
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from jlogstash.