wuchong / my-flink-project Goto Github PK

View Code? Open in Web Editor NEW

270.0 21.0 184.0 5.57 MB

Java 100.00%

my-flink-project's Introduction

本项目主要用于我最近写的几篇《Flink 入门》系列文章的示例工程代码。并不是直接生产可用的代码。

如果你对《Flink 入门》系列比较感兴趣，欢迎关注我的博客：http://wuchong.me/tags/Flink入门/

也可以关注我的个人微信公众号：

my-flink-project's People

Contributors

Stargazers

Watchers

Forkers

chakra-coder yaoqi aaronli008 luochenxi lybigdata xhcom-ui lanbaby ye-lun yoreyuan xiangtao guozhao-github feiniaoyuyu gtfd333 whitespur zzmlover rogerhuangzb gitcyy baiweiguo zhilangtaosha mwd1992 skyformat99 fish008eb vosix husttb gzush foreverbaby jaslou yelijun ideepthink lccbiluox2 xiaoxiong2060 lifei128 jsnorman andery119 fbyan maodeng8888 runfreely imperio-wxm markzhou537 foreverl tonylincon alexguo88 lyle-liang ligeng33200 yezonggang andyzju temperrain zhengqiangtan chenxingqiang ren645263 sundy20 tianxiaasa sunnerrr aigod fanchou pengdaolong zl03 chengjianhit chenboeason org-flink wanghuidev junyong-tsui kingrocy dhzy0425 jjmei whqcfp xufuzhou1201 quanoc qenvelope wentaob nodephp shanghai-jerry dingfan-df jakesd chinarefers xuxinpie wolongdedami wuwenxu ljwkevin simplechen laphilee shitao0713 feelever fengfuli caserwin josh0yeh finnxu yan-yunfeng lianxiaobao juneman wanqiufeng hjsw1 aquarius-wing liyinchao yunlingfly jiandan1996 li24361 izheng waterbeach huang-shuxing

my-flink-project's Issues

请问方便把csv文件发一份么？平台上没有了

POJO type error

See the following error while running the sample TopNItems application:

imestampedFileInputSplit cannot be used as a POJO type because not all fields are valid POJO fields, and must be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization"

为什么不来一版scala的。

商品数量比较大超过Int32 怎么办？

首先很感谢你写的教程和示范代码！
在HotItems.java中line134，allItems是一个Java List，如果ListState状态中存的商品数目比较大超过Int32时怎么办呢？

在HotItems.java中当点击数量总数少于topSize时，会报数据越界错误

在HotItems.java中当点击数量总数少于topSize时，会报数据越界错误
在模拟数据中，当一段时间内的点击数量只有1条，设置的topSize为3时
ItemViewCount currentItem = allItems.get(i); 会数组越界

Caused by: java.lang.IndexOutOfBoundsException: Index: 1, Size: 1
	at java.util.ArrayList.rangeCheck(ArrayList.java:657)
	at java.util.ArrayList.get(ArrayList.java:433)
	at com.app.java.myflink.HotItems$TopNHotItems.onTimer(HotItems.java:140)
	at org.apache.flink.streaming.api.operators.KeyedProcessOperator.invokeUserFunction(KeyedProcessOperator.java:94)
	at org.apache.flink.streaming.api.operators.KeyedProcessOperator.onEventTime(KeyedProcessOperator.java:72)
	at org.apache.flink.streaming.api.operators.InternalTimerServiceImpl.advanceWatermark(InternalTimerServiceImpl.java:251)
	at org.apache.flink.streaming.api.operators.InternalTimeServiceManager.advanceWatermark(InternalTimeServiceManager.java:128)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.processWatermark(AbstractStreamOperator.java:746)
	at org.apache.flink.streaming.runtime.io.StreamInputProcessor$ForwardingValveOutputHandler.handleWatermark(StreamInputProcessor.java:262)
	... 7 more

我尝试做了如下修改

for (int i=0; i<allItems.size() && i < topSize; i++)

将该程序打包提交JOB到flink web时，报org.apache.flink.client.program.ProgramInvocationException: The program plan could not be fetched - the program aborted pre-maturely

错误描述：经过排查，是在获取执行计划json生成streamgraph出错

出错原因：网上查找资料猜测可能是发生在TimSort排序算法，意思就是比较方法违反约束，传送门

wuchong / my-flink-project Goto Github PK

my-flink-project's Introduction

my-flink-project's People

Contributors

Stargazers

Watchers

Forkers

my-flink-project's Issues

请问方便把csv文件发一份么？平台上没有了

POJO type error

为什么不来一版scala的。

商品数量比较大超过Int32 怎么办？

在HotItems.java中当点击数量总数少于topSize时，会报数据越界错误

将该程序打包提交JOB到flink web时，报org.apache.flink.client.program.ProgramInvocationException: The program plan could not be fetched - the program aborted pre-maturely

Recommend Projects

React

Vue.js

Typescript

TensorFlow

Django

Laravel

D3

Recommend Topics

javascript

web

server

Machine learning

Visualization

Game

Recommend Org

Facebook

Microsoft

Google

Alibaba

D3

Tencent