Giter VIP home page Giter VIP logo

leek's Introduction

##Leek — 韭菜的自我救赎

Leek是一款基于分布式的简易版智能实时选股系统,计算能力超强,代码量极少。

####基于(Flume+KafKa+JStorm+Esper+MySQL)

  • 分布式架构、可自由调节计算能力。
  • Flume 实时日志数据提取。
  • KafKa 连接 Flume 和 JStorm,用于消息数据中转。
  • JStorm + Esper 分布式实时数据处理。
  • MySQL 保存数据筛选结果。

####目前实现了几种简单的策略:

  • 大单卖(stock-stategy-1): 选出股票的卖5档总手数大于买5档口总手数100倍时的股票;
  • 大单买(stock-stategy-2): 选出股票的买5档总手数大于卖5档口总手数100倍时的股票;
  • 放巨量(stock-stategy-3): 选出在10秒内成交量超过1000万时的股票;

####相关部署

####架构图: ####Storm计算节点: ####Esper计算模型:

leek's People

Contributors

wesleychuforever avatar wosyingjun avatar zhuwenb avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

leek's Issues

本地运行jstorm2.1.1 任务均报这个错 Attempting to call unbound fn: #'carbonite.api/register-serializers

com.twitter carbonite 1.4.0 com.esotericsoftware.kryo kryo 2.21 com.esotericsoftware.minlog minlog

18:21:53.021 [EventManagerImp] ERROR c.a.j.d.supervisor.SyncProcessEvent - Failed Sync Process
java.lang.RuntimeException: java.lang.IllegalStateException: Attempting to call unbound fn: #'carbonite.api/register-serializers
at backtype.storm.serialization.SerializationFactory.getKryo(SerializationFactory.java:75) ~[classes/:na]
at backtype.storm.serialization.KryoValuesDeserializer.(KryoValuesDeserializer.java:33) ~[classes/:na]
at backtype.storm.serialization.KryoTupleDeserializer.(KryoTupleDeserializer.java:52) ~[classes/:na]
at com.alibaba.jstorm.daemon.worker.WorkerData.updateKryoSerializer(WorkerData.java:420) ~[classes/:na]
at com.alibaba.jstorm.daemon.worker.WorkerData.(WorkerData.java:376) ~[classes/:na]
at com.alibaba.jstorm.daemon.worker.Worker.(Worker.java:67) ~[classes/:na]
at com.alibaba.jstorm.daemon.worker.Worker.mk_worker(Worker.java:248) ~[classes/:na]
at com.alibaba.jstorm.daemon.supervisor.SyncProcessEvent.launchWorker(SyncProcessEvent.java:440) ~[classes/:na]
at com.alibaba.jstorm.daemon.supervisor.SyncProcessEvent.startNewWorkers(SyncProcessEvent.java:987) ~[classes/:na]
at com.alibaba.jstorm.daemon.supervisor.SyncProcessEvent.run(SyncProcessEvent.java:182) ~[classes/:na]
at com.alibaba.jstorm.daemon.supervisor.SyncSupervisorEvent.run(SyncSupervisorEvent.java:191) ~[classes/:na]
at com.alibaba.jstorm.event.EventManagerImp.run(EventManagerImp.java:71) ~[classes/:na]
at com.alibaba.jstorm.callback.AsyncLoopRunnable.run(AsyncLoopRunnable.java:95) ~[classes/:na]
at java.lang.Thread.run(Thread.java:724) ~[na:1.7.0_25]
Caused by: java.lang.IllegalStateException: Attempting to call unbound fn: #'carbonite.api/register-serializers
at clojure.lang.Var$Unbound.throwArity(Var.java:43) ~[clojure-1.6.0.jar:na]
at clojure.lang.AFn.invoke(AFn.java:36) ~[clojure-1.6.0.jar:na]
at clojure.lang.Var.invoke(Var.java:383) ~[clojure-1.6.0.jar:na]
at carbonite.JavaBridge.registerPrimitives(JavaBridge.java:43) ~[carbonite-1.4.0.jar:na]
at backtype.storm.serialization.SerializationFactory.getKryo(SerializationFactory.java:72) ~[classes/:na]
... 13 common frames omitted
本地运行jstorm2.1.1 任务均报这个错
目前怀疑是这两个jar版本不兼容 ,有碰到过类似的问题请指点下啊

分析的数据来源是?

HI, 看到Flume里面的配置只是stock.log,没看到其他说明。能不能介绍下数据来源,以及如何在一个新环境中搭建配置起来?

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.