Giter VIP home page Giter VIP logo

koala's Introduction

koala

人生如戏,全凭演技

Parameters

  • KOALA_INBOUND_ADDR: ip:port, the address inbound server will bind to
  • KOALA_SUT_ADDR: ip:port, the address inbound will call
  • KOALA_OUTBOUND_ADDR: ip:port, the address all outgoing traffic will be redirected to
  • KOALA_LOG_FILE: STDOUT/STDERR/filepath, if using filepath, the log will rotate every hour
  • KOALA_LOG_LEVEL: TRACE/DEBUG/INFO/ERROR/FATAL

Build tags

  • koala_go: for go application compiled with koala-go
  • koala_replayer: enable replaying mode
  • koala_recorder: enable recording mode

koala_replayer and koala_recorder can be enabled at the same time, to benchmark recording with replaying.

Recording

recording

  • intercept tcp send/recv
  • associate send/recv data to same thread id as "session"
  • request => response => request, so we can know when a "talk" (with request/response pair) is complete
  • use udp 127.127.127.127:127 to inform recorder with helper information.
  • for "system under test" using thread multiplexing (one thread doing more than one thing), map real thread id to virtual thread id by helper information.

Replaying

replaying

replaying builds on same mechanism, but much more complex

  • "system under test" is a process, "replayer inbound server" and "replayer outbound server" lives in same process. They are two tcp servers started by the .so loaded via LD_PRELOAD.
  • session to replay is injected into the process via "replayer inbound server" tcp connection
  • "replayer inbound server" call the "system under test" via tcp connection, store the "session id <=> inbound socket" mapping.
  • "system under test" call external dependencies, which is intercepted to "replayer outbound server", store the "inbound socket <=> outbound socket" mapping
  • "replayer outbound server" use its own socket to lookup the mapping, to find which session to replay

Gateways

koala support two modes by different gateways (https://github.com/v2pro/koala/tree/master/gateway)

gateway

Real World Scenarios

  • Long Connection: reusing connection sequentially is not a issue, just update the mapping
  • Multiplexing: one thread handing multiple business processes at the same time, need "helper information"
  • One Way Communication: request without response, need "helper information" to cut two requests out
  • Greeting: protocol like mysql send greeting before request. use the ip:port or just guess, to decide if greeting is needed.

koala's People

Contributors

taowen avatar lnhote avatar qiaodandedidi avatar

Watchers

James Cloos avatar  avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.