Giter VIP home page Giter VIP logo

dozer's Introduction

Data APIs, done right!

⚡️ Open-source platform to build, publish and manage blazing-fast real-time data APIs in minutes ⚡️

CI Coverage Status Docs Join on Discord License


Quick Start

Refer to our getting started and examples section for more details.

1) End-to-end hypercharge postgres example

docker-compose -f examples/1_hypercharge_postgres/docker-compose.yml up

2) Real time Ethereum stats example

Get a websocket url from one of the hosted eth node providers such as Infura and initialize the env variable ETH_WSS_URL.

# Intialize ETH Web Socker Url
export ETH_WSS_URL=<WSS_URL>

docker-compose -f examples/2_eth_stats_sample/docker-compose.yml up

Running Dozer CLI

To view list of commands

docker run -it \
  public.ecr.aws/k7k6x1d4/dozer \
  dozer -h

Run dozer as a single process with a local dozer-config.yaml

# `dozer-config.yaml` should be in your current directory.
docker run -it \
  -v "$PWD":/usr/dozer \
  -p 8080:8080 \
  -p 50051:50051 \
  public.ecr.aws/k7k6x1d4/dozer \
  dozer

Releases

We release dozer typically every 2 weeks and is available on our releases page. Currently we publish a binary for Ubuntu 20.04 and also as a docker container.

Please visit our issues section if you are having any trouble running the project.

Architecture

Architecture

  • Create blazing fast end to end APIs in minutes with a simple configuration.
  • Build and rapidly iterate on customer facing data apps.
  • Extend Dozer with custom connectors, operators and Api transformations using WASM.
  • Built in Rust with performance and extensibility in mind.

Read more about Dozer here

Features

  • Connect your sources
    • Import real time data from Postgres as CDC, Snowflake Table Stream etc.
    • Create your own connector using Rust
    • Automatic schema evolution and validation
  • Transform in REAL-TIME
    • Use SQL to perform joins, aggregations and filter operations in real time across sources.
    • Use it like an ORM; Map relational data to object entities using Dozer SQL extensions
    • Build custom functions for aggregation, selection etc. using WASM
  • Optimize for serving
    • Define indices with a simple configuration
    • Support for multiple indices such as Inverted, Full Text, Compound, Geo (Coming soon!) etc.
    • Apply filter and sort operations on cached data
    • Support for Push and Pull queries
  • Publish blazing fast APIs
    • gRPC and REST APIs automatically generated
    • Protobuf an Open API documentation
    • TypeSafe APIs
    • Realtime Streaming

Contributing

Please refer to Contributing for more details.

dozer's People

Contributors

chloeminkyung avatar chubei avatar dependabot[bot] avatar duonganhthu43 avatar karolisg avatar mediuminvader avatar snork-alt avatar tinnguyen71 avatar v3g42 avatar

Watchers

 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.