Giter VIP home page Giter VIP logo

rohankumardubey / stencil Goto Github PK

View Code? Open in Web Editor NEW

This project forked from raystack/stencil

0.0 0.0 0.0 5.09 MB

Stencil is a schema registry that provides schema management and validation dynamically, efficiently, and reliably to ensure data compatibility across applications.

Home Page: https://odpf.github.io/stencil/

License: Apache License 2.0

JavaScript 6.79% Java 16.15% Clojure 6.44% Go 68.84% TypeScript 0.85% CSS 0.14% Makefile 0.52% HTML 0.22% Dockerfile 0.06%

stencil's Introduction

Stencil

Test Release License Version

Stencil is a schema registry that provides schema mangement and validation to ensure data compatibility across applications. It enables developers to create, manage and consume schemas dynamically, efficiently, and reliably, and provides a simple way to validate data against those schemas. Stencil support multiple formats including Protobuf, Avro and JSON.

Key Features

Discover why users choose Stencil as their main schema registry

  • Version history Stencil stores versioned history of proto descriptor file on specified namespace and name
  • Backward compatibility enforce backward compatibility check on upload by default
  • Flexbility ability to skip some of the backward compatibility checks while upload
  • Descriptor fetch ability to download proto descriptor files
  • Metadata provides metadata API to retrieve latest version number given a name and namespace
  • Clients in multiple languages Stencil provides clients in GO, Java, JS languages to interact with Stencil server and deserialize messages using dynamic schema

Documentation

Explore the following resources to get started with Stencil:

  • Documentation provides guidance on using stencil.
  • Server provides details on getting started with stencil server.
  • Clients provides reference to supported stencil clients.

Installation

Install Stencil on macOS, Windows, Linux, OpenBSD, FreeBSD, and on any machine.

Binary (Cross-platform)

Download the appropriate version for your platform from releases page. Once downloaded, the binary can be run from anywhere. You don’t need to install it into a global location. This works well for shared hosts and other systems where you don’t have a privileged account. Ideally, you should install it somewhere in your PATH for easy use. /usr/local/bin is the most probable location.

MacOS

stencil is available via a Homebrew Tap, and as downloadable binary from the releases page:

brew install odpf/tap/stencil

To upgrade to the latest version:

brew upgrade stencil

Linux

stencil is available as downloadable binaries from the releases page. Download the .deb or .rpm from the releases page and install with sudo dpkg -i and sudo rpm -i respectively.

Windows

stencil is available via scoop, and as a downloadable binary from the releases page:

scoop bucket add stencil https://github.com/odpf/scoop-bucket.git

To upgrade to the latest version:

scoop update stencil

Docker

We provide ready to use Docker container images. To pull the latest image:

docker pull odpf/stencil:latest

To pull a specific version:

docker pull odpf/stencil:v0.3.3

Usage

Stencil has three major components. Server, CLI and clients. Stencil server and CLI are bundled in a single binary.

Server

Stencil server provides a way to store and fetch schemas and enforce compatibility rules. Run stencil server --help to see instructions to manage Stencil server.

Stencil server also provides a fully-featured GRPC and HTTP API to interact with Stencil server. Both APIs adheres to a set of standards that are rigidly followed. Please refer to proton for GRPC API definitions.

CLI

Stencil CLI allows users to iteract with server to create, view, and search schemas. CLI is fully featured but simple to use, even for those who have very limited experience working from the command line. Run stencil --help to see list of all available commands and instructions to use.

Clients

Stencil clients allows application to interact with stencil server to eserialize and deserialize messages using schema. Stencil supports clients in multiple languages.

Running locally

Dependencies:
- Git
- Go 1.16 or above
- Yarn (Needed for UI)
- PostgreSQL 13 or above
# Clone the repo
$ git clone [email protected]:odpf/stencil.git

# Check all build comamnds available
$ make help

# Build meteor binary file
$ make build

# Init server config
$ cp config/config.yaml config.yaml

# Run database migrations
$ ./stencil server migrate

# Start stencil server
$ ./stencil server start

Running tests

# Running all unit tests
$ make test

# Print code coverage
$ make coverage

Contribute

Development of Stencil happens in the open on GitHub, and we are grateful to the community for contributing bugfixes and improvements. Read below to learn how you can take part in improving stencil.

Read our contributing guide to learn about our development process, how to propose bugfixes and improvements, and how to build and test your changes to stencil.

To help you get your feet wet and get you familiar with our contribution process, we have a list of good first issues that contain bugs which have a relatively limited scope. This is a great place to get started.

This project exists thanks to all the contributors.

stencil's People

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.