Giter VIP home page Giter VIP logo

swiple / swiple Goto Github PK

View Code? Open in Web Editor NEW
78.0 2.0 10.0 124 MB

Swiple enables you to easily observe, understand, validate and improve the quality of your data

Home Page: https://swiple.io

License: Other

Makefile 0.37% Dockerfile 0.37% Python 61.33% HTML 0.30% JavaScript 37.02% CSS 0.61%
data data-observability data-quality observability python validation fastapi data-profiling data-science data-analytics

swiple's Introduction

Maintenance Python 3.9 Slack

Welcome

Welcome to Swiple! 🚀

What is Swiple?

Swiple is an automated data monitoring platform that helps analytics and data engineering teams seamlessly monitor the quality of their data. With automated data analysis and profiling, scheduling and alerting, teams can resolve data quality issues before they impact mission critical resources.

Features

  • 📈 Measure the data quality of a SQL query, table, or view.
  • 🏗 Generate data expectations using Automated Data Profiling.
  • 🕑 Schedule validations to run on any recurrence interval.
  • 📄 Automated Data Docs
  • 🫡 Add Objectives / SLA's for your data.
  • 🔔 Get notified when the quality of your data changes.

Supported Databases

Authentication

  • Username/Password
  • OAuth
    • Github
    • Google
    • Microsoft
    • Okta

Notifications

  • Email
  • Slack
  • Microsoft Teams
  • OpsGenie
  • PagerDuty

Get started in 4 commands

Licensing

Source code in this repository is covered by the Elastic License 2.0.

swiple's People

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar

swiple's Issues

[Feature]: Support for multiple datastore for storing expectations and validation results.

Initial Checks

  • I have searched GitHub for a duplicate issue and I'm sure this is something new
  • I have searched Google & StackOverflow for a solution and couldn't find anything
  • I have read and followed the docs and the FAQ's and still think this is a bug
  • I am confident that the issue is with swiple and not my configuration in docker/.env or docker/.env-non-dev

Description

Need a feature to change expectation and validation store to GCS/BQ in swiple? I want to store my expectation in GCS and validation result in BQ. Feature should support different datastore for expectation and validation results.
slack link: https://swiple.slack.com/archives/C03U46W8L9L/p1673418448418559

If UI related, what browsers are you seeing the problem on?

No response

Relevant log output

No response

[Bug]: can’t access the website

Initial Checks

  • I have searched GitHub for a duplicate issue and I'm sure this is something new
  • I have searched Google & StackOverflow for a solution and couldn't find anything
  • I have read and followed the docs and the FAQ's and still think this is a bug
  • I am confident that the issue is with swiple and not my configuration in docker/.env or docker/.env-non-dev

Description

I installed Swiple via Docker on a remote computer, but I can’t access the website. The remote computer’s IP address is 192.168.123.88. When I try to access http://192.168.123.88:3000/ through the browser, I noticed that the browser is making a request to this endpoint http://127.0.0.1:8000/api/v1/user/me. I think this might be the reason for the issue. So, I searched for “8000” in the project folder and replaced it with “3001,” then executed “docker compose -f docker-compose-non-dev.yaml up.” However, it didn’t work, and it’s still trying to access http://127.0.0.1:8000/api/v1/user/me.

If UI related, what browsers are you seeing the problem on?

No response

Relevant log output

[root@172-16-0-175 swiple]# grep -rn 3001 . |grep -v backend/app/sample_data/data |grep -v  poetry.lock |grep 3001
./backend/app/settings.py:27:    SWIPLE_API_URL: AnyHttpUrl = Field(default="http://swiple_api:3001")
./backend/app/settings.py:30:    BACKEND_CORS_ORIGINS: List[AnyHttpUrl] = Field(default=["http://swiple_api:3001", "http://127.0.0.1:3000"])
./backend/Dockerfile:54:CMD ["uvicorn", "app.main:app", "--host", "0.0.0.0", "--port", "3001"]
./backend/main.py:5:    uvicorn.run("app.main:app", host="0.0.0.0", port=3001, reload=True, env_file="../docker/.env-local")
./docker/.env-local:2:SWIPLE_API_URL=http://192.168.123.88:3001
./docker/.env-local:4:BACKEND_CORS_ORIGINS=["http://127.0.0.1:3000", "http://192.168.123.88:3001", "http://192.168.123.88:3000"]
./docs/package.json:7:    "start": "docusaurus start --port 3001",
./docs/package.json:12:    "serve": "docusaurus serve --port 3001",
./frontend/.env.development:1:REACT_APP_API_DOMAIN=http://192.168.123.88:3001/api/v1
./frontend/.env.production:1:REACT_APP_API_DOMAIN=http://192.168.123.88:3001/api/v1
./docker-compose.yaml:19:    command: ["uvicorn", "app.main:app", "--host", "0.0.0.0", "--port", "3001", "--reload"]
./docker-compose.yaml:22:      - "3001:3001"
./docker-compose-non-dev.yaml:23:      - "3001:3001"

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.