Giter VIP home page Giter VIP logo

dqops / dqo Goto Github PK

View Code? Open in Web Editor NEW
55.0 5.0 12.0 73.37 MB

Data Quality and Observability platform for the whole data lifecycle, from profiling new data sources to full automation with Data Observability. Configure data quality checks from the UI or in YAML files, let DQOps run the data quality checks daily to detect data quality issues.

Home Page: https://dqops.com/docs/

License: Apache License 2.0

Python 18.30% Shell 0.06% Batchfile 0.05% HCL 0.01% Java 72.79% Jinja 4.09% Dockerfile 0.01% JavaScript 0.01% HTML 0.01% TypeScript 4.58% CSS 0.01% Handlebars 0.08%
data-ops data-quality data-quality-checks data-quality-measurement data-quality-monitoring data-quality-report monitoring data-observability data-profiling

dqo's People

Contributors

andreijanowski avatar documati avatar dqops avatar fibonafide avatar joankal avatar joanna-kalinowska-pg avatar lazarmiuchin avatar mackrack avatar mj426382 avatar nephasia avatar patrykjay-dsstream avatar pawel-duda avatar piotrczarnas avatar psychologianauki avatar radoslawnowak avatar rklimek123-dqo avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar

dqo's Issues

Able to host in our own GCP Org?

Looking at what you are offering here & think it's wonderful. Kudos for the level of detail & knowledge sharing put in across the board - not unnoticed!

I am Dir of Data Science & MLops with an org committed to automating & proactively responding to data incidents. We are a GCP, cloud-first group.

My question is, rather than joining DQOPS GCP resources, are we able to set up shop within our organization? Meaning not just the front end, but everything??

I haven't been able to find anything speaking to that on the resources you have share - but if that's a possibility I'd love to learn more.

I'm guessing the initial reaching is something like, it's not just one service or tool it's integrated widely across the board. Compute, messaging, hosting etc...which would be understandable certainly.

That said, this is what we do on a daily basis (manage massive data & provide that to customers end-to-end. I'm not worried about handing to /stand up, maintain & sustain on our own.

So if you could share a bit about what that would look like, or perhaps we could jump on a call to do the same.

Appreciate it! ๐Ÿ”ฅ

Error adding MS SQL SERVER

Command failed, error message: Cannot invoke "com.dqops.connectors.sqlserver.SqlServerAuthenticationMode.toString()" because "cloned.authenticationMode" is null

Please enter one of the [] values: 10
SQL Server host name (--sqlserver-host) [${SQLSERVER_HOST}]: 00000
SQL Server port number (--sqlserver-port) [${SQLSERVER_PORT}]: 1433
SQL Server database name (--sqlserver-database) [${SQLSERVER_DATABASE}]: mydatabase
SQL Server user name (--sqlserver-user) [${SQLSERVER_USER}]: myuser
SQL Server user password (--sqlserver-password) [${SQLSERVER_PASSWORD}]: mypassword
Disable SSL encryption (--sqlserver-disable-encryption) [y,N]: Y
Connection CIGAM was successfully added.
Run 'table import -c=mydatabase' to import tables.
dqo> table import -c=mydatabase
Command failed, error message: Cannot invoke "com.dqops.connectors.sqlserver.SqlServerAuthenticationMode.toString()" because "cloned.authenticationMode" is null
dqo>

Error trying to add DQOps connection to DuckDB using the CLI

dqo> connection add --duckdb-directories=<"path"="/folder1/subfolder2/my-salesforce-pipeline">

Command failed, error message: Cannot invoke "com.dqops.cli.terminal.TerminalFactory.getReader()" because "this.terminalFactory" is null

Not sure what the proper syntax for the console command.

I tried to do a similar thing using the Web interface and got this error:

com.zaxxer.hikari.pool.HikariPool$PoolInitializationException: Failed to initialize pool: Invalid Input Error: Unrecognized configuration property "path"

Thanks.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.