Topic: data-catalog Goto Github

Some thing interesting about data-catalog

👇 Here are 98 public repositories matching this topic...

aaronspring / remote_climate_data

data-catalog,a collection of remote climate data accessed via intake cached to disk

User: aaronspring

data-catalog shapefiles accessibility netcdf thredds-catalogs opendap observations climate-science climate-data remote

amundsen-io / amundsen

data-catalog,Amundsen is a metadata driven application for improving the productivity of data analysts, data scientists and engineers when interacting with data.

Organization: amundsen-io

Home Page: https://www.amundsen.io/amundsen/

amundsen data-catalog data-discovery linuxfoundation metadata

apache / gravitino

data-catalog,World's most powerful open data catalog for building a high-performance, geo-distributed and federated metadata lake.

Organization: apache

Home Page: https://gravitino.apache.org

datalake lakehouse metadata federated-query stratosphere metalake skycomputing data-catalog ai-catalog model-catalog

apecs-org / polar-eo-database

data-catalog,Polar Earth Observation Database of satellite sensors

Organization: apecs-org

remote-sensing earth-observation satellite data-catalog antarctica arctic high-mountain-asia open-science

awesome-mlops / awesome-data-management

data-catalog,A curated list of awesome open source tools and commercial products to catalog, version, and manage data 🚀

Organization: awesome-mlops

awesome awesome-list data-management dataops dataops-platform dataops-principles data-catalog data-centric-ai data-lifecycle data-management-platform

aws-samples / aws-dbs-refarch-datalake

data-catalog,Reference Architectures for Datalakes on AWS

Organization: aws-samples

data-lake data-analytics amazon-emr ingest-data emr-cluster glue hive-metastore data-catalog data-transformation

bayer-group / colid-data-marketplace-frontend

data-catalog,The Data Marketplace frontend repository is part of the Corporate Linked Data Catalog - short: COLID - application. Users can search for registered resources in COLID. It provides a search bar, aggregation filters and search result displaying including term highlighting.

Organization: bayer-group

Home Page: https://bayer-group.github.io/COLID-Documentation/

colid data-catalog data-catalogue linked-data rdf shacl fair fair-data findable elasticsearch

bayer-group / colid-documentation

data-catalog,The documentation repository is part of the Corporate Linked Data Catalog - short: COLID - application.

Organization: bayer-group

Home Page: https://bayer-group.github.io/COLID-Documentation/

colid data-catalogue data-catalog linked-data rdf shacl fair fair-data findable elasticsearch

bayer-group / colid-setup

data-catalog,The setup repository is part of the Corporate Linked Data Catalog - short: COLID - application. It helps setting up a local environment based on Docker Compose.

Organization: bayer-group

Home Page: https://bayer-group.github.io/COLID-Documentation/

colid data-catalog data-catalogue linked-data rdf shacl fair fair-data findable elasticsearch

cafincubator / midden

data-catalog,A research metadata catalog and metadata editor that integrates into common workflows used in academic research.

Organization: cafincubator

data data-management data-science research data-catalog metadata research-data-management academic

carte-data / carte

data-catalog,A Python library to generate static data catalog sites. Carte scrapes metadata from your data assets and generates a fully searchable front end that's just HTML.

Organization: carte-data

Home Page: https://docs.cartedata.com

data-catalog data-discovery data-documentation carte lightweight-data-catalogs python-library

cdcgov / cdh-lava-react

data-catalog,CDC Data Hub Lifecycle, Analysis & Visualization Accelerator (LAVA) REACT Components based on machine readable requirements.

Organization: cdcgov

sql databricks metadata security devops data-science azure test-automation data-visualization pyspark

commondataio / dataportals-registry

data-catalog,Registry of data portals, catalogs, data repositories including data catalogs dataset and catalog description standard

Organization: commondataio

Home Page: https://registry.commondata.io

data-catalog data-portal data-repository datasets registry data-discovery opendata dataset open-data

darenasc / aeda

data-catalog,Build a data catalog by running a single line of code

User: darenasc

data-exploration eda database data-catalog metadata metadata-extraction

datahub-project / datahub

data-catalog,The Metadata Platform for your Data Stack

Organization: datahub-project

Home Page: https://datahubproject.io

metadata linkedin datahub data-catalog data-discovery hacktoberfest

datopian / portal.js.bak

data-catalog,🌀 The JS data presentation framework. For a single dataset to a full catalog.

Organization: datopian

Home Page: https://portal-78qurbwf9-datopian1.vercel.app/

data-portal-frontends data-portal data-catalog ckan data-presentation

dbt-content / google-datacatalog-dbt-tag

data-catalog,Update a Google Data Catalog tag with dbt Cloud run metadata

User: dbt-content

Home Page: https://www.getdbt.com

dbt google-cloud data-catalog tag google-datacatalog dbtcloud

finraos / herd-mdl

data-catalog,Herd-MDL, a turnkey managed data lake in the cloud. See https://finraos.github.io/herd-mdl/ for more information.

Organization: finraos

mdl data-lake data-catalog

gabledata / recap

data-catalog,Work with your web service, database, and streaming schemas in a single format.

Organization: gabledata

Home Page: https://recap.build

data-catalog data-discovery data-engineering data-integration data-pipelines etl metadata recap

getmetamapper / metamapper

data-catalog,Metamapper is a data discovery and documentation platform for improving how teams understand and interact with their data.

Organization: getmetamapper

Home Page: https://www.metamapper.io

data-catalog data-curation data-discovery data-warehouse django metadata metamapper python schema-inspection

getstrm / pace

data-catalog,Data policy IN, dynamic view OUT: PACE is the Policy As Code Engine. It helps you to programatically create and apply a data policy to a processing platform like Databricks, Snowflake or BigQuery (or plain 'ol Postgres, even!) with definitions imported from Collibra, Datahub, ODD and the like.

Organization: getstrm

Home Page: https://pace.getstrm.com

data-catalog data-processing policy-enforcement bigquery data-contracts data-governance databricks snowflake

google / grizzly

data-catalog,End-to-end DataOps platform deployed by Terraform.

Organization: google

dataops dataops-platform gcp terraform airflow bigquery cloud-storage composer data-catalog data-loss-prevention

googlecloudplatform / bigquery-data-lineage

data-catalog,Reference implementation for real-time Data Lineage tracking for BigQuery using Audit Logs, ZetaSQL and Dataflow.

Organization: googlecloudplatform

Home Page: https://cloud.google.com/blog/products/data-analytics/architecting-a-data-lineage-system-for-bigquery

data-lineage bigdata bigquery zetasql dataflow data-governance data-management data-catalog

googlecloudplatform / datacatalog-connectors-bi

data-catalog,Sample code with integration between Data Catalog and BI data sources.

Organization: googlecloudplatform

python gcp metadata-management metadata datacatalog looker looker-sdk tableau qlik qlik-sense

googlecloudplatform / datacatalog-connectors-rdbms

data-catalog,Sample code with integration between Data Catalog and RDBMS data sources.

Organization: googlecloudplatform

python rdbms database-management metadata-management metadata-extraction gcp datacatalog sqlserver postgresql mysql

googlecloudplatform / datacatalog-tag-engine

data-catalog,Tag Engine automates the process of creating, updating, deleting, and populating metadata in bulk with the Google Cloud services Data Catalog and Dataplex. Tag Engine is licensed under the Apache 2 license terms. Please make sure to read, understand and agree to the terms of the LICENSE and CONTRIBUTING files before proceeding.

Organization: googlecloudplatform

bigquery data-catalog cloud-storage firestore cloud-run dataplex

googlecloudplatform / datacatalog-tag-history

data-catalog,Historical metadata of your data warehouse is a treasure trove to discover not just insights about changing data patterns, but also quality and user behaviour. This solution creates Data Catalog Tags history in BigQuery since Data Catalog keeps only the latest version of metadata for fast searchability.

Organization: googlecloudplatform

Home Page: https://cloud.google.com/community/tutorials/datacatalog-tag-history

data-governance metadata-management analytics data-catalog bigquery

guinsoolab / darkseal

data-catalog,A Single place to Discover, Collaborate, and Get your data right

Organization: guinsoolab

Home Page: https://guinsoolab.github.io/glab/#/app/darkseal

metadata catalog data-catalog data-discovery data-platform data-structures metadata-management metadata-standard guinsoolab data-documentation

ihsn / nada

data-catalog,National Data Archive (NADA) is an open source data cataloging system that serves as a portal for researchers to browse, search, compare, apply for access, and download relevant census or survey information. It was originally developed to support the establishment of national survey data archives.

Organization: ihsn

Home Page: http://nada.ihsn.org

data-catalog data-catalog-management data-catalog-backend data-portal data catalog catalogue nada data-documentation-initiative ddi-codebook

intake / intake

data-catalog,Intake is a lightweight package for finding, investigating, loading and disseminating data.

Organization: intake

Home Page: https://intake.readthedocs.io/

data-access data-catalog python

intake / intake-esm

data-catalog,An intake plugin for parsing an Earth System Model (ESM) catalog and loading assets into xarray datasets.

Organization: intake

Home Page: https://intake-esm.readthedocs.io

cmip6 data-catalog pangeo earth-system-model data-access intake climate-datasets cesm-lens hacktoberfest

liambindle / bashdatacatalog

data-catalog,A simple portable file cataloging tool for bash

User: liambindle

data-catalog bash geos-chem gchp big-data

nasa / data-nasa-gov-frontpage

data-catalog,a frontpage for data.nasa.gov

Organization: nasa

Home Page: https://nasa.github.io/data-nasa-gov-frontpage/

data-visualization data-catalog treemap datasets nasa frontpage metadata open-data gov-tech gov

ncar / esm-collection-spec

data-catalog,Earth System Model Collection specification

Organization: ncar

esm-catalog-specification intake-esm xdev data-catalog

odpi / egeria-docs

data-catalog,Documentation repository for the Egeria project.

Organization: odpi

Home Page: https://egeria-project.org

egeria documentation metadata open-source open-metadata metadata-management metadata-extraction metadata-api metadata-editor metadata-parser

open-metadata / openmetadata

data-catalog,OpenMetadata is a unified metadata platform for data discovery, data observability, and data governance powered by a central metadata repository, in-depth column level lineage, and seamless team collaboration.

Organization: open-metadata

Home Page: https://open-metadata.org

metadata datadiscovery data-science dataquality data-profiling metadata-management dataengineering data-catalog data-observability dbt

open-metadata / openmetadata-site

data-catalog,Open Standard for Metadata. A Single place to Discover, Collaborate and Get your data right.

Organization: open-metadata

Home Page: https://open-metadata.org

automation bigdata bigdataanalytics data-catalog data-discovery data-observability data-profiling data-quality-monitoring data-science datadiscovery

opendatadiscovery / awesome-data-catalogs

data-catalog,📙 Awesome Data Catalogs and Observability Platforms.

Organization: opendatadiscovery

awesome awesome-list big-data data-catalog data-discovery data-engineering data-quality datacatalog datadiscovery dataops metadata metadata-management ml observability open-source opendata opensource oss

opendatadiscovery / odd-collector

data-catalog,Open-source metadata collector based on ODD Specification

Organization: opendatadiscovery

data-catalog data-discovery data-governance data-observability data-piplines data-platform data-profiling datacatalog hacktoberfest lineage

opendatadiscovery / odd-platform

data-catalog,First open-source data discovery and observability platform. We make a life for data practitioners easy so you can focus on your business.

Organization: opendatadiscovery

Home Page: https://opendatadiscovery.org

alerting bigdata data-catalog data-discovery data-engineering data-exploration data-governance data-lineage data-observability data-pipelines data-platform data-profiling data-quality data-science datacatalog lineage metadata metadata-management observability oss

raystack / meteor

data-catalog,Meteor is an easy-to-use, plugin-driven metadata collection framework to extract data from different sources and sink to any data catalog.

Organization: raystack

Home Page: https://raystack.github.io/meteor/

metadata collector scraper extractors sinks bigdata data-catalog data-management dataops