garyli1019 Goto Github PK

adv-object-tracking

airbyte

Airbyte is an open-source EL(T) platform that helps you replicate your data in your warehouses, lakes and databases.

arrow

Apache Arrow is a cross-language development platform for in-memory data. It specifies a standardized language-independent columnar memory format for flat and hierarchical data, organized for efficient analytic operations on modern hardware. It also provides computational libraries and zero-copy streaming messaging and interprocess communication. Languages currently supported include C, C++, Java, JavaScript, Python, and Ruby.

bitsail

BitSail is a distributed, high-performance data integration framework and both support streaming and batch mode. At present, BitSail is mainly designed with the ELT model, which have EB data size and use for Bytedance。

candle

Minimalist ML framework for Rust

carnd-advanced-lane-lines

carnd-behavioral-cloning

carnd-traffic-sign-classifier

Udacity self-driving car nano degree term1 German traffic sign classifier project

carnd-vehicle_detection

data-juicer

A one-stop data processing system to make data higher-quality, juicier, and more digestible for LLMs! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷为大语言模型提供更高质量、更丰富、更易”消化“的数据！

datasets

🤗 The largest hub of ready-to-use datasets for ML models with fast, easy-to-use and efficient data manipulation tools

dbt-core

dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications.

debezium

Change data capture for a variety of databases. Please log issues at https://issues.redhat.com/browse/DBZ.

delta

This connector allows Apache Spark™ to read from and write to Delta Lake.

delta-rs

A native Rust library for Delta Lake, with bindings into Python

doris

Apache Doris is an easy-to-use, high performance and unified analytics database.

flink

Apache Flink

flink-cdc-connectors

CDC Connectors for Apache Flink®

hf-hub

Rust client for the huggingface hub aiming for minimal subset of features over `huggingface-hub` python package

hyperspace

An open source indexing subsystem that brings index-based query acceleration to Apache Spark™ and big data workloads.

impala

Apache Impala

incubator-hudi

Upserts And Incremental Processing on Big Data

kafka-connect-hdfs

Kafka Connect HDFS connector

lance

Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, with more integrations coming..

lancedb

Developer-friendly, serverless vector database for AI applications. Easily add long-term memory to your LLM apps!

opencv_surf

parquet-mr

Apache Parquet

pointnet-keras

Keras implementation for Pointnet

presto

The official home of the Presto distributed SQL query engine for big data

pulsar

Apache Pulsar - distributed pub-sub messaging system