jiafuzha Goto Github PK

ata-cms

daal

Intel® oneAPI Data Analytics Library (oneDAL)

daos

DAOS Storage Engine

daos-java-new-api

daos-shuffle

Spark Shuffle Manager Based on DAOS

dask-yarn

Deploy dask on YARN clusters

e2eaiok

Intel® End-to-End AI Optimization Kit

hadoop

Apache Hadoop

hibench

HiBench is a big data benchmark suite.

hpnl

High Performance Network Library for RDMA

incubator-uniffle

Uniffle is a high performance, general purpose Remote Shuffle Service.

incubator-uniffle-website

Apache Uniffle (Incubating) Website

intel-extension-for-transformers

Extending Hugging Face transformers APIs for Transformer-based models and improve the productivity of inference deployment. With extremely compressed models, the toolkit can greatly improve the inference efficiency on Intel platforms.

jlse-ml

llm-on-ray

Pretrain, finetune and serve LLMs on Intel platforms with Ray

llmass_cicd

neural-speed

An innovative library for efficient LLM inference via low-bit quantization

oap

Optimized Analytics Package for Spark Platform

oap-mllib

Optimized Spark package to accelerate machine learning algorithms in Apache Spark MLlib.

primer

Source code of C++ Primer 4th ed

ray

Ray is a unified framework for scaling AI and Python applications. Ray consists of a core distributed runtime and a toolkit of libraries (Ray AIR) for accelerating ML workloads.

ray-yarn

ray on yarn

raydp

RayDP provides simple APIs for running Spark on Ray and integrating Spark with AI libraries.

remote-shuffle

Spark* shuffle plugin for support shuffling data through a remote Hadoop-compatible file system, as opposed to vanilla Spark's local-disks.

rpcloganalysis

analyze logs collected from spark app's execution

scikit-learn_bench

scikit-learn_bench benchmarks various implementations of machine learning algorithms across data analytics frameworks. It currently support the scikit-learn, DAAL4PY, cuML, and XGBoost frameworks for commonly used machine learning algorithms.

spark

Apache Spark

spark-daos-job

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs