rustui / ort Goto Github PK

---

ort is an (unofficial) ONNX Runtime 1.16 wrapper for Rust based on the now inactive onnxruntime-rs. ONNX Runtime accelerates ML inference on both CPU & GPU.

• Guide
• API reference
• Examples
• Migrating from v1.x to v2.0

• Discord: #💬｜ort-discussions
• GitHub Discussions
• Email

_{Open a PR to add your project here 🌟}

• Twitter uses ort to serve homepage recommendations to hundreds of millions of users.
• Bloop uses ort to power their semantic code search feature.
• pyke Diffusers uses ort for efficient Stable Diffusion image generation on both CPUs & GPUs.
• edge-transformers uses ort for accelerated transformer model inference at the edge.
• Ortex uses ort for safe ONNX Runtime bindings in Elixir.