mjkong / jetstream Goto Github PK
View Code? Open in Web Editor NEWThis project forked from google/jetstream
JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs welcome).
License: Apache License 2.0