sirmr1001 / async-batcher Goto Github PK
View Code? Open in Web Editor NEWThis project forked from dacus1995/async-batcher
Small package that provides zero latency cost dynamic batching for ML model serving for async endpoints handlers.
License: MIT License