Comments (9)
@fbbradheintz : We agreed to document this and the documentation is available in master branch :
https://github.com/pytorch/serve/blob/master/docs/default_handlers.md
from serve.
Sample input to induce failure
from serve.
@fbbradheintz @mycpuorg : The pre-processing and post-processing for the default image classification handler is implemented for torchvision's imagenet based models like densenet, resnet etc. Thus we use the standard normalization for imagenet models which is based on RGB images.
We expect the user to implement a custom handler for other image-classification models, for e.g. MNIST digit classifier or other models which are not trained using imagenet dataset, which uses different normalization parameters. We will add a documentation describing the expected input and output of all default handlers.
E.g :
- default image_classifer expects a RGB image file as input and returns the probability of top 5 results
- default text_classifier expects a text file as input and returns the classification of the text.
from serve.
@harshbafna
We can explicitly say that image_classifier handles only RGB images and so on for other default handlers. That is reasonable, however, it is not OK for the classifier handler to crash. We must handle it as an exception and return an error code at a minimum.
from serve.
If you can put up the doc change, I'll close this.
from serve.
Added documentation in stage_release
branch.
commit : 4ab6f7c
from serve.
Looks good. Please close after merge.
from serve.
Regression in the 4/10 build.
from serve.
Sounds good. Thanks!
from serve.
Related Issues (20)
- PyTorch serve with custom translators returning Unknown exception HOT 4
- Newer Base Image KServe Container fails with exec /usr/local/bin/dockerd-entrypoint.sh: exec format error HOT 7
- Reduce or remove worker retries for specific failures HOT 6
- Update describe model management API to show all model configuration options
- support install cpp dependency in auto-benchmark
- Custom class handler missing BaseHandler
- Kserve nightly CPU tests failure HOT 1
- gRPC Model Metadata using Open Inference Protocol HOT 1
- `\ready` API for Kubernetes probe to know when TorchServe backend is ready to receive traffic HOT 1
- CPU Launcher fails available check with venv HOT 3
- Can torchserve return image data? HOT 1
- Nightly upload to pypi failed HOT 1
- Conda nightlies not getting uploaded for the last 6 days HOT 1
- Building frontend from source in docker
- v0.10.0 OpenAPI specification does not validate
- improve security doc for model security check
- [RFC]: Deprecation notice for TorchText installation in TorchServe
- Torchserve error for more than 14 python async requests on workflow HOT 2
- TorchServe linux aarch64 plan
- Serve multiple models with both CPU and GPU HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from serve.