Deployment Prediction Error about vertex-ai-samples HOT 7 CLOSED

Thanks! I am tagging @RajeshThallam, who wrote one of our PyTorch serving notebooks in this repo, in case he might be familiar with the errors you're seeing. Please keep in mind that we are not able to provide official support here, so I'll provide a couple more options to consider:

• Google Cloud Platform support options are at https://cloud.google.com/support/
• You can ask a question on Stack Overflow using the tag google-cloud-ml. This tag not only receives responses from the Stack Overflow community, but also from Google engineers, who monitor the tag and offer unofficial support.

from vertex-ai-samples.

What was the conclusion? I am facing the same issue. Thank you for your hints.

from vertex-ai-samples.

Hi @annatn998, can you provide the link to the notebook that you're starting from?

from vertex-ai-samples.

@kweinmeister I am using a workbench notebook from a private GCP project, but I'll copy and paste a link to the files that I'm using for deployment!

train.py - file used to train model
Dockerfile - torchserve dockerfile for prediction
custom_handler.py - custom handler for GCN model
models.py - because it's an eager model we include a model-file into the torch archive

pytorch_torchserve.zip

from vertex-ai-samples.

Closing as this is not the right forum for support requests.

from vertex-ai-samples.

@annatn998 Hi!
Were you able to solve the issue?

from vertex-ai-samples.

Nevermind, found an inconsistency between handler expectation and json envelope parser. Also was missing header in curl -H "Content-Type: application/json"...

from vertex-ai-samples.