python (12.9k questions)

javascript (9.2k questions)

reactjs (4.7k questions)

java (4.2k questions)

java (4.2k questions)

c# (3.5k questions)

c# (3.5k questions)

html (3.3k questions)

Questions - torchserve

How can I register a local model.mar to a running torchserve service?

I have a running torchserve service. According to the docs, I can register a new model at port 8081 with the ManagementAPI. When running curl -X OPTIONS http://localhost:8081, the output also states f...
test-img

c0mr4t

pytorch

torchserve

Votes: 0

Answers: 1

Latest Answer

I just figured it out. Everything I stated was completely correct and under normal circumstances, all of this would have worked. The error is arising because I am running the torchserve instance in a ...
test-img

c0mr4t

Torchserve fails to load model on docker while it runs locally

I have a torchscript model (.pt) that I can successfully load and serve with torch serve on my local machine. On the other side, when trying to deploy it in the oficial torchserve docker it will compl...
test-img

eljiwo

python

docker

torch

torchserve

Votes: 0

Answers: 1

Latest Answer

The first thing to know is that docker tags are just tags. Just because it is tagged "latest" does not mean anything. In fact you will see that version 0.5.2-cpu is newer than latest-cpu her...
test-img

Chai

Posts

Questions

Blogs

Jobs