I don’t seem to quite understand how to deploy a model with a custom handler as an inference endpoint. Specifically, I’m trying to use this model (which alread has a custom handler): philschmid/stable-diffusion-v1-4-endpoints · Hugging Face I went through these steps trying to follow the tutorial: …

Anybody? If someone has a link/resource that could help me solve this by myself, I’d be more than happy! :slight_smile:

cc @philschmid btw, might be better to post this in the “inference endpoints” section, rather than “beginners”

Hello @eykarim , You can check out this tutorial: Custom Inference with Hugging Face Inference Endpoints or the documentation on how to create custom handlers: Create custom Inference Handler Those include e2e example with uploading the model. FYI we also have a dedicated inference endpoints sect…

Hi Phil! Thanks for the tutorial. I worked through it a second time yesterday and now have a model deployed: eykarim/stable-diffusion-v1 · Hugging Face As I wrote in my original post, I was assuming that once I have a model deployed with a custom handler (marked as “endpoints-template”) I should be…

Creating inference endpoint with custom handler - is this how it should work?

Beginners

philschmid November 27, 2022, 9:44am 6

I responded in your other thread: Why is my model not showing up in the search bar for Inference Endpoints? - #2 by philschmid

Topic		Replies	Views
Help with custom handler.py for model inference endpoint Beginners	1	846	February 24, 2024
Requirements for Hosting LLM via Inference Endpoints Inference Endpoints on the Hub	2	128	June 13, 2025
Guide/Tutorial to write an inference endpoint for custom models Inference Endpoints on the Hub	5	2173	October 19, 2024
Custom handler with gated model Inference Endpoints on the Hub	5	903	January 25, 2024
Inference Endpoint Deployment Error Beginners	2	101	February 7, 2025

Creating inference endpoint with custom handler - is this how it should work?

Related topics