Create Dedicated Endpoint from container image

You can create a dedicated endpoint from arbitrary container images that expose a web service by selecting the Create from Container Image option.

You can specify the container image, command, and port in the Image configuration section. If the container image is hosted in a private registry, you can also add the registry auth in registries page.

For example, this configuration can create a vllm endpoint from a PyTorch container image, install the vllm package, and run the vllm server for Qwen2.5-1.B model.

create from container image

For more details about the configuration options, checkout the Configuration Options guide.

Lepton AI

© 2025