lep pod

Manages pods on the Lepton AI cloud.

A Pod (short for "Lepton AI Pod") is a container runtime that allows you to run interactive sessions on the Lepton AI cloud. Think of it as a remote server that you can access via SSH, and use it as a remote development environment. You can use it to run Jupyter notebooks, or to run a terminal session, similar to a cloud VM but much more lightweight.

Usage

lep pod [OPTIONS] COMMAND [ARGS]...

Options

  • --help : Show this message and exit.

Commands

  • create : Creates a pod with the given resource shape, mount, env and...
  • list : Lists all pods in the current workspace.
  • remove : Removes a pod.

lep pod create

Creates a pod with the given resource shape, mount, env and secret.

Usage

lep pod create [OPTIONS]

Options

  • -n, --name TEXT : Name of the pod to create.
  • --resource-shape TEXT : Resource shape for the pod. Available types are: 'cpu.small', 'cpu.medium', 'cpu.large', 'gpu.a10', 'gpu.a10.6xlarge', 'gpu.a100-40gb', 'gpu.2xa100-40gb', 'gpu.4xa100-40gb', 'gpu.8xa100-40gb', 'gpu.a100-80gb', 'gpu.2xa100-80gb', 'gpu.4xa100-80gb', 'gpu.8xa100-80gb', 'gpu.h100-sxm', 'gpu.2xh100-sxm', 'gpu.4xh100-sxm', 'gpu.8xh100-sxm'.
  • --mount TEXT : Persistent storage to be mounted to the deployment, in the format STORAGE_PATH:MOUNT_PATH.
  • -e, --env TEXT : Environment variables to pass to the deployment, in the format NAME=VALUE.
  • -s, --secret TEXT : Secrets to pass to the deployment, in the format NAME=SECRET_NAME. If secret name is also the environment variable name, you can omit it and simply pass SECRET_NAME.
  • --image-pull-secrets TEXT : Secrets to use for pulling images.
  • -ng, --node-group TEXT : Node group for the pod. If not set, use on-demand resources. You can repeat this flag multiple times to choose multiple node groups. Multiple node group option is currently not supported but coming soon for enterprise users. Only the first node group will be set if you input multiple node groups at this time.
  • --container-image TEXT : Container image to run.
  • --container-command TEXT : Command to run in the container.
  • -lg, --log-collection BOOLEAN : Enable or disable log collection (true/false). If not provided, the workspace setting will be used.
  • --help : Show this message and exit.

lep pod list

Lists all pods in the current workspace.

Usage

lep pod list [OPTIONS]

Options

  • -p, --pattern TEXT : Regular expression pattern to filter pod names.
  • --help : Show this message and exit.

lep pod remove

Removes a pod.

Usage

lep pod remove [OPTIONS]

Options

  • -n, --name TEXT : The pod name to remove. [required]
  • --help : Show this message and exit.
Lepton AI

© 2024