Lepton AI

Create a Dev Pod

For AI application developers, it is of great importance to have a handy development environment to develop and test your AI applications. With Pod, you'll be able to have a AI development environment with:

  • Fast startup time: Get your dev environment ready in seconds.
  • Easy to use: No need to install anything, just use your browser or terminal to access the dev environment.
  • Storage integration: Mount your storage to the dev environment and access it.

To create a pod, you can use the CLI or the dashboard UI. In this page, we will go through the steps to create a dev pod with CLI.

Create with CLI

For creating a pod, you can use the following command:

lep pod create --name mypod --resource-shape <your-resource-shape>

Configure Options

  • Pod Name: the name of the Pod, only alphanumeric characters (a-z, 0-9) and '-' allowed.
  • Resource Shape: the resource type of the Pod. A10, A100, and H100 are supported. The GPU Count will be 1 by default. If you need more GPUs, you can specify the GPU Count.
  • Node Groups: (Optional) the node group that the Pod will be created in. If not specified, the Pod will be created using the on-demand resource.
  • Nodes: (Optional) Only available once the Node Groups is specified. Specify the list of nodes that the Pod will be created in. If not specified, the Pod will be created in the first available node within the Node Group specified.
  • Container Image: (Optional) the container image that will be used to create the Pod. Choose from default image lists or pass in docker image urls like ollama/ollama:latest. If not specified, the default image will be used.
  • Container Command: (Optional) the command to run in the Pod when the container starts.
  • SSH Public Key: (Optional) the public key that will be added to the authorized_keys file in the Pod. You can use this to specify the public key that you want to use to access the Pod.
  • File System Mount: (Optional) the file system that will be mounted to the Pod. You can access the file system in the Pod if specified. If not specified, the storage will be ephemeral and will be deleted once the Pod is deleted or restarted.

Advanced Settings

  • Private Image Registry Auth: (Optional)the private image registry authentication that will be used to pull the container image. You can use this to specify the private image registry authentication if the container image is hosted in a private registry.
  • Environment Variables: (Optional)the environment variables that will be injected into the Pod. You can use this to specify the environment variables that your AI application needs.
  • Visibility: (Optional)the visibility of the Pod. You can use this to specify the visibility of the Pod. If the visibility is set to private, only the creator of the Pod can access the Pod. If the visibility is set to public, all the users in the workspace can access the Pod.
  • Shared Memory: (Optional) the shared memory size of the Pod. The shared memory size is the size of the shared memory that will be allocated to the Pod. The default value is 64MB.
Lepton AI

© 2024