Management

There are many built-in features for you to manage your node group better, including Shapes, Quota, and Queue.

Quota

Quota defines the maximum amount of resources from a node group that can be allocated to current workspace.

Workspace Configurations

Workspace admins can configure quotas for a node group, including the following options:

GPU: The maximum number of GPUs that can be used.
CPU: The maximum number of CPUs that can be used.
Memory: The maximum amount of memory that can be used.
Max priority: Max priority determines the highest priority that can be set for a workload using the current node group, ranging from 1 to 9.
Priority policy: There are two priority policies: Strict and Flexible.
- Best Effort: Resources are allocated according to the priority of the workload as much as possible
- Strict: Resources are allocated strictly according to the priority of the workload. You can also configure the strict policy scope to Within the workspace or Cross multiple workspaces.

User Configurations

User configurations are used to limit the resources that can be used by a user.

User: The user that the configuration belongs to, select from the workspace members.
GPU: The maximum number of GPUs that can be used by the user.
CPU: The maximum number of CPUs that can be used by the user.
Memory: The maximum amount of memory that can be used by the user.
Max priority: The max priority that the user can set for a workload, range from 1 to max priority of the node group.

Queue

Queue shows the workloads status in the node group, with three status:

Pending: The workload is pending to get in the queue.
Queueing: The workload is in the queue and waiting for the resources.
Admitted: The workload is admitted to the node group and running.

Release protection is a feature that prevents the nodes in the node group from being deleted accidentally. You can set release protection at node level in your node group detail page, press the menu button or the right side of the node, and click on Enable Release Protection or Disable Release Protection.

Shapes

You can also manage resource shapes for a node group. Switch to the Shapes tab, and click on Add Shape to create a new shape:

Name: The name of the shape, for you to manage shapes easier.
Resource: Number of CPUs, Memory, and Storage.
GPU: Number of GPUs and the GPU type. The available GPU types are defined by the node group.
Description: Description of the shape.