Provision Instance
How to provision an instance using availability data
Before you start, ensure that you have API Key with Instances -> Read and write
permission
Checking GPU Availability
First, check available GPU configurations:
Filter results using these options:
--gpu-type
: Specific GPU model (e.g., H100_80GB)--regions
: Geographic locations (e.g., united_states,canada)--gpu-count
: Number of GPUs needed--socket
: Socket type (PCIe, SXM4, etc.)
Creating an Instance
Create a new instance interactively:
Available Options
Short ID from availability list
Cloud ID from provider
GPU model (e.g., H100_80GB, A100)
Number of GPUs required
Instance name (alphanumeric and dashes only)
Storage size in GB
Number of virtual CPUs
RAM in GB
Operating system image
Team identifier for the instance
Interactive Creation Process
If options are not provided, the CLI will guide you through:
- GPU Selection
- Configuration Options
- Resource Allocation
- Image Selection
- Team Assignment
The CLI will show default values and valid ranges for resources like disk size, vCPUs, and memory based on the selected GPU configuration.
Using Custom Templates
To use a custom environment:
- Select a template from the Templates Page
- Create instance with template:
Ensure your template is compatible with the selected GPU configuration.
Managing Your Instance
Monitor instance status:
SSH into your instance:
Configure your SSH key path in CLI settings and run chmod 400 on your private_key.pm before using SSH.
Terminate instance:
You’ll be prompted to confirm before termination.