Before you start, ensure that you have API Key with
Instances -> Read and write
permissionChecking GPU Availability
First, check available GPU configurations:Filter results using these options:
--gpu-type
: Specific GPU model (e.g., H100_80GB)--regions
: Geographic locations (e.g., united_states,canada)--gpu-count
: Number of GPUs needed--socket
: Socket type (PCIe, SXM4, etc.)--provider
: Name of a provider
Creating an Instance
Create a new instance interactively:Available Options
Short ID from availability list
Cloud ID from provider
GPU model (e.g., H100_80GB, A100)
Number of GPUs required
Instance name (alphanumeric and dashes only)
Storage size in GB
Number of virtual CPUs
RAM in GB
Operating system image
Team identifier for the instance
Environment Variable in form
KEY=value
- this can be used multiple timesInteractive Creation Process
If options are not provided, the CLI will guide you through:- GPU Selection
- Configuration Options
- Resource Allocation
- Image Selection
- Team Assignment
The CLI will show default values and valid ranges for resources like disk size, vCPUs, and memory based on the selected GPU configuration.
Using Custom Templates
To use a custom environment:- Select a template from the Templates Page
- Create instance with template:
Ensure your template is compatible with the selected GPU configuration.
Managing Your Instance
Monitor instance status:Configure your SSH key path in CLI settings and run chmod 400 on your private_key.pm before using SSH.
You’ll be prompted to confirm before termination.