Before you start, ensure you have set your API keys and SSH key path as outlined in the CLI introduction.

Retrieving Availability Data

To see all available GPU types and their current pricing across all regions, simply run:

prime availability list

This command will display a table showing all available GPU configurations, including details like GPU type, count, location, price per hour, and stock status.

Retrieving filtered Availability Data

You can then use filters like --gpu-type, --regions, or --gpu-count to narrow down the results. Here are all available filters:

Available Filters

  • --gpu-type: Filter by specific GPU model

    • Example: --gpu-type H100_80GB
    • Optional string value
  • --gpu-count: Filter by number of GPUs

    • Example: --gpu-count 2
    • Optional integer value
  • --regions: Filter by geographic regions

    • Example: --regions united_states,canada or --regions united_states --regions canada
    • Optional, can specify multiple regions
  • --socket: Filter by socket type

    • Example: --socket PCIe
    • Accepts values: PCIe, SXM2, SXM3, SXM4, SXM5
    • Optional string value
  • --group-similar: Group similar configurations from same provider

    • Example: --no-group-similar
    • Default: true
    • Optional boolean flag

Example with Multiple Filters

prime availability list --gpu-type H100_80GB --regions united_states --socket PCIe --no-group-similar

Understanding the Terminal Output

Here’s an example of what the command output looks like:

IDGPU TypeGPUsSocketProviderLocationStockPrice/HrMemory (GB)SecurityvCPUsRAM (GB)
346663H100_80GB2PCIerunpodN/ALow$5.40160secure_cloud32502
551ffdH100_80GB2PCIerunpodUSLow$5.40160secure_cloud32502

Each row represents a unique GPU configuration available for deployment. The output includes:

  • A unique ID for the configuration
  • GPU specifications (type, count, socket)
  • Provider and location information
  • Current stock status
  • Pricing and hardware details