Before you start, ensure that you have API Key with
Availability -> Read permissionRetrieving Availability Data
Suppose you want to check pricing options for a single H100 GPU, with the location restricted to the United States or Canada. To do this, send a request to our availability endpoint as shown below:You can generate request samples using our interactive
Availability API
documentationUnderstanding the Response Object
Here is an example of the JSON response you might receive:Example response
For a full breakdown of the response schema, see the
Get Gpu Availability Endpoint documentationprovider
Indicates the company or platform providing the GPU. You may encounter multiple offers from the same provider.
cloudId
A unique identifier provided by the GPU provider. This value is required if you plan to provision the GPU through our provisioning API.
dataCenter
Optional but necessary if present in the response. If the provider operates multiple datacenters with the same cloudId, you must specify which data center to use when provisioning the GPU.
disk, vcpu, memory
Each field informs you about the resources available for the selected GPU. Some providers allow you to modify defaultCount, so you can customize things like number of vcpus available in your instance. If the value is customizable, then the property contains attributes like minCount, maxCount, pricePerUnit, step and defaultIncludedInPrice.
In the example above your server will include 16 vpcus and 251GB of RAM, with customizable disk space. If the disk space is adjustable, its cost is calculated separately from the prices property. Here’s an example breakdown of total costs:
minCount and maxCount adjustable by step and you’ll pay pricePerUnit/hr for every unit you want to use.
Some providers offer predefined server configurations, with the defaultIncludedInPrice set to true. This means the defaultCount is included in the base price, but any changes (even reductions) will incur additional charges.
prices and security
There are two types of offers:
- Secure Cloud
- Community Cloud
security type is set to secure_cloud, then the price is defined in prices -> onDemand. Otherwise, community pricing is stored in prices -> communityPrice.
Some providers may also use dynamic pricing for their instances. If the field isVariable is set to true, the price may fluctuate based on demand.