> ## Documentation Index
> Fetch the complete documentation index at: https://docs.hyperbolic.ai/docs/llms.txt
> Use this file to discover all available pages before exploring further.

# On-Demand GPU Overview

> Launch H100, H200, and B200 GPUs in minutes

Hyperbolic On-Demand GPUs provide high-performance GPU capacity for training, fine-tuning, inference, benchmarking, and custom deployments.

Teams can launch GPU instances, configure their runtime environment, and scale compute as workload requirements change, without committing to reserved infrastructure before the workload is proven.

Available GPU types, regions, cluster configurations, and networking options may vary based on current supply. For specific capacity or configuration requirements, contact [sales@hyperbolic.ai](mailto:sales@hyperbolic.ai).

## On-Demand GPU Infrastructure

<Card title="On-Demand Cloud" icon="shield-check" color="#3b82f6">
  **H100, H200 & B200 GPU Clusters**

  Access H100, H200, and B200 GPUs from single instances to massive clusters with InfiniBand networking.

  * **Latest Hardware**: H100 80GB, H200 141GB, and B200 192GB GPUs
  * **Guaranteed Availability**: 99.5% uptime SLA
  * **Instant Deployment**: Clusters ready in minutes
  * **Scalable**: Single GPU to 128+ GPU clusters
  * **InfiniBand Networking**: Up to 3.2 Tb/s for maximum multi-GPU performance
</Card>

## Key Features

### Instant Deployment

* Deploy GPUs in under 5 minutes
* No sales calls or procurement delays
* Pre-configured with CUDA, PyTorch, TensorFlow
* Available in multiple regions worldwide

### Flexible Access

* Full SSH root access to your instances
* Docker support with pre-built ML images
* Persistent storage options available (depending on region)

### Simple Billing

* Pay only for what you use (hourly billing)
* No upfront commitments or contracts
* Automatic failure detection (no charges for failed instances)
* Pay by credit card

### Developer-Friendly

* REST API for automation
* Agent-compatible endpoints

## Regions & Data Centers

<Info>
  GPUs are available across multiple regions for optimal latency and compliance requirements.
</Info>

### Available Regions

* **North America**
* **Europe**
* **United Kingdom**

<Tip>
  Select regions closest to your users for inference workloads, or regions with the best GPU availability for training tasks.
</Tip>

## Use Cases

<AccordionGroup>
  <Accordion title="Model Training" icon="brain">
    * **Fine-tune LLMs** on custom datasets with multi-GPU support
    * **Train computer vision models** with high-throughput data pipelines
    * **Run distributed training** across multiple nodes with InfiniBand
    * **Experiment with architectures** using automatic checkpointing

    **Recommended GPUs**: H100 for most training tasks, H200 for ultra-large models
  </Accordion>

  <Accordion title="Model Deployment" icon="rocket">
    * **Host custom inference endpoints** with auto-scaling capabilities
    * **Deploy production model servers** using TorchServe, Triton, or vLLM
    * **Run batch inference jobs** with optimized throughput
    * **A/B test different models** with traffic splitting

    **Recommended GPUs**: H100 for high-throughput inference, H200 for serving 70B+ parameter models
  </Accordion>

  <Accordion title="Development & Research" icon="code">
    * **Prototype AI applications** with Jupyter notebooks
    * **Test GPU-accelerated code** with full debugging capabilities
    * **Build ML pipelines** with MLflow or Kubeflow integration
    * **Reproduce paper results** with exact environment replication

    **Recommended GPUs**: H100 for most research, H200 for cutting-edge experiments
  </Accordion>

  <Accordion title="Multi-GPU Clusters" icon="server">
    * **Large language model training** with model parallelism
    * **Distributed deep learning** with data parallelism
    * **High-performance computing** workloads
    * **Massive batch processing** with coordinated jobs

    **Recommended Setup**: 8x or 16x H100 with InfiniBand for optimal performance
  </Accordion>
</AccordionGroup>

## Security Best Practices

<Warning>
  Always follow security best practices when deploying GPU instances with public access.
</Warning>

### Instance Security

* **SSH Keys**: Use strong SSH keys, never share private keys
* **Updates**: Keep your OS and packages updated
* **Monitoring**: Set up logging and monitoring for suspicious activity

### Data Protection

* **Encryption**: Use encrypted storage for sensitive data
* **Backups**: Regular backups of important models and datasets
* **Access Control**: Implement proper IAM policies
* **Compliance**: Ensure compliance with data regulations (GDPR, HIPAA)

## Performance Benchmarks

### Training Performance Comparison

| Workload                | H100 80GB     | H100 + IB (8x) | H200 141GB    | H200 + IB (8x) |
| ----------------------- | ------------- | -------------- | ------------- | -------------- |
| Llama 2 7B Fine-tuning  | 18 min/epoch  | 3 min/epoch    | 15 min/epoch  | 2 min/epoch    |
| Llama 2 70B Fine-tuning | 3.5 hrs/epoch | 30 min/epoch   | 2.8 hrs/epoch | 25 min/epoch   |
| Mixtral 8x7B Training   | 8 hrs         | 1.2 hrs        | 6.5 hrs       | 1 hr           |
| GPT-3 175B Fine-tuning  | N/A           | 48 hrs         | 36 hrs        | 28 hrs         |

<Info>
  Benchmarks are approximate and vary based on batch size, precision, and optimization settings.
</Info>

## Getting Started

<Steps>
  <Step title="Set Up Your Account">
    * [Create your account](https://app.hyperbolic.ai)
    * Add your SSH public key in account settings
    * Fund with \$5.00+ to get started (credit card)
  </Step>

  <Step title="Choose Your GPU">
    Browse available GPUs at [app.hyperbolic.ai](https://app.hyperbolic.ai)

    <Tip>
      Choose H100 for most AI workloads, H200 for ultra-large models requiring maximum memory, or B200 for frontier-scale training and inference demanding the highest performance.
    </Tip>
  </Step>

  <Step title="Launch Instance">
    * Select GPU type and quantity
    * Configure storage (if needed)
    * Add or configure your SSH key for access
    * Click "Rent" to deploy
  </Step>

  <Step title="Connect & Build">
    ```bash theme={null}
    # Connect via SSH
    {ssh command from your Active Instances page}

    # Verify GPU is available
    nvidia-smi

    # Start building!
    python train.py
    ```
  </Step>
</Steps>

## Resources

<CardGroup cols={2}>
  <Card title="Quickstart Guide" icon="play" href="/docs/on-demand/quickstart">
    5-minute tutorial to launch your first GPU instance
  </Card>
</CardGroup>

<Info>
  **Need help?** Email [support@hyperbolic.ai](mailto:support@hyperbolic.ai) for support inquiries, or use the in-app chat widget for immediate assistance.
</Info>