> ## Documentation Index
> Fetch the complete documentation index at: https://hyperbolic.ai/docs/llms.txt
> Use this file to discover all available pages before exploring further.

# On-Demand GPU Quick Start

> Launch your first H100, H200, B200, or B300 GPU instance

Use this guide to launch your first On-Demand GPU instance on Hyperbolic. This guide walks you through account setup, funding, SSH configuration, and launching your first GPU instance.

## Prerequisites

Before you begin, make sure you have:

> [card] SSH Key Pair
>
> Required for secure instance access. We'll show you how to create one if needed.

> [card] Terminal Access
>
> Basic command line familiarity for SSH connections and running commands.

## Step 1: Create Your Account

**1. Sign Up**

Visit [app.hyperbolic.ai](https://app.hyperbolic.ai) and create your account using:

* Email address
* Google OAuth
* GitHub OAuth

**2. Verify Email**

Check your inbox for a verification email and click the link to activate your account.

## Step 2: Generate & Add SSH Key

> [!WARNING]
>
> SSH keys are required for instance access. Password authentication is disabled for security.

> [tab] macOS/Linux
>
> ### Generate a new SSH key
>
> ```bash theme={null}
> # Generate ED25519 key (recommended)
> ssh-keygen -t ed25519 -C "your-email@example.com"
>
> # Or generate RSA key (legacy)
> ssh-keygen -t rsa -b 4096 -C "your-email@example.com"
> ```
>
> ### Copy your public key
>
> ```bash theme={null}
> # For ED25519
> cat ~/.ssh/id_ed25519.pub
>
> # For RSA
> cat ~/.ssh/id_rsa.pub
> ```

> [tab] Windows
>
> ### Using PowerShell
>
> ```powershell theme={null}
> # Generate key
> ssh-keygen -t ed25519 -C "your-email@example.com"
>
> # Display public key
> type $env:USERPROFILE\.ssh\id_ed25519.pub
> ```
>
> ### Using PuTTYgen
>
> 1. Download [PuTTYgen](https://www.putty.org/)
> 2. Click "Generate" and move mouse randomly
> 3. Save private key
> 4. Copy public key from text area

### Add SSH Key to Hyperbolic

1. Go to [Settings > SSH Keys](https://app.hyperbolic.ai/settings/ssh-keys)
2. Paste your public key or drag and drop your `.pub` file
3. Optionally edit the key's name, then save it

You can save multiple keys and select one when you launch an instance. See [SSH Keys](https://hyperbolic.ai/docs/general/account-management.md#ssh-keys) for details.

## Step 3: Fund Your Account

Add credits to rent GPUs.

> [tab] Credit Card
>
> 1. Go to [Billing](https://app.hyperbolic.ai/billing)
>
> 2. Click "Add Funds"
>
> 3. Enter amount of credits you want to add
>
> 4. Click "Pay Now"
>
> 5. Complete payment via Stripe
>
> > [!NOTE]
> >
> > Credit card payments are processed instantly and securely via Stripe.

## Step 4: Choose Your GPU

Browse available GPUs and select based on your needs:

### GPU Selection Guide

For current rates, check live pricing in the [Hyperbolic console](https://app.hyperbolic.ai/gpus).

| Use Case | Recommended GPU | Why |
| - | - | - |
| **Model Development** | H100 80GB | Industry standard for AI development |
| **Production Training** | H100 80GB | Fast training, reliable performance |
| **Large Models (70B+)** | H200 141GB | Maximum memory for huge models |
| **Distributed Training** | H100 + InfiniBand | Multi-node clusters with fast interconnect |
| **Ultra-Large Models** | H200 + InfiniBand | Next-gen performance for cutting-edge AI |

> [card] [Browse On-Demand GPUs](https://app.hyperbolic.ai/gpus)
>
> View real-time GPU availability and pricing

## Step 5: Launch Your First Instance

### Quick Launch (Web UI)

**1. Select GPU**

1. Go to [Hyperbolic](https://app.hyperbolic.ai)
2. Filter by GPU type, price, or region
3. Click on an available GPU listing

**2. Configure Instance**

* **Storage**: Add if needed (optional)
* **Label**: Name your instance (optional)

**3. Launch**

1. Review configuration and pricing
2. Click "Start Building"
3. Instance launches in under 5 minutes
4. Copy the SSH connection string

### Launch via API

Automate instance creation with our REST API:

```bash Virtual Machine theme={null}
curl -X POST "https://api.hyperbolic.ai/v2/on-demand/rentals" \
  -H "Authorization: Bearer $HYPERBOLIC_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "rentalType": "virtual-machine",
    "gpuType": "h100",
    "gpuCount": 1
  }'
```

```bash Bare Metal theme={null}
curl -X POST "https://api.hyperbolic.ai/v2/on-demand/rentals" \
  -H "Authorization: Bearer $HYPERBOLIC_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "rentalType": "bare-metal",
    "gpuType": "h100",
    "gpuCount": 8,
    "networkType": "infiniband"
  }'
```

See [Create a rental](https://hyperbolic.ai/docs/api-reference/rentals/create-a-rental.md) for every field, including regions and SSH keys.

## Step 6: Connect to Your Instance

Once your instance is running, connect via SSH:

```bash theme={null}
# Basic connection
ssh ubuntu@<instance-ip>

# With specific key file
ssh -i ~/.ssh/id_ed25519 ubuntu@<instance-ip>
```

### First Commands to Run

```bash theme={null}
# Check GPU status
nvidia-smi

# Check CUDA version
nvcc --version

# Check available disk space
df -h

# Check Python and pip
python3 --version
pip3 --version

# Monitor GPU usage in real-time
watch -n 1 nvidia-smi
```

## Step 7: Start Building

### Quick Examples

> [tab] Train a Model
>
> ```python theme={null}
> # train.py
> import torch
> import torch.nn as nn
> from torch.utils.data import DataLoader
>
> # Check GPU availability
> device = torch.device('cuda' if torch.cuda.is_available() else 'cpu')
> print(f"Using device: {device}")
>
> # Your model
> model = YourModel().to(device)
>
> # Training loop
> for epoch in range(num_epochs):
>     for batch in dataloader:
>         inputs, labels = batch
>         inputs, labels = inputs.to(device), labels.to(device)
>         # Training code here
> ```
>
> Run with:
>
> ```bash theme={null}
> python3 train.py
> ```

> [tab] Run Jupyter
>
> ```bash theme={null}
> # Install Jupyter if not present
> pip install jupyter
>
> # Start Jupyter with no browser
> jupyter notebook --no-browser --port=8888
>
> # From your local machine, forward the port:
> # ssh -L 8888:localhost:8888 ubuntu@<instance-ip>
> # Then open: http://localhost:8888
> ```

> [tab] Fine-tune LLM
>
> ```bash theme={null}
> # Clone your repo or upload data
> git clone https://github.com/your-repo/llm-finetuning.git
> cd llm-finetuning
>
> # Install requirements
> pip install -r requirements.txt
>
> # Run fine-tuning
> python finetune.py \
>   --model_name "meta-llama/Llama-2-7b-hf" \
>   --dataset "your-dataset" \
>   --output_dir "./fine-tuned-model"
> ```

## Managing Your Instance

### Monitor Usage

Check your instance status and billing:

```bash theme={null}
# On the instance - check GPU utilization
nvidia-smi

# Check running processes
ps aux | grep python

# Monitor system resources
htop
```

### Save Your Work

> [!WARNING]
>
> Always save your work regularly to persistent storage or cloud backups!

```bash theme={null}
# Save to persistent storage
cp -r /workspace/results /mnt/storage/

# Upload to cloud storage
aws s3 cp model.pth s3://your-bucket/models/

# Push to git
git add .
git commit -m "Save checkpoint"
git push
```

### Stop or Terminate

> [tab] Via Web UI
>
> 1. Go to [My Instances](https://app.hyperbolic.ai/instances)
> 2. Find your running instance
> 3. Click "Terminate"

> [tab] Via API
>
> ```bash theme={null}
> curl -X POST "https://api.hyperbolic.ai/v2/on-demand/rentals/terminate" \
>   -H "Authorization: Bearer $HYPERBOLIC_API_KEY" \
>   -H "Content-Type: application/json" \
>   -d '{"rentalId": "<rental-id>"}'
> ```

## Common Issues & Solutions

> [!NOTE]
>
> If you're still experiencing issues after trying these solutions, please contact us at [**support@hyperbolic.ai**](mailto:support@hyperbolic.ai) or use the chat in the bottom-right corner of the [app](https://app.hyperbolic.ai) after you sign in.

### Connection Issues

> [accordion] Permission denied (publickey)
>
> **Problem**: SSH key not recognized
>
> **Solution**:
>
> ```bash theme={null}
> # Check you're using the right key
> ssh -i ~/.ssh/correct_key ubuntu@<ip>
>
> # Verify key is added to account
> # Go to app.hyperbolic.ai/settings
> ```

> [accordion] Connection timeout
>
> **Problem**: Cannot reach instance
>
> **Solution**:
>
> * Check instance is running in dashboard
> * Verify IP address is correct
> * Check firewall/security group settings
> * Try different region if persistent

> [accordion] Host key verification failed
>
> **Problem**: SSH host key changed
>
> **Solution**:
>
> ```bash theme={null}
> # Remove old host key
> ssh-keygen -R <instance-ip>
>
> # Then reconnect
> ssh ubuntu@<instance-ip>
> ```

### GPU Issues

> [accordion] CUDA out of memory
>
> **Problem**: GPU memory exhausted
>
> **Solution**:
>
> ```python theme={null}
> # Reduce batch size
> batch_size = 16  # Lower this
>
> # Use gradient accumulation
> accumulation_steps = 4
>
> # Clear cache
> torch.cuda.empty_cache()
>
> # Use mixed precision
> from torch.cuda.amp import autocast
> with autocast():
>     output = model(input)
> ```

> [accordion] GPU not detected
>
> **Problem**: nvidia-smi shows no GPUs
>
> **Solution**:
>
> ```bash theme={null}
> # Check drivers
> nvidia-smi
> ```
>
> GPU drivers are preinstalled on all instances. If `nvidia-smi` does not report your GPUs, contact support rather than installing drivers yourself.
>
> > [!WARNING]
> >
> > Don't run `sudo reboot` from inside the instance. If the dashboard shows a **Reboot** action for your instance, use that; if it doesn't, contact support — an in-OS reboot on those machines can leave the instance unrecoverable.

> [!TIP]
>
> **Still need help?** Email [**support@hyperbolic.ai**](mailto:support@hyperbolic.ai) or use the chat in the bottom-right corner of the [app](https://app.hyperbolic.ai) after you sign in. See [Support](https://hyperbolic.ai/docs/general/support.md) for support hours.

## Best Practices

> [card] Optimize Usage
>
> Monitor GPU utilization to ensure you're getting the most from your H100/H200/B200 instances.

> [card] Save Checkpoints
>
> Regularly save model checkpoints and important data to persistent storage or cloud.

> [card] Monitor Usage
>
> Use `nvidia-smi` and billing dashboard to track GPU utilization and costs.

> [card] Terminate When Done
>
> Always terminate instances when finished to avoid unnecessary charges.

## Next Steps

> [card] [Managing Instances](https://hyperbolic.ai/docs/on-demand/managing-instances.md)
>
> Learn advanced instance management, monitoring, and automation

> [card] [Storage & Networking](https://hyperbolic.ai/docs/on-demand/storage-and-ports.md)
>
> Configure persistent storage and custom networking

## Need Help?

For additional support:

* **Email**: [support@hyperbolic.ai](mailto:support@hyperbolic.ai)
* **Chat**: Sign in to the [app](https://app.hyperbolic.ai) and use the chat in the bottom-right corner


This documentation is built and hosted on [Mintlify](https://mintlify.com), a developer documentation platform.