Troubleshooting

Fix common cloud GPU problems

Fixes for the problems that come up most on rented GPUs: SSH key and connection errors, full disks and failed launches, with the exact commands to run.

Explore the collection

Find your next step.

10 pages
Troubleshooting

Permission denied (publickey)

Fix 'Permission denied (publickey)' on a rented GPU: wrong username, wrong key file, file permissions, ECDSA keys and a signup key you never downloaded.

Explore
Troubleshooting

Connection refused

Why SSH says 'Connection refused' or times out right after a GPU launches, how long to wait before it is a real problem and what to check next.

Explore
Troubleshooting

No space left on device

Find what filled the disk on a GPU VM, usually Docker images, model downloads or pip and Hugging Face caches, and clear or move it without breaking things.

Explore
Troubleshooting

Host key verification failed

Why SSH says 'REMOTE HOST IDENTIFICATION HAS CHANGED' or 'Host key verification failed' after a new launch, and how to clear the old key safely.

Explore
Troubleshooting

NVML version mismatch

What 'Failed to initialize NVML: Driver/library version mismatch' means on a rented GPU, usually a driver update without a reboot, and how to fix it safely.

Explore
Troubleshooting

Torch not compiled with CUDA

Fix 'Torch not compiled with CUDA enabled' on a rented GPU: a CPU-only PyTorch build, the wrong environment or a mismatched wheel, with the check and the fix.

Explore
Troubleshooting

CUDA out of memory

Fix 'CUDA out of memory' in training, vLLM, Ollama and ComfyUI: find what is using the memory, the settings that free it, and when a bigger GPU is the answer.

Explore
Troubleshooting

Ollama not using the GPU

Check whether Ollama runs a model on the GPU or the CPU with ollama ps, and fix the usual causes on a rented GPU: a model too big, drivers or Docker flags.

Explore
Troubleshooting

Open WebUI problems

Fix Open WebUI on a rented GPU when it cannot reach Ollama, lists no models or loops on sign-in, including the DeployGPU template's private link.

Explore
Troubleshooting

CUDA_VISIBLE_DEVICES

Use CUDA_VISIBLE_DEVICES to choose which GPUs a process sees on a 2, 4 or 8 GPU VM, run several jobs side by side, and avoid the GPU numbering surprises.

Explore

The error messages a rented GPU throws often look generic, but the causes on DeployGPU are specific: a login user that changes by provider, a status that reads Running before SSH is actually listening, a disk that is a fixed size chosen at launch. This section matches the exact text on your screen to the cause that is actually likely here, with the command to check it and the fix.

Start with what you see

What you seeUsually meansWhere to look
Permission denied (publickey)The username, key file or key type is wrong for this launchPermission denied (publickey)
Connection refused or a timeout right after launchThe status reads Running before SSH is actually listening, or the instance is goneConnection refused
No space left on deviceThe fixed disk filled with Docker images, model weights or cachesNo space left on device
REMOTE HOST IDENTIFICATION HAS CHANGED or Host key verification failedA relaunched VM reuses an IP address your computer has seen beforeHost key verification failed
Failed to initialize NVML: Driver/library version mismatchThe NVIDIA driver was updated while the old one is still loadedNVML driver/library version mismatch
Torch not compiled with CUDA enabledA CPU-only PyTorch build, or a different Python environmentTorch not compiled with CUDA enabled
CUDA out of memoryAnother process holds the GPU, or the job is too big for the cardCUDA out of memory
Ollama answers slowly and ollama ps shows CPUThe model and its context do not fit in GPU memoryOllama not using the GPU
Open WebUI loops on sign-in or lists no modelsThe wrong DeployGPU account, or nothing pulled yetOpen WebUI connection and sign-in problems
A job uses the wrong GPU on a multi-GPU VMGPU numbering or CUDA_VISIBLE_DEVICESCUDA_VISIBLE_DEVICES
An app link returns 403 or asks you to sign in againSigned in as another account, or the deployment stoppedThe app link problems page in the docs
A deployment fails before it ever reaches RunningA capacity or provisioning problem, reported with a failure code and refunded automaticallyThe deployment failures reference, or handling provisioning failures if you launch through the API

Who is likely responsible

Some of this is DeployGPU's own doing, some is the provider underneath, and some is a command or a setting you chose. A wrong SSH username comes from the provider's own image, not from DeployGPU. A disk that filled up is on whatever you installed on it. A deployment that fails with a code such as PROVIDER_CAPACITY means the provider had no capacity for that offer at that moment, and the reserved hour is refunded automatically. Knowing which one you are looking at saves a support ticket that could not have fixed it anyway.

When to contact support

Contact support when a deployment is stuck in a state the dashboard cannot explain, when a charge does not match what the pricing page describes, or when none of the pages here match what you are seeing. The contact page is the way in, and the SSH guide is worth reading before the next launch rather than after.

Browse all 10 pages above ↑