NVIDIA · Blackwell
Rent RTX 5090 cloud servers by the month
A whole GeForce RTX 5090 with 32 GB of GDDR7 in a dedicated virtual machine, for image and video generation, small or quantized LLMs and development. One flat monthly price.
- GPU memory
- 32 GB GDDR7
- Bandwidth
- 1.79 TB/s per GPU
- Interconnect
- PCIe Gen5 x16
- Tensor formats
- FP4 · FP8 · BF16
- Whole GPU, never shared
- Cancel any month
- 99.9% uptime SLA
- Card or crypto
Configurations & pricing
-
1× GeForce RTX 5090 In stock
Dedicated VM · full GPU passthrough
16 vCPU · 64 GB RAM · 1 TB NVMe · 10 Gbps
$449/mo
≈ $0.62 per GPU-hour
Delivery date confirmed before you pay. Missed it? Full refund.
Specifications
RTX 5090 specs and server configurations
Vendor-published figures for the GPU, then exactly what you get in each server we rent. Everything below is in your written confirmation before you pay.
NVIDIA GeForce RTX 5090
- Architecture
- BlackwellNVIDIA
- GPU memory
- 32 GB GDDR7
- Memory bandwidth
- 1.79 TB/s
- FP4
- 3,352 AI TOPSVendor figure, with sparsity
- FP8
- SupportedNo dense figure published
- BF16 / FP16
- SupportedNo dense figure published
- GPU interconnect
- PCIe Gen5 x16no NVLink
- Form factor
- PCIe card · GeForce
- Max power
- 575 W
Server configurations
| Specification | 1× GeForce RTX 5090 |
|---|---|
| GPUs | 1 × 32 GB GDDR7 |
| Server type | Single GPU |
| CPU | 16 vCPU |
| Memory | 64 GB |
| Storage | 1 TB NVMe |
| Network | 10 Gbps |
| Bandwidth | 20 TB/mo included |
| Price | $449/mo |
- Root access over SSH
- Ubuntu with drivers, CUDA and Docker
- IPv4 + IPv6 /64
- DDoS mitigation
Compute figures are vendor specifications for dense math, with structured-sparsity figures where published. Real-world throughput depends on your model, precision and software.
Best for
What the RTX 5090 is best at
Where this GPU earns its monthly price, and when another one is the smarter choice.
-
Image generation
SDXL with large batches, and 12B-parameter image models such as FLUX.1 in FP8.
-
Development and prototyping
A persistent CUDA box to build and test code before moving it to H100 or H200 servers.
-
Small and quantized LLMs
8B models in BF16, or 32B models in 4-bit, fit in 32 GB.
-
Video drafts and previews
Smaller or FP8 video models for drafts and previews, at $449 per month.
Consider instead
- NVIDIA RTX PRO 6000 Blackwell When you need more than 32 GB, for example video models in BF16 or 70B LLMs, with 96 GB per GPU.
- NVIDIA H100 SXM For production LLM serving or fine-tuning on a data-center GPU with 80 GB of HBM3.
- NVIDIA L40S When 48 GB is enough and you want a data-center card for 14B models in BF16, at $890 per month.
Memory sizing
Which models fit on the RTX 5090?
GPUs needed to serve a model at moderate context: weights plus about 20% for the KV cache and runtime. For your exact model, context and batch size, use the VRAM calculator.
| Model size | BF16 2 bytes/param | FP8 1 byte/param | 4-bit 0.5 bytes/param |
|---|---|---|---|
| 8B Llama 3.1 8B class | 1 GPU | 1 GPU | 1 GPU |
| 14B Qwen3 14B class | 1 GPUtight | 1 GPU | 1 GPU |
| 32B Qwen3 32B class | Does not fit | Does not fit | 1 GPU |
| 70B Llama 3.3 70B class | Does not fit | Does not fit | Does not fit |
| 120B Large dense or MoE | Does not fit | Does not fit | Does not fit |
| 235B Qwen3 235B MoE class | Does not fit | Does not fit | Does not fit |
| 405B Llama 3.1 405B class | Does not fit | Does not fit | Does not fit |
| 671B DeepSeek-V3 / R1 MoE | Does not fit | Does not fit | Does not fit |
How to read it
- 1 GPUFits on a single RTX 5090
- tightFits with a short context only
- —Does not fit on this GPU
Sized for real models
Open the VRAM calculatorEstimates for inference with weights quantized to the precision shown; long contexts and large batches need more memory for the KV cache. “Tight” means it fits with a short context only. — means it does not fit on this single GPU.
If you want to rent RTX 5090 power without buying and hosting the card yourself, we offer one whole GeForce RTX 5090 with 32 GB of GDDR7 in a dedicated virtual machine for $449 per month. It is our lowest-priced plan and a good fit for image generation, small or quantized language models, prototyping and development, as long as your work fits in 32 GB. Below, we show exactly where that limit bites.
What the RTX 5090 is, and what it is not
The RTX 5090 is NVIDIA's Blackwell GeForce flagship. Per NVIDIA's specifications, it has 32 GB of GDDR7 at 1.79 TB/s, connects over PCIe Gen5 and draws up to 575 W, and its Tensor Cores support low-precision formats down to FP4, which NVIDIA lists at 3,352 AI TOPS with sparsity. For models that fit in memory, that bandwidth is high for the price: more than the L40S (864 GB/s) or the RTX PRO 6000 (1.6 TB/s).
It is still a GeForce card designed for desktops, not a data-center GPU. It has no NVLink, its memory stops at 32 GB, and we rent it as a single-GPU plan only. Treat it as a fast, affordable GPU for work that fits, not as a substitute for an H100 in production. If you are upgrading from an older card, our page on how it compares with the previous GeForce generation covers the differences, and RTX 5090 vs RTX PRO 6000 shows when to step up.
What fits in 32 GB, and what does not
Weights take roughly 2 bytes per parameter in BF16, 1 in FP8 and 0.5 in 4-bit, plus KV cache or activations and 10–30% headroom.
- Image generation: SDXL, with about 3.5B parameters, takes around 7 GB in FP16 and leaves room for large batches. A 12B-parameter model such as FLUX.1 needs about 24 GB for its BF16 weights alone, so on 32 GB you run it in FP8 (about 12 GB) or let the pipeline unload the text encoder once the prompt is encoded.
- Video generation: a 14B-parameter video model needs about 28 GB in BF16 before activations, which does not leave enough room. Use FP8 weights, a smaller model variant, or a 96 GB RTX PRO 6000.
- LLM inference: an 8B model in BF16 (about 16 GB) leaves roughly 10 GB for KV cache after headroom; a 14B model fits in FP8 (about 14 GB) but not in BF16; a 32B model fits in 4-bit (about 16 GB). A 70B model does not fit, even in 4-bit (about 35 GB). For scale, a Llama-style 8B model with grouped-query attention (32 layers, 8 KV heads) needs about 0.13 MB of KV cache per token in BF16, so 10 GB holds roughly 75,000 tokens across all active requests.
- Training: LoRA on image models and QLoRA on 8B–14B LLMs work. Full fine-tuning with Adam needs roughly 16–20 bytes per parameter, which limits it to models of around 1B parameters.
The plan's 64 GB of system RAM also limits how much you can offload to the CPU, so treat 32 GB as a firm ceiling. When you reach it, move video and large image pipelines to the RTX PRO 6000 and LLM serving to the L40S or H100; our generative media guide covers sizing for media workloads.
A development box with the same CUDA stack
An RTX 5090 also works well as a persistent development machine. You get root access over SSH, Ubuntu 22.04 or 24.04 with NVIDIA drivers, CUDA, Docker and the NVIDIA Container Toolkit preinstalled, and 1 TB of NVMe where downloaded models and datasets stay between sessions. Code written here runs on our H100 and H200 servers with the same CUDA tooling, as long as any compiled extensions target both architectures, so you can prototype at $449 per month and move to a data-center GPU when the workload grows.
One practical point: Blackwell needs recent software. Install PyTorch builds for CUDA 12.8 or later; older builds do not include kernels for this GPU and stop with a "no kernel image is available" error. A quick check after setup:
nvidia-smi # GPU model, driver and CUDA version
python -c "import torch; print(torch.cuda.get_device_name(0), torch.version.cuda)"
Editors that work over SSH connect directly, and web tools such as JupyterLab or ComfyUI are best reached through an SSH tunnel rather than a public port. Our guides to NVIDIA drivers and CUDA and to remote development go further.
What it costs to rent RTX 5090
The RTX 5090 costs $449 per month, about $0.62 per hour if it runs all 730 hours. That suits an always-on generation queue or a small endpoint serving traffic around the clock. For a development box, it depends on how you count: used 8 hours a day on 22 working days (176 hours), it costs about $2.55 per used hour, in exchange for an environment that is always ready. For a single weekend of work, hourly billing elsewhere usually costs less. To find your break-even point, divide $449 by the hourly rate you would pay.
The price includes 20 TB of outbound traffic per month with no egress fees within that allowance, a public IPv4 address and an IPv6 /64, DDoS mitigation, 24/7 support from engineers and the 99.9% availability SLA, with no setup fee. Your environment stays as you left it for as long as you keep the plan.
Ordering an RTX 5090
Request the plan on the site, and we confirm the configuration, price, location and delivery date in writing before you pay. Payment is by card or in crypto (how crypto payment works), and access details arrive by email. Most orders need only an email address and a payment. If we miss the confirmed delivery date, you can cancel for a full refund, and you can cancel any month with no fee. For several 5090s for a team or a class, ask us about volume pricing.
How much does it cost to rent an RTX 5090?
$449 per month for one whole RTX 5090, about $0.62 per hour if it runs all month. There is no setup fee, and 20 TB of outbound traffic per month is included.
Is the RTX 5090 a data-center GPU?
No. It is a GeForce card with 32 GB of GDDR7, which we rent for image generation, small models and development. For production LLM work, our data-center GPUs such as the L40S, RTX PRO 6000 and H100 are the better fit.
Can I run a 70B model on an RTX 5090?
No. Even in 4-bit, a 70B model needs about 35 GB for its weights alone, more than the card's 32 GB. Use an RTX PRO 6000 or an H100 instead.
Which PyTorch version do I need?
A build for CUDA 12.8 or later, which includes kernels for Blackwell GPUs. Older builds stop with a "no kernel image is available" error.
Can I get several RTX 5090s in one server?
No, we rent the RTX 5090 as a single-GPU plan only. For multi-GPU work, see the 8-GPU RTX PRO 6000 server or our HGX servers.
Can I pay for an RTX 5090 in crypto?
Yes. Bitcoin, Ethereum, USDT, USDC and Litecoin are accepted at an exchange rate locked at checkout, and the invoice is the same as for a card payment.
Talk to an engineer
Get your RTX 5090 server this month.
Tell us what you need. A GPU engineer replies with availability, a confirmed delivery date and a payment link.
- Delivery date confirmed before you pay
- Cancel any month
- Card or crypto, same price