Skip to content

Compute infrastructure

GPU TCO Analyzer

Model a local GPU workstation or cluster against rented capacity — hardware, TDP load, persistent storage, depreciation, and the utilization floor at which owning stops paying.

Runs in your browser Audited by Gini Loh
Instrument panel Deterministic · nothing leaves the page
⚡

Compare Blackwell 96GB vs Cloud Renting Options

Quick-load 1x RTX Pro 6000 Blackwell (96GB) against 1x 96GB Cloud GPU or 2x RTX 6000 Ada (48GB x 2 = 96GB pooled).

Comparing:🏠 Local RTX Pro 6000 Blackwell (Workstation/Max-Q 96GB) (96GB)vs☁️ Cloud 1x Hyperstack NVIDIA RTX PRO 6000 (96 GB)
Active Cloud Option: Hyperstack
⚙️

Your Usage Pattern

Hours per Day
hrs
1 hour24 hours
Days per Month
days
1 day30 days
Evaluation Horizon3.0 yrs
mo
1 mo36 mo (3 yrs)60 mo (5 yrs)84 mo (7 yrs)

Monthly Usage

108 hours

🎮

Select Local GPU

Hardware Cost

$12,400

Power Draw (TDP)

600W

3-Year Hardware Resale Value (%)
%
0% (Full loss)20% (Default)50% (High return)

Estimated Salvage Recovery: $2,480 after 36 months

Cost of Capital / Interest Rate (%/yr)
%
0% (Cash/Zero cost)5% (Treasury Yield)15% (High Debt/WACC)

Opportunity Cost of Locked CapEx: +$2,010 over 36 mo

System components (CPU, RAM, Motherboard, etc.)
$
$0$5,000
Local Electricity Rate
$/kWh
$0.05/kWh$0.60/kWh
☁️

Select Cloud Provider & GPU

Number of Cloud GPUs to Rent

Effective Hourly Rate: 1x @ $1.80 = $1.80/hr

Cloud Storage Size
GB
10 GB1,200 GB
Provider:Hyperstack
Billing Model:Per-minute billing
Network Egress:Generally zero egress fees
Storage rate:$0.10/GB/mo

GPU TCO RECEIPT

Cost Analysis Breakdown

Comparing Local vs Hyperstack

LOCAL HARDWARE (1x 96GB)

GPU Cost:
$12,400
System components:
$1,000
Electricity (36 mo):
$397
Maintenance budget:
$2,010
Cost of Capital (5%/yr):
+$2,010
Less 3-Yr Resale (20%):
-$2,480
Net Local TCO:
$15,337
Cost per Hour:$3.945/hr

Hyperstack (1x NVIDIA RTX PRO 6000)

Usage (1x @ $1.8/hr):
$6,998
Storage (36 mo):
$360
Total Cloud Cost:
$7,358
Cost per Hour:$1.893/hr
☁️ Cloud Wins!

Cloud saves $7,978

Renting on demand prevents costly hardware depreciation and upfront CapEx.

Selected Cloud Provider
Hyperstack(1x NVIDIA RTX PRO 6000)
Deploy on Hyperstack →

Break-Even Point

> 7 Years

Resale Value Recovery

$2,480

Renting vs. Owning Cumulative Cost Timeline

Graph of cumulative expenditures over time (0 to 36 months). Intersecting lines graphically highlight the exact Break-Even point.

Local Owning Net TCO
Cloud Renting (1x)
$0$2k$4k$6k$8k$10k$12k$14k$16k$18k$20km0m12m24m36💵 RESALE OFFSET (-20%)
Hover over any month on the graph to inspect exact TCO numbers & savings breakdown.

Cloud GPU Directory & Price Explorer

Filter and search through detailed specifications, egress policies, storage costs, and hourly rates of 12 major cloud GPU services. Click "Compare" on any GPU configuration to load it into the TCO calculator above.

🔍

RunPod

Standard

Targets developers needing fast, flexible deployments with Secure Cloud (enterprise data centers) and Community Cloud (peer-to-peer distributed networks). Supports containerized pods, serverless endpoints, and dedicated multi-GPU clusters.

Try RunPod (No Upfront Cost) →
Billing UnitPer-second billing (Secure Cloud)
Network EgressFree egress
Storage Cost$0.10 to $0.20 per GB / month
GPU ModelVRAMRate ($/hr)Alternatives / SpotCompare
NVIDIA B300288 GB$7.39/hr—
NVIDIA B200180 GB$5.89/hrServerless: $8.64
NVIDIA H200 SXM141 GB$4.39/hr—
NVIDIA H100 SXM80 GB$3.29/hrP2P: $2.69/hr
NVIDIA H100 PCIe80 GB$2.89/hr—
NVIDIA A100 SXM80 GB$1.49/hr—
NVIDIA A100 PCIe80 GB$1.39/hr—
NVIDIA L40S48 GB$0.86/hrSpot option available
NVIDIA RTX 409024 GB$0.69/hrSpot option available
NVIDIA RTX 309024 GB$0.46/hrSpot option available

Lambda Labs

Enterprise

Focuses on simplicity, research teams, and enterprise model pre-training. Features the "Lambda Stack"—a pre-configured Ubuntu environment loaded with PyTorch, CUDA, and NCCL.

Deploy on Lambda Labs →
Billing UnitPer-hour billing
Network EgressFree and unlimited egress
Storage Cost$0.20 per GB / month
GPU ModelVRAMRate ($/hr)Alternatives / SpotCompare
NVIDIA B200 SXM6180 GB$6.99/hr8-GPU node: $6.69
NVIDIA H100 SXM80 GB$4.29/hr8-GPU node: $3.99
NVIDIA H100 PCIe80 GB$3.29/hrOr $2.49
NVIDIA GH20096 GB$2.29/hrOr $1.49
NVIDIA A100 SXM80 GB$1.79/hr—
NVIDIA RTX A600048 GB$1.09/hr—
NVIDIA RTX 6000 Ada48 GB$0.69/hr—

Nebius AI Cloud

Enterprise

Specializes in standalone applications and highly scalable Kubernetes clusters mapped across European compliance standards. High-end configurations utilize Intel Sapphire Rapids and NVLink interconnect networks.

Deploy on Nebius →
Billing UnitBilled based on resource usage
Network EgressStandard compliance network
Storage Cost$0.071 per GiB / month
GPU ModelVRAMRate ($/hr)Alternatives / SpotCompare
NVIDIA H200 NVLink141 GB$4.50/hr8x node: $36.00
NVIDIA H100 NVLink80 GB$3.85/hr8x node: $30.80
NVIDIA B200180 GB$5.50/hr—
NVIDIA L40S PCIe48 GB$1.35/hr—

Spheron Network

Decentralized

Operates as a decentralized bare-metal aggregator, securing enterprise SLA guarantees from data center partners while passing on significant cost reductions, particularly for spot instances.

Deploy on Spheron →
Billing UnitPer-minute billing with no minimum commitments
Network EgressZero egress fees
Storage Cost$0.10 per GB / month
GPU ModelVRAMRate ($/hr)Alternatives / SpotCompare
NVIDIA B300 SXM288 GB$6.80/hrSpot: $2.45/hr
NVIDIA B200 SXM6180 GB$6.02/hrSpot: $2.12/hr
NVIDIA H200 SXM141 GB$4.54/hr—
NVIDIA H100 SXM580 GB$2.50/hrSpot: $1.03/hr
NVIDIA H100 PCIe80 GB$2.01/hr—
NVIDIA A100 SXM480 GB$1.07/hrSpot: $0.60/hr
NVIDIA L40S PCIe48 GB$0.81/hrRange: $0.72 - $0.91
NVIDIA RTX 409024 GB$0.55/hr—

UpCloud

Standard

Helsinki-headquartered European cloud provider offering single and multi-GPU nodes mapped with dedicated resource configurations. The entire platform operates on 100% renewable energy.

Try UpCloud →
Billing UnitUsage-based hourly billing
Network EgressZero egress fees within generous fair usage (1 to 48 TB)
Storage Cost$0.12 per GB / month
GPU ModelVRAMRate ($/hr)Alternatives / SpotCompare
NVIDIA B200180 GB$5.20/hrRange: $5.16 - $5.23
NVIDIA H100 SXM80 GB$2.06/hrRange: $2.05 - $2.08
NVIDIA L40S48 GB$1.28/hrRange: $1.27 - $1.29
NVIDIA L40S Mid48 GB$1.43/hr—
NVIDIA L40S High48 GB$2.07/hr—
NVIDIA L424 GB$0.66/hrRange: $0.66 - $0.67

AceCloud

Standard

India-focused private cloud provider specializing in highly competitive local rates, bare-metal isolation, and bypassing complex hyperscaler management. Flat-rate billing with included 24/7 dedicated support.

Try AceCloud →
Billing UnitFlat-rate hourly billing
Network EgressFree and unlimited network egress
Storage Cost$0.10 per GB / month
GPU ModelVRAMRate ($/hr)Alternatives / SpotCompare
NVIDIA H100 HGX80 GB$3.78/hr₹315.07/hr
NVIDIA A10080 GB$2.22/hr₹184.93/hr
NVIDIA RTX 6000 Ada48 GB$1.01/hr₹84.28/hr
NVIDIA RTX A600048 GB$0.71/hr₹59.08/hr
NVIDIA A3024 GB$0.86/hr₹71.92/hr
NVIDIA A216 GB$0.28/hr₹23.01/hr

Vast.ai

Decentralized

Operates a massive global, peer-to-peer marketplace that aggregates computing units from crypto mines, independent data centers, and personal machines. Extremely cost-efficient, but does not offer standard enterprise SLAs.

Try Vast.ai (Best Pricing) →
Billing UnitHourly billing dynamically adjusted on supply & demand
Network EgressVaries by machine and host network speed
Storage Cost$0.05 per GB / month (approx)
GPU ModelVRAMRate ($/hr)Alternatives / SpotCompare
NVIDIA H100 SXM580 GB$3.20/hrSpot: $1.90/hr
NVIDIA A100 80GB80 GB$1.40/hrSpot: $0.71/hr
NVIDIA L40S48 GB$0.47/hrSpot: $0.27/hr
NVIDIA RTX 409024 GB$0.32/hrSpot: $0.13/hr
NVIDIA RTX A400016 GB$0.09/hrSpot: $0.06/hr

Hyperstack

Enterprise

European-focused, enterprise-grade GPU cloud featuring instant provisioning, per-minute billing, and clean bare-metal environments with zero configuration overhead.

Deploy on Hyperstack →
Billing UnitPer-minute billing
Network EgressGenerally zero egress fees
Storage Cost$0.10 per GB / month
GPU ModelVRAMRate ($/hr)Alternatives / SpotCompare
NVIDIA H200141 GB$3.50/hr—
NVIDIA H100 SXM580 GB$1.90/hrSpot: $1.52/hr
NVIDIA H100 NVL94 GB$1.95/hr—
NVIDIA A100 SXM80 GB$1.35/hr—
NVIDIA RTX PRO 600096 GB$1.80/hr—
NVIDIA L4040 GB$1.00/hr—
NVIDIA RTX A600048 GB$0.50/hr—
NVIDIA RTX A400016 GB$0.15/hr—

Thunder Compute

Standard

Focuses on direct VS Code SSH execution, live hardware swaps, and persistent workspaces, catering to ML engineers looking for simple, low-cost developer boxes with one-click single GPU access.

Start on Thunder Compute →
Billing UnitPer-minute billing with persistent storage volumes
Network EgressIncluded network egress
Storage Cost$0.15 per GB / month
GPU ModelVRAMRate ($/hr)Alternatives / SpotCompare
NVIDIA H100 SXM80 GB$1.38/hrNeocloud floor
NVIDIA A10080 GB$0.78/hrOr $0.66/hr floor
NVIDIA RTX A600048 GB$0.35/hr—

CoreWeave

Enterprise

Highly specialized AI hyperscaler, backing massive multi-node training workflows and VFX pipelines. Billed per-second. Capacity is primarily sold in 8-GPU node increments or contracted clusters.

Scale on CoreWeave →
Billing UnitPer-second billing
Network EgressZero egress or request fees
Storage Cost$0.07 to $0.11 per GB / month
GPU ModelVRAMRate ($/hr)Alternatives / SpotCompare
NVIDIA GB200384 GB$10.50/hr4x HGX Node
NVIDIA B200192 GB$8.60/hr8x HGX Node ($68.80/hr)
NVIDIA GH20096 GB$6.50/hrStandalone VM
NVIDIA H200 SXM141 GB$6.31/hr8x HGX Node ($50.44/hr)
NVIDIA H100 SXM580 GB$6.16/hrCommitted: $2.44
NVIDIA A100 SXM80 GB$2.70/hrCommitted: $1.19
NVIDIA L40S48 GB$2.25/hr8x Node ($18.00/hr)
NVIDIA L4040 GB$1.25/hr8x Node ($10.00/hr)

GMI Cloud

Enterprise

Operates isolated, private GPU environments that eliminate hypervisor overhead, leading to lower per-token costs. Flat-rate pricing with dedicated clusters.

Deploy on GMI Cloud →
Billing UnitFlat-rate pricing model
Network EgressDedicated network connection
Storage Cost$0.10 per GB / month
GPU ModelVRAMRate ($/hr)Alternatives / SpotCompare
NVIDIA H200 SXM141 GB$2.55/hrRange: $2.50 - $2.60
NVIDIA H100 SXM80 GB$2.00/hrHGX dedicated clusters
NVIDIA B200180 GB$4.00/hr—
NVIDIA GB200384 GB$8.00/hr—

JarvisLabs

Standard

Targets developers needing sub-90-second startups, persistent notebooks, and transparent billing. User-friendly and very responsive.

Start on JarvisLabs →
Billing UnitHourly billing with transparent dashboard
Network EgressZero egress fees
Storage Cost$0.10 per GB / month
GPU ModelVRAMRate ($/hr)Alternatives / SpotCompare
NVIDIA H200141 GB$3.80/hr—
NVIDIA H100 SXM80 GB$2.69/hr—
NVIDIA A100 (80GB)80 GB$1.49/hr—
NVIDIA RTX 6000 Ada48 GB$0.99/hr—
NVIDIA RTX 309024 GB$0.29/hr—

Operator notes

How to run it

  1. 1. Set sustained active hours per day and days per month — the utilization figure drives everything.
  2. 2. Select the accelerator and add system-component overhead.
  3. 3. Enter your electricity tariff and the persistent storage volume your datasets actually need.
  4. 4. Read the break-even utilization, not just the headline delta.

Model logic

Owned cost = hardware + system overhead + TDP × tariff × duty cycle + maintenance reserve − residual value. Leased cost = rate × hours × seats + egress + persistent storage.

Walkthrough

GPU TCO video guide

FAQ

What goes into the owned-cost side?

The selected accelerator, the system-component overhead (CPU, RAM, board, cooling, PSU), electricity under sustained TDP load at your tariff, and an annual hardware maintenance reserve. Depreciation is modelled as residual-value decay, because the resale floor moves every generation.

Why does persistent storage show up on the rental side?

Rental price per GPU-hour is the visible line. Storage for datasets and checkpoints is the one that surprises finance at close, so it is priced at a persistent-volume rate rather than assumed to be free.

What is the real break-even variable?

Utilization. Below the break-even utilization percentage in your own inputs, renting wins on total cost regardless of how attractive the sticker price of the hardware looks — and the engine reports that floor explicitly rather than hiding it in a single comparison number.

Related dispatch

long-hallway-with-row-servers-center

Self-Hosted AI: When to Buy vs Rent GPUs

For AI developers and deep learning engineers, the decision to invest in a self-hosted AI rig versus renting cloud GPU compute has never been more critical—or more confusing. With rising electricity costs and fluctuating cloud rates, the wrong choice can drain your budget by thousands. The Giniloh GPU Cost Calculator cuts through the noise by delivering a precise break-even analysis based on your actual workload. Using a real-world scenario—a $3,500 local build versus $1.80 per hour cloud GPU—the calculator reveals that most moderate users (12 weekly compute hours) are better off outsourcing. The local rig’s true cost-per-use climbs to $2.60 an hour when factoring in electricity and maintenance, overshadowing the cloud’s $1.80. This data-driven verdict empowers you to avoid costly hardware mistakes and optimize your AI budget without sacrificing performance or control.

Read dispatch