Gateway operational · 16 models live · GPU capacity on demand Read the docs →
LINGYUNS gateway
// LLM gateway · GPU cloud

Every frontier model.
One endpoint.

Route GPT, Claude, Gemini, Llama and DeepSeek through one OpenAI-compatible API — then rent the NVIDIA GPUs behind them by the hour. Prepaid in USD, metered per million tokens, no vendor accounts to juggle.

16models behind one API
8upstream providers
6GPU classes on demand
lingyuns · gateway
# one base_url swap — keep your existing SDK
from openai import OpenAI

client = OpenAI(
    base_url="https://api.lingyuns.com/v1",
    api_key="ly-sk-••••••••••••",
)

resp = client.chat.completions.create(
    model="deepseek-v3",
    messages=[{"role": "user", "content": "Summarise this filing"}],
)
# routed · failover on · metered per 1M tokens
print(resp.choices[0].message.content)
p50 latency 240 ms · failover on
GPT-4o $2.5/M in GPT-4o mini $0.15/M in o3-mini $1.1/M in Claude 3.5 Sonnet $3/M in Claude 3.5 Haiku $0.8/M in Gemini 1.5 Pro $1.25/M in Gemini 1.5 Flash $0.075/M in Llama 3.1 405B $2.7/M in + 8 more see catalog GPT-4o $2.5/M in GPT-4o mini $0.15/M in o3-mini $1.1/M in Claude 3.5 Sonnet $3/M in Claude 3.5 Haiku $0.8/M in Gemini 1.5 Pro $1.25/M in Gemini 1.5 Flash $0.075/M in Llama 3.1 405B $2.7/M in + 8 more see catalog
How it works

From sign-up to first token in one afternoon

No contracts, no minimum commit. A billing specialist confirms your first funding and the gateway opens for your keys.

01 / FUND

Create an account

Sign up with your work email and pick a token pack or GPU reservation. Checkout issues an invoice with wire and USDT instructions.

02 / CONNECT

Receive your key

Once payment clears, credits land on your balance and an API key (ly-sk-…) is issued to your dashboard — shown once, hashed at rest.

03 / SHIP

Point your SDK at the gateway

Swap base_url and ship. Streaming, tool calls, vision and embeddings all pass through; usage shows up per model, per day.

Token packs

Prepay in USD, spend across every model

One balance covers the whole catalog. Credits never expire while your account is active, and volume packs carry bonus credits.

Starter
$19.00one-time
2M tokens

For prototypes, side projects and first integrations.

Buy Starter

$9.5 per 1M blended

Most popular
Growth
$99.00one-time
11M tokens

For production apps in their first year of scale.

Buy Growth

$9 per 1M blended

Scale
$299.00one-time
36M tokens

For teams shipping AI features to thousands of users.

Buy Scale

$8.3056 per 1M blended

Best value
Enterprise
$999.00one-time
135M tokens

For high-volume workloads and platform teams.

Buy Enterprise

$7.4 per 1M blended

Compare packs in detail →

GPU cloud

Rent the silicon behind the models

Single-GPU instances from an RTX 4090 to an H200 — hourly for experiments, monthly for production. CUDA, vLLM and TensorRT-LLM images ready to boot.

RTX 4090
24 GB VRAM · 16 vCPU
Best value
$0.55 / hour

Best price/performance for 7B–14B inference and fine-tuning.

Reserve RTX 4090
RTX A6000
48 GB VRAM · 24 vCPU
$0.89 / hour

48GB cards for larger context inference and multi-model serving.

Reserve RTX A6000
L40S
48 GB VRAM · 32 vCPU
Inference
$1.29 / hour

Purpose-built for generative AI inference at scale.

Reserve L40S

See all GPU classes →

Cost estimator
Estimated spend
$0.00

Prepaid credits · no subscription fee

ROUTING

Automatic failover

Requests retry across provider capacity on 429s and timeouts. Your app sees one stable endpoint and one stable rate limit.

OBSERVABILITY

Usage you can audit

Token counts per model per day, spend alerts and hard budget caps — all visible on the dashboard before the invoice arrives.

INFRASTRUCTURE

US-operated, USD-billed

Lingyun Technology inc, Fruita CO. Invoices in USD, wired or paid in USDT. Zero-retention mode available on request.

Ship your first request today

Create an account, pick a pack, and the gateway is yours — one key for every model, one dashboard for every token.