A real 252 GB HBM fast lane.
The B300 GPU has 252 GB of HBM3e at 7.1 TB/s. Models whose weights, cache and runtime allocations stay here are the cleanest fit for low-latency work.
DGX Station is a desk-side NVIDIA system where official NVFP4 builds of the 233 GiB-class MiniMax M3 and 465 GB GLM‑5.2 can fit in one coherent memory space. That does not make every token fast, every framework ready or a roughly €100,000 workstation the right first machine.
The Blackwell Ultra GPU and Grace CPU can access a coherent pool, but the pool contains two physically different memory tiers. Weight placement, KV cache, precision and runtime support still decide useful performance.
The B300 GPU has 252 GB of HBM3e at 7.1 TB/s. Models whose weights, cache and runtime allocations stay here are the cleanest fit for low-latency work.
Grace contributes LPDDR5X at 396 GB/s. Models larger than HBM can remain local without PCIe staging, but decode can slow when active weights repeatedly cross the lower-bandwidth tier.
One trillion BF16 parameters need about 2 TB before cache or runtime overhead. A mixed NVFP4 checkpoint at roughly 5.0–5.2 effective bits per parameter would use about 625–650 GB before runtime and cache, so the 1T claim is a tight capacity boundary—not a comfortable default.
NVIDIA's peak figure is sparse FP4 Tensor arithmetic. Autoregressive decode is often constrained by memory movement, kernels, batch size and the number of active MoE parameters. Ask for time to first token, decode speed per user, aggregate throughput, power at the wall and the exact model/precision/context—not a single peak-compute number.
As checked 24 July 2026, NVIDIA labels the Windows product “Coming in Q4.” It keeps the GB300 platform, adds Windows infrastructure and WSL support, and can be configured with an additional RTX PRO GPU. The current Linux OEM listings describe Ubuntu with NVIDIA AI Developer Tools. Buy against the exact Windows or Ubuntu SKU, driver branch, expansion hardware and OEM support entitlement; do not assume a conversion path unless that OEM documents one.
Read the official Windows product notice →Spark maximizes affordable memory capacity in a tiny power envelope. Station adds a datacentre-class GPU memory tier, much larger coherent capacity, enterprise management and team-serving options.
| Decision | DGX Spark | DGX Station | What changes | Practical reading |
|---|---|---|---|---|
| Compute | GB10 Grace Blackwell; 20-core Arm CPU | GB300 Grace Blackwell Ultra; 72-core Arm CPU | Up to 1 versus 20 sparse FP4 PFLOPS | A 20× peak ratio is not a universal 20× workload ratio. |
| NVFP4 | ✓ Native Blackwell Validate the current GB10 kernel and engine path. | ✓ Native Blackwell Ultra Native W4A4 when the serving stack supports the model. | Both are newer-generation FP4 platforms; Station adds much more fast and coherent memory. | H100/H200 servers are different: Hopper lacks native FP4 Tensor Cores and uses a fallback where supported. |
| Coherent memory | 128 GB LPDDR5X | 748 GB total: 252 GB HBM3e + 496 GB LPDDR5X | 5.8× total capacity plus a dedicated HBM tier | Station moves 70–400B models into a far healthier memory envelope. |
| Memory bandwidth | 273 GB/s across unified LPDDR5X | 7.1 TB/s HBM3e; 396 GB/s CPU LPDDR5X; 900 GB/s C2C | A fast lane and a capacity lane | Know which tier holds the active weights and cache. |
| Vendor model ceiling | Up to 200B; up to 405B with two | Up to 1T; two systems can link | Frontier open-weight capacity becomes a one-node experiment | Ceilings describe fit, not quant quality or interactive speed. |
| Networking | ConnectX‑7 at 200 Gb/s | ConnectX‑8 up to 800 Gb/s | Faster two-node and storage fabric | Optics, cables, storage and switching are separate costs. |
| Power | 140 W GB10 TDP; 240 W supply | 1,600 W total-system specification | Office appliance becomes facilities-aware equipment | Confirm circuit, heat, acoustics and OEM configuration before ordering. |
| Operations | DGX OS; single-user companion or small endpoint | Ubuntu 24.04 with NVIDIA AI Developer Tools/CUDA-X plus BMC, Redfish and DCGM capabilities; NVIDIA AI Enterprise is a distinct entitlement unless the order states otherwise. | Central team node and fleet management become credible | A separate Windows Station is listed as coming in Q4; verify the exact SKU, NVIDIA AI Enterprise order line and support branch. |
| Best role | PoC, model evaluation, private single-user agents and ARM/CUDA development | Large-model development, local frontier inference, shared lab service and migration rehearsal | From proving a workflow to reproducing a larger production model class | Neither is automatically a highly available production service. |
These bands are planning estimates for one active model with useful context headroom. Package metadata, quantization scales, multimodal towers, speculative models, cache and concurrency can move the boundary.
Everyday agents fit well. The speculative ceiling reserves 20–25% of 128 GB and assumes a mixed checkpoint at 5.0–5.2 bits per parameter. NVIDIA's “up to 200B” figure is a tighter vendor ceiling, not the comfortable target.
This is the distinctive performance tier: the estimate leaves 20–25% of 252 GB HBM3e for runtime and cache. Larger checkpoints can still fit, but they cross into the slower coherent-memory lane.
This is speculative mixed-checkpoint memory math across 748 GB, not a benchmark. A 1T model may load only with less headroom, more aggressive precision choices or offload.
| Model class | Approximate weight math | DGX Spark | DGX Station | Verdict |
|---|---|---|---|---|
| 20–35B dense | ≈13–23 GB at 5.0–5.2 bits/parameter before runtime | Comfortable with useful context | Easy, but usually poor capital efficiency for one stream | Spark, RTX or rented GPU is normally the sweet spot. |
| 30–120B sparse MoE | ≈19–78 GB at 5.0–5.2 bits/parameter; all experts stay stored | Best balance when the NVFP4 build and GB10 kernels are mature | Strong high-concurrency or higher-precision tier | Spark for one developer; Station for a team or heavier evaluation. |
| 70–120B dense | ≈44–78 GB at mixed NVFP4; ≈70–120 GB at ideal eight-bit | Fits, but dense decode can expose the 273 GB/s limit | Clean HBM-resident target with room for cache | Station begins to make performance sense if this is the daily workload. |
| 200–405B | ≈125–263 GB at mixed NVFP4 before runtime and cache | A 200B fit is tight; two-node planning is ≈295–330B with headroom versus NVIDIA's up-to-405B ceiling | Roughly 200–300B can remain in HBM with useful reserve; larger builds spill into coherent memory | Station's clearest single-box advantage. |
| MiniMax M3 · 428B / 23B active | Official repositories: 232.9 GiB NVFP4; 413.3 GiB MXFP8; 795.5 GiB BF16 | One is out; two leave too little reserve for the official NVFP4 package plus runtime and useful cache | NVFP4 fits across coherent memory, but nearly fills the 252 GB HBM tier before runtime and cache | Plausible local candidate; the published NVIDIA recipe is nightly vLLM, TP8 on B200—not a measured single-Station run. |
| GLM‑5.2 · 753B / 40B active MoE | Official NVIDIA NVFP4 repository: 465 GB; BF16: about 1.51 TB, before runtime | Out of scope; even two are below the official NVFP4 package size | Fits across coherent memory with about 283 GB left before runtime and cache; not HBM-resident | Measured in the linked Station hands-on at about 24 decode tok/s for one stream; retain its exact runtime, prompt and quantization when comparing. |
| 1T class | ≈625–650 GB at mixed NVFP4; about 2 TB at BF16 | Out of scope | Tight capacity demonstration with ≈98–123 GB left before runtime and cache | Do not interpret the vendor ceiling as comfortable serving, full-precision training or million-token context. |
GLM‑5.2 has 753B total and 40B active parameters. NVIDIA's official NVFP4 repository is 465 GB, so the weights fit inside 748 GB but exceed the 252 GB HBM tier. The linked Station hands-on reports about 24 decode tok/s for one stream and about 243 prefill tok/s; use those as video-reported workload results, not a universal speed claim.
Pin the exact NVFP4 checkpoint, runtime/container, prompt length, output length and concurrency. Record cold and warm time to first token, per-user decode, aggregate throughput, peak memory in each tier, power at the wall and task accuracy against the unquantized or hosted reference.
GLM‑5.3 is available through the Coding Plan and uses the same base model as GLM‑5.2, but Z.ai had not released its weights or local serving recipes when checked on 15 August. Keep the 465 GB fit and every Station speed figure labelled GLM‑5.2 until a 5.3 checkpoint is measured on the same setup.
NVIDIA's MiniMax M3 NVFP4 repository totals about 232.9 GiB. It fits in Station's 748 GB coherent pool, but is approximately all of the advertised 252 GB HBM tier after unit conversion, leaving no comfortable HBM-only room for the runtime, multimodal tower, speculative model or KV cache. The current model card requires a nightly vLLM image and shows TP8 on B200; it does not establish single-GB300 Station support or speed.
Replay 50–100 real GPT‑5.4 mini jobs through the same agent scaffold. Compare passed tasks, reviewer edits, wall-clock time, tool-call failures, input/cache/output tokens, TTFT, decode, peak HBM and LPDDR use, and wall power. Current API prices make M3 2.5× cheaper on input and 3.75× on output below 512K, but only cost per accepted task tells you whether the switch saves money.
As of 3 August 2026, Alex Ziskind's ASUS Station hands-on adds agent-concurrency testing. Hosted-model comparisons and non-Station local MiniMax M3 measurements also exist, but procurement still needs reproducible model-level tokens-per-second, latency, memory-tier placement and wall-power tables on the exact Station configuration.
Artificial Analysis scores M3 44 versus GPT‑5.4 mini at xhigh 40 on its composite. On the much narrower English word-sense SenseBench, M3 is at 90.62% and several GPT‑5.4 mini low runs are at 89.49–90.89%. Those are hosted-model results, not proof of an NVFP4 Station build.
On ClawProBench's 89-task OpenCode TerminalBench 2.1 run, M3 solved 28 tasks and GPT‑5.4 mini solved 12. M3 used 302.0M input tokens versus 22.6M, so the result supports capability but warns against translating cheaper tokens directly into cheaper completed work.
Inspect the task, harness and token totals →The video below tests agent concurrency on an ASUS ExpertCenter Pro ET900N G3. Do not generalize that run to every checkpoint, quantization, context or concurrency. Separately, a community 4-bit MLX run on a 512 GB Mac Studio M3 Ultra reported 27.2 tok/s at a 1K prompt and 16.6 tok/s at 65K, with 226.6–238.1 GB peak memory.
Ziskind tests NVFP4 model throughput, continuous batching, an active agent swarm, power and thermals on the ExpertCenter Pro ET900N G3. The charts below reconstruct the video-reported values; preserve the exact runtime, prompts and logs before transferring them to a purchase decision.
Every bar keeps its metric and concurrency attached. Approximate ranges are shown as ranges; their bars use the midpoint only for visual scale. The 4,096 tok/s Nemotron burst is separated from the roughly 2,600 tok/s result reported at 128 concurrent requests.
Decode and prefill use separate axes. Longer is better within each block only.
Aggregate tok/s across parallel requests—not the speed seen by each user.
Throughput and watts use separate axes. Power values are reported at the superchip boundary.
Reported just above this level at 128 concurrent requests. Nemotron and Qwen both showed a dip around concurrency 32.
The video identifies concurrency 64 as the efficiency peak. Treat this as an optimum marker rather than a throughput comparison because no exact tok/s value accompanies this observation.
Aggregate decode rises from about 35 tok/s at concurrency 4 to 56 tok/s at 16; prompt processing reaches about 1,800 tok/s at 16.
Lambda's MLPerf Training v5.1 table reports a 72× GB300 NVL72 cluster at 1.26 minutes for Llama 2 70B LoRA and 14.25 minutes for Llama 3.1 8B. Its 1.27× comparison is against the best GB200 NVL72 result from the prior MLPerf round, and Lambda attributes gains to both hardware and a newer software stack.
Inspect Lambda's methods and table →NVIDIA says GB300 NVL72 delivered more than 4× Llama 3.1 405B pretraining and nearly 5× Llama 2 70B LoRA performance versus Hopper with the same GPU count. That is useful training-system evidence, but it combines architecture, methods, networking and software.
Read NVIDIA's MLPerf account →Distributed training does not scale linearly down to one desktop GPU, and a Station's 252 GB HBM3e differs from the 279 GB accelerators listed in Lambda's cluster. Only a run on the quoted Station SKU answers the purchase question.
Carry the distinction into acceptance →The creator video supplies useful measurements. A procurement-grade comparison still needs the complete manifest, repeated runs and raw result file below.
Cold and warm time to first token plus tokens per second per user at 1, 8 and 32 concurrent requests.
Prefill throughput, cache size, memory-tier placement and decode degradation at useful—not merely advertised—contexts.
Energy per million generated tokens and task-quality regression versus the reference checkpoint at the same harness settings.
NVIDIA defines and brands the DGX Station reference platform, but the official route is to contact a partner rather than use a first-party checkout. These manufacturer pages are buying routes, not endorsements; storage, added RTX PRO graphics, cooling, acoustics, rack conversion, regional availability, warranty and software support can differ.
DGX Station / GB300 tower.
Open ASUS system page →GB300 AI development workstation.
Open Dell system page →GB300 workstation configuration.
Open Exxact system page →Deskside AI supercomputer.
Open GIGABYTE system page →DGX Station-class workstation.
Open HP system page →NVIDIA DGX Station.
Open MSI system page →ARS-511GD-NB-LCC · tower or 5U.
Open Supermicro system page →Before a five- or six-figure hardware commitment, rent the candidate workload and establish whether the model’s memory tier, serving behavior and acceptance result justify ownership. A rental is a test drive, not a GPU-availability, hardware-validation, benchmark-equivalence or price guarantee.
These ASUS, MSI, Dell and HP introductions establish product shape and positioning. They are vendor demonstrations, not independent reviews or benchmark runs.
Use the film to inspect ASUS's system framing. Confirm storage, added RTX PRO GPU, support, acoustics, lead time and final memory figure on the quoted SKU.
The trailer shows MSI's DGX Station implementation. Treat its performance language as positioning until the exact system is independently tested.
Dell's short overview shows the intended form factor and enterprise role. Ask Dell for the same acceptance evidence as any other OEM.
HP's introduction shows its DGX Station implementation and intended workstation role. Confirm the exact memory, storage, graphics, support and acceptance result on the quoted configuration.
One European NVIDIA Elite Partner listed DGX Station at €99,888 excluding VAT on 24 July 2026. OEM configuration, warranty, delivery, storage, networking and regional pricing can change the actual project total.
You repeatedly run or adapt 120–700B models, the data cannot use an ordinary cloud endpoint, several developers share the node, and queueing or egress already has a measured cost.
You need private PoC, agent evaluation, ARM/CUDA development or sparse MoE inference below 128 GB. Prove demand before multiplying capital cost and facilities work.
Use a short controlled rental or OEM evaluation unit to establish precision, quality, throughput and utilization. Buy only when the repeatable workload beats the fully loaded alternative.
DGX Station is an OEM platform, so the NVIDIA architecture does not settle storage, support, acoustics, delivery, additional GPU or operating-system details for a particular quote.
| Gate | Ask the supplier | Run during acceptance | Keep | Reject when |
|---|---|---|---|---|
| Exact configuration | Memory, SSDs, added RTX PRO GPU, firmware, OS/support branch, warranty and lead time | Inventory, health, ECC, storage and network checks | Signed bill of materials and support entitlement | The delivered SKU or software branch differs from the tested quote. |
| Software entitlement | EC or order line for NVIDIA AI Enterprise: GPU metric, term, support level, start date, renewal and any trial conditions | Register only the stated entitlement and record its support contact | EC, activation record and named escalation path | Preinstallation, a NIM download or an OEM compatibility claim is offered instead of the stated entitlement. |
| Model result | The exact checkpoint, quant, container, engine, context and concurrency | Your cold/warm benchmark and quality holdout | Raw logs, manifest and result summary | Only peak PFLOPS, rack results or an undisclosed prompt are offered. |
| Facilities | Maximum and typical draw, connector/circuit, heat, sound pressure and service clearance | Sustained load in the intended room | Power, thermal and acoustic readings | The office, circuit or cooling cannot sustain the quoted configuration. |
| Recovery | Firmware/OS recovery, BMC access, spare parts and response times | Rebuild one model service from a clean manifest and restore its data | Offline recovery material and tested runbook | A failed SSD, update or image leaves no supported recovery route. |
| Scale path | Validated cables, optics, two-node software, storage fabric and migration support | Only the topology you expect to buy | Network diagram, compatibility list and measured delta | “Up to 800 Gb/s” substitutes for an end-to-end result. |
Spark proves the workflow. Station proves the larger model class. Neither proves the business case for you.