Power rating
Published detail1,600 W Titanium PSU capacity at 115–240 V; lower 12 V rail capacity at 100–114 V. [1]
Manufacturer product image. The selected configuration may vary.
GB300 Grace Blackwell Ultra
A GB300 system that moves from tower to 5U rack with an optional kit, bridging deskside experiments and an on-premises installation.
Compared withNVIDIA DGX Station
BEFORE IT ARRIVES
What this configuration needs on your premises.
Plan a ventilated equipment space for sustained shared workloads. A suitable office is possible after checking power, noise and physical access; its internal liquid loop does not require a data center by itself.
1,600 W Titanium PSU capacity at 115–240 V; lower 12 V rail capacity at 100–114 V. [1]
1,600 W PSU input rating: 115–240 V AC, 50–60 Hz. Confirm the delivered cord and low-voltage operating restrictions. [1]
NVIDIA specifies a 20 A circuit for the DGX Station platform. Have the supplier confirm the exact OEM system, input voltage and regional connection requirements. [3]
Closed-loop, direct-to-chip liquid cooling plus chassis fans (two 120 mm, one 80 mm, one 60 mm and one 40 mm). [1][2]
Whole-system ambient temperature and humidity limits are not verified. A power-supply temperature limit is not a system limit.
No comparable noise measurement under an AI workload verified. Ask for dB(A), distance, workload and ambient conditions; audition it before placing it beside people.
ACTUAL CONSUMPTION
PSU capacity, chip TDP and measured consumption describe different things. Only measurements with a stated configuration and test method appear here.
No attributable wall-power test for this configuration was established in this review. Measure at the outlet with the exact model, workload, runtime and power mode recorded.
Allow for sustained room heat, including after office hours. A ventilated equipment room may be more practical for multiple systems or continuous jobs. An internal liquid cooler does not remove the need for room cooling.
Lab planning guidance. Office suitability depends on the installed configuration, shared circuits, heat removal and acceptable noise; a workstation label alone does not settle it.
Enter average power at the wall for the hours you are modeling, or an explicit planning assumption. Supply wattage and chip TDP are not consumption measurements.
Add wall power to calculate a scenario.
Scenario only. Hours outside this period are excluded: include idle time for an always-on system. Displays, networking, UPS losses and room air conditioning are extra. Heat assumes the computer and power supply release their heat into this room; it does not size a circuit or an HVAC system. Currency selects your tariff’s unit, with no conversion.
Manufacturer documentation and attributed first-hand hardware inspections, scoped to the named model or configuration. “Not verified” identifies a gap in this review, not a claim that the manufacturer has no documentation. Installation assessments are the Lab’s interpretation.
Keep sensitive processing on your infrastructure. Inspect every connection in the complete stack.
Control access, connectivity and updates. A local machine still needs a secure deployment.
Generate tokens on your own compute. Understand the full cost of the useful work it delivers.
SHARED WORK AROUND THIS PLATFORM
Reference-platform guidance and field records. Exact OEM configurations need their own validation.
A professional-services firm’s on-premises deployment: applications, confidentiality and the expertise to operate the system. The firm is not named at its request.
Connect applications to a model server on a GB10 or GB300 reference platform using vLLM.
Explore SGLang serving, structured output and the conditions to check on a GB300 workstation.
THE PLATFORM BEHIND THE MACHINE
8 catalog configurations
BEYOND THE SPECIFICATION
Published guidance and checklists to help you investigate the full deployment.
UT’s reported journey across serving stacks, hardware integration and customer feedback. A starting record for the decisions and evidence still to publish.
An operator-reported startup observation from UT’s GB10/GB300 work. The next step is to identify the exact configuration and separate the startup phases.
An execution agent and confidential engineering test assets show how on-premises AI extends beyond office applications.
THE CONFIGURATION
ON YOUR PREMISES
BEFORE YOU CHOOSE
Optional rackmount kit; confirm rails, rack depth, circuit and acoustic suitability with the integrator.
748 GB combines 252 GB GPU and 496 GB CPU memory. An optional display GPU has its own separate memory.
Manufacturer specificationsHelp improve this record. Suggest a correction
IN THE FIELD
Operating records from customers, contributors and the Lab.
In an office, a factory, an engineering lab or beside your test equipment. Share a deployment and keep the people behind it credited.
Contribute a deploymentTHE SHARED TECHNICAL LIBRARY
Supplier recipes, community experience and UT’s deployment lessons, connected to the hardware.
Browse serving, development and application guides.
Individual playbooks have their own hardware support matrices. Do not assume all target both platforms.
Why runtime selection became an operating decision at UT.
The narrative is operator-reported. Pinned versions and comparable results are still to be attached.
Separate download, preparation, model loading and service readiness.
An open investigation, not a diagnosed universal NIM issue. Cold and warm starts need separate measurement.
Loading updates…
MEMBER RATINGS · SELF-DECLARED, NOT MEASURED
One rating per member, tied to a Lab profile. Stars count immediately; written verdicts are published after a quick review by the Lab team. A rating is an opinion about fit for a job, not a benchmark.
THE PEOPLE BEHIND THE MACHINES
Questions, ideas and experience from putting AI machines to work. You do not need a finished deployment to contribute.
Loading the discussion…
THE MACHINE × THE MODEL × THE WORKLOAD
Connect the model, serving stack, workload and cost of operating this box.
| Model | Serving configuration | Capacity planning | Evidence | Inspect |
|---|---|---|---|---|
| Checkpoint default · confirm dtype | Vendor starting point | |||
| Checkpoint default · confirm dtype | Vendor starting point | |||
| Checkpoint default · confirm dtype | Vendor starting point | |||
| Checkpoint default · confirm dtype | Vendor starting point |
Mutable container tag; pin its digest and model revision.
Reference-platform evidence does not establish exact-OEM performance.
Each measured result belongs to one box configuration, one model, one serving stack and one workload. Publish latency, per-stream speed, request rate, errors and task quality together.