{"title":"Infinity Forge GPU Servers","description":"\u003cp\u003eFour-GPU and eight-GPU server platforms for on-premises AI and compute, configured and quoted per project.\u003c\/p\u003e","products":[{"product_id":"infinity-forge-4-4x-rtx-pro-6000-blackwell-max-q-96gb-server-epyc-9575f","title":"Infinity Forge 4 | High-Performance Multi-GPU Server | 4x RTX PRO 6000 Blackwell Max-Q 96GB Server | EPYC 9575F","description":"\u003cp\u003eFor AI teams that have outgrown one or two GPUs. It is designed for organizations serving large open models to many users, labs running four-GPU fine-tuning, render studios and managed service providers hosting private AI for their clients, in a server room or colocation facility with 200 to 240 V power and a rack at least 1,000 mm deep. It delivers four times the GPU memory of a single-GPU Forge 2 in a purpose-built GPU chassis with front-to-back airflow and 1+1 redundant power.\u003c\/p\u003e\n\u003cp\u003eEvery Forge 4 is a consultative build, specified around your models, users and site. The reference configuration places four NVIDIA RTX PRO 6000 Blackwell Max-Q 96GB GPUs (384GB of GDDR7 ECC in total) on PCIe 5.0 x16 slots in a 4U single-socket AMD EPYC GPU server platform such as the MSI G4101. It pairs a 64-core AMD EPYC 9575F under a closed-loop liquid cooling module with 384GB of DDR5-6400 ECC registered memory across all twelve channels, dual 25GbE SFP28, two 4TB NVMe drives for the operating system and models, twelve U.2 NVMe bays for expansion, a dedicated BMC port and 1+1 redundant 3000 W power supplies. The platform, GPU count, memory, storage and networking are confirmed with you, and the GPU configuration is confirmed in writing with the platform vendor, before we quote.\u003c\/p\u003e\n\u003cp\u003eFour 96GB GPUs hold Qwen3-235B-A22B-Instruct-2507 in its official FP8 release (236 GB of weights) with a 128K-token context and over 100GB left for concurrent sessions (Infinity estimate), or several large models side by side, such as gpt-oss-120b on one GPU and a 70B model at 8-bit on another. MIG divides the GPUs into as many as sixteen isolated 24GB instances for a shared cluster, and PyTorch FSDP spreads fine-tuning across all four cards.\u003c\/p\u003e\n\u003cp\u003eCompared with Forge 2, it doubles the maximum GPU count to four and moves to a 12-channel EPYC platform with redundant power and 25GbE as standard, but it needs 200 to 240 V power and an 831 mm-deep chassis. Compared with Forge 8, it stays single-socket with 300 W GPUs and draws roughly 2.2 kW, against about 6.9 kW for Forge 8's eight 600 W Server Edition GPUs.\u003c\/p\u003e\n\u003cp\u003eThe build includes a processor BIOS check, BMC\/IPMI and Redfish setup, a 72-hour burn-in that validates every GPU's PCIe 5.0 x16 link, thermals and power, and the AI stack: NVIDIA open driver and CUDA, NVIDIA Container Toolkit, vLLM configured across the four GPUs and MIG profiles, with an as-built document. A site readiness survey covering voltage, circuits and inlet type, rack depth, cooling and network is required before ordering and is credited against the order.\u003c\/p\u003e\n\u003cp\u003eOptions include starting with two GPUs and adding two later; a value and virtual-GPU variant with four RTX PRO 5000 Blackwell 72GB GPUs (288GB, on NVIDIA's vGPU supported list; licences separate); 768GB of system memory where supply allows; dual 100GbE networking; enterprise U.2 NVMe storage; and on-site installation by two technicians with a lift.\u003c\/p\u003e\n\u003cp\u003eIt needs 200 to 240 V power on two circuits, a deep rack and a two-person or lift installation, and it has no onboard data network ports, so a network card is always fitted. GPUs connect over PCIe 5.0 without NVLink, Max-Q GPUs do not support NVIDIA vGPU, and a 671B-class model at 4-bit (about 405 GB) does not fit in 384GB. Components are ordered per project and some are non-cancellable, so a deposit is required.\u003c\/p\u003e\n\u003cp\u003eBacked by the Infinity Computers 3-Year Hardware Warranty and Lifetime Technical Support, with no contractual on-site response time. Delivered by pallet freight to a loading dock or server room, or delivered and installed by Infinity by quote. Configured and quoted per project in CAD before HST; built and tested in Ontario.\u003c\/p\u003e","brand":"Infinity Computers Canada","offers":[{"title":"Default Title","offer_id":67625060860098,"sku":"INF-FG-4","price":0.0,"currency_code":"CAD","in_stock":false}],"thumbnail_url":"\/\/cdn.shopify.com\/s\/files\/1\/0766\/3593\/0818\/files\/infinity-sentinel-business-server-front-mesh.png?v=1794006309"},{"product_id":"infinity-forge-8-8x-rtx-pro-6000-blackwell-server-edition-96gb-server-2x-epyc-9575f","title":"Infinity Forge 8 | Enterprise AI Research Server | 8x RTX PRO 6000 Blackwell Server Edition 96GB Server | 2x EPYC 9575F","description":"\u003cp\u003eFor university and hospital research groups, AI start-ups and enterprises that need sustained eight-GPU capacity with data kept on site: an on-premises alternative to shared HPC allocations or long-term cloud GPU rental. It is a data-centre system that draws about 6.9 kW, needs four 220 to 240 V inputs and occupies 4U of a deep rack, so every project begins with a consultation and a site survey.\u003c\/p\u003e\n\u003cp\u003eThe reference design is built on the ASUS ESC8000A-E13, a 4U dual-socket GPU server in which each of eight dual-slot GPU slots has its own PCIe 5.0 x16 link to a processor. It pairs two 64-core AMD EPYC 9575F processors and 768GB of DDR5-6400 ECC registered memory with eight NVIDIA RTX PRO 6000 Blackwell Server Edition GPUs (96GB of GDDR7 ECC each, 768GB in total), cooled by the chassis's GPU fan modules and configurable up to 600 W each. Dual 100GbE networking, two 3.84TB enterprise U.2 NVMe drives and 3+1 redundant 3200 W Titanium power supplies complete it. The platform, GPU model and count, memory and fabric are confirmed for each project.\u003c\/p\u003e\n\u003cp\u003e768GB of GPU memory holds a 671B-parameter open model such as DeepSeek-V3.1 at 4-bit (Q4_K_M, 405 GB) with ample room for long contexts and many users (Infinity estimate), or several large models in parallel. The Server Edition supports NVIDIA vGPU, so the node can host GPU-accelerated virtual machines and desktops, and MIG can create up to 32 isolated 24GB instances for a shared research cluster.\u003c\/p\u003e\n\u003cp\u003eCompared with Forge 4, it doubles the GPU count and moves to 600 W Server Edition GPUs that support NVIDIA vGPU, two processors with 24 memory channels, 3+1 redundant power and 100GbE. It is not an NVSwitch training system: GPUs communicate over PCIe 5.0, which suits inference, fine-tuning and many parallel jobs.\u003c\/p\u003e\n\u003cp\u003eEach project includes assembly, BIOS and BMC setup, GPU power-cap configuration matched to your power feeds, a 72-hour burn-in validating every GPU's link, thermals and power, the CUDA stack with the NVIDIA Container Toolkit, optional vGPU host setup and an as-built document. A site survey covering four 220 to 240 V \/ 16 A inputs, PDU sizing, about 23,500 BTU\/h of cooling, rack depth and floor loading is mandatory; on-site installation, Slurm or Kubernetes setup and a remote-monitoring arrangement are quoted.\u003c\/p\u003e\n\u003cp\u003eOptions include starting with four GPUs and expanding to eight, eight RTX PRO 5000 Blackwell 72GB GPUs (576GB) subject to platform-vendor confirmation, 1.5TB of system memory where supply allows, a RAID\/HBA card for more NVMe drives, and 400 Gb fabric for multi-node work.\u003c\/p\u003e\n\u003cp\u003eIt is for data centres only: 220 to 240 V power, about 6.9 kW and about 23,500 BTU\/h of heat, a deep rack and a lift installation. The 3+1 power supplies protect against a supply failure; surviving the loss of a whole A\/B power feed at full load needs a GPU power cap or more feed capacity. There are no onboard data ports and no NVLink, and only two NVMe drives without a RAID\/HBA card. Platform and Server Edition GPU availability, pricing and lead time are confirmed at quote; there is no stock unit.\u003c\/p\u003e\n\u003cp\u003eBacked by the Infinity Computers 3-Year Hardware Warranty and Lifetime Technical Support, with no contractual on-site response time. Delivered by pallet freight with liftgate and inside delivery to the data centre, or installed by Infinity by quote. Every order is quoted in CAD before HST, with a deposit and agreed terms; built and tested in Ontario.\u003c\/p\u003e","brand":"Infinity Computers Canada","offers":[{"title":"Default Title","offer_id":67625060925634,"sku":"INF-FG-8","price":0.0,"currency_code":"CAD","in_stock":false}],"thumbnail_url":"\/\/cdn.shopify.com\/s\/files\/1\/0766\/3593\/0818\/files\/infinity-sentinel-business-server-front-mesh.png?v=1794006309"}],"url":"https:\/\/infinitycomputers.ca\/collections\/infinity-forge-servers.oembed","provider":"Infinity Computers Canada","version":"1.0","type":"link"}