Quad GPU 5U Rackmount Workstation for Deploying AI Models
Convertible 5U rackmount server / tower workstation for fine-tuning and starting deployment of large language model inference and other AI-based tools.
Overview
Convertible 5U rackmount server / tower workstation designed for fine-tuning and inference with LLMs and other AI models.
- Supports up to 4x NVIDIA RTX PRO™ 6000 Blackwell Max-Q video cards with a total of 384GB of VRAM
- Tested with Llama-2-70b-chat-hf and Falcon-40b
- Runs on 120V power – requires a single 20 amp or two 15 amp circuits
Not sure what you need?
Tell us your situation and one of our experts will reply within 1 business day to help configure the right computer for your workflow. If you don’t see what you are looking for here, check out our other systems for more options.
System Ports
Back Ports:
- USB BIOS Flashback Button
- Clear CMOS Switch
- USB 2.0 Port(s)
- iKVM LAN Port (RJ-45)
- USB 3.2 Gen 2 (USB 3.1) Port(s)
- 10G LAN Ports (RJ-45)
- USB 3.2 Type C Port(s)
- USB 3.2 Gen 2×2 Type C
- VGA Out Port
- Audio Jacks
Front ports:
- Power Switch
- Reset Switch
- HDD LED
- LAN LED
- USB 3.2 Gen 1 (USB 3.0) Port(s)
- USB 3.2 Type C Port(s)