Puget Systems Returns to SIGGRAPH 2024 to Demonstrate its On-Premises Generative AI and Machine Learning Custom Server
Puget Systems to Debut Newest Custom LLM AI Training and Inference Server with Support for Up to Eight NVIDIA RTX Ada Generation GPUs, NVIDIA L40S GPUs or NVIDIA H100 Tensor Core GPUs, and NVIDIA Networking Platforms
Auburn, WA (July 25, 2024) – Puget Systems (www.puget systems.com) today announced it is returning to SIGGRAPH 2024 in Denver later this month to debut its newest custom Generative AI and Machine Learning server. With support for up to eight NVIDIA RTX™ Ada Generation GPUs, NVIDIA L40S GPUs or NVIDIA H100 Tensor Core GPUs with H100 NVL, the newest LLM AI Training and Inference Servers from Puget Systems are optimized for maximum GPU performance in a 4U server in on-premises local data center deployments.
To demonstrate the power of its newest specialized AI Training and Inference servers, the team from Puget Systems will be on hand at SIGGRAPH 2024 in booth #536 to showcase a sophisticated, GPU-intensive, real-time AI image generation solution that uses a StreamDiffusion pipeline. The demonstration will be run locally on the Puget Systems server to showcase how these complex, hardware-intensive workflows – which require powerful GPUs, such as the NVIDIA RTX 6000 Ada Generation GPU, to generate high-quality imagery with smooth frame rates – are possible using Puget Systems’ custom, localized hardware.
Attendees at SIGGRAPH 2024 will see how the Puget Systems Generative AI and Machine Learning Server can pass a source image into a Stream Diffusion operator in TouchDesigner with a GUI to control the Stream Diffusion parameters, such as the Acceleration Library, Resolution, Steps, and Prompt. Additionally, various input methods, including webcams, visual noise, Adobe Photoshop (for live AI painting), and a mouse pointer for physical fluid simulation, can be selected in the GUI. The interpretation of the input image then creates an AI-generated output image in real-time at high frame rates.
The Puget Systems AI Training and Inference Server: Flexible, Scalable, Powerful
The Puget Systems AI Training and Inference Servers are rack-mount workstations specifically designed for GPU-intensive generative AI workflows, much like the StreamDiffusion demo shown in Puget Systems’ booth at SIGGRAPH 2024.
The newest Puget Systems AI Training and Inference Servers offer AMD’s EYPC line of processors, which are designed for demanding server workloads, offering up to 128 cores with support for 1.5TB DDR5 ECC RAM and 128 PCIe Gen 5 lanes. The servers use a pair of those CPUs to enable up to eight dual-width GPUs in a 4U rackmount chassis, and several hot-swap drive bays are easily accessible on the front, along with a pair of USB ports.
With support for up to eight NVIDIA GPUs with up to 752GB of total VRAM, this server is ideal for machine learning, AI, and rendering workloads. Additionally, for enterprise or data center customers, the Puget Systems AI Training and Inference Server also offers support for the NVIDIA L40S or NVIDIA H100 NVL Tensor Core GPU. The NVIDIA H100 NVL GPU is ideal for LLM inference with its high compute density, memory bandwidth, and energy efficiency, and NVIDIA NVLink architecture. It also delivers extraordinary acceleration to power the world’s highest-performing elastic data centers for AI, data analytics, and high-performance computing (HPC) applications. Select Puget Servers also support the NVIDIA BlueField® networking platform, including the NVIDIA BlueField-3 DPU.
For more information, please visit here or contact one of Puget Systems’ expert tech consultants.
Pricing and Availability
Puget Systems custom AI Training and Inference servers are available for configuration for a wide range of generative AI applications. To learn more, please visit here. To learn more about Puget Systems’ Canadian consulting and sales operations, please visit here.
About Puget Systems
Puget Systems is based in the Seattle suburb of Auburn, WA, and specializes in high-performance custom-built computers. We emphasize customization with a laser focus on understanding each customer’s specific workflow and offer personal consulting and support that we believe is becoming quite rare in the industry. Our goal is to provide each client with the best possible computer for their needs and budget. For more information or to see how Puget Systems can design a system specifically tailored to the work that you do, please visit www.pugetsystems.com.