GIGABYTE Releases 2U Server: G262-ZR0 with NVIDIA HGX A100 4-GPU (2024)

');$('.tpu-fancybox-wrap').css('maxWidth', maxWidth);*/instance.$refs.stage.on('transitionend', function() {updateButtonPos(instance);});},onUpdate: updateButtonPos,afterShow: function(instance, slide) {updateButtonPos(instance);instance.$refs.inner.find('.fancybox-tpu-nav').show();},beforeClose: function(instance, slide) {instance.$refs.inner.find('.fancybox-tpu-nav').hide();},afterClose: function(instance, slide) {$('.tpu-fancybox-wrap').contents().unwrap();$('body').removeClass('tpu-fancybox-body-wrap')},baseTpl: '

' +'

' +'

' +'

' +'' +'' +'' +'

' +'

' +'

' +'

' +'

',});});}loadjs.ready(['jquery', 'fancybox', 'swiper'], function() {attachLightbox('a[data-fancybox]');if ($(window).width()<600) {$('.imgcontainer').each(function() {var $this=$(this);if (($this.find('a').length==1) || ($this.find('a').length>7))return;$this.addClass('swiper-container');$this.find('a').addClass('swiper-slide').css('width', 'auto').wrapAll('

');$this.find('.swiper-wrapper').after('

');new Swiper ($this.eq(0), { slidesPerView: 'auto', slidesPerGroup: 1, spaceBetween: 15, pagination: { el: '.swiper-pagination', clickable: true } });});}$('.newspost').on('click', '.spoiler > .button, .spoiler > a', function(e) {e.preventDefault();$(this).next('div').toggle();});$('.newspost').on('click', '.ispoiler', function(e) {e.preventDefault();$(this).find('div').css('filter', '');$(this).removeClass('ispoiler');});$('.contnt').on('click', '.newspoll_btn', function() {popup.Show('TechPowerUp Quick Poll','Loading...');$.get('/news-poll/options?id='+$(this).data('id'), function(data) {$('#popup_content').html(data);});});});

Friday, February 19th 2021

GIGABYTE Releases 2U Server: G262-ZR0 with NVIDIA HGX A100 4-GPU (1)

Press Releaseby

AleksandarK
Discuss (15 Comments)

GIGABYTE Technology, (TWSE: 2376), an industry leader in high-performance servers and workstations, today announced the G262-ZR0 for HPC, AI, and data analytics. Designed to support the highest-level of performance in GPU computing, the G262-ZR0 incorporates fast PCIe 4.0 throughput in addition to NVIDIA HGX technologies and NVIDIA NVLink to provide industry leading bandwidth performance.

Key Technologies of the G262-ZR0:

  • NVIDIA A100 with 40 GB or 80 GB: 40 GB of VRAM with 1.6 TB/s of memory bandwidth or 80G of VRAM with 2.0 TB/s bandwidth for high-level computational throughput.
  • Excellent GPU-to-GPU communication via 3rd gen NVIDIA NVLink with 600 GB/s bandwidth.
  • Reduction in latency and CPU utilization with Mellanox Socket Direct technology. In this dual-socket server, a single CPU can access the network by bypassing the inter-processor communication bus and adjacent CPU.
  • PCIe 4.0 allows for faster interconnect (compared to PCIe 3.0) and low latency for NICs and NVMe drives via PCIe switch fabric.
  • Ultra-fast 200 Gbps access of GPUs on other servers with RDMA and HDR InfiniBand.

Introduction to the G262-ZR0:
The G262-ZR0 offers the highest GPU compute possible in a 2U chassis, and it is built with the latest technology to provide the fastest connections. 128 cores from the dual 2nd gen AMD EPYC processors and 160 PCIe Gen 4 lanes are required for the max throughput between CPU-to-CPU and CPU-to-GPU connections. Inside the G262 is the NVIDIA HGX A100 4-GPU platform for impressive performance in HPC and AI. In addition, the G262 has 16 DIMM slots for up to 4 TB of DDR4-3200 MHz memory in 8-channels. There are 6 low-profile (Gen 4) slots, one OCP 3.0 slot, and dual 1GbE LAN ports. For drives, 4x 2.5" U.2 NVMe/SATA bays and 2x M.2 slots. Powering the system are 2x 3000 W 80+ Platinum redundant power supplies. To accommodate such a powerful system a strong emphasis on thermal design was incorporated and the server was split creating a chamber dedicated to cooling the GPUs, and another for CPUs, memory, and expansion slots.

Remote and Multiple Server Management:
As part of GIGABYTE's value proposition, GIGABYTE provides GIGABYTE Management Console (GMC) for BMC server management via a web browser-based platform. Additionally, GIGABYTE Server Management (GSM) software is free to download and used to monitor and manage multiple servers. GMC and GSM offer great value while reducing license and customer maintenance costs.

Related News

  • Tags:
  • 4 TB
  • 6 TB
  • 8-channel
  • A100
  • AMD
  • CPU
  • EPYC
  • GIGABYTE
  • GPU
  • Mellanox
  • NVIDIA
  • NVLink
  • NVMe
  • PCIe
  • Remote
  • Server
  • Technology
  • U.2
  • Apr 16th 2020 AMD Ryzen 4000 Series "Vermeer" CPUs to be Compatible with B450 Motherboards (58)
  • Nov 3rd 2022 AMD Radeon RX 7900 XTX Performance Claims Extrapolated, Performs Within Striking Distance of RTX 4090 (164)
  • Jan 29th 2024 Top AMD RDNA4 Part Could Offer RX 7900 XTX Performance at Half its Price and Lower Power (292)
  • Jan 22nd 2024 Intel 15th-Generation Arrow Lake-S Could Abandon Hyper-Threading Technology (100)
  • May 10th 2024 AMD Hits Highest-Ever x86 CPU Market Share in Q1 2024 Across Desktop and Server (140)
  • May 9th 2024 NVIDIA Testing GeForce RTX 50 Series "Blackwell" GPU Designs Ranging from 250 W to 600 W (84)
  • Apr 12th 2024 NVIDIA Points Intel Raptor Lake CPU Users to Get Help from Intel Amid System Instability Issues (106)
  • Dec 11th 2022 First Alleged AMD Radeon RX 7900-series Benchmarks Leaked (146)
  • Apr 15th 2024 Sony PlayStation 5 Pro Specifications Confirmed, Console Arrives Before Holidays (119)
  • Dec 6th 2023 Set Your Calendars: Windows 12 is Coming in June 2024 with Arm Support and AI Features (163)
Add your own comment
#1
Caring1

Mining/ Gaming edition? :laugh:

#2
kayjay010101

I've been around a lot of loud servers, but that looks to be a screamer. It's even got fans sticking out of the front over the ears! I guess you need that to cool 3KW in 2U's lol
But seriously, this looks insane. A lot of awesome hardware in just 2U's. I can't even imagine how many digits one of these would run ya kitted out. 6? maybe even 7.

#3
mashie
kayjay010101I've been around a lot of loud servers, but that looks to be a screamer. It's even got fans sticking out of the front over the ears! I guess you need that to cool 3KW in 2U's lol
But seriously, this looks insane. A lot of awesome hardware in just 2U's. I can't even imagine how many digits one of these would run ya kitted out. 6? maybe even 7.

I would guess $100k considering the bigger brother with twice the hardware is $200k: www.datacenterdynamics.com/en/news/nvidia-launches-5-petaflops-dgx-a100-and-cloud-centric-hgx-a100/

#5
TumbleGeorge

Ultra performance machine for a ton of money with slow old 1Gbps network? When 2*10Gbps is very normal in use from years.

#6
mashie
TumbleGeorgeUltra performance machine for a ton of money with slow old 1Gbps network? When 2*10Gbps is very normal in use from years.

No one that buy such servers will use the integrated NIC's for anything but iLO/device management.

Due to different requirements for different users the network cards for production traffic are not included, those 16x PCIe 4.0 slots will hold multiple 100G or Infiniband NIC's.

#8
mashie

The $200k price is for a fully loaded pod.

I can only imagine servers have the same type of discount as networking kit so silly discounts may apply (I look at you Cisco).

#9
TumbleGeorge
mashieNo one that buy such servers will use the integrated NIC's for anything but iLO/device management.

Due to different requirements for different users the network cards for production traffic are not included, those 16x PCIe 4.0 slots will hold multiple 100G or Infiniband NIC's.

It always makes an impression when in a $ 100,000+ product, the designer or assembler has saved a few dollars and used the lowest class for an interface. I would understand him if it was a machine that will produce tens of millions of units and the savings from questionable action summarized up to a solid amount of ca$h.... But in this case ...Yes they will sale biuld in on pcie card network parts additionally...and will milk clients for more money for "optional parts and accessories". So correctly, so capitalistically :D

#10
ypsylon

For sure it does look like epic setup, without any CPU puns. 7 fans (or 10 if under that front shroud are doubles), probably about 8-12Amps each at max tilt... woof. That's how much solid, rendering workstation draws total power. With noise levels challenging space shuttle during lift-off. ;)

One thing you can count on tho. There will be at least one person/company which will try it for mining. To recoup part of the investment - safest bet you'll ever make. Even if in previous mining craze Quadros or Teslas were much inferior, but at 50k right now/1 BTC they don't have to run this for very long.

#11
Patriot
TumbleGeorgeIt always makes an impression when in a $ 100,000+ product, the designer or assembler has saved a few dollars and used the lowest class for an interface. I would understand him if it was a machine that will produce tens of millions of units and the savings from questionable action summarized up to a solid amount of ca$h.... But in this case ...Yes they will sale biuld in on pcie card network parts additionally...and will milk clients for more money for "optional parts and accessories". So correctly, so capitalistically :D

You do realize different customers want different nics right? Not everyone wants or needs the $2k nic, and some want 4 of them...
GIGABYTE Releases 2U Server: G262-ZR0 with NVIDIA HGX A100 4-GPU (4)

#12
TumbleGeorge
PatriotYou do realize different customers want different nics right? Not everyone wants or needs the $2k nic, and some want 4 of them...
GIGABYTE Releases 2U Server: G262-ZR0 with NVIDIA HGX A100 4-GPU (5)

Nik's integrated on motherboards is much much cheaper than models on dedicated pcie adapters.

#13
Patriot
TumbleGeorgeNik's integrated on motherboards is much much cheaper than models on dedicated pcie adapters.

Just... no.

#14
Jism
TumbleGeorgeNik's integrated on motherboards is much much cheaper than models on dedicated pcie adapters.

Yeah but, in professional stuff; it's kind of different then your local homebased NIC. Enterprise hardware is designed for 24 hours constant bashing, years long.

#15
Wirko

A car analogy. Everybody loves them, I know. Wheeled excavators, bulldozers etc., in particular the heaviest types, the ones that easily exceed 200k €, are sold without wheels. Wheels must be ordered separately. There are several types, costing ... well, more than that 200G card apiece (wheel and tyre).

Add your own comment
GIGABYTE Releases 2U Server: G262-ZR0 with NVIDIA HGX A100 4-GPU (2024)
Top Articles
Latest Posts
Article information

Author: Dan Stracke

Last Updated:

Views: 6391

Rating: 4.2 / 5 (43 voted)

Reviews: 82% of readers found this page helpful

Author information

Name: Dan Stracke

Birthday: 1992-08-25

Address: 2253 Brown Springs, East Alla, OH 38634-0309

Phone: +398735162064

Job: Investor Government Associate

Hobby: Shopping, LARPing, Scrapbooking, Surfing, Slacklining, Dance, Glassblowing

Introduction: My name is Dan Stracke, I am a homely, gleaming, glamorous, inquisitive, homely, gorgeous, light person who loves writing and wants to share my knowledge and understanding with you.