- Get link
- X
- Other Apps
Nvidia Servers
This is a topic which I feel is missed by a really large number of people. Servers. We all talk about cloud services these days and how there are hundreds of servers in the background doing the work. There are some incredible setups which include loads of storage, massive amounts of speed via hardware and network as well as stupidly high quantities of memory and processing power.Welcome to Nvidia's world
About a 2 years ago, Nvidia launched its first server system, the DGX-1. It was and still is a massively overpowerd system which can probably do the job 5 servers do for a standard business (at a price).
Here's a couple of numbers for you. The DGX-1 has up to 1000 TFLOPS of processing power (with 8 Tesla V100 GPU), 40,000+ CUDA cores, 128GB of GPU memory as well as 2, yes 2! 20 core Xeon E5-2698 processors. On top of that, it makes todays new DDR4 machines look limited with 512GB of DDR4 memory on top of all that!
Introducing the DGX-2
The DGX-2 also can be selected with the V100 GPU but now instead of 8 GPU's, theres 16! This means an insane 2 TFLOPS of GPU processing power is now available. This brings the CUDA core count over 80,000!
Just to make sure the performance stays at peak, the DGX-2 comes with 2 Xeons again but this time 24 core 8168's!
So is that it? No, the amount of system memory has been TRIPLED to 1.5 TB. There are some further insane specs to add too so the best way to demonstrate them is in a table.
| DGX-1 | DGX-2 | |
|---|---|---|
| GPU's | 8 Tesla V100's | 16 Tesla V100's |
| TFLOPS | ~1000 | ~2000 |
| GPU Memory | 128GB | 512GB |
| CPU | Dual Xeon E5-2698 20 Cores @ 2.2GHz | Dual Xeon 8168 24 Cores @ 2.7GHz |
| CUDA Cores | 40,960 | 81,920 |
| Power requirements | 3.2 kw | 10 kw |
| DDR4 Memory | 512GB | 1.5TB |
| Storage | 4 x 1.92TB SSD Raid 0 | 2 x 960GB NVME SSD's and 8 x 3.84TB NVME SSD's |
| Network | 2 x 10GbE | 8X 100Gb/sec Infiniband/100GigE Dual 10/25Gb/sec Ethernet |
Comments