We are currently looking at new hardware packages to get more GPUs into our systems. We have been buying 1U and 2U rackmount servers with one to multiple GPUs installed. We are possibly looking for blade/chassis solutions that would support GPU or some type of modular system.
Do you have a preferred solution or one you are looking at?
I haven’t seen much over 8-10GPUs/enclosure, e.g. https://www.exxactcorp.com/Exxact-TS4-194492555-DPN-E194492555 or nVidia’s DGX series.
One has to be cautious of power consumption and heat dissipation with packaging that dense; water cooling on the cards and cpu will probably be a required.
Of course, with nVidia quoting lead times of months and really inflated prices right now, you’ll spend a lot of $$ to maybe get something someday.
We have Dell 2U systems with 4x Nvidia Tesla V100s, normal air cooling. The chassis are spaced out with 1U between each.