HPC Cluster: Mixed Intel CPU and AMD/NVidia GPU nodes

I’m looking at a really good value on Intel based compute nodes but also need a few full 8 way NVLink GPU nodes in the mix. At the moment the later are being quoted with AMD cpu. Is this going to be a pain to maintain? Will it require too many separate modules and installations to accommodate different CPU architectures or will things “just work”