Can I run HPC software on cloud resources?
CURATOR: Raminder Singh
Cost aside, the answer is mostly “yes, to a point,” but it also depends on which cloud, setup and job type.
They will generally all work just fine if the jobs are independent or loosely coupled. Points of caution include: heavy network or disk I/O - most instances will have limits that lead to bottlenecks at lower usages than most on-premise HPC’s.
This recent paper comparing the performance of typical HPC applications on Cori and AWS might be of interest : [2011.00656] 10 Years Later: Cloud Computing is Closing the Performance Gap
1 Like