Amazing work by NVIDIA & Google on implementing auto-activation out of the box for Google's NCCL Plugin for ConnectX-7/8 NCCL. This was implemented due to feedback from SemiAnalysis a couple of quarters ago to massively improve the out-of-the-box experience on the GCP platform!
Previously, users would need to mess around with the correct library load paths and env vars to get it set up correctly for optimized performance on NVIDIA ConnectX NICs on GCP NVIDIA GPU machines, but now it is fully automated!
Multi-node jobs on GCP ConnectX NICs now get optimized NCCL collectives without hand-set library paths or env vars, removing a misconfiguration that quietly cost throughput.
