Please ignore my prior answer, I just noticed you are running single-node.
In addition to Howard's suggestions, check if you have nvlink between GPUs.
George.
On Wed, Jun 4, 2025 at 10:11 AM George Bosilca wrote:
> What's the network on your cluster ? Without a very good network you
> canno
"
Subject: [EXTERNAL] Re: [OMPI users] Horovod Performance with OpenMPI
What's the network on your cluster ? Without a very good network you cannot
obtain anything closer to the single GPU, because the data exchanged between
the two GPUs will become the bottleneck.
George.
On Wed, J
What's the network on your cluster ? Without a very good network you cannot
obtain anything closer to the single GPU, because the data exchanged
between the two GPUs will become the bottleneck.
George.
On Wed, Jun 4, 2025 at 5:56 AM Shruti Sharma wrote:
> Hi
> I am currently running Horovod
