[OMPI users] Received data is different than sent data after Allgatherv() call

2017-11-30 Thread Konstantinos Konstantinidis
Hi, I will use a small part of C++ code to demonstrate my problem during shuffling. Assume that each slave has to shuffle some unsigned char array defined as *unsigned char* data *within some intracommunicator. *unsigned lineSize = 100;* *unsigned long long no_keys = 10;* *int bytes_send_count = (

Re: [OMPI users] Received data is different than sent data after Allgatherv() call

2017-11-30 Thread Gilles Gouaillardet
should the send buffer for MPI_Allgatherv() be data instead of &data ? BTW, is this issue specific to Open MPI ? If this is a general MPI issue, forums such as https://stackoverflow.com are a better place for this. Cheers, Gilles On 11/30/2017 5:02 PM, Konstantinos Konstantinidis wrote: Hi,

Re: [OMPI users] Openmpi 1.10.4 crashes with 1024 processes

2017-11-30 Thread Götz Waschk
Hi everyone, I have managed to solve the first part of this problem. It was caused by the quota on /tmp, that's where the session directory of openmpi was stored. There's a XFS default quota of 100MB to prevent users from filling up /tmp. Instead of an over quota message, the result was the openmp

Re: [OMPI users] Openmpi 1.10.4 crashes with 1024 processes

2017-11-30 Thread Jeff Squyres (jsquyres)
Can you upgrade to 1.10.7? That's the last release in the v1.10 series, and has all the latest bug fixes. > On Nov 30, 2017, at 9:53 AM, Götz Waschk wrote: > > Hi everyone, > > I have managed to solve the first part of this problem. It was caused > by the quota on /tmp, that's where the sessi

Re: [OMPI users] Openmpi 1.10.4 crashes with 1024 processes

2017-11-30 Thread Götz Waschk
Dear Jeff, I'm using openmpi as shipped by OpenHPC, so I'll upgrade 1.10 to 1.10.7 when they do. But it isn't 1.10 that is failing for me but openmpi 3.0.0. Regards, Götz On Thu, Nov 30, 2017 at 4:24 PM, Jeff Squyres (jsquyres) wrote: > Can you upgrade to 1.10.7? That's the last release in the

[OMPI users] IMB-MPI1 hangs after 30 minutes with Open MPI 3.0.0 (was: Openmpi 1.10.4 crashes with 1024 processes)

2017-11-30 Thread Jeff Squyres (jsquyres)
Ah, I was misled by the subject. Can you provide more information about "hangs", and your environment? You previously cited: - E5-2697A v4 CPUs and Mellanox ConnectX-3 FDR Infiniband - SLRUM - Open MPI v3.0.0 - IMB-MPI1 Can you send the information listed here: https://www.open-mpi.org/com