Re: [OMPI users] EXTERNAL: Re: qp memory allocation problem

2011-09-12 Thread Nathan Hjelm
On Mon, 12 Sep 2011, Blosch, Edwin L wrote: It was set to 0 previously. We've set it to 4 and restarted some service and now it works. So both your and Samuel's suggestions worked. On another system, slightly older, it was defaulted to 3 instead of 0, and apparently that explains why the j

Re: [OMPI users] EXTERNAL: Re: qp memory allocation problem

2011-09-12 Thread Blosch, Edwin L
, 2011 12:05 PM To: Open MPI Users Subject: Re: [OMPI users] EXTERNAL: Re: qp memory allocation problem On Mon, 12 Sep 2011, Blosch, Edwin L wrote: > Nathan, I found this parameters under /sys/module/mlx4_core/parameters. > How do you incorporate a changed value? What to rest

Re: [OMPI users] EXTERNAL: Re: qp memory allocation problem

2011-09-12 Thread Samuel K. Gutierrez
On Sep 12, 2011, at 10:16 AM, Blosch, Edwin L wrote: > Samuel, > > This worked. Great! > Did this magic line disable the use of per-peer queue pairs? Yes, it sure did. > I have seen a previous post by Jeff that explains what this line does > generally, but I didn’t study the post in deta

Re: [OMPI users] EXTERNAL: Re: qp memory allocation problem

2011-09-12 Thread Nathan Hjelm
On Mon, 12 Sep 2011, Blosch, Edwin L wrote: Nathan, I found this parameters under /sys/module/mlx4_core/parameters. How do you incorporate a changed value? What to restart/rebuild? Forgot to say that you will need to reload the mlx4_core module by either rebooting or unloading/reloadi

Re: [OMPI users] EXTERNAL: Re: qp memory allocation problem

2011-09-12 Thread Nathan Hjelm
On Mon, 12 Sep 2011, Blosch, Edwin L wrote: Nathan, I found this parameters under /sys/module/mlx4_core/parameters. How do you incorporate a changed value? What to restart/rebuild? Add the following line to /etc/modprobe (replace X with the appropriate value for log_mtts_per_seg): opti

Re: [OMPI users] EXTERNAL: Re: qp memory allocation problem

2011-09-12 Thread Blosch, Edwin L
Nathan, I found this parameters under /sys/module/mlx4_core/parameters. How do you incorporate a changed value? What to restart/rebuild? -Original Message- From: users-boun...@open-mpi.org [mailto:users-boun...@open-mpi.org] On Behalf Of Nathan Hjelm Sent: Monday, September 12, 2011

Re: [OMPI users] EXTERNAL: Re: qp memory allocation problem

2011-09-12 Thread Blosch, Edwin L
Samuel, This worked. Did this magic line disable the use of per-peer queue pairs?I have seen a previous post by Jeff that explains what this line does generally, but I didn't study the post in detail, so if you could provide a little explanation I would appreciate it. Ed From: users-boun