Hello Jeff.
I am a newbie on LAM over IB and I couldn't see among the 5 parameters,
which one affects the memory that gets pinned.
It talks about memory managers (I use the default ptmalloc2), envelopes and
tiny message criterion of 1024,hca and port.
I assume that hca and port are fine since it works with 4 processes within a
node but when I want to use more than 2 processes per node it fails.
What should I try if it even fails a 'hello world' app. Can you tell me a
simple example about what parameter to try ?
Is there a way of understanding the reason of this pinning memory problem
and how that relates to the ssi rpi ib parameters ?
Do you think is a limitation of my system? How can I verify that.
Is there an easy way to trace where the problem is?
Thank you for your patience.
-----Original Message-----
From: lam-bounces_at_[hidden] [mailto:lam-bounces_at_[hidden]] On Behalf Of
Jeff Squyres
Sent: Tuesday, November 15, 2005 1:41 PM
To: General LAM/MPI mailing list
Subject: Re: LAM: help with LAM over IB
Look at section 9.3.4 of the LAM/MPI User's Guide -- it talks
specifically about the ib RPI and the SSI parameters that are
available. There's a bunch of descriptions in there about the pros and
conns of increasing/decreasing the pinned memory values, etc.
On Nov 15, 2005, at 12:28 PM, Joshua Mora wrote:
> Thank you Jeff for your replay.
> I read the documentation but I couldn't find any parameters that
> modify the
> pinned memory at startup for ssi rpi ib module.
> Thanks.
>
> -----Original Message-----
> From: lam-bounces_at_[hidden] [mailto:lam-bounces_at_[hidden]] On
> Behalf Of
> Jeff Squyres
> Sent: Tuesday, November 15, 2005 9:38 AM
> To: General LAM/MPI mailing list
> Subject: Re: LAM: help with LAM over IB
>
> On Nov 14, 2005, at 10:11 AM, Joshua Mora wrote:
>
>> I am trying to use LAM 7.1.1 and latest betas to spawn more than 2
>> processes per node (4 processors per node) using module ssi rpi ib.
>> Any other modules are working fine.
>
> Are you saying that you can't launch more than 2 processes on a node
> using IB?
>
> If so, it could well be because of pinned memory limitations. You can
> use run-time LAM SSI parameters to decrease the amount of memory that
> is pinned at startup -- see the LAM/MPI User's Guide
> (http://www.lam-mpi.org/using/docs/) for specific details about the
> Infiniband RPI SSI parameters.
>
> --
> {+} Jeff Squyres
> {+} The Open MPI Project
> {+} http://www.open-mpi.org/
>
> _______________________________________________
> This list is archived at http://www.lam-mpi.org/MailArchives/lam/
>
> _______________________________________________
> This list is archived at http://www.lam-mpi.org/MailArchives/lam/
>
--
{+} Jeff Squyres
{+} The Open MPI Project
{+} http://www.open-mpi.org/
_______________________________________________
This list is archived at http://www.lam-mpi.org/MailArchives/lam/
|
