Jeff,
if i am reading it right, it is choosing tcp. the first attachment is from a naked (PBS) lamboot then
mpirun -np 4 -ssi rpi_verbose level:1000 a.out
and the second (from the same lamboot) is from
mpirun -np 4 -ssi rpi gm -ssi rpi_verbose level:1000 a.out
so i guess i'll have to add the switch to get GM? is there a configure switch i can give to make GM the default?
of course, i can always just give the "-ssi rpi gm" switch...
thanks for your time,
-rich
/***************************************************************************************/
n0<11188> ssi:rpi: Opening, verbosity:1000
n0<11188> ssi:rpi: opening module crtcp
n0<11188> ssi:rpi: querying module crtcp
n0<11188> ssi:rpi:crtcp: module initializing
n0<11188> ssi:rpi:crtcp:verbose: 1000
n1<31975> ssi:rpi: Opening, verbosity:1000
n1<31975> ssi:rpi: opening module crtcp
n1<31975> ssi:rpi: querying module crtcp
n0<11188> ssi:rpi:crtcp:priority: 25
n0<11188> ssi:rpi: module available: crtcp, priority: 25
n0<11188> ssi:rpi: opening module gm
n1<31975> ssi:rpi:crtcp: module initializing
n1<31975> ssi:rpi:crtcp:verbose: 1000
n1<31975> ssi:rpi:crtcp:priority: 25
n0<11188> ssi:rpi: querying module gm
n1<31975> ssi:rpi: module available: crtcp, priority: 25
n1<31975> ssi:rpi: opening module gm
n1<31975> ssi:rpi: querying module gm
n0<11189> ssi:rpi: Opening, verbosity:1000
n0<11189> ssi:rpi: opening module crtcp
n0<11189> ssi:rpi: querying module crtcp
n1<31976> ssi:rpi: Opening, verbosity:1000
n0<11189> ssi:rpi:crtcp: module initializing
n1<31976> ssi:rpi: opening module crtcp
n1<31976> ssi:rpi: querying module crtcp
n0<11189> ssi:rpi:crtcp:verbose: 1000
n0<11189> ssi:rpi:crtcp:priority: 25
n1<31976> ssi:rpi:crtcp: module initializing
n0<11189> ssi:rpi: module available: crtcp, priority: 25
n1<31976> ssi:rpi:crtcp:verbose: 1000
n0<11189> ssi:rpi: opening module gm
n1<31976> ssi:rpi:crtcp:priority: 25
n0<11189> ssi:rpi: querying module gm
n1<31976> ssi:rpi: module available: crtcp, priority: 25
n1<31976> ssi:rpi: opening module gm
n1<31976> ssi:rpi: querying module gm
n0<11188> ssi:rpi:gm: module initializing
n0<11188> ssi:rpi:gm:verbose: 1000
n0<11188> ssi:rpi:gm:priority: 50
n0<11188> ssi:rpi: module available: gm, priority: 50
n0<11188> ssi:rpi: opening module lamd
n0<11188> ssi:rpi: querying module lamd
n0<11188> ssi:rpi:lamd: module initializing
n0<11188> ssi:rpi:lamd:verbose: 1000
n0<11188> ssi:rpi:lamd:priority: 10
n0<11188> ssi:rpi: module available: lamd, priority: 10
n0<11188> ssi:rpi: opening module sysv
n0<11188> ssi:rpi: querying module sysv
n0<11188> ssi:rpi:sysv: module initializing
n0<11188> ssi:rpi:sysv:verbose: 1000
n0<11188> ssi:rpi:sysv:priority: 30
n0<11188> ssi:rpi: module available: sysv, priority: 30
n0<11188> ssi:rpi: opening module tcp
n0<11188> ssi:rpi: querying module tcp
n0<11188> ssi:rpi:tcp: module initializing
n0<11188> ssi:rpi:tcp:verbose: 1000
n0<11188> ssi:rpi:tcp:priority: 75
n0<11188> ssi:rpi: module available: tcp, priority: 75
n0<11188> ssi:rpi: opening module usysv
n0<11188> ssi:rpi: querying module usysv
n0<11188> ssi:rpi:usysv: module initializing
n0<11188> ssi:rpi:usysv:verbose: 1000
n1<31975> ssi:rpi:gm: module initializing
n0<11188> ssi:rpi:usysv:priority: 40
n1<31975> ssi:rpi:gm:verbose: 1000
n1<31975> ssi:rpi:gm:priority: 50
n0<11188> ssi:rpi: module available: usysv, priority: 40
n1<31975> ssi:rpi: module available: gm, priority: 50
n1<31975> ssi:rpi: opening module lamd
n1<31975> ssi:rpi: querying module lamd
n1<31975> ssi:rpi:lamd: module initializing
n1<31975> ssi:rpi:lamd:verbose: 1000
n1<31975> ssi:rpi:lamd:priority: 10
n1<31975> ssi:rpi: module available: lamd, priority: 10
n1<31975> ssi:rpi: opening module sysv
n1<31975> ssi:rpi: querying module sysv
n1<31975> ssi:rpi:sysv: module initializing
n1<31975> ssi:rpi:sysv:verbose: 1000
n1<31975> ssi:rpi:sysv:priority: 30
n1<31975> ssi:rpi: module available: sysv, priority: 30
n1<31975> ssi:rpi: opening module tcp
n1<31975> ssi:rpi: querying module tcp
n1<31975> ssi:rpi:tcp: module initializing
n1<31975> ssi:rpi:tcp:verbose: 1000
n1<31975> ssi:rpi:tcp:priority: 75
n1<31975> ssi:rpi: module available: tcp, priority: 75
n1<31975> ssi:rpi: opening module usysv
n1<31975> ssi:rpi: querying module usysv
n1<31975> ssi:rpi:usysv: module initializing
n1<31975> ssi:rpi:usysv:verbose: 1000
n1<31975> ssi:rpi:usysv:priority: 40
n1<31975> ssi:rpi: module available: usysv, priority: 40
n0<11189> ssi:rpi:gm: module initializing
n0<11189> ssi:rpi:gm:verbose: 1000
n0<11189> ssi:rpi:gm:priority: 50
n0<11189> ssi:rpi: module available: gm, priority: 50
n0<11189> ssi:rpi: opening module lamd
n0<11189> ssi:rpi: querying module lamd
n0<11189> ssi:rpi:lamd: module initializing
n0<11189> ssi:rpi:lamd:verbose: 1000
n0<11189> ssi:rpi:lamd:priority: 10
n0<11189> ssi:rpi: module available: lamd, priority: 10
n0<11189> ssi:rpi: opening module sysv
n0<11189> ssi:rpi: querying module sysv
n0<11189> ssi:rpi:sysv: module initializing
n0<11189> ssi:rpi:sysv:verbose: 1000
n0<11189> ssi:rpi:sysv:priority: 30
n0<11189> ssi:rpi: module available: sysv, priority: 30
n0<11189> ssi:rpi: opening module tcp
n0<11189> ssi:rpi: querying module tcp
n0<11189> ssi:rpi:tcp: module initializing
n0<11189> ssi:rpi:tcp:verbose: 1000
n1<31976> ssi:rpi:gm: module initializing
n1<31976> ssi:rpi:gm:verbose: 1000
n1<31976> ssi:rpi:gm:priority: 50
n1<31976> ssi:rpi: module available: gm, priority: 50
n1<31976> ssi:rpi: opening module lamd
n1<31976> ssi:rpi: querying module lamd
n0<11189> ssi:rpi:tcp:priority: 75
n0<11189> ssi:rpi: module available: tcp, priority: 75
n0<11189> ssi:rpi: opening module usysv
n1<31976> ssi:rpi:lamd: module initializing
n0<11189> ssi:rpi: querying module usysv
n1<31976> ssi:rpi:lamd:verbose: 1000
n1<31976> ssi:rpi:lamd:priority: 10
n0<11189> ssi:rpi:usysv: module initializing
n0<11189> ssi:rpi:usysv:verbose: 1000
n0<11189> ssi:rpi:usysv:priority: 40
n1<31976> ssi:rpi: module available: lamd, priority: 10
n0<11189> ssi:rpi: module available: usysv, priority: 40
n1<31976> ssi:rpi: opening module sysv
n1<31976> ssi:rpi: querying module sysv
n1<31976> ssi:rpi:sysv: module initializing
n1<31976> ssi:rpi:sysv:verbose: 1000
n1<31976> ssi:rpi:sysv:priority: 30
n1<31976> ssi:rpi: module available: sysv, priority: 30
n1<31976> ssi:rpi: opening module tcp
n1<31976> ssi:rpi: querying module tcp
n1<31976> ssi:rpi:tcp: module initializing
n1<31976> ssi:rpi:tcp:verbose: 1000
n1<31976> ssi:rpi:tcp:priority: 75
n1<31976> ssi:rpi: module available: tcp, priority: 75
n1<31976> ssi:rpi: opening module usysv
n1<31976> ssi:rpi: querying module usysv
n1<31976> ssi:rpi:usysv: module initializing
n1<31976> ssi:rpi:usysv:verbose: 1000
n1<31976> ssi:rpi:usysv:priority: 40
n1<31976> ssi:rpi: module available: usysv, priority: 40
n0<11188> ssi:rpi:tcp: module initializing
n0<11188> ssi:rpi:tcp:short: 65536 bytes
n1<31975> ssi:rpi:tcp: module initializing
n1<31975> ssi:rpi:tcp:short: 65536 bytes
n0<11189> ssi:rpi:tcp: module initializing
n0<11189> ssi:rpi:tcp:short: 65536 bytes
n1<31976> ssi:rpi:tcp: module initializing
n1<31976> ssi:rpi:tcp:short: 65536 bytes
n0<11188> ssi:rpi: selected RPI module tcp
n0<11189> ssi:rpi: selected RPI module tcp
n1<31975> ssi:rpi: selected RPI module tcp
n1<31976> ssi:rpi: selected RPI module tcp
node08
node08
node07
node07
n1<31976> ssi:rpi:tcp: module finalizing
n1<31976> ssi:rpi: Closing
n1<31975> ssi:rpi:tcp: module finalizing
n1<31975> ssi:rpi: Closing
n0<11188> ssi:rpi:tcp: module finalizing
n0<11188> ssi:rpi: Closing
arg 0 = a.out
hello from rank 2
arg 0 = a.out
hello from rank 0
arg 0 = a.out
hello from rank 3
n0<11189> ssi:rpi:tcp: module finalizing
n0<11189> ssi:rpi: Closing
arg 0 = a.out
hello from rank 1
/***********************************************************************************/
n1<31979> ssi:rpi: Opening, verbosity:1000
n1<31979> ssi:rpi: looking for module named gm
n1<31979> ssi:rpi: opening module gm
n1<31979> ssi:rpi: querying module gm
n0<11193> ssi:rpi: Opening, verbosity:1000
n0<11193> ssi:rpi: looking for module named gm
n0<11193> ssi:rpi: opening module gm
n0<11193> ssi:rpi: querying module gm
n1<31980> ssi:rpi: Opening, verbosity:1000
n1<31980> ssi:rpi: looking for module named gm
n1<31980> ssi:rpi: opening module gm
n1<31980> ssi:rpi: querying module gm
n0<11194> ssi:rpi: Opening, verbosity:1000
n0<11194> ssi:rpi: looking for module named gm
n0<11194> ssi:rpi: opening module gm
n0<11194> ssi:rpi: querying module gm
n1<31979> ssi:rpi:gm: module initializing
n1<31979> ssi:rpi:gm:verbose: 1000
n1<31979> ssi:rpi:gm:priority: 50
n0<11193> ssi:rpi:gm: module initializing
n0<11193> ssi:rpi:gm:verbose: 1000
n0<11193> ssi:rpi:gm:priority: 50
n1<31980> ssi:rpi:gm: module initializing
n1<31980> ssi:rpi:gm:verbose: 1000
n1<31980> ssi:rpi:gm:priority: 50
n0<11194> ssi:rpi:gm: module initializing
n0<11194> ssi:rpi:gm:verbose: 1000
n0<11194> ssi:rpi:gm:priority: 50
n0<11193> ssi:rpi:gm:max_tiny_size: 1024
n0<11193> ssi:rpi:gm:max_short_size: 8192
n0<11193> ssi:rpi:gm:memory_pin: 1
n0<11193> ssi:rpi: selected RPI module gm
n0<11194> ssi:rpi:gm:max_tiny_size: 1024
n0<11194> ssi:rpi:gm:max_short_size: 8192
n0<11194> ssi:rpi:gm:memory_pin: 1
n0<11194> ssi:rpi: selected RPI module gm
n1<31979> ssi:rpi:gm:max_tiny_size: 1024
n1<31979> ssi:rpi:gm:max_short_size: 8192
n1<31979> ssi:rpi:gm:memory_pin: 1
n1<31979> ssi:rpi: selected RPI module gm
n1<31980> ssi:rpi:gm:max_tiny_size: 1024
n1<31980> ssi:rpi:gm:max_short_size: 8192
n1<31980> ssi:rpi:gm:memory_pin: 1
n1<31980> ssi:rpi: selected RPI module gm
node07
node07
node08
node08
n0<11193> ssi:rpi: Closing
n1<31979> ssi:rpi: Closing
arg 0 = a.out
hello from rank 0
arg 0 = a.out
hello from rank 2
n0<11194> ssi:rpi: Closing
n1<31980> ssi:rpi: Closing
arg 0 = a.out
hello from rank 1
arg 0 = a.out
hello from rank 3
/***********************************************************************************/
Jeff Squyres wrote:
>
> On Sat, 27 Sep 2003, Richard Drake wrote:
>
> > Following is the result of laminfo. I did find and use GM with
> > configure: --with-gm=/usr/gm-1.5.2.1_Linux-2.4.18-4smp
>
> Excellent.
>
> > Does this mean that by default, MPI programs will use the native Myrinet
> > interfaces (when, say, using straight "lamboot" on a PBS scheduled
> > process)? Or does one need to do something special to get the native
> > Myrinet to be used?
>
> It should do it by default -- LAM tries to pick the "best" communications
> device by default. You can verify this by either:
>
> 1) Use "-ssi rpi gm" as arguments to mpirun, which forces the use of the
> gm module.
>
> 2) Use "-ssi rpi_verbose level:1000" as arguments to mpirun, and you can
> see if the gm module was selected to be used (it should be).
>
> --
> {+} Jeff Squyres
> {+} jsquyres_at_[hidden]
> {+} http://www.lam-mpi.org/
> _______________________________________________
> This list is archived at http://www.lam-mpi.org/MailArchives/lam/
|