Is anybody else trying out new lam builds [nightly snapshots] with
infiniband?
I'm seeing sharp scaling performance drops in bandwidth as I scale from
8x2 -> 16x2 [couple hundred MB/s drops to 10s of MB/s]. mpich2-1.0.1
doesn't have this issue and performs well out to at least 64x2.
If anybody's got hints on ways to get better performance from:
setenv LAM_MPI_SSI_rpi ib
...I'd like to hear them.
-Galen
--
Galen Arnold, consulting group system engineer
National Center for Supercomputing Applications
605 E. Springfield Avenue (217) 244-3473
Champaign, IL 61820 arnoldg_at_[hidden]
|