[Lustre-discuss] IB storage as an OST target

[chas williams - CONTRACTOR]

On Wed, 30 Mar 2011 12:00:04 -0400
David Dillow <dave at thedillows.org> wrote:

> While it is true both are full duplex, there are also setup messages
> flowing in both directions to set up the large transfers. In the past,
> we've certainly seen problems at scale with small messages getting
> blocked behind large bulk traffic on LNET. It would be interesting to
> see how much self-interference is generated when running storage over
> the same HCA as LNET, versus having them on separate NICs -- especially

i kind of gather that if your clients are doing a mix of i/o (reads and
writes) that this is going to happen regardless.  two hcas/ports get a
sort of parallelism to help alleviate some of this congestion.  but a
faster port (say 40G) would just as helpful?