Objective
To get together some (non-sales fluff enhanced) real home benchmarks for Infiniband equipment based around known or standard parameters. With these figures and the information provided in the paramteters section, the hope is to help others get an idea of how fast they should be able to go and what is required to get there for the different HCAs, link speeds and protocols. I also hoep it will answer questions like "What speeds am I likely to see using IPoIB on XXX card using DDR between Windows and Linux".
Parameters
Hardware - Infiniband.
Infiniband card (model, version and firmware level).
Any switch or infrustructure between the two cards.
Hardware - Source.
Machines processor
Machines PCIe details (version and number of electrical lanes - ie PCIe 3.0 x8) - Note some PCIe slots are not fully wired electrically. Some physical x8 slots may only be x4 electrical.
Machines storage (what are you pulling data from for the benchmark - RaidZ, Raid5, single disk, ssd, ram drive etc).
Hardware - Destination.
Machines processor.
Machines PCIe details.
Machines storage.
Operating System.
Source OS
Destination OS
Infiniband.
Raw Link Speed (SDR/DDR/QDR etc).
Protocol (IPoIB, SRP, iSER, NFSoIB, etc).
Benchmark Method.
Software used.
Parameters set.
Filesize.
Results
Speed.
CPU usage.
Comments (ie. any IB tuning to MTU etc).
Screenshots (if possible).
Additional
Any ideas or suggestions most welcome.
I will collate the results, probably in to a separate post to keep them uncluttered from this discussion.
I hope we can set standard (free) benchmark software and parameters based on suggestions and results submitted.
If this proves popular then I will probably put together a submission form to make it easier for people to provide the details.