Charles,
How is your Ceph Cluster project going? I am getting one Flextronics F-X430066 8-Port 4X SDR InfiniBand External Switch that is arriving in two days time.
Which adapter card did you decide to use with the switch that you selected? I found this thread related to this one:
[ceph-users] Is Ceph appropriate for small installations?
I have two Mellanox adapters MHGA28-1TC Adapter Card that communicate using ibping when connected with this cable:
Mellanox MC1104130-002 MicroGiGaCN latch, 30 AWG, 3 meter Copper Cable
And I am looking at getting two Qlogic adapters: INFINIBAND PCI-E DUAL PORT HCA 7104-HCA-128LP
My goal is to create a small cluster with good RMDA (remote DMA) performance. To me that implies the adapter cards must have memory since RDMA is not a stateless offload protocol.
I'm not certain that on-board memory in the network is a requirement for RDMA. My memory requirement limits my choice of adapter cards.
Regards,
Vincent Randal
Longmont, Colorado