have you tried turning TCP offload on the driver to OFF.
No, I'll give that a try.
But considering your connecting via windows mapped network, which uses CIFS, then thats your problem right there. CIFS just cant carry that much data.
A member of the Servethehome forums has a ConnectX 20Gb IB card that does 2000MB/s using the mapped starwind drive method in Windows2008R2, with IPoIB. So I figured my brand new ConnectX-3 40GbE card would get at least that...
Im guesing your not using a 40Gb Mellanox managed switch either, as i believe there are many benefits to doing so, like collision management etc.
That might have something to do with it. I believe he had his card connected to a switch.
You need a SCSI transport like iSCSI and then connect windows using iscsi initiator over your IB IP network. iSCSI on 20Gb Infiniband cards using firmware 2.7 and later get 1800MB/s read write over iSCSI on SCST Target.
My limited understanding of iSCSI targets is that they can only be accessed by one machine; is that correct? I'm a 3D Artist, not an IT Pro so I really have limited knowledge of these things. I use Maya for my work and it requires a project directory where it organizes the scene assets. Each scene references textures and geometry that have to be accessible in the same directory structure to all of the render slaves that will be working on the frames. Directory mapping is very convenient for this purpose. SCST may be fast but if it doesn't accomplish what my specific job requires then it's just not suitable.
Use ubuntu to setup SCST. takes 30 mins. no need to recompile teh kernel it works just as good without that.
I'm game to give linux a try, but Ubuntu has very limited support in 3D. I mostly use Autodesk and theFoundry products which are all RHL. It was always my intention to one day switch to CentOS.
Also make sure you use a LSI raid card or something better than mobo raid.
I have a brand new LSI 9271-8iCC
