Re: Will there be ESXi 5.x driver support for ConnectX adapters?
Thanks again. I'll probably keep poking at it, I think the 4k issue probably has to do with opensm and how it is starting as a service under Windows. Might need to run opensm under a Linux system,...
View ArticleRe: Will there be ESXi 5.x driver support for ConnectX adapters?
Hi wark286,Yes 4K mtu is supported in IPoIB for vSphere 5 as explained in the User Manual.You basically need to configure the SM to enable 4K mtu for IPoIB (check your SM user manual, the configuration...
View ArticleRe: Will there be ESXi 5.x driver support for ConnectX adapters?
I've run through all of the command and configuration recommendations in the user manuals, best I can get is 2044 MTU. Could possibly be opensm not listening to my partitions.conf file as when I run...
View ArticleRe: Will there be ESXi 5.x driver support for ConnectX adapters?
Hi wark286,Indeed, looks like your opensm is not listening to the config file (the test you've done using saquery reflects this fact).If you're running opensm from a host, try to run it manually:>...
View ArticleRe: Will there be ESXi 5.x driver support for ConnectX adapters?
Looks like running it from command line and specifying the file did the trick, hadn't used the -P argument previously. Not sure why it wasn't reading correctly when running as a service in Windows,...
View ArticleRe: Dual port FDR connectx-3 card
What gadis said. If for no other reason then PCIe3 x8 has a theoretical max bandwidth of about 56Gbps.
View ArticleClik here to view.
Re: Will there be ESXi 5.x driver support for ConnectX adapters?
Interesting. I had a chance to do some testing and I found that if I connect my 2 nodes direct, I can get an active_mtu of 4096, but if I go through my switch (Voltaire ISR9024D), it drops to...
View ArticleRe: Suggestions for *quiet* Infiniband switch?
So my latest quirk is that if I connect two cards direct, I get an active_mtu of 4096, but if it passes through the switch, it drops to 2048. More digging around.
View ArticleRe: Will there be ESXi 5.x driver support for ConnectX adapters?
Also noticed something weird when I switched from my ESXi 4.1 test install to a 5.1 install. After getting the drivers installed, it connected to the infiniband network at 4x, however, when I enabled...
View ArticleRe: Dual port FDR connectx-3 card
that's correct.X16 should give you better ability with both ports - the card can. it is what's underneath it that is limiting us. :-)
View ArticleRe: dual port FDR ConnectX-3 card
Redirecting you to this thread - same question: Dual port FDR connectx-3 card
View ArticleRe: MCQH29-XDR firmware for RDMA
I managed to flash my Dell mezzanine cards with firmware version 2.10.720, and I wrote an article about it. RDMA is now enabled, and maximum throughput of an SMB share, measured using IOMeter, improved...
View ArticleRe: Mellanox (old Voltaire) ISR9024D-M recover flash area
Hi yairi! Thank you for your reply. I'll check it this weekend and reply on this thread...:)
View ArticleClik here to view.
Re: sx1036 as IB-to IP gateway
Thanks a lot for the very informative image. A short follow-up question:Is it so that the blocked ports are caused by using split cables? example: port 4 uses a 4*10G split cable so port 1 is...
View ArticleRebuilding OFED 1.5.3 for new Linux kernel
I administer a HP cluster of 3 head nodes and 60 compute nodes. All run RHEL 6.2 x86_64 with kernel 2.6.32-220. All nodes have Mellanox Technologies MT26428 [ConnectX VPI PCIe 2.0 5GT/s - IB QDR /...
View ArticleInfiniband on Linux... defaults to datagram mode somehow?
RHEL v5.5kernel 2.6.18-194.el5 What I have discovered, is that if you don't have "ONBOOT=yes" in your ifcfg-ib# script... the interface will come up in "datagram" mode, regardless of what is in...
View ArticleRe: Infiniband on Linux... defaults to datagram mode somehow?
Are you using MLNX OFED 2.0?Starting from MLNX OFED 2.0, the default mode is UD.From the User Manual section 1.3.4:The IP over IB (IPoIB) driver is a network interface implementation over InfiniBand....
View ArticleRe: Infiniband on Linux... defaults to datagram mode somehow?
Well, I think its just what comes with the kernel source... ################################################################################ module ib_ipoib filename:...
View ArticleRe: Will there be ESXi 5.x driver support for ConnectX adapters?
hii tried some older ConnectX1 HP Mezzanine cards. upgrade the firmware to 1.2 (from memory)and use the older version on ESXi 5.0 driverDownload Drivers v1.8.0 for ESXi 5.X (Builds: 469512 &...
View ArticleRe: Rebuilding OFED 1.5.3 for new Linux kernel
hiwe face a similar problem. The only way to solve it is to run a pre-prod cluster. install the updates and test it. (takes a few hours) we use HP C7000 blades with HP BL460 and 465 G7 Servers using...
View Article