Connecting SX1016 MLAG Pair to Cisco VSS
I have a SX1016 pair configured as an MLAG pair that I have connected to my Cisco 6509 VSS. I followed document linked below. We seem to be experiencing some strange behavior when attempting to access...
View ArticleRe: Which ESXi driver to use for SRP/iSER over IB (not Eth!)?
This is one of the reason I have given up on infiniband for our storage, dropping protocol support and dropping adapter support because newer versions appear. Just not worth it anymore.
View ArticleRe: Which ESXi driver to use for SRP/iSER over IB (not Eth!)?
Will we have the honour of someone from Mellanox responding to this one? They seem to be monitoring these forums pretty closely, so no response so far looks a bit strange...
View ArticleRe: VMware ESXi 6.0 virtual ib_ipoib interfaces
I have a similar problem: i cant get IP over IB working.MT 27500 ConnectX-3 (PSID MT_1100120019) on ESX 6 (latest Updates 2 days ago). In the BIOS (SuperMicro) I set in the PCIe Configuration Page...
View ArticleRe: Windows, TCP/IP - lowest possible latency?
How low RTT could I expect to see with Mellanox hardware?
View ArticleClik here to view.
Re: Which ESXi driver to use for SRP/iSER over IB (not Eth!)?
Mellanox SRP initiator in vSphere OFED 1 8.2.4 shows me a good performance.But it has a issue with ZFS SRP target that cause problem to VM auto start function in ESXi host.SRP is a native RDMA SCSI...
View ArticleQuestion about stacking
We just got two SX1012 swtiches for use with a SCALE cluster.We received a stacking cable with the pair, which I have plugged into port 10 on both switches.When I asked Scale, they said that plugging...
View ArticleClik here to view.
'State: Initializing' but works
Hi all, I am linking 2 identical nodes with 2 IB cables (2 ports are in different subnet). I found the port 2 state is in 'Initializing' (till yesterday, both port status were Active).Subnet manager is...
View ArticleRe: 'State: Initializing' but works
Hi, Do you have a subnet manager running on the 2nd subnet via port 2?
View ArticleRe: Which ESXi driver to use for SRP/iSER over IB (not Eth!)?
This is mostly exactly the current question I am trying to answer for myself.We have a few ESXi hosts currently on v5.5 with dual port VPI adapters.We want to run SRP/iSER on one port back to our SAN...
View ArticleRe: MCX354A-FCBT & Switch Speed Issue
Sorry for the lack of response on this - I have been so busy lately this project has got delayed due to more important commitments.At this stage I think the FDR vs. FDR10 answer is the most likely...
View ArticleRe: Question about stacking
Hi Craig, The SX1012 switches don't support Stacking, it does support MLAG, can you try reviewing the below article (if you haven't reviewed it already). HowTo Configure MLAG on Mellanox Switches Also...
View ArticleRe: Question about stacking
Well i have it configured to talk over the port that the stacking cable is connected into, but if you are saying that it can't use a stacking cable, that is probably my issue. I will further investigate.
View ArticleRe: MCX354A-FCBT & Switch Speed Issue
Hi,MSX6015T-1SFSMSX6015T-1BRS These two models can only do FDR10. Its a hardware limitation.Normally there is a sticker on the switch with a part number and serial number. Try this:If you have a...
View ArticleClik here to view.
mlnx_tune does not detect the BIOS I/O non-posted prefetch settings?
I have four AIC SB122A-PH 1U all NVMe storage servers. Two of them have Intel E5-2620v3 2.4Ghz CPUs, 8 x 16GiB 1833Mhz DDR4 DIMMs, 2 x DC S3510 SATA SSDs, 8 x DC P3700 NVMe SSDsTwo of them have Intel...
View ArticleClik here to view.
How to setup IPoIB correctly?
We have a small network for testing. Its layout is shown below. The orange-colored IP addresses are the current IPoIB setup. They are done with /etc/sysconfig/network-scripts/ifcfg0-ib0 using IP...
View ArticleRe: dma_map_single not able to receive capsules on ARM with mellanox card
Hello, I advise you to contact Mellanox Support (support@mellanox.com) and describe your project, configuration and further elaborate on what you're trying to do with Mellanox NICs over ARM platforms.
View ArticleCan multiple versions of mlnx-ofed exist in the same IB fabric?
Hi, we have installed compute nodes with RHELS6.3 and MLNX_OFED_LINUX-2.0-2.0.5 using an Infiniband network. We intend to upgrade to RHELS6.7 and mlnx-ofed 3.x.In a rolling upgrade scenario, can we...
View ArticleRe: Windows, TCP/IP - lowest possible latency?
Should I expect any difference between ConnectX 3 Pro and ConnectX 4 EN in this case?
View ArticleI have 2 colocation sites located 6-7km apart. I can rent a 10gb wave between...
Title says about all; We are starting our cloud-hosting company at 2 sites, in the future it will be 3 sites in total. For now however, we start at 2 sites. I have a SX1036 with dual PSU that I am...
View Article