Re: Sockperf performance tuning (ConnectX-3 VPI NIC)
Hello, With iperf 3 I see around 36-40 Gpbs : "numactl --cpunodebind=1 --membind=1 iperf -c 1.1.1.11-ib -P 8" With IPoIB I believe affinity management is key. try using the set_irq_affinity script...
View ArticleHow to program with SDP (Sockets Direct Protocol) on Linux
I have install the OFED on my computer with Linux OS.Now, I want to program with SDP.On some website, it says that the SDP uses the number of 27 for it's protocol family, which is represented by the...
View ArticleRe: How to upgrade to latest version of MLNX-OS ?
Hello Anand, thank you for that GREAT and updated link !I do need the current BOOT ROM software which boots the MLNX-OS,and instructions how to install it to the SX6012F, with no OS installed.Switch is...
View ArticleRe: Sockperf performance tuning (ConnectX-3 VPI NIC)
I finally got it. I had a configuration problem. I see now 1,4usec with UDP ping ping using sockperf and LIBVMA as well as up to 2 Gbyte/s TCP throughput with larger messages with sockperf. We will...
View ArticleRe: Sockperf performance tuning (ConnectX-3 VPI NIC)
Great, thanks for the update. What was the original configuration issue ?
View ArticleRe: Sockperf performance tuning (ConnectX-3 VPI NIC)
It is embarrassing, there was a problem with the network configuration, so I tested Ethernet not Infiniband The problem stemed from the fact that before I tried so many things and then we did a clean...
View ArticleRe: SX1012 Switch and connect to a Dell PowerConnect 2824
Christhe QSA module converts the QSFP port to a form factor that can accept either and SFP+ direct attached optic or the SFP optic (in case you want to go to 1GbE RJ-45 or Base SX) If you want 10GE...
View ArticleDecrease latency
I have three identical clusters using mlx4_core: Mellanox ConnectX core driver v2.2-1 (Feb, 2014)mlx4_en: Mellanox ConnectX HCA Ethernet driver v2.2-1 (Feb 2014)<mlx4_ib> mlx4_ib_add: mlx4_ib:...
View ArticleOFED 2.4-1.0.4 crashes under ConnectX-3 Payload change
Dear all, I have a ConnectX-3 device connected to an INTEL XEON E3 CPU running CentOS 6.5.During boot, the BIOS sets the Max Payload Size (MPS) of the IB PCIe port to 256 bytes.If the MPS is changed...
View ArticleRe: Decrease latency
I would check BIOS settings of the third system? Could you check sections (2.4.2-2.4.5) of the performance tuning...
View ArticleRe: How to upgrade to latest version of MLNX-OS ?
Im not sure I understand. The 6005 is an unmanaged switch. The 6012 is a managed switch. We dont provide a BOOT ROM. If you have a managed switch we can provide an image. What model does the switch...
View ArticleRe: LED light indicator on connectX-3 - possibly dead port
I have come to the conclusion that this port on the card is in fact dead - oh well!
View ArticleRe: Can ConnectX-3 EN work with libvma?
Thanks for your reply.I've try to use "--with-vma", and issue still exist, and error message is the same as using "vma-eth"From lsmod, rdma_ucm and rdma_cm has been loaded, Does some config needed to...
View ArticleRe: ANYONE HAVE EXPERIENCE WITH JUNIPER SWITCHES & MELLANOX ETHERNET...
Hi Eddie,I just spotted your question about Juniper/Mellanox compatibility. On June 8thMellanox and Prolabs will officially launch a series of Mellanox LinkX cablesand Transceivers that will enable...
View ArticleAre you experiencing interoprerability problems when trying to connect...
On 8th June 2015, Mellanox and ProLabs (UK) Ltd will launch arange of LinkX copper Ethernet cables and transceivers that will enable interoperabilitybetween Mellanox switches and NIC's and other vendor...
View ArticleRe: Can ConnectX-3 EN work with libvma?
Hello, Yes, you need at least the ethernet driver and low level driver - mlx4_en and mlx4_core which is why it looks to me that there's something wrong in your installation. it is not related to VMA...
View ArticleRe: Can ConnectX-3 EN work with libvma?
mlx4_en and mlx4_core are loaded by mlnx-en-2.4-1.0.0.1 which is installed before OFED. After unload them and uninstall mlnx-en-2.4-1.0.0.1, it works.Thanks very much
View ArticleRe: LED light indicator on connectX-3 - possibly dead port
Paul, you can now buy a LinkX Transceiver or Cable that will allow interoperability between Mellanox and Cisco equipment. Mellanox and ProLabs (UK) Ltd will launch a new range of LinkX prioducts that...
View ArticleRe: 40GE Cisco compatibility question
Hi Chris, I was just trawling through the questions on this site and found your question about interoperability between Cisco and Mellanox switches. This problem is now solved by the introduction of...
View Article