Clik here to view.
ESXi 6 SRP initiator to Solaris COMSTAR SRP Target will crash ESXi 6 host...
SRP initiator 1.8.2.4 on ESXi 5.x show me a good RDMA performance. But upgrade to ESXi 6 or above - include ESXi 6 update 2 with latest patch - then it show me a PSOD (Purple Screen Of Death) with APD...
View ArticleRe: Is there a way to download the latest OFED ISO via wget or curl?
You should accept EULA before downloading. You might download it, place somewhere on the fabric and then reuse this location.
View ArticleRe: Is there a way to download the latest OFED ISO via wget or curl?
Alkx, Thanks for your comment but it was not responsive to the question. We are fully aware of the means to download while accepting the EULA, as is obvious. We are operating in a closed environment...
View ArticleClik here to view.
Proper Use of Core-Direct/Cross Channel Communication
I wanted to ask a couple of questions about using Core-Direct/cross channel communication. The documentation I've found is a little bit sparse, and I was hoping you could fill in a couple gaps. Thus...
View ArticleRe: “Invalid module format” error while loading nv_peer_mem in CentOS 6.6
If both hosts are the same, modules should load fine. There must be some difference between them. Try to compare the OS, kernel, and relevant kernel modules - size, checksum, location, etc. Most likely...
View ArticleRe: “Invalid module format” error while loading nv_peer_mem in CentOS 6.6
This is exactly what I'm thinking, with the addition that host2 has been working fine (with that module loaded) for almost 2 months.OS and kernel are the same (CentOS 6.6, 2.6.32-504.el6.x86_64), also...
View ArticleHow do I configure the MAX_MTU and ACTIVE MTU of a Connect-X2 or -X3
I'm currently working a task to migrate some software from RHEL 6.3 to RHEL 6.7 (no, 7 isn't an option). I'm having issues getting our RDMA connection online, on our Connect-X2 cards. Specifically,...
View ArticleClik here to view.
Re: “Invalid module format” error while loading nv_peer_mem in CentOS 6.6
Are you able to unload and load nvidia modules on the host1? What will happen if host1 will be rebooted? What is the output of "modinfo <MODULE> |grep srcversion" command, where <MODULE>...
View ArticleRe: “Invalid module format” error while loading nv_peer_mem in CentOS 6.6
Hi alkx, What will happen if host1 will be rebooted? Host1 has been rebooted several times, and nv_peer_mem service still starts successfully every time. Are you able to unload and load nvidia modules...
View ArticleWhere is the latest header file for windows libibverbs?
I have libibverbs.DLL installed by Mellanox WinOF 5.22 adapter in my system32 folder.Where can I find header file (verbs.h as I guess) and import library (LIB file) for it?I need the header file at least.
View ArticleRe: “Invalid module format” error while loading nv_peer_mem in CentOS 6.6
Ok. Seems that there is no module loading issue, as all required module are loaded. You may run 'bash -x service nv_peer_mem start' or add more prints to startup scripts and check from the output what...
View ArticleClik here to view.
Re: Which ESXi driver to use for SRP/iSER over IB (not Eth!)?
Two months later and still no reaction from Mellanox. They post lots of information here, mainly about new products, but what about taking care of existing products/customers? I have seen the 2.4.0...
View ArticleRe: nvidia_peer_memory for Cuda8 ?
Seems to be known issue: add support for NV dma mappings APIs · Issue #3 · Mellanox/nv_peer_memory · GitHub
View ArticleRe: “Invalid module format” error while loading nv_peer_mem in CentOS 6.6
Anything in dmesg?The only suspicious line seems to be "nv_p2p_dummy: exports duplicate symbol nvidia_p2p_free_page_table (owned by nvidia)", which appears 6 times in dmesg output, anyway I attach...
View ArticleClik here to view.
Re: Which ESXi driver to use for SRP/iSER over IB (not Eth!)?
I heard launching about new vSphere 6.5 yesterday. I'm also heard that Mellanox will drop a support Infiniband iSER on ConnectX-3 and belows from some source that I can't remember exactly now. I give...
View ArticleQuestion for how to use MTUSB on MSB7790?
Dear Admin, I have a customer who has MSB7790 EDR switch , 455A-ECAT EDR HCA and EDR AOC.The customer use the command(mst ib add) to add switch device under /dev/mst/.And use the latest MSB7790...
View ArticleRe: “Invalid module format” error while loading nv_peer_mem in CentOS 6.6
But from earlier comments, it looks like nv_peer_mem is loaded on vega2. Is there same prints about duplicate symbol on the other host comming from nv_p2p_dummy?There must be something different...
View ArticleRe: Which ESXi driver to use for SRP/iSER over IB (not Eth!)?
What's your RDMA Storage target and OS?I prefer Solaris family ZFS COMSTAR but ESXi 6.0 and above won't work properly. Best Regards.
View ArticleClik here to view.
Re: 40Gb/s IPoIB only gives 5Gb/s real throughput?!
Hello I have actually gone ahead and buit a second computer with a PCIe 3.0 board.Unfortunately I cannot get the promised speed whatever I try:This is the same maximum speed as before: 5.8Gbit...
View ArticleRe: Which ESXi driver to use for SRP/iSER over IB (not Eth!)?
ZFS on Linux seems to be very stable for me.Bear in mind that with LIO you will be able to use SRP only with CentOS inbox drivers. If you choose to install Mellanox OFED, you will have access only to...
View Article