Just tried the newer WinOF 5.10 drivers. Still no go. The adapter status for both ports says they have no cable plugged in.
Which is weird, as one port definitely does, and one doesn't.
ibstat output from the Windows box:
>ibstat
CA 'ibv_device0'
CA type:
Number of ports: 2
Firmware version: 2.9.1000
Hardware version: 0xa0
Node GUID: 0x0002c9030000cc74
System image GUID: 0x0002c9030000cc77
Port 1:
State: Active
Physical state: LinkUp
Rate: 20
Base lid: 2
LMC: 0
SM lid: 1
Capability mask: 0x90580000
Port GUID: 0x0002c9030000cc75
Link layer: IB
Transport: IB
Port 2:
State: Down
Physical state: Polling
Rate: 10
Base lid: 0
LMC: 0
SM lid: 0
Capability mask: 0x90580000
Port GUID: 0x0002c9030000cc76
Link layer: IB
Transport: IB
That shows one port is up and talking to the fabric, and the other port not. ibnetdiscover from the same box:
>ibnetdiscover
#
# Topology file: generated on Mon Apr 25 15:33:13 2016
#
# Initiated from node 0002c9030000cc74 port 0002c9030000cc75
vendid=0x2c9
devid=0x634a
sysimgguid=0x2c9030000cacf
caguid=0x2c9030000cacc
Ca 2 "H-0002c9030000cacc" # "MT25408 ConnectX Mellanox Technologies"
[1](2c9030000cacd) "H-0002c9030000cc74"[1] (2c9030000cc75) # lid 1 lmc 0 "WINPC" lid 2 4xDDR
vendid=0x2c9
devid=0x634a
sysimgguid=0x2c9030000cc77
caguid=0x2c9030000cc74
Ca 2 "H-0002c9030000cc74" # "WINPC"
[1](2c9030000cc75) "H-0002c9030000cacc"[1] (2c9030000cacd) # lid 2 lmc 0 "MT25408 ConnectX Mellanox Technologies" lid 1 4xDDR
The setup is a super simple testing one. The Windows PC is connected directly to a FreeBSD box, which is running IPoIB and OpenSM.
Anyone have ideas?