OK, interesting. I added vlan 1 to port-channel 2. Port-channel 2 is the Ethernet link to a pair of Arista switches which are supplying vlan 236 as a trunk to the Mellanox switch (BTW it is a 6036G). From what I have read, VLAN 1 is the default vlan for the Infiniband interfaces on the box. There are two active IB interfaces IB1/9 and IB1/36 with clients on them. The end result I am trying to do is bridge the IP traffic between the Infiniband side and the Ethernet side. In my config, proxy-arp 1 is the Infiniband side and proxy-arp 2 is the Ethernet side. In my mind, in this scenario vlan 1 should not be part of the Ethernet side. In the documentation I am using there are some commands that don't work (show ib sm and show ip routing). I may be using the wrong documentation for the hardware/firmware I have here.
After adding vlan 1 to port-channel 2
MLNX-R307 [standalone: master] (config) # show interface proxy-arp
Proxy-arp 1
Admin state: Enabled
Operational state: Up
GUID: F4:52:14:03:00:13:62:38
Internet Address: 10.4.136.16/22
Broadcast Address: 10.4.139.255
Description: N/A
MTU: 4092
Counters: Disabled
Bridged interfaces: vlan 1, pkey 0x7fff
Proxy-arp 2
Admin state: Enabled
Operational state: Down
GUID: F4:52:14:03:00:13:62:38
Internet Address: 10.3.136.16/22
Broadcast Address: 10.3.139.255
Description: N/A
MTU: 4092
Counters: Disabled
Bridged interfaces: vlan 236, pkey 0x236(D)
MLNX-R307 [standalone: master] (config) #
Info on active IB interfaces. These are links to storage device (IB1/9) and Mellanox SX6015 (IB1/36)
IB1/9 state:
Logical port state : Active
Physical port state : LinkUp
Current line rate : 56.0 Gbps
Supported speeds : sdr, ddr, qdr, fdr10, fdr
Speed : fdr
Supported widths : 1X, 4X
Width : 4X
Max supported MTUs : 4096
MTU : 4096
VL capabilities : VL0 - VL7
Operational VLs : VL0 - VL3
Description :
Phy-profile : high-speed-ber
Width reduction mode :
RX bytes : 88262856
RX packets : 306471
RX errors : 0
Symbol errors : 0
VL15 dropped packets : 0
TX bytes : 382523544
TX packets : 2527164
TX wait : 0
TX discarded packets : 0
IB1/36 state:
Logical port state : Active
Physical port state : LinkUp
Current line rate : 56.0 Gbps
Supported speeds : sdr, ddr, qdr, fdr10, fdr
Speed : fdr
Supported widths : 1X, 4X
Width : 4X
Max supported MTUs : 4096
MTU : 4096
VL capabilities : VL0 - VL7
Operational VLs : VL0 - VL3
Description :
Phy-profile : high-speed-ber
Width reduction mode :
RX bytes : 186531872
RX packets : 990642
RX errors : 0
Symbol errors : 0
VL15 dropped packets : 0
TX bytes : 383614108
TX packets : 2416465
TX wait : 0
TX discarded packets : 0
1. Should vlan 1 be associated with IB1/9 and IB1/36 instead of port-channel 2?
2. Should I be using a different document for configuring this?