Register for the iXsystems Community to get an ad-free experience

LACP Issues - 9.3

Status
Not open for further replies.
Joined
Dec 29, 2014
Messages
1,073
I am running FreeNAS-9.3-STABLE-201504100216 on an HP DL380 G6 with 32G of RAM and Intel(R) Xeon(R) CPU X5667 @ 3.07GHz dual CPU's. The 10G NIC card is a Chelsio.

cxgbc0@pci0:16:0:0: class=0x020000 card=0x00011425 chip=0x00311425 rev=0x00
hdr=0x00
vendor = 'Chelsio Communications Inc'
device = 'T320 10GbE Dual Port Adapter'
class = network
subclass = ethernet

The switch is an HP 5820X (H3C). Version information follows.

HP Comware Platform Software
Comware Software, Version 5.20.105, Release 1809P03
Copyright (c) 2010-2015 Hewlett-Packard Development Company, L.P.
HP 5820X-14XG-SFP+ Switch with 2 Interface Slots uptime is 1 week, 6 days, 23 hours, 33 minutes

HP 5820X-14XG-SFP+ Switch with 2 Interface Slots with 2 Processors
1024M bytes SDRAM
4M bytes Nor Flash Memory
512M bytes Nand Flash Memory
Config Register points to Nand Flash

Hardware Version is Ver.B
CPLDA Version is 003, CPLDB Version is 003
BootRom Version is 301
[SubSlot 0] 14SFP Plus+4GE Hardware Version is Ver.B
[SubSlot 1] No Module
[SubSlot 2] No Module
[SubSlot 3] No Module


Here is the relevant portion of the switch configuration.

#
link-aggregation load-sharing mode destination-ip source-ip
#
vlan 252
description 10G-NFS
#
interface Bridge-Aggregation3
description FreeNAS-G6
port access vlan 252
link-aggregation load-sharing mode source-ip
#
interface Vlan-interface252
ip address 192.168.252.40 255.255.255.0
#
interface Ten-GigabitEthernet1/0/11
port link-mode bridge
description FreeNAS G6 - P1
port access vlan 252
flow-control
flow-interval 60
port link-aggregation group 3
#
interface Ten-GigabitEthernet1/0/12
port link-mode bridge
description FreeNAS G6 - P2
port access vlan 252
flow-control
flow-interval 60
port link-aggregation group 3
#


Right now the switch is set to static link aggregation, and FreeNAS is set to load balance. When it was previously configured for LACP, the second port on the NIC would generate errors from the switch about improper LACP. See the following.

Apr 13 08:49:04 192.168.253.40 2015 HP-5820X-14XG %%10IFNET/3/LINK_UPDOWN(l): Ten-GigabitEthernet1/0/11 link status is UP.
Apr 13 08:49:08 192.168.253.40 2015 HP-5820X-14XG %%10LAGG/1/AggPortRecoverActive(t): Trap 1.3.6.1.4.1.25506.8.25.2.4: Aggregation Group 3: port member 12320778 becomes ACTIVE!
Apr 13 08:49:08 192.168.253.40 2015 HP-5820X-14XG %%10LAGG/5/LAGG_ACTIVE(l): Member port Ten-GigabitEthernet1/0/11 of aggregation group BAGG3 becomes ACTIVE.
Apr 13 08:49:14 192.168.253.40 2015 HP-5820X-14XG %%10LAGG/1/AggPortInactive2(t): Trap 1.3.6.1.4.1.25506.8.25.2.3: Aggregation Group 3: port member 12320778 becomes INACTIVE!
Apr 13 08:49:14 192.168.253.40 2015 HP-5820X-14XG %%10LAGG/5/LAGG_INACTIVE_PARTNER(l): Member port Ten-GigabitEthernet1/0/11 of aggregation group BAGG3 becomes INACTIVE because the port's partner is improper for being attached.
Apr 13 08:49:16 192.168.253.40 2015 HP-5820X-14XG %%10LAGG/1/AggPortRecoverActive(t): Trap 1.3.6.1.4.1.25506.8.25.2.4: Aggregation Group 3: port member 12320778 becomes ACTIVE!
Apr 13 08:49:16 192.168.253.40 2015 HP-5820X-14XG %%10LAGG/5/LAGG_ACTIVE(l): Member port Ten-GigabitEthernet1/0/11 of aggregation group BAGG3 becomes ACTIVE.
Apr 13 08:49:18 192.168.253.40 2015 HP-5820X-14XG %%10LLDP/6/LLDP_CREATE_NEIGHBOR(l): New neighbor created on Port Ten-GigabitEthernet1/0/11 (IfIndex 12320778), Chassis ID is 0007-4306-3f9b, Port ID is cxgb1.
Apr 13 08:49:44 192.168.253.40 2015 HP-5820X-14XG %%10LAGG/1/AggPortInactive2(t): Trap 1.3.6.1.4.1.25506.8.25.2.3: Aggregation Group 3: port member 12320778 becomes INACTIVE!
Apr 13 08:49:44 192.168.253.40 2015 HP-5820X-14XG %%10LAGG/5/LAGG_INACTIVE_PARTNER(l): Member port Ten-GigabitEthernet1/0/11 of aggregation group BAGG3 becomes INACTIVE because the port's partner is improper for being attached.
Apr 13 08:49:46 192.168.253.40 2015 HP-5820X-14XG %%10LAGG/1/AggPortRecoverActive(t): Trap 1.3.6.1.4.1.25506.8.25.2.4: Aggregation Group 3: port member 12320778 becomes ACTIVE!
Apr 13 08:49:46 192.168.253.40 2015 HP-5820X-14XG %%10LAGG/5/LAGG_ACTIVE(l): Member port Ten-GigabitEthernet1/0/11 of aggregation group BAGG3 becomes ACTIVE.
Apr 13 08:50:14 192.168.253.40 2015 HP-5820X-14XG %%10LAGG/1/AggPortInactive2(t): Trap 1.3.6.1.4.1.25506.8.25.2.3: Aggregation Group 3: port member 12320778 becomes INACTIVE!


I have switched the transceiver in both the NIC and on the switch side, but the errors continue. I am trying to determine if this seems like hardware (NIC or switch port), but there don't seem to be any other problems. All the errors seem to be around LACP. The other oddity is that the LLDP information from that second interface seems to think there are two LLDP peers there. Both ports connect directly to a single switch port.

[root@freenas ~]# ifconfig cxgb0
cxgb0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
description: connected to HP-5820X-14XG
options=6c07bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCS
UM,TSO4,TSO6,LRO,VLAN_HWTSO,LINKSTATE,RXCSUM_IPV6,TXCSUM_IPV6>
ether 00:07:43:06:3f:9b
nd6 options=9<PERFORMNUD,IFDISABLED>
media: Ethernet 10Gbase-SR <full-duplex>
status: active
[root@freenas ~]# ifconfig cxgb1
cxgb1: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
description: connected to 2 peers
options=6c07bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCS
UM,TSO4,TSO6,LRO,VLAN_HWTSO,LINKSTATE,RXCSUM_IPV6,TXCSUM_IPV6>
ether 00:07:43:06:3f:9b
nd6 options=9<PERFORMNUD,IFDISABLED>
media: Ethernet 10Gbase-SR <full-duplex>
status: active

I can certainly replace the NIC with another similar one, but I am looking for some direction as to whether this is hardware or software.
 
Joined
Dec 29, 2014
Messages
1,073
No progress. I am doing a static etherchannel for the moment, but that isn't really what I want to do. I certainly don't think LACP is broken in FreeNAS because it negotiates a 4 member LAGG with my HP 2848 switch correctly. The 2848 negotiates a 2 member LAGG with the 5820X fine, but FreeNAS and the 5820X don't seem to like one another. I am debating turning off LLDP on FreeNAS although that seems like quite a stretch.
 
Status
Not open for further replies.
Top