View Issue Details

IDProjectCategoryView StatusLast Update
0014670CentOS-7[All Projects] generalpublic2018-04-13 07:38
Reportersabramichev 
PriorityimmediateSeveritymajorReproducibilityalways
Status newResolutionopen 
Product Version 
Target VersionFixed in Version 
Summary0014670: RX_ERR on bond interface (be2net+bonding)
Description

Hi guys

Help to understand the problem

I get RX _ ERR on the interface bond1, and on slaves interfaces there are no errors.

Network Card :
Ethernet controller: Emulex Corporation OneConnect 10Gb NIC (be3) (rev 03)
Subsystem: Emulex Corporation Device e718
Physical Slot: 0-5
Flags: bus master, fast devsel, latency 0, IRQ 133, NUMA node 1
Memory at c8108000 (64-bit, non-prefetchable) [size = 16K]
Memory at c8080000 (64-bit, non-prefetchable) [size = 128K]
Memory at c80a0000 (64-bit, non-prefetchable) [size = 128K]
Expansion ROM at c8180000 [disabled] [size = 256K]
Capabilities: [40] Power Management version 3
Capabilities: [48] MSI-X: Enable + Count = 32 Masked-
Capabilities: [c0] Express Endpoint, MSI 00
Capabilities: [b8] Vital Product Data
Capabilities: [100] Advanced Error Reporting
Capabilities: [180] Single Root I / O Virtualization (SR-IOV)
Capabilities: [160] Alternative Routing-ID Interpretation (ARI)
Capabilities: [168] Device Serial Number f0-2f-a7-ff-fe-5a-9f-0e
Capabilities: [12c] Transaction Processing Hints
Kernel driver in use: be2net
Kernel modules: be2net

Be2net module:
modinfo be2net
filename: /lib/modules/3.10.0-693.el7.x86_64/kernel/drivers/net/ethernet/emulex/benet/be2net.ko.xz
license: GPL
author: Emulex Corporation
description: Emulex OneConnect NIC Driver 11.4.0.0r
version: 11.4.0.0r
rhelversion: 7.4
 


Module bonding:

modinfo bonding
filename: /lib/modules/3.10.0-693.el7.x86_64/kernel/drivers/net/bonding/bonding.ko.xz
author: Thomas Davis, tadavis@lbl.gov and many others
description: Ethernet Channel Bonding Driver, v3.7.1
version: 3.7.1
license: GPL
alias: rtnl-link-bond
rhelversion: 7.4
srcversion: 3F7A5A65495F3B40F22AEFD


be2net module according to the documentation I updated

parm: num_vfs: Number of PCI VFs to initialize (uint)
parm: rx_frag_size: Size of a fragment that holds rcvd data. (ushort)

cat / sys / bus / pci / drivers / be2net / module / parameters / rx_frag_size
8192


Look at this:


ifconfig bond1
bond1: flags = 5187 <UP, BROADCAST, RUNNING, MASTER, MULTICAST> mtu 9000
        ether f0: 2f: a7: 5a: 9f: 12 txqueuelen 10000 (Ethernet)
        RX packets 58037320 bytes 70152736285 (65.3 GiB)
        RX errors 779367229 dropped 3246433 overruns 1604558081 frame 1483518545
        TX packets 24222260 bytes 6970092100 (6.4 GiB)
        TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0



 ifconfig enp4s0f1
enp4s0f1: flags = 6211 <UP, BROADCAST, RUNNING, SLAVE, MULTICAST> mtu 9000
        ether f0: 2f: a7: 5a: 9f: 12 txqueuelen 10000 (Ethernet)
        RX packets 21267497 bytes 24209831887 (22.5 GiB)
        RX errors 0 dropped 0 overruns 0 frame 0
        TX packets 13999435 bytes 950260462 (906.2 MiB)
        TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0

ifconfig enp132s0f1
enp132s0f1: flags = 6211 <UP, BROADCAST, RUNNING, SLAVE, MULTICAST> mtu 9000
        ether f0: 2f: a7: 5a: 9f: 12 txqueuelen 10000 (Ethernet)
        RX packets 36654095 bytes 45820936405 (42.6 GiB)
        RX errors 0 dropped 0 overruns 0 frame 0
        TX packets 10215548 bytes 6019018390 (5.6 GiB)
        TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0



cat / proc / net / bonding / bond1 | grep enp
Slave Interface: enp132s0f1
Slave Interface: enp4s0f1


cat / proc / net / bonding / bond1 | grep Fa
Link Failure Count: 0
Link Failure Count: 0


[root @ suv-s09-08-06 ~] # ethtool -k enp132s0f1 | grep rx
rx-checksumming: off
rx-vlan-offload: on [fixed]
rx-vlan-filter: on [fixed]
rx-fcs: off [fixed]
rx-all: off [fixed]
rx-vlan-stag-hw-parse: off [fixed]
rx-vlan-stag-filter: off [fixed]
[root @ suv-s09-08-06 ~] # ethtool -k enp4s0f1 | grep rx
rx-checksumming: off
rx-vlan-offload: on [fixed]
rx-vlan-filter: on [fixed]
rx-fcs: off [fixed]
rx-all: off [fixed]
rx-vlan-stag-hw-parse: off [fixed]
rx-vlan-stag-filter: off [fixed]
[root @ suv-s09-08-06 ~]


Ring parameters for enp4s0f1:
Pre-set maximums:
RX: 1024
RX Mini: 0
RX Jumbo: 0
TX: 2048
Current hardware settings:
RX: 1024
RX Mini: 0
RX Jumbo: 0
TX: 2048


Ring parameters for enp4s0f1:
Pre-set maximums:
RX: 1024
RX Mini: 0
RX Jumbo: 0
TX: 2048
Current hardware settings:
RX: 1024
RX Mini: 0
RX Jumbo: 0
TX: 2048



Help me to understand !
Tagsbonding be2bet
abrt_hash
URL

Activities

TrevorH

TrevorH

2018-04-10 09:04

developer   ~0031589

Since you appear to be using the original 7.4 kernel in which bonding was completely broken, you need to yum update to the latest 7.4 kernel - currently 3.10.0-693.21.1.el7 and retest.
sabramichev

sabramichev

2018-04-13 06:15

reporter   ~0031611

uname -mrm
3.10.0-693.21.1.el7.x86_64 x86_64

Kernel Interface table
Iface MTU RX-OK RX-ERR RX-DRP RX-OVR TX-OK TX-ERR TX-DRP TX-OVR Flg
bond0 1500 7942431 1 2 19211567 3125648 0 0 0 BMmRU
bond1 1500 9463406 5950531 100 24420 12277091 0 0 0 BMmRU
enp132s0 1500 6140364 1 0 0 199149 0 0 0 BMsRU
enp132s0 1500 421212 0 0 0 11675777 0 0 0 BMsRU
enp4s0f0 1500 1802067 0 0 0 2926499 0 0 0 BMsRU
enp4s0f1 1500 9042194 0 0 0 601314 0 0 0 BMsRU
sabramichev

sabramichev

2018-04-13 07:38

reporter   ~0031612

Look this

[root@suv-s09-08-03 ~]# ip -s -s link show enp132s0f1
5: enp132s0f1: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 1500 qdisc mq master bond1 portid 0200000000000000000000000000003000 state UP mode DEFAULT qlen 1000
    link/ether f0:2f:a7:5a:9a:12 brd ff:ff:ff:ff:ff:ff
    RX: bytes packets errors dropped overrun mcast
    93679633 471241 0 0 0 267425
    RX errors: length crc frame fifo missed
               0 0 0 0 0
    TX: bytes packets errors dropped carrier collsns
    17607691638 12831373 0 0 0 0
    TX errors: aborted fifo window heartbeat transns
               0 0 0 0 2
[root@suv-s09-08-03 ~]# ip -s -s link show bond1
22: bond1: <BROADCAST,MULTICAST,MASTER,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP mode DEFAULT qlen 1000
    link/ether f0:2f:a7:5a:9a:12 brd ff:ff:ff:ff:ff:ff
    RX: bytes packets errors dropped overrun mcast
    10804462148 10333080 5950531 100 0 561643
    RX errors: length crc frame fifo missed
               394448 5833 5260297 24420 0
    TX: bytes packets errors dropped carrier collsns
    17667211372 13489684 0 0 0 0
    TX errors: aborted fifo window heartbeat transns
               0 0 0 0 2
[root@suv-s09-08-03 ~]#



bond1
RX errors: length crc frame fifo missed
               394448 5833 5260297 24420 0

Issue History

Date Modified Username Field Change
2018-04-10 08:51 sabramichev New Issue
2018-04-10 08:51 sabramichev Tag Attached: bonding be2bet
2018-04-10 09:04 TrevorH Note Added: 0031589
2018-04-13 06:15 sabramichev Note Added: 0031611
2018-04-13 07:38 sabramichev Note Added: 0031612