View Issue Details

IDProjectCategoryView StatusLast Update
0015950CentOS-7kernelpublic2019-03-25 07:15
ReporterDaniel-1982 
PriorityurgentSeveritycrashReproducibilityrandom
Status newResolutionopen 
PlatformDELL R230OSCentOS LinuxOS Version7.2.1511 (Core)
Product Version7.2.1511 
Target VersionFixed in Version 
Summary0015950: CentOS reboot at Mar 22nd 09:25 2019
DescriptionCentOS reboot at Mar 22nd 09:25 2019
Steps To Reproduce1) Kernel:
Linux WCGSeGW-02 3.10.0-514.el7.centos.x86_64 #1 SMP Thu Jun 22 18:56:30 CST 2017 x86_64 x86_64 x86_64 GNU/Linux

2) Crash log of vmcore:
      KERNEL: /usr/lib/debug/lib/modules/3.10.0-514.el7.x86_64/vmlinux
    DUMPFILE: ./vmcore [PARTIAL DUMP]
        CPUS: 1foreach: seek error: kernel virtual address: ffffffffffffffff type: "cpu_online_map"

        DATE: Fri Mar 22 09:25:14 2019
      UPTIME: 8 days, 15:23:45
LOAD AVERAGE: 0.73, 0.54, 0.52
       TASKS: 403
    NODENAME: WCGSeGW-02
     RELEASE: 3.10.0-514.el7.centos.x86_64
     VERSION: #1 SMP Thu Jun 22 18:56:30 CST 2017
     MACHINE: x86_64 (3000 Mhz)
      MEMORY: 15.8 GB
       PANIC: "kernel BUG at net/core/skbuff.c:2289!"
         PID: 0
     COMMAND: "swapper/0"
        TASK: ffffffff819c1460 [THREAD_INFO: ffffffff819ac000]
         CPU: 0
       STATE: TASK_RUNNING (PANIC)
Additional Informationvmcore-dmesg :
[746626.589955] ------------[ cut here ]------------
[746626.589984] kernel BUG at net/core/skbuff.c:2289!
[746626.590007] invalid opcode: 0000 [#1] SMP
[746626.590029] Modules linked in: gtp_relay(OE) sctp ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter drbg ansi_cprng authenc xfrm6_mode_tunnel xfrm4_mode_tunnel fuse xfrm4_tunnel tunnel4 ipcomp xfrm_ipcomp esp4 ah4 af_key iTCO_wdt iTCO_vendor_support intel_powerclamp dcdbas coretemp intel_rapl iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper i2c_i801 cryptd sg pcspkr mei_me mei shpchp nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic sr_mod cdrom mgag200 i2c_algo_bit drm_kms_helper syscopyarea crct10dif_pclmul crct10dif_common sysfillrect sysimgblt fb_sys_fops crc32c_intel ttm drm i2c_core ahci libahci libata megaraid_sas tg3 ptp pps_core dm_mirror dm_region_hash
[746626.590448] dm_log dm_mod
[746626.590460] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G OE ------------ 3.10.0-514.el7.centos.x86_64 #1
[746626.590504] Hardware name: Dell Inc. PowerEdge R230/0FRVY0, BIOS 2.4.3 01/31/2018
[746626.590538] task: ffffffff819c1460 ti: ffffffff819ac000 task.ti: ffffffff819ac000
[746626.590572] RIP: 0010:[<ffffffff8155d162>] [<ffffffff8155d162>] skb_copy_and_csum_bits+0x2f2/0x300
[746626.590617] RSP: 0018:ffff88046fc03608 EFLAGS: 00010206
[746626.590642] RAX: 0000000000000438 RBX: 0000000000000124 RCX: 00000000db971279
[746626.590673] RDX: 0000000079db9712 RSI: ffff88035777c4e8 RDI: ffff88035777d4e8
[746626.590705] RBP: ffff88046fc03660 R08: 120000008a060000 R09: 0000000000000438
[746626.590736] R10: 00000000000009b4 R11: ffff88035777c4e8 R12: 00000000000009b4
[746626.590767] R13: 0000000000000438 R14: 0000000000000000 R15: 0000000000000438
[746626.590799] FS: 0000000000000000(0000) GS:ffff88046fc00000(0000) knlGS:0000000000000000
[746626.590835] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[746626.590861] CR2: 00007f0b7de2d400 CR3: 00000000019ba000 CR4: 00000000003407f0
[746626.590892] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[746626.590924] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[746626.590955] Stack:
[746626.590966] ffff88041def3000 ffff880085e0cf00 ffffffff8155e9b1 00000000000009b4
[746626.591005] ffff88035777c0b0 db97127919eaccff ffff88041def3000 ffff88042da37ef0
[746626.591043] 0000000000000020 0000000000000000 ffff880457babf00 ffff88046fc03748
[746626.591081] Call Trace:
[746626.591093] <IRQ>
[746626.591104]
[746626.591117] [<ffffffff8155e9b1>] ? __alloc_skb+0xa1/0x2d0
[746626.591138] [<ffffffff81562163>] skb_segment+0x753/0xa40
[746626.591168] [<ffffffffa00b2d07>] ? ipt_do_table+0x337/0x710 [ip_tables]
[746626.591206] [<ffffffffa05ebad3>] sctp_gso_segment+0xa3/0x1f0 [sctp]
[746626.591237] [<ffffffff815ec96d>] inet_gso_segment+0x13d/0x340
[746626.591265] [<ffffffff81589600>] ? flow_cache_lookup+0x1f0/0x420
[746626.591295] [<ffffffff81570eef>] skb_mac_gso_segment+0x9f/0x110
[746626.591324] [<ffffffff81570fbd>] __skb_gso_segment+0x5d/0xb0
[746626.591352] [<ffffffff8161669f>] xfrm_output+0x9f/0x130
[746626.591378] [<ffffffff81608242>] xfrm4_output_finish+0x32/0x40
[746626.591405] [<ffffffff816080eb>] __xfrm4_output+0x2b/0x40
[746626.591431] [<ffffffff8160829b>] xfrm4_output+0x4b/0xc0
[746626.591457] [<ffffffff815b428e>] ? __ip_local_out_sk+0xee/0x100
[746626.591485] [<ffffffff815b42d1>] ip_local_out_sk+0x31/0x40
[746626.591512] [<ffffffff815b4643>] ip_queue_xmit+0x143/0x3a0
[746626.591544] [<ffffffffa05ce01c>] sctp_v4_xmit+0x5c/0xa0 [sctp]
[746626.591578] [<ffffffffa05e85c5>] sctp_packet_transmit+0x725/0xac0 [sctp]
[746626.592684] [<ffffffffa05d9922>] sctp_outq_flush+0x2c2/0xc00 [sctp]
[746626.593780] [<ffffffff810967e2>] ? internal_add_timer+0x32/0x70
[746626.594875] [<ffffffff81098dcb>] ? mod_timer+0x14b/0x230
[746626.595943] [<ffffffffa05dacbc>] sctp_outq_uncork+0x1c/0x20 [sctp]
[746626.596986] [<ffffffffa05cc2fa>] sctp_cmd_interpreter.isra.23+0x1fa/0x1410 [sctp]
[746626.598009] [<ffffffffa05cb94b>] sctp_do_sm+0xdb/0x350 [sctp]
[746626.598996] [<ffffffff81558248>] ? sk_reset_timer+0x18/0x30
[746626.599953] [<ffffffff815d584b>] ? tcp_prequeue+0x25b/0x2e0
[746626.600881] [<ffffffffa05ea9c0>] ? sctp_oname+0x30/0x30 [sctp]
[746626.601781] [<ffffffffa05cbd9e>] sctp_generate_heartbeat_event+0xde/0x150 [sctp]
[746626.602669] [<ffffffffa05cbcc0>] ? sctp_generate_t3_rtx_event+0x100/0x100 [sctp]
[746626.603534] [<ffffffff81095976>] call_timer_fn+0x36/0x110
[746626.604388] [<ffffffffa05cbcc0>] ? sctp_generate_t3_rtx_event+0x100/0x100 [sctp]
[746626.605240] [<ffffffff81098667>] run_timer_softirq+0x237/0x340
[746626.606079] [<ffffffff8108f0ff>] __do_softirq+0xef/0x280
[746626.606908] [<ffffffff81697fdc>] call_softirq+0x1c/0x30
[746626.607724] [<ffffffff8102d365>] do_softirq+0x65/0xa0
[746626.608531] [<ffffffff8108f495>] irq_exit+0x115/0x120
[746626.609331] [<ffffffff81698c55>] smp_apic_timer_interrupt+0x45/0x60
[746626.610140] [<ffffffff8169719d>] apic_timer_interrupt+0x6d/0x80
[746626.610939] <EOI>
[746626.610950]
[746626.611729] [<ffffffff81513f52>] ? cpuidle_enter_state+0x52/0xc0
[746626.612518] [<ffffffff81513f48>] ? cpuidle_enter_state+0x48/0xc0
[746626.613221] [<ffffffff81514099>] cpuidle_idle_call+0xd9/0x210
[746626.613856] [<ffffffff8103516e>] arch_cpu_idle+0xe/0x30
[746626.614481] [<ffffffff810e7c95>] cpu_startup_entry+0x245/0x290
[746626.615100] [<ffffffff816743a7>] rest_init+0x77/0x80
[746626.615711] [<ffffffff81b0a05a>] start_kernel+0x42c/0x44d
[746626.616320] [<ffffffff81b09a37>] ? repair_env_string+0x5c/0x5c
[746626.616920] [<ffffffff81b09120>] ? early_idt_handlers+0x120/0x120
[746626.617527] [<ffffffff81b095ee>] x86_64_start_reservations+0x2a/0x2c
[746626.618094] [<ffffffff81b09742>] x86_64_start_kernel+0x152/0x175
[746626.618596] Code: 45 c8 e9 01 fe ff ff be df 08 00 00 48 c7 c7 3b 95 94 81 4c 89 5d c0 89 45 c8 e8 fa 87 b2 ff 4c 8b 5d c0 8b 45 c8 e9 05 ff ff ff <0f> 0b 66 90 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48
[746626.619716] RIP [<ffffffff8155d162>] skb_copy_and_csum_bits+0x2f2/0x300
[746626.620263] RSP <ffff88046fc03608>
Tagskernel skbuff.c 2289
abrt_hash
URL

Activities

tigalch

tigalch

2019-03-25 06:11

manager   ~0034079

First of all, you should update all packages to the current ones with 'yum update'.
Daniel-1982

Daniel-1982

2019-03-25 07:15

reporter   ~0034080

OK, i will update all by yum. Thank you!
BTW, could you give more detail about the skbuff.c:2289 ?

Issue History

Date Modified Username Field Change
2019-03-25 03:42 Daniel-1982 New Issue
2019-03-25 03:42 Daniel-1982 Tag Attached: kernel skbuff.c 2289
2019-03-25 06:11 tigalch Note Added: 0034079
2019-03-25 07:15 Daniel-1982 Note Added: 0034080