View Issue Details

IDProjectCategoryView StatusLast Update
0015687CentOS-7kernelpublic2019-01-10 09:38
Reporterdaixj 
PriorityhighSeveritymajorReproducibilityhave not tried
Status newResolutionopen 
Product Version7.3.1611 
Target VersionFixed in Version 
Summary0015687: kernel: NMI watchdog: BUG: soft lockup - CPU#7 stuck for 22s! (ceph _raw_spin_lock)
DescriptionJan 9 11:31:41 node04 xinetd[1259]: EXIT: svncproxy status=0 pid=20868 duration=0(sec)
Jan 9 11:31:42 node04 pgsqlx(shterm_postgres)[20012]: INFO: mon out, rc:8
Jan 9 11:31:43 node04 kernel: libceph: mon2 10.11.77.84:6789 session lost, hunting for new mon
Jan 9 11:31:43 node04 kernel: libceph: mon1 10.11.77.12:6789 session established
Jan 9 11:31:47 node04 su: (to rabbitmq) root on none
Jan 9 11:31:47 node04 systemd: Started Session c373470 of user rabbitmq.
Jan 9 11:31:47 node04 systemd: Starting Session c373470 of user rabbitmq.
Jan 9 11:31:47 node04 kernel: NMI watchdog: BUG: soft lockup - CPU#7 stuck for 22s! [kworker/7:1:18423]
Jan 9 11:31:47 node04 kernel: Modules linked in: ceph libceph dns_resolver ipt_MASQUERADE nf_nat_masquerade_ipv4 tun binfmt_misc ip6t_rpfilter ipt_REJECT nf_reject_ipv4 ip6t_REJECT nf_reject_ipv6 xt_conntrack ip_set nfnetlink ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter intel_powerclamp coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev vmw_balloon sg pcspkr parport_pc parport i2c_piix4 vmw_vmci shpchp nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_vs nf_conntrack ip_tables xfs libcrc32c
Jan 9 11:31:47 node04 kernel: sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm mptspi ata_piix crct10dif_pclmul scsi_transport_spi crct10dif_common drm crc32c_intel serio_raw mptscsih libata mptbase vmxnet3 i2c_core floppy fjes dm_mirror dm_region_hash dm_log dm_mod
Jan 9 11:31:47 node04 kernel: CPU: 7 PID: 18423 Comm: kworker/7:1 Not tainted 3.10.0-514.26.2.el7.x86_64 #1
Jan 9 11:31:47 node04 kernel: Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
Jan 9 11:31:47 node04 kernel: Workqueue: events delayed_work [ceph]
Jan 9 11:31:47 node04 kernel: task: ffff880253203ec0 ti: ffff880247c44000 task.ti: ffff880247c44000
Jan 9 11:31:47 node04 kernel: RIP: 0010:[<ffffffff8168ea92>] [<ffffffff8168ea92>] _raw_spin_lock+0x32/0x50
Jan 9 11:31:47 node04 kernel: RSP: 0018:ffff880247c47c68 EFLAGS: 00000287
Jan 9 11:31:47 node04 kernel: RAX: 00000000000062b6 RBX: ffff880247c47bf0 RCX: 0000000000000100
Jan 9 11:31:47 node04 kernel: RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffff88001a2fef50
Jan 9 11:31:47 node04 kernel: RBP: ffff880247c47c68 R08: ffff880247c44000 R09: 0000000000000000
Jan 9 11:31:47 node04 kernel: R10: 0000000000000001 R11: 0000000000000000 R12: 00000000ffffffff
Jan 9 11:31:47 node04 kernel: R13: ffff880253203ec0 R14: ffff88083609b024 R15: ffff88083609b020
Jan 9 11:31:47 node04 kernel: FS: 0000000000000000(0000) GS:ffff880437d80000(0000) knlGS:0000000000000000
Jan 9 11:31:47 node04 kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jan 9 11:31:47 node04 kernel: CR2: 00007f08efabe400 CR3: 00000000019be000 CR4: 00000000003407e0
Jan 9 11:31:47 node04 kernel: DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Jan 9 11:31:47 node04 kernel: DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Jan 9 11:31:47 node04 kernel: Stack:
Jan 9 11:31:47 node04 kernel: ffff880247c47d90 ffffffffa0669400 ffff8802bd120800 ffff880247c47ca0
Jan 9 11:31:47 node04 kernel: ffffffff813183b5 0000000000000000 0000000000000400 ffff880247c47d98
Jan 9 11:31:47 node04 kernel: ffffffff810d2902 000000078104e13c ffff8802bd120808 ffff8802bfc08c00
Jan 9 11:31:47 node04 kernel: Call Trace:
Jan 9 11:31:47 node04 kernel: [<ffffffffa0669400>] ceph_check_caps+0x6a0/0xb80 [ceph]
Jan 9 11:31:47 node04 kernel: [<ffffffff813183b5>] ? cpumask_next_and+0x35/0x50
Jan 9 11:31:47 node04 kernel: [<ffffffff810d2902>] ? load_balance+0x1e2/0x990
Jan 9 11:31:47 node04 kernel: [<ffffffffa066cfa4>] ceph_check_delayed_caps+0x84/0xf0 [ceph]
Jan 9 11:31:47 node04 kernel: [<ffffffffa0674245>] delayed_work+0x35/0x260 [ceph]
Jan 9 11:31:47 node04 kernel: [<ffffffff810a845b>] process_one_work+0x17b/0x470
Jan 9 11:31:47 node04 kernel: [<ffffffff810a9296>] worker_thread+0x126/0x410
Jan 9 11:31:47 node04 kernel: [<ffffffff810a9170>] ? rescuer_thread+0x460/0x460
Jan 9 11:31:47 node04 kernel: [<ffffffff810b0a4f>] kthread+0xcf/0xe0
Jan 9 11:31:47 node04 kernel: [<ffffffff810b0980>] ? kthread_create_on_node+0x140/0x140
Jan 9 11:31:47 node04 kernel: [<ffffffff81697758>] ret_from_fork+0x58/0x90
Jan 9 11:31:47 node04 kernel: [<ffffffff810b0980>] ? kthread_create_on_node+0x140/0x140
Jan 9 11:31:47 node04 kernel: Code: 00 02 00 f0 0f c1 07 89 c2 c1 ea 10 66 39 c2 75 01 c3 55 83 e2 fe 0f b7 f2 48 89 e5 b8 00 80 00 00 eb 0d 66 0f 1f 44 00 00 f3 90 <83> e8 01 74 0a 0f b7 0f 66 39 ca 75 f1 5d c3 0f 1f 80 00 00 00
TagsNo tags attached.
abrt_hash
URL

Activities

TrevorH

TrevorH

2019-01-10 09:38

manager   ~0033552

Run `yum update` to get current on 7.6, reboot to make the new kernel active then see if the problem recurs.

7.3 is unsupported and has been since the release of 7.4 in September 2017.

Issue History

Date Modified Username Field Change
2019-01-10 09:31 daixj New Issue
2019-01-10 09:38 TrevorH Note Added: 0033552