View Issue Details

IDProjectCategoryView StatusLast Update
0018300CentOS-7-OTHERpublic2021-09-13 13:58
Reportersaroj_kumar Assigned To 
PrioritynormalSeveritymajorReproducibilityalways
Status closedResolutionno change required 
Product Version7.8-2003 
Summary0018300: kernel panic error after upgrading kernel
DescriptionAt the same time we also got some OS level logs where we can see some issue with the kernel and java process at the same time after which the issue appear.

 

Attached the logs snippet from the OS level /var/log/messages file for the same.

 

Could you please analyse the same and let us know in case there is any issue with java or os kernel.

 

We are using java version : "1.8.0_281"
AEM Version : 6.5.9.0
Centos version : CentOS Linux release 7.8.2003 (Core)
Kernel version : 3.10.0-1160.41.2.el7
Additional Informationfind the log :

Sep 7 19:28:42 pddpex-aem5-publish1 kernel: divide error: 0000 [#1] SMP
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: Modules linked in: udp_diag tcp_diag in
et_diag binfmt_misc iptable_filter vfat fat dm_mirror dm_region_hash dm_log dm_mod e
xt4 mbcache jbd2 joydev hv_utils ptp pps_core sg hv_balloon nf_conntrack_ipv4 nf_def
rag_ipv4 xt_conntrack nf_conntrack iptable_security xt_owner sb_edac iosf_mbi crc32_
pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper i2c_piix4 ablk_helpe
r pcspkr cryptd ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic ata_gene
ric pata_acpi hv_storvsc scsi_transport_fc hv_netvsc hyperv_keyboard hid_hyperv scsi
_tgt ata_piix hyperv_fb crct10dif_pclmul crct10dif_common libata crc32c_intel serio_
raw hv_vmbus
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: CPU: 1 PID: 1343 Comm: gitlab-runner Ta
inted: G ------------ T 3.10.0-1160.41.1.el7.x86_64.debug #1
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: Hardware name: Microsoft Corporation Vi
rtual Machine/Virtual Machine, BIOS 090008 12/07/2018
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: task: ffff8ae69f900000 ti: ffff8ae685ab
0000 task.ti: ffff8ae685ab0000
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: RIP: 0010:[<ffffffff81f079bb>] [<fffff
fff81f079bb>] task_numa_find_cpu+0x31b/0x6d0
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: RSP: 0000:ffff8ae685ab3b00 EFLAGS: 000
10246
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: RAX: 0000000000000000 RBX: ffff8ae685ab3bb0 RCX: 000000000000ffff
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: RDX: 0000000000000000 RSI: ffff8ae684554000 RDI: 0000000000000246
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: RBP: ffff8ae685ab3b80 R08: 0000000000000000 R09: 0000000000000000
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: R10: 0000000000000002 R11: 0000000000000000 R12: ffff8adf7b3a8000
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: R13: 0000000000000002 R14: 000000000000000d R15: 000000000000000d
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: FS: 000000c0002b8090(0000) GS:ffff8adfa3000000(0000) knlGS:0000000000000000
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: CR2: 000000000339b420 CR3: 00000007848e2000 CR4: 00000000001606e0
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: Call Trace:
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: [<ffffffff81f0775d>] ? task_numa_find_cpu+0xbd/0x6d0
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: [<ffffffff81f0815c>] task_numa_migrate+0x3ec/0x8c0
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: [<ffffffff81f07d75>] ? task_numa_migrate+0x5/0x8c0
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: [<ffffffff81f08680>] numa_migrate_preferred+0x50/0x60
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: [<ffffffff81f092c7>] task_numa_fault+0x377/0xd40
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: [<ffffffff81f096fc>] ? task_numa_fault+0x7ac/0xd40
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: [<ffffffff820473ac>] do_numa_page+0x1bc/0x250
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: [<ffffffff8204775a>] handle_pte_fault+0x31a/0xd70
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: [<ffffffff8204aee4>] handle_mm_fault+0x3a4/0x9b0
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: [<ffffffff82694b9f>] __do_page_fault+0x20f/0x5a0
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: [<ffffffff82694f65>] do_page_fault+0x35/0x90
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: [<ffffffff82690818>] page_fault+0x28/0x30
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: Code: 84 65 03 00 00 45 01 ed 41 8d 55 01 4d 63 ed 48 63 d2 48 8b 94 d0 08 01 00 00 4a 03 94 e8 08 01 00 00 48 69 c2 e8 03 00 00 31 d2 <48> f7 b6 f8 00 00 00 4c 01 45 c8 48 29 45 c8 48 8b 45 c8 48 39
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: RIP [<ffffffff81f079bb>] task_numa_find_cpu+0x31b/0x6d0
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: RSP <ffff8ae685ab3b00>
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: ---[ end trace 2d00652442bf3d12 ]---
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: BUG: sleeping function called from invalid context at kernel/rwsem.c:21
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: in_atomic(): 1, irqs_disabled(): 0, pid: 1343, name: gitlab-runner
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: INFO: lockdep is turned off.
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: CPU: 1 PID: 1343 Comm: gitlab-runner Tainted: G D ------------ T 3.10.0-1160.41.1.el7.x86_64.debug #1
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: Hardware name: Microsoft Corporation Virtual Machine/Virtual Machine, BIOS 090008 12/07/2018
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: Call Trace:
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: [<ffffffff82683695>] dump_stack+0x19/0x1b
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: [<ffffffff81ef509b>] __might_sleep+0x17b/0x240
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: [<ffffffff8268a51a>] down_read+0x2a/0xb0

Sep 7 19:28:42 pddpex-aem5-publish1 kernel: [<ffffffff81eccd53>] exit_signals+0x33/0x150
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: [<ffffffff81eb5fbc>] do_exit+0xcc/0xba0
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: [<ffffffff81eb23e0>] ? kmsg_dump+0x130/0x1d0
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: [<ffffffff81eb22e4>] ? kmsg_dump+0x34/0x1d0
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: [<ffffffff82691910>] oops_end+0xa0/0xe0
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: [<ffffffff81e394db>] die+0x4b/0x70
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: [<ffffffff82691040>] do_trap+0x60/0x170
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: [<ffffffff81e3525e>] do_divide_error+0xae/0x120
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: [<ffffffff81f079bb>] ? task_numa_find_cpu+0x31b/0x6d0
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: [<ffffffff822286ec>] ? trace_hardirqs_off_thunk+0x1a/0x1c
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: [<ffffffff8269e01e>] divide_error+0x1e/0x30
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: [<ffffffff81f079bb>] ? task_numa_find_cpu+0x31b/0x6d0
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: [<ffffffff81f0775d>] ? task_numa_find_cpu+0xbd/0x6d0
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: [<ffffffff81f0815c>] task_numa_migrate+0x3ec/0x8c0
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: [<ffffffff81f07d75>] ? task_numa_migrate+0x5/0x8c0
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: [<ffffffff81f08680>] numa_migrate_preferred+0x50/0x60
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: [<ffffffff81f092c7>] task_numa_fault+0x377/0xd40
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: [<ffffffff81f096fc>] ? task_numa_fault+0x7ac/0xd40
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: [<ffffffff820473ac>] do_numa_page+0x1bc/0x250
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: [<ffffffff8204775a>] handle_pte_fault+0x31a/0xd70
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: [<ffffffff8204aee4>] handle_mm_fault+0x3a4/0x9b0

Sep 7 19:28:42 pddpex-aem5-publish1 kernel: [<ffffffff82694b9f>] __do_page_fault+0x20f/0x5a0
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: [<ffffffff82694f65>] do_page_fault+0x35/0x90
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: [<ffffffff82690818>] page_fault+0x28/0x30
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: BUG: scheduling while atomic: gitlab-runner/1343/0x10000002
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: INFO: lockdep is turned off.
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: Modules linked in: udp_diag tcp_diag inet_diag binfmt_misc iptable_filter vfat fat dm_mirror dm_region_hash dm_log dm_mod ext4 mbcache jbd2 joydev hv_utils ptp pps_core sg hv_balloon nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack iptable_security xt_owner sb_edac iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper i2c_piix4 ablk_helper pcspkr cryptd ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi hv_storvsc scsi_transport_fc hv_netvsc hyperv_keyboard hid_hyperv scsi_tgt ata_piix hyperv_fb crct10dif_pclmul crct10dif_common libata crc32c_intel serio_raw hv_vmbus
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: CPU: 1 PID: 1343 Comm: gitlab-runner Tainted: G D ------------ T 3.10.0-1160.41.1.el7.x86_64.debug #1
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: Hardware name: Microsoft Corporation Virtual Machine/Virtual Machine, BIOS 090008 12/07/2018
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: Call Trace:
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: [<ffffffff82683695>] dump_stack+0x19/0x1b
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: [<ffffffff8267bd27>] __schedule_bug+0x7d/0x8c
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: [<ffffffff8268b26c>] __schedule+0x7dc/0x820
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: [<ffffffff81ef97a6>] __cond_resched+0x26/0x30
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: [<ffffffff8268b5fa>] _cond_resched+0x3a/0x50
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: [<ffffffff8268a51f>] down_read+0x2f/0xb0
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: [<ffffffff81eccd53>] exit_signals+0x33/0x150
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: [<ffffffff81eb5fbc>] do_exit+0xcc/0xba0
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: [<ffffffff81eb23e0>] ? kmsg_dump+0x130/0x1d0
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: [<ffffffff81eb22e4>] ? kmsg_dump+0x34/0x1d0
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: [<ffffffff82691910>] oops_end+0xa0/0xe0
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: [<ffffffff81e394db>] die+0x4b/0x70
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: [<ffffffff82691040>] do_trap+0x60/0x170
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: [<ffffffff81e3525e>] do_divide_error+0xae/0x120
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: [<ffffffff81f079bb>] ? task_numa_find_cpu+0x31b/0x6d0
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: [<ffffffff822286ec>] ? trace_hardirqs_off_thunk+0x1a/0x1c
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: [<ffffffff8269e01e>] divide_error+0x1e/0x30
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: [<ffffffff81f079bb>] ? task_numa_find_cpu+0x31b/0x6d0
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: [<ffffffff81f0775d>] ? task_numa_find_cpu+0xbd/0x6d0
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: [<ffffffff81f0815c>] task_numa_migrate+0x3ec/0x8c0
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: [<ffffffff81f07d75>] ? task_numa_migrate+0x5/0x8c0
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: [<ffffffff81f08680>] numa_migrate_preferred+0x50/0x60
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: [<ffffffff81f092c7>] task_numa_fault+0x377/0xd40
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: [<ffffffff81f096fc>] ? task_numa_fault+0x7ac/0xd40
Sep 7 19:28:42 pddpex-aem5-publish1 kernel: [<ffffffff820473ac>] do_numa_page+0x1bc/0x250
Sep 7 19:28:43 pddpex-aem5-publish1 kernel: [<ffffffff8204775a>] handle_pte_fault+0x31a/0xd70
Sep 7 19:28:43 pddpex-aem5-publish1 kernel: [<ffffffff8204aee4>] handle_mm_fault+0x3a4/0x9b0
Sep 7 19:28:43 pddpex-aem5-publish1 kernel: [<ffffffff82694b9f>] __do_page_fault+0x20f/0x5a0
Sep 7 19:28:43 pddpex-aem5-publish1 kernel: [<ffffffff82694f65>] do_page_fault+0x35/0x90
Sep 7 19:28:43 pddpex-aem5-publish1 kernel: [<ffffffff82690818>] page_fault+0x28/0x30
Sep 7 19:28:43 pddpex-aem5-publish1 kernel: note: gitlab-runner[1343] exited with preempt_count 1
TagsNo tags attached.
abrt_hash
URL

Activities

There are no notes attached to this issue.

Issue History

Date Modified Username Field Change
2021-09-08 10:56 saroj_kumar New Issue
2021-09-13 13:58 TrevorH Status new => closed
2021-09-13 13:58 TrevorH Resolution open => no change required