2016-12-02 20:16 UTC

View Issue Details Jump to Notes ]
IDProjectCategoryView StatusLast Update
0006098CentOS-5kernelpublic2014-02-26 02:15
Reporterrbeamoh 
PriorityhighSeveritycrashReproducibilityrandom
StatusnewResolutionopen 
Platformi686 OSCentosOS Version5.7
Product Version5.7 
Target VersionFixed in Version 
Summary0006098: kernel: BUG: soft lockup - CPU#0 stuck for 60s! [scsi_eh_0:254]
Descriptionkernel crashes and puts NFS export in read only mode.
Nov 21 12:06:34 rryofs-cs009 kernel: STORVSC_DRV: sdev (f7892400) dev obj (f7892
da8) - host resetting...
Nov 21 12:06:34 rryofs-cs009 kernel: STORVSC: resetting host adapter...
Nov 21 12:07:34 rryofs-cs009 kernel: BUG: soft lockup - CPU#0 stuck for 60s! [sc
si_eh_0:524]
Nov 21 12:07:34 rryofs-cs009 kernel:
Nov 21 12:07:34 rryofs-cs009 kernel: Pid: 524, comm: scsi_eh_0
Nov 21 12:07:34 rryofs-cs009 kernel: EIP: 0060:[<c04f2c5f>] CPU: 0
Nov 21 12:07:34 rryofs-cs009 kernel: EIP is at delay_tsc+0xb/0x13
Nov 21 12:07:34 rryofs-cs009 kernel: EFLAGS: 00000297 Tainted: G ---- (
2.6.18-274.17.1.el5.centos.plusPAE #1)
Nov 21 12:07:34 rryofs-cs009 kernel: EAX: 4dd62997 EBX: 002c5c16 ECX: 4dacfc7c E
DX: 0000fbf0
Nov 21 12:07:34 rryofs-cs009 kernel: ESI: f8918d10 EDI: f7921a80 EBP: f7892da8 D
S: 007b ES: 007b
Nov 21 12:07:34 rryofs-cs009 kernel: CR0: 8005003b CR2: b7f0c000 CR3: 36c181e0 C
R4: 000006f0
Nov 21 12:07:34 rryofs-cs009 kernel: [<c04f2c90>] __delay+0x6/0x7
Nov 21 12:07:34 rryofs-cs009 kernel: [<f891177f>] StorVscOnHostReset+0x8c/0x141
 [storvsc]
Nov 21 12:16:02 rryofs-cs009 rpc.statd[2377]: Received erroneous SM_UNMON request from rryofs-cs009.ry.wpafb.af.mil for 134.131.15.2
Nov 21 12:16:02 rryofs-cs009 kernel: [<f885e7ff>] scsi_try_host_reset+0x3a/0x88 [scsi_mod]
Nov 21 12:16:02 rryofs-cs009 kernel: [<f885f370>] scsi_eh_ready_devs+0x342/0x404 [scsi_mod]
Nov 21 12:16:02 rryofs-cs009 kernel: [<f885fbaa>] scsi_error_handler+0x2e4/0x43b [scsi_mod]
Nov 21 12:16:02 rryofs-cs009 kernel: [<f885f8c6>] scsi_error_handler+0x0/0x43b [scsi_mod]
Nov 21 12:16:02 rryofs-cs009 kernel: [<c0437276>] kthread+0xc0/0xee
Nov 21 12:16:02 rryofs-cs009 kernel: [<c04371b6>] kthread+0x0/0xee
Nov 21 12:16:02 rryofs-cs009 kernel: [<c0405c87>] kernel_thread_helper+0x7/0x10
Nov 21 12:16:02 rryofs-cs009 kernel: =======================
Nov 21 12:16:02 rryofs-cs009 kernel: INFO: task nfsd:2859 blocked for more than 120 seconds.
Nov 21 12:16:02 rryofs-cs009 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Nov 21 12:16:02 rryofs-cs009 kernel: nfsd D 0000567D 1360 2859 1 2860 2834 (L-TLB)
Nov 21 12:16:02 rryofs-cs009 kernel: f5b15de8 00000046 a1a5f924 0000567d c0823200 00000000 cfb518c0 0000000a
Nov 21 12:16:02 rryofs-cs009 kernel: c325b550 a1a6f16f 0000567d 0000f84b 00000000 c325b65c c3112b00 f6e523c0
Nov 21 12:16:02 rryofs-cs009 kernel: 00000000 00000000 0b3a8652 f789b78c c310d72c c042d7b3 c3112b44 0b3a8652
Nov 21 12:16:02 rryofs-cs009 kernel: Call Trace:
Nov 21 12:16:02 rryofs-cs009 kernel: [<c042d7b3>] getnstimeofday+0x30/0xb6
Nov 21 12:16:02 rryofs-cs009 kernel: [<c0621600>] io_schedule+0x36/0x59
Nov 21 12:16:02 rryofs-cs009 kernel: [<c0458272>] sync_page+0x0/0x3b
Nov 21 12:16:02 rryofs-cs009 kernel: [<c04582aa>] sync_page+0x38/0x3b
Nov 21 12:16:02 rryofs-cs009 kernel: [<c0621712>] __wait_on_bit_lock+0x2a/0x52
Nov 21 12:16:02 rryofs-cs009 kernel: [<c04581ed>] __lock_page+0x52/0x59
Nov 21 12:16:02 rryofs-cs009 kernel: [<c0437368>] wake_bit_function+0x0/0x3c
Nov 21 12:16:02 rryofs-cs009 kernel: [<c0458a19>] do_generic_mapping_read+0x1f7/0x382
Nov 21 12:16:02 rryofs-cs009 kernel: [<c0458bea>] generic_file_sendfile+0x46/0x5b
Nov 21 12:16:02 rryofs-cs009 kernel: [<f92175bc>] nfsd_read_actor+0x0/0xba [nfsd]

Steps To ReproduceCannot reproduce manually
Tags5.10
Attached Files
  • ? file icon m (28,936 bytes) 2012-11-26 16:38 -
    Nov 21 12:06:34 rryofs-cs009 kernel: STORVSC_DRV: sdev (f7892400) dev obj (f7892da8) - host resetting...
    Nov 21 12:06:34 rryofs-cs009 kernel: STORVSC: resetting host adapter...
    Nov 21 12:07:34 rryofs-cs009 kernel: BUG: soft lockup - CPU#0 stuck for 60s! [scsi_eh_0:524]
    Nov 21 12:07:34 rryofs-cs009 kernel: 
    Nov 21 12:07:34 rryofs-cs009 kernel: Pid: 524, comm:            scsi_eh_0
    Nov 21 12:07:34 rryofs-cs009 kernel: EIP: 0060:[<c04f2c5f>] CPU: 0
    Nov 21 12:07:34 rryofs-cs009 kernel: EIP is at delay_tsc+0xb/0x13
    Nov 21 12:07:34 rryofs-cs009 kernel:  EFLAGS: 00000297    Tainted: G     ----  (2.6.18-274.17.1.el5.centos.plusPAE #1)
    Nov 21 12:07:34 rryofs-cs009 kernel: EAX: 4dd62997 EBX: 002c5c16 ECX: 4dacfc7c EDX: 0000fbf0
    Nov 21 12:07:34 rryofs-cs009 kernel: ESI: f8918d10 EDI: f7921a80 EBP: f7892da8 DS: 007b ES: 007b
    Nov 21 12:07:34 rryofs-cs009 kernel: CR0: 8005003b CR2: b7f0c000 CR3: 36c181e0 CR4: 000006f0
    Nov 21 12:07:34 rryofs-cs009 kernel:  [<c04f2c90>] __delay+0x6/0x7
    Nov 21 12:07:34 rryofs-cs009 kernel:  [<f891177f>] StorVscOnHostReset+0x8c/0x141 [storvsc]
    Nov 21 12:16:02 rryofs-cs009 rpc.statd[2377]: Received erroneous SM_UNMON request from rryofs-cs009.ry.wpafb.af.mil for 134.131.15.2
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<f8912746>] storvsc_host_reset_handler+0x4c/0x7c [storvsc]
    Nov 21 12:16:02 rryofs-cs009 rpc.statd[2377]: Received erroneous SM_UNMON request from rryofs-cs009.ry.wpafb.af.mil for 134.131.15.2
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<f885e7ff>] scsi_try_host_reset+0x3a/0x88 [scsi_mod]
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<f885f370>] scsi_eh_ready_devs+0x342/0x404 [scsi_mod]
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<f885fbaa>] scsi_error_handler+0x2e4/0x43b [scsi_mod]
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<f885f8c6>] scsi_error_handler+0x0/0x43b [scsi_mod]
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c0437276>] kthread+0xc0/0xee
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c04371b6>] kthread+0x0/0xee
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c0405c87>] kernel_thread_helper+0x7/0x10
    Nov 21 12:16:02 rryofs-cs009 kernel:  =======================
    Nov 21 12:16:02 rryofs-cs009 kernel: INFO: task nfsd:2859 blocked for more than 120 seconds.
    Nov 21 12:16:02 rryofs-cs009 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
    Nov 21 12:16:02 rryofs-cs009 kernel: nfsd          D 0000567D  1360  2859      1          2860  2834 (L-TLB)
    Nov 21 12:16:02 rryofs-cs009 kernel:        f5b15de8 00000046 a1a5f924 0000567d c0823200 00000000 cfb518c0 0000000a 
    Nov 21 12:16:02 rryofs-cs009 kernel:        c325b550 a1a6f16f 0000567d 0000f84b 00000000 c325b65c c3112b00 f6e523c0 
    Nov 21 12:16:02 rryofs-cs009 kernel:        00000000 00000000 0b3a8652 f789b78c c310d72c c042d7b3 c3112b44 0b3a8652 
    Nov 21 12:16:02 rryofs-cs009 kernel: Call Trace:
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c042d7b3>] getnstimeofday+0x30/0xb6
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c0621600>] io_schedule+0x36/0x59
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c0458272>] sync_page+0x0/0x3b
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c04582aa>] sync_page+0x38/0x3b
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c0621712>] __wait_on_bit_lock+0x2a/0x52
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c04581ed>] __lock_page+0x52/0x59
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c0437368>] wake_bit_function+0x0/0x3c
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c0458a19>] do_generic_mapping_read+0x1f7/0x382
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c0458bea>] generic_file_sendfile+0x46/0x5b
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<f92175bc>] nfsd_read_actor+0x0/0xba [nfsd]
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<f9216528>] nfsd_vfs_read+0x228/0x313 [nfsd]
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<f92175bc>] nfsd_read_actor+0x0/0xba [nfsd]
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<f9216a0c>] nfsd_read+0x87/0x9d [nfsd]
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<f921c6a3>] nfsd3_proc_read+0xdd/0x127 [nfsd]
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<f92131a4>] nfsd_dispatch+0xbb/0x1a9 [nfsd]
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<f914080f>] svc_process+0x3c2/0x62d [sunrpc]
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<f9213676>] nfsd+0x17e/0x284 [nfsd]
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<f92134f8>] nfsd+0x0/0x284 [nfsd]
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c0405c87>] kernel_thread_helper+0x7/0x10
    Nov 21 12:16:02 rryofs-cs009 kernel:  =======================
    Nov 21 12:16:02 rryofs-cs009 kernel: INFO: task nfsd:2860 blocked for more than 120 seconds.
    Nov 21 12:16:02 rryofs-cs009 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
    Nov 21 12:16:02 rryofs-cs009 kernel: nfsd          D 0000567D  1724  2860      1          2861  2859 (L-TLB)
    Nov 21 12:16:02 rryofs-cs009 kernel:        f781fd74 00000046 295456f4 0000567d f7921a80 c0823200 00000000 0000000a 
    Nov 21 12:16:02 rryofs-cs009 kernel:        f791b550 2954ca8c 0000567d 00007398 00000000 f791b65c c3112b00 f6e52c80 
    Nov 21 12:16:02 rryofs-cs009 kernel:        f7921a80 00000000 0b3a76b2 f789bbdc f781fdb4 c042d7b3 c3112b44 0b3a76b2 
    Nov 21 12:16:02 rryofs-cs009 kernel: Call Trace:
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c042d7b3>] getnstimeofday+0x30/0xb6
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c0621600>] io_schedule+0x36/0x59
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c04790c7>] sync_buffer+0x30/0x33
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c06217d7>] __wait_on_bit+0x33/0x58
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c0479097>] sync_buffer+0x0/0x33
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c0479097>] sync_buffer+0x0/0x33
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c062185e>] out_of_line_wait_on_bit+0x62/0x6a
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c0437368>] wake_bit_function+0x0/0x3c
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c0479044>] __wait_on_buffer+0x1c/0x1f
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<f8a90f89>] ext4_find_entry+0x35b/0x514 [ext4]
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c04ca069>] inode_has_perm+0x54/0x5c
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<f8a92b3f>] ext4_lookup+0x28/0xb2 [ext4]
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c0483c04>] __lookup_hash+0xc5/0xf3
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c0484035>] lookup_one_len+0x4a/0x58
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<f9217299>] nfsd_lookup_dentry+0x344/0x3ca [nfsd]
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<f921733c>] nfsd_lookup+0x1d/0x98 [nfsd]
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<f921c4a1>] nfsd3_proc_lookup+0xaf/0xbd [nfsd]
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<f92131a4>] nfsd_dispatch+0xbb/0x1a9 [nfsd]
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<f914080f>] svc_process+0x3c2/0x62d [sunrpc]
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<f9213676>] nfsd+0x17e/0x284 [nfsd]
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<f92134f8>] nfsd+0x0/0x284 [nfsd]
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c0405c87>] kernel_thread_helper+0x7/0x10
    Nov 21 12:16:02 rryofs-cs009 kernel:  =======================
    Nov 21 12:16:02 rryofs-cs009 kernel: INFO: task pdflush:176 blocked for more than 120 seconds.
    Nov 21 12:16:02 rryofs-cs009 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
    Nov 21 12:16:02 rryofs-cs009 kernel: pdflush       D 00005681  1736   176     19           177   175 (L-TLB)
    Nov 21 12:16:02 rryofs-cs009 kernel:        c323caa8 00000046 e29bc706 00005681 f7dd4ae0 c323cbac 00000046 0000000a 
    Nov 21 12:16:02 rryofs-cs009 kernel:        f7f41aa0 e29c5259 00005681 00008b53 00000000 f7f41bac c3112b00 f6e52c80 
    Nov 21 12:16:02 rryofs-cs009 kernel:        f892e5eb 00000000 0b3b13d0 c3205bac c3101d08 c042d7b3 c3205bac ffffffff 
    Nov 21 12:16:02 rryofs-cs009 kernel: Call Trace:
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<f892e5eb>] VmbusChannelSetEvent+0x28/0x79 [vmbus]
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c042d7b3>] getnstimeofday+0x30/0xb6
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c0621600>] io_schedule+0x36/0x59
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c0479097>] sync_buffer+0x0/0x33
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c04790c7>] sync_buffer+0x30/0x33
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c0621712>] __wait_on_bit_lock+0x2a/0x52
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c0479097>] sync_buffer+0x0/0x33
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c062179c>] out_of_line_wait_on_bit_lock+0x62/0x6a
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c0437368>] wake_bit_function+0x0/0x3c
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c04791f1>] __lock_buffer+0x21/0x24
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<f8a2b50a>] do_get_write_access+0x4d/0x384 [jbd2]
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<f8a858e5>] ext4_read_block_bitmap+0x56/0x324 [ext4]
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<f8a2b859>] jbd2_journal_get_write_access+0x18/0x26 [jbd2]
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<f8a9facb>] __ext4_journal_get_write_access+0x33/0x40 [ext4]
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<f8aa6823>] ext4_mb_mark_diskspace_used+0x67/0x399 [ext4]
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<f8aa6dee>] ext4_mb_new_blocks+0x299/0x567 [ext4]
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c045c622>] get_page_from_freelist+0x96/0x378
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<f8a9f643>] ext4_ext_get_blocks+0x138d/0x16fa [ext4]
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<f89119be>] StorVscOnIORequest+0x18a/0x1fc [storvsc]
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<f8911a20>] StorVscOnIORequest+0x1ec/0x1fc [storvsc]
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c04ec32c>] cfq_set_request+0x2fa/0x3cb
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c04eb5d8>] cfq_add_crq_rb+0xc6/0xe2
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c04e480a>] __make_request+0x38b/0x45f
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<f8a8aff3>] ext4_get_blocks+0xf9/0x1a5 [ext4]
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<f8a8b18d>] mpage_da_map_blocks+0x9e/0x6f4 [ext4]
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c045e41f>] pagevec_lookup_tag+0x1b/0x22
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c049737b>] write_cache_pages+0x132/0x2db
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c0457fe4>] find_get_pages_tag+0x30/0x75
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<f8a8e9d1>] ext4_da_writepages+0x338/0x4d6 [ext4]
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c045d315>] do_writepages+0x20/0x32
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c04957ff>] __writeback_single_inode+0x166/0x2a5
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c0495c22>] sync_sb_inodes+0x17e/0x221
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c0495e71>] writeback_inodes+0x6a/0xb0
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c045d842>] wb_kupdate+0xcb/0x130
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c045dc63>] pdflush+0x0/0x1a1
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c045dd6e>] pdflush+0x10b/0x1a1
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c045d777>] wb_kupdate+0x0/0x130
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c0437276>] kthread+0xc0/0xee
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c04371b6>] kthread+0x0/0xee
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c0405c87>] kernel_thread_helper+0x7/0x10
    Nov 21 12:16:02 rryofs-cs009 kernel:  =======================
    Nov 21 12:16:02 rryofs-cs009 kernel: INFO: task kjournald:593 blocked for more than 120 seconds.
    Nov 21 12:16:02 rryofs-cs009 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
    Nov 21 12:16:02 rryofs-cs009 kernel: kjournald     D 0000568C  2624   593     19           623   524 (L-TLB)
    Nov 21 12:16:02 rryofs-cs009 kernel:        f744ded4 00000046 a4db1c01 0000568c cfef7dc0 00000001 00000000 0000000a 
    Nov 21 12:16:02 rryofs-cs009 kernel:        f795caa0 a4db3129 0000568c 00001528 00000002 f795cbac c3120788 f79a03c0 
    Nov 21 12:16:02 rryofs-cs009 kernel:        0b3c7996 00000000 0b3c7996 f7dd5ccc f744df14 c042d7b3 f7dd5ccc ffffffff 
    Nov 21 12:16:02 rryofs-cs009 kernel: Call Trace:
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c042d7b3>] getnstimeofday+0x30/0xb6
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c0621600>] io_schedule+0x36/0x59
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c04790c7>] sync_buffer+0x30/0x33
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c06217d7>] __wait_on_bit+0x33/0x58
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c0479097>] sync_buffer+0x0/0x33
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c0479097>] sync_buffer+0x0/0x33
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c062185e>] out_of_line_wait_on_bit+0x62/0x6a
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c0437368>] wake_bit_function+0x0/0x3c
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c0479044>] __wait_on_buffer+0x1c/0x1f
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<f884e89a>] journal_commit_transaction+0x8b6/0xf3c [jbd]
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c042e60d>] lock_timer_base+0x15/0x2f
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c042e68c>] try_to_del_timer_sync+0x65/0x6c
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<f8851d08>] kjournald+0xa1/0x1c2 [jbd]
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c043733b>] autoremove_wake_function+0x0/0x2d
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<f8851c67>] kjournald+0x0/0x1c2 [jbd]
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c0437276>] kthread+0xc0/0xee
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c04371b6>] kthread+0x0/0xee
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c0405c87>] kernel_thread_helper+0x7/0x10
    Nov 21 12:16:02 rryofs-cs009 kernel:  =======================
    Nov 21 12:16:02 rryofs-cs009 kernel: INFO: task kjournald:1585 blocked for more than 120 seconds.
    Nov 21 12:16:02 rryofs-cs009 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
    Nov 21 12:16:02 rryofs-cs009 kernel: kjournald     D 0000568D  2544  1585     19          1591  1579 (L-TLB)
    Nov 21 12:16:02 rryofs-cs009 kernel:        f7f47ed4 00000046 c59091a3 0000568d cffd6dc0 00000001 00000000 0000000a 
    Nov 21 12:16:02 rryofs-cs009 kernel:        f6e27000 c590a1e6 0000568d 00001043 00000002 f6e2710c c3120788 f79a03c0 
    Nov 21 12:16:02 rryofs-cs009 kernel:        0b3c9f1a 00000000 0b3c9f1a c33b39cc f7f47f14 c042d7b3 c33b39cc fffffffe 
    Nov 21 12:16:02 rryofs-cs009 kernel: Call Trace:
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c042d7b3>] getnstimeofday+0x30/0xb6
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c0621600>] io_schedule+0x36/0x59
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c04790c7>] sync_buffer+0x30/0x33
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c06217d7>] __wait_on_bit+0x33/0x58
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c0479097>] sync_buffer+0x0/0x33
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c0479097>] sync_buffer+0x0/0x33
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c062185e>] out_of_line_wait_on_bit+0x62/0x6a
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c0437368>] wake_bit_function+0x0/0x3c
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c0479044>] __wait_on_buffer+0x1c/0x1f
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<f884e89a>] journal_commit_transaction+0x8b6/0xf3c [jbd]
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c042e60d>] lock_timer_base+0x15/0x2f
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c042e68c>] try_to_del_timer_sync+0x65/0x6c
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<f8851d08>] kjournald+0xa1/0x1c2 [jbd]
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c043733b>] autoremove_wake_function+0x0/0x2d
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<f8851c67>] kjournald+0x0/0x1c2 [jbd]
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c0437276>] kthread+0xc0/0xee
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c04371b6>] kthread+0x0/0xee
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c0405c87>] kernel_thread_helper+0x7/0x10
    Nov 21 12:16:02 rryofs-cs009 kernel:  =======================
    Nov 21 12:16:02 rryofs-cs009 kernel: INFO: task jbd2/sda-8:1610 blocked for more than 120 seconds.
    Nov 21 12:16:02 rryofs-cs009 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
    Nov 21 12:16:02 rryofs-cs009 kernel: jbd2/sda-8    D 00005681  2620  1610     19          1611  1591 (L-TLB)
    Nov 21 12:16:02 rryofs-cs009 kernel:        f6dcbe80 00000046 ca6dc36f 00005681 cfa520c0 c0823200 00000000 0000000a 
    Nov 21 12:16:02 rryofs-cs009 kernel:        f6d1c000 ca6dd848 00005681 000014d9 00000000 f6d1c10c c3112b00 f6e52c80 
    Nov 21 12:16:02 rryofs-cs009 kernel:        0b3b10aa 00000000 0b3b10aa c322d33c f6dcbec0 c042d7b3 c322d33c ffffffff 
    Nov 21 12:16:02 rryofs-cs009 kernel: Call Trace:
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c042d7b3>] getnstimeofday+0x30/0xb6
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c0621600>] io_schedule+0x36/0x59
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c04790c7>] sync_buffer+0x30/0x33
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c06217d7>] __wait_on_bit+0x33/0x58
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c0479097>] sync_buffer+0x0/0x33
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c0479097>] sync_buffer+0x0/0x33
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c062185e>] out_of_line_wait_on_bit+0x62/0x6a
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c0437368>] wake_bit_function+0x0/0x3c
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c0479044>] __wait_on_buffer+0x1c/0x1f
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<f8a2d2ce>] jbd2_journal_commit_transaction+0x875/0xf3b [jbd2]
    Nov 21 12:16:02 rryofs-cs009 kernel:  [<c042e60d>] lock_timer_base+0x15/0x2f
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<f8a30978>] kjournald2+0x83/0x1a4 [jbd2]
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<c043733b>] autoremove_wake_function+0x0/0x2d
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<f8a308f5>] kjournald2+0x0/0x1a4 [jbd2]
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<c0437276>] kthread+0xc0/0xee
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<c04371b6>] kthread+0x0/0xee
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<c0405c87>] kernel_thread_helper+0x7/0x10
    Nov 21 12:16:03 rryofs-cs009 kernel:  =======================
    Nov 21 12:16:03 rryofs-cs009 kernel: INFO: task syslogd:2217 blocked for more than 120 seconds.
    Nov 21 12:16:03 rryofs-cs009 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
    Nov 21 12:16:03 rryofs-cs009 kernel: syslogd       D 0000568C  2132  2217      1          2220  2204 (NOTLB)
    Nov 21 12:16:03 rryofs-cs009 kernel:        f79beed0 00000082 98f6c190 0000568c c0457fe4 0000000e 00000000 0000000a 
    Nov 21 12:16:03 rryofs-cs009 kernel:        f7961550 98f7f5ee 0000568c 0001345e 00000002 f796165c c3120788 f6f7fc80 
    Nov 21 12:16:03 rryofs-cs009 kernel:        f6c20a68 00000000 00000001 f79beecc c041f0c8 00000000 00000000 ffffffff 
    Nov 21 12:16:03 rryofs-cs009 kernel: Call Trace:
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<c0457fe4>] find_get_pages_tag+0x30/0x75
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<c041f0c8>] __wake_up+0x2a/0x3d
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<f88512c1>] log_wait_commit+0x80/0xc7 [jbd]
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<c043733b>] autoremove_wake_function+0x0/0x2d
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<f884c679>] journal_stop+0x196/0x1bb [jbd]
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<c0495832>] __writeback_single_inode+0x199/0x2a5
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<c045d320>] do_writepages+0x2b/0x32
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<c0458e23>] __filemap_fdatawrite_range+0x66/0x72
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<c0495ed0>] sync_inode+0x19/0x24
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<f8884019>] ext3_sync_file+0xb1/0xdc [ext3]
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<c0478c01>] do_fsync+0x41/0x83
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<c0478c60>] __do_fsync+0x1d/0x2b
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<c0404f4b>] syscall_call+0x7/0xb
    Nov 21 12:16:03 rryofs-cs009 kernel:  =======================
    Nov 21 12:16:03 rryofs-cs009 kernel: INFO: task nfsd:2859 blocked for more than 120 seconds.
    Nov 21 12:16:03 rryofs-cs009 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
    Nov 21 12:16:03 rryofs-cs009 kernel: nfsd          D 0000567D  1360  2859      1          2860  2834 (L-TLB)
    Nov 21 12:16:03 rryofs-cs009 kernel:        f5b15de8 00000046 a1a5f924 0000567d c0823200 00000000 cfb518c0 0000000a 
    Nov 21 12:16:03 rryofs-cs009 kernel:        c325b550 a1a6f16f 0000567d 0000f84b 00000000 c325b65c c3112b00 f6e523c0 
    Nov 21 12:16:03 rryofs-cs009 kernel:        00000000 00000000 0b3a8652 f789b78c c310d72c c042d7b3 c3112b44 0b3a8652 
    Nov 21 12:16:03 rryofs-cs009 kernel: Call Trace:
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<c042d7b3>] getnstimeofday+0x30/0xb6
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<c0621600>] io_schedule+0x36/0x59
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<c0458272>] sync_page+0x0/0x3b
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<c04582aa>] sync_page+0x38/0x3b
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<c0621712>] __wait_on_bit_lock+0x2a/0x52
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<c04581ed>] __lock_page+0x52/0x59
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<c0437368>] wake_bit_function+0x0/0x3c
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<c0458a19>] do_generic_mapping_read+0x1f7/0x382
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<c0458bea>] generic_file_sendfile+0x46/0x5b
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<f92175bc>] nfsd_read_actor+0x0/0xba [nfsd]
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<f9216528>] nfsd_vfs_read+0x228/0x313 [nfsd]
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<f92175bc>] nfsd_read_actor+0x0/0xba [nfsd]
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<f9216a0c>] nfsd_read+0x87/0x9d [nfsd]
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<f921c6a3>] nfsd3_proc_read+0xdd/0x127 [nfsd]
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<f92131a4>] nfsd_dispatch+0xbb/0x1a9 [nfsd]
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<f914080f>] svc_process+0x3c2/0x62d [sunrpc]
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<f9213676>] nfsd+0x17e/0x284 [nfsd]
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<f92134f8>] nfsd+0x0/0x284 [nfsd]
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<c0405c87>] kernel_thread_helper+0x7/0x10
    Nov 21 12:16:03 rryofs-cs009 kernel:  =======================
    Nov 21 12:16:03 rryofs-cs009 kernel: INFO: task nfsd:2860 blocked for more than 120 seconds.
    Nov 21 12:16:03 rryofs-cs009 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
    Nov 21 12:16:03 rryofs-cs009 kernel: nfsd          D 0000567D  1724  2860      1          2861  2859 (L-TLB)
    Nov 21 12:16:03 rryofs-cs009 kernel:        f781fd74 00000046 295456f4 0000567d f7921a80 c0823200 00000000 0000000a 
    Nov 21 12:16:03 rryofs-cs009 kernel:        f791b550 2954ca8c 0000567d 00007398 00000000 f791b65c c3112b00 f6e52c80 
    Nov 21 12:16:03 rryofs-cs009 kernel:        f7921a80 00000000 0b3a76b2 f789bbdc f781fdb4 c042d7b3 c3112b44 0b3a76b2 
    Nov 21 12:16:03 rryofs-cs009 kernel: Call Trace:
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<c042d7b3>] getnstimeofday+0x30/0xb6
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<c0621600>] io_schedule+0x36/0x59
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<c04790c7>] sync_buffer+0x30/0x33
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<c06217d7>] __wait_on_bit+0x33/0x58
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<c0479097>] sync_buffer+0x0/0x33
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<c0479097>] sync_buffer+0x0/0x33
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<c062185e>] out_of_line_wait_on_bit+0x62/0x6a
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<c0437368>] wake_bit_function+0x0/0x3c
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<c0479044>] __wait_on_buffer+0x1c/0x1f
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<f8a90f89>] ext4_find_entry+0x35b/0x514 [ext4]
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<c04ca069>] inode_has_perm+0x54/0x5c
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<f8a92b3f>] ext4_lookup+0x28/0xb2 [ext4]
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<c0483c04>] __lookup_hash+0xc5/0xf3
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<c0484035>] lookup_one_len+0x4a/0x58
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<f9217299>] nfsd_lookup_dentry+0x344/0x3ca [nfsd]
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<f921733c>] nfsd_lookup+0x1d/0x98 [nfsd]
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<f921c4a1>] nfsd3_proc_lookup+0xaf/0xbd [nfsd]
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<f92131a4>] nfsd_dispatch+0xbb/0x1a9 [nfsd]
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<f914080f>] svc_process+0x3c2/0x62d [sunrpc]
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<f9213676>] nfsd+0x17e/0x284 [nfsd]
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<f92134f8>] nfsd+0x0/0x284 [nfsd]
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<c0405c87>] kernel_thread_helper+0x7/0x10
    Nov 21 12:16:03 rryofs-cs009 kernel:  =======================
    Nov 21 12:16:03 rryofs-cs009 kernel: INFO: task nfsd:2861 blocked for more than 120 seconds.
    Nov 21 12:16:03 rryofs-cs009 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
    Nov 21 12:16:03 rryofs-cs009 kernel: nfsd          D 00005689  1672  2861      1          2862  2860 (L-TLB)
    Nov 21 12:16:03 rryofs-cs009 kernel:        f59c2bcc 00000046 ee689b16 00005689 c33ed800 00000001 cfa835f0 0000000a 
    Nov 21 12:16:03 rryofs-cs009 kernel:        f6d1c550 ee694be6 00005689 0000b0d0 00000000 f6d1c65c c3112b00 f6e52c80 
    Nov 21 12:16:03 rryofs-cs009 kernel:        00000000 0e300024 0b3c1f60 f789b33c c310031c c042d7b3 c3112b44 0b3c1f60 
    Nov 21 12:16:03 rryofs-cs009 kernel: Call Trace:
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<c042d7b3>] getnstimeofday+0x30/0xb6
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<c0621600>] io_schedule+0x36/0x59
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<c0479097>] sync_buffer+0x0/0x33
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<c04790c7>] sync_buffer+0x30/0x33
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<c0621712>] __wait_on_bit_lock+0x2a/0x52
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<c0479097>] sync_buffer+0x0/0x33
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<c062179c>] out_of_line_wait_on_bit_lock+0x62/0x6a
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<c0437368>] wake_bit_function+0x0/0x3c
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<c04791f1>] __lock_buffer+0x21/0x24
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<f8a2b50a>] do_get_write_access+0x4d/0x384 [jbd2]
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<f8a898ae>] __ext4_get_inode_loc+0x103/0x3a5 [ext4]
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<f8a2b859>] jbd2_journal_get_write_access+0x18/0x26 [jbd2]
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<f8a9facb>] __ext4_journal_get_write_access+0x33/0x40 [ext4]
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<f8a89b88>] ext4_reserve_inode_write+0x27/0x57 [ext4]
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<f8a89beb>] ext4_mark_inode_dirty+0x33/0x19b [ext4]
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<f8a8f19f>] ext4_dirty_inode+0x24/0x35 [ext4]
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<c0495f02>] __mark_inode_dirty+0x27/0x14d
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<c048e1a3>] file_update_time+0x30/0xa1
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<c0459db2>] __generic_file_aio_write_nolock+0x38d/0x52a
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<c04c9a03>] avc_has_perm+0x3c/0x46
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<c04ca069>] inode_has_perm+0x54/0x5c
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<f90b2352>] find_exported_dentry+0x79/0x489 [exportfs]
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<c045a081>] __generic_file_write_nolock+0x86/0x9a
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<c043733b>] autoremove_wake_function+0x0/0x2d
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<c06218b2>] mutex_lock+0xb/0x19
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<c045a0cc>] generic_file_writev+0x37/0x96
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<c045a095>] generic_file_writev+0x0/0x96
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<c0476965>] do_readv_writev+0x149/0x247
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<c0476248>] do_sync_write+0x0/0xf1
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<c041e26e>] __wake_up_common+0x2f/0x53
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<f8a86b10>] ext4_file_open+0xcc/0xd4 [ext4]
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<c0476a9a>] vfs_writev+0x37/0x43
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<f9216140>] nfsd_vfs_write+0xca/0x28a [nfsd]
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<f8a86a44>] ext4_file_open+0x0/0xd4 [ext4]
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<c0474fa0>] __dentry_open+0xea/0x1ab
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<c04750a6>] dentry_open+0x45/0x4b
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<f9216970>] nfsd_write+0x96/0xab [nfsd]
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<f921c7be>] nfsd3_proc_write+0xd1/0xeb [nfsd]
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<f92131a4>] nfsd_dispatch+0xbb/0x1a9 [nfsd]
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<f914080f>] svc_process+0x3c2/0x62d [sunrpc]
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<f9213676>] nfsd+0x17e/0x284 [nfsd]
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<f92134f8>] nfsd+0x0/0x284 [nfsd]
    Nov 21 12:16:03 rryofs-cs009 kernel:  [<c0405c87>] kernel_thread_helper+0x7/0x10
    Nov 21 12:16:03 rryofs-cs009 kernel:  =======================
    Nov 21 12:16:03 rryofs-cs009 kernel: statd: server localhost not responding, timed out
    Nov 21 12:16:03 rryofs-cs009 kernel: lockd: cannot unmonitor 134.131.15.2
    Nov 21 12:16:03 rryofs-cs009 kernel: statd: server localhost not responding, timed out
    Nov 21 12:16:03 rryofs-cs009 kernel: lockd: cannot monitor 134.131.15.6
    Nov 21 12:16:03 rryofs-cs009 kernel: statd: server localhost not responding, timed out
    Nov 21 12:16:03 rryofs-cs009 kernel: lockd: cannot monitor 134.131.15.6
    Nov 21 12:16:03 rryofs-cs009 kernel: statd: server localhost not responding, timed out
    Nov 21 12:16:03 rryofs-cs009 kernel: lockd: cannot monitor 134.131.15.6
    Nov 21 12:16:03 rryofs-cs009 kernel: statd: server localhost not responding, timed out
    
    ? file icon m (28,936 bytes) 2012-11-26 16:38 +
  • log file icon 60sStuck.log (9,028 bytes) 2014-01-31 00:33
  • log file icon bug6098_022514.log (4,143 bytes) 2014-02-26 02:13

-Relationships
+Relationships

-Notes

~0016080

rbeamoh (reporter)

Linux rryofs-cs009.ry.wpafb.af.mil 2.6.18-274.17.1.el5.centos.plusPAE #1 SMP Wed Jan 11 11:42:43 EST 2012 i686 i686 i386 GNU/Linux

~0019179

jingold (reporter)

I have also had this issue with 2.6.18-308.13.1.el5.

~See Attached for logs

~0019180

tigalch (manager)

How about the current kernel from 5.10 (kernel-2.6.18-371.4.1)

~0019374

jingold (reporter)

Well the same server is now running 5.10 with the 2.6.18-371.4.1.el5 kernel. I have attached the relevant log information.
+Notes

-Issue History
Date Modified Username Field Change
2012-11-26 16:38 rbeamoh New Issue
2012-11-26 16:38 rbeamoh File Added: m
2012-11-26 16:40 rbeamoh Note Added: 0016080
2014-01-31 00:26 jingold Note Added: 0019179
2014-01-31 00:33 jingold File Added: 60sStuck.log
2014-01-31 09:00 tigalch Note Added: 0019180
2014-02-26 02:13 jingold Tag Attached: 5.10
2014-02-26 02:13 jingold File Added: bug6098_022514.log
2014-02-26 02:15 jingold Note Added: 0019374
+Issue History