View Issue Details

IDProjectCategoryView StatusLast Update
0001634CentOS-4kernelpublic2007-06-18 11:14
ReporterAntoine Brenner Assigned To 
PrioritynormalSeveritycrashReproducibilityhave not tried
Status assignedResolutionopen 
Product Version4.4 - i386 
Summary0001634: kernel panic on lvremove
DescriptionThis is what I had on the /var/log/messages:

Dec 31 01:28:17 g5 kernel: Unable to handle kernel paging request at virtual address 00100100
Dec 31 01:28:17 g5 kernel: printing eip:
Dec 31 01:28:17 g5 kernel: e03262da
Dec 31 01:28:17 g5 kernel: *pde = 00000000
Dec 31 01:28:17 g5 kernel: Oops: 0000 [#1]
Dec 31 01:28:17 g5 kernel: Modules linked in: ipt_REJECT ipt_state ip_conntrack iptable_filter ip_tables dm_snapshot parport
_pc lp parport autofs4 i2c_dev i2c_core sunrpc md5 ipv6 dm_mirror button battery ac uhci_hcd ehci_hcd 8139too mii tg3 ahci e
xt3 jbd raid1 dm_mod ata_piix libata aic79xx sd_mod scsi_mod
Dec 31 01:28:17 g5 kernel: CPU: 0
Dec 31 01:28:17 g5 kernel: EIP: 0060:[<e03262da>] Not tainted VLI
Dec 31 01:28:17 g5 kernel: EFLAGS: 00010217 (2.6.9-42.0.3.EL)
Dec 31 01:28:17 g5 kernel: EIP is at exit_exception_table+0x2b/0x56 [dm_snapshot]
Dec 31 01:28:17 g5 kernel: eax: ddf20580 ebx: e07d73d8 ecx: e003e080 edx: 00100100
Dec 31 01:28:17 g5 kernel: esi: db72f5e0 edi: 00100100 ebp: 0000507b esp: dc652f20
Dec 31 01:28:17 g5 kernel: ds: 007b es: 007b ss: 0068
Dec 31 01:28:17 g5 kernel: Process lvremove (pid: 17328, threadinfo=dc652000 task=cc8aadd0)
Dec 31 01:28:17 g5 kernel: Stack: 000283d8 00008000 ddf20580 db72f580 e01bb080 00000000 00000000 e03267f2
Dec 31 01:28:17 g5 kernel: e01bb080 c15fb280 e0032185 c146c380 c15fb280 e003de40 089c5840 e0031798
Dec 31 01:28:17 g5 kernel: c146c380 e0179000 e0034258 00000004 00000000 dc652000 e00354e3 e0179000
Dec 31 01:28:17 g5 kernel: Call Trace:
Dec 31 01:28:17 g5 kernel: [<e03267f2>] snapshot_dtr+0x27/0x58 [dm_snapshot]
Dec 31 01:28:17 g5 kernel: [<e0032185>] table_destroy+0x39/0x83 [dm_mod]
Dec 31 01:28:17 g5 kernel: [<e0031798>] dm_put+0xdf/0xeb [dm_mod]
Dec 31 01:28:17 g5 kernel: [<e0034258>] dev_remove+0xbf/0xcc [dm_mod]
Dec 31 01:28:17 g5 kernel: [<e00354e3>] ctl_ioctl+0xd9/0x13c [dm_mod]
Dec 31 01:28:17 g5 kernel: [<e0034199>] dev_remove+0x0/0xcc [dm_mod]
Dec 31 01:28:17 g5 kernel: [<c0180401>] sys_ioctl+0x297/0x336
Dec 31 01:28:17 g5 kernel: [<c0318e63>] syscall_call+0x7/0xb
Dec 31 01:28:17 g5 kernel: [<c031007b>] build_polexpire+0x75/0xe0
Dec 31 01:28:17 g5 kernel: Code: 55 31 ed 57 56 89 c6 53 83 ec 0c 89 54 24 08 8b 00 40 89 44 24 04 39 c5 7d 2d c7 04 24 00 0
0 00 00 8b 1c 24 03 5e 04 8b 13 39 da <8b> 3a 74 0d 8b 44 24 08 e8 e2 e0 e2 df 89 fa eb ed 83 04 24 08
Dec 31 01:28:17 g5 kernel: <0>Fatal exception: panic in 5 seconds
Additional Information# uname -a
Linux g5 2.6.9-42.0.3.EL #1 Fri Oct 6 05:59:54 CDT 2006 i686 i686 i386 GNU/Linux
# cat /etc/redhat-release
CentOS release 4.4 (Final)

LVM is mounted atop a soft raid1 (md) array of two scsi disks:

pvdisplay
  --- Physical volume ---
  PV Name /dev/md1
  VG Name VolGroup00
  PV Size 66.41 GB / not usable 0
  Allocatable yes
  PE Size (KByte) 32768
  Total PE 2125
  Free PE 314
  Allocated PE 1811
  PV UUID pw2vLM-FNAg-npnr-neuJ-PF33-31iq-rmwKyS


Here is how I create the snapshots (created daily at about 01:27) :
lvcreate -L2500M --snapshot --name shothome /dev/VolGroup00/LogVol00
I then mount them ro. When I want to remove them, (daily just before re-creating them) I umount them, and then:
lvremove -f /dev/VolGroup00/shothome

The filesystem is ext3.

There has been a lot of IO on the /dev/VolGroup00/LogVol00 on the day before the crash. (imapsync of many mails to the new cyrus store, but the total volume of mails transfered is not too big: less than 1GB). However, more than 3GB of mails have been transfered the previous day without any problems with the snapshot system.

TagsNo tags attached.

Activities

pyxel

pyxel

2007-01-01 03:32

reporter   ~0004298

Hello,

Why did you use force option of lvremove and what's the output when you try to lvremove it without this force option ? Can you check if your physical volumes are ok too (you can test it with dd command for example) ?

more informations will be helpful :-)

Regards,

Marek Mahut.
JohnnyHughes

JohnnyHughes

2007-01-01 16:47

administrator   ~0004301

does this happen reproducibly or only the one time ...

are you sure that the umount worked, etc.

ie ... I test the umount on my scalix backup script and do not remove the LV if it is still mounted ... something like this:

IS_MOUNT=`cat /proc/mounts | grep $BKUP_MNT_PT`
IS_MOUNT2=`cat /proc/mounts | grep /dev/$VOL_GRP/$BKUP_LVM`

if [ "$IS_MOUNT"x != x ] || [ "$IS_MOUNT2"x != x ]; then
  if [ "$IS_MOUNT"x != x ]; then
    umount $BKUP_MNT_PT >> $LOG 2>&1
  fi
  if [ "$IS_MOUNT2"x != x ]; then
    umount /dev/$VOL_GRP/$BKUP_LVM >> $LOG 2>&1
  fi
  IS_MOUNT=`cat /proc/mounts | grep $BKUP_MNT_PT`
  IS_MOUNT2=`cat /proc/mounts | grep /dev/$VOL_GRP/$BKUP_LVM`
  if [ "$IS_MOUNT"x != x ] || [ "$IS_MOUNT2"x != x ]; then
    echo "$IS_MOUNT $IS_MOUNT2 mounted, aborting..." | tee -a $LOG
    exit 4
  fi
fi

(the above tries to remove the mount point by both of it's names and fails of it can not umount)

I have had problems if I try to remove the LV and it stayed mounted ... thus my check :)
Antoine Brenner

Antoine Brenner

2007-01-02 19:21

reporter   ~0004309

It does not crash _every_ time I run the lvremove, but it crashed again today, after some (between 10 000 and 80 000) mails have been added to the volume.

Jan 2 13:56:34 g5 kernel: Unable to handle kernel NULL pointer dereference at virtual address 00000000
Jan 2 13:56:34 g5 kernel: printing eip:
Jan 2 13:56:34 g5 kernel: e03262da
Jan 2 13:56:34 g5 kernel: *pde = 00000000
Jan 2 13:56:34 g5 kernel: Oops: 0000 [#1]
Jan 2 13:56:34 g5 kernel: Modules linked in: ipt_REJECT ipt_state ip_conntrack iptable_filter ip_tables dm_snapshot parport
_pc lp parport autofs4 i2c_dev i2c_core sunrpc md5 ipv6 dm_mirror button battery ac uhci_hcd ehci_hcd 8139too mii tg3 ahci e
xt3 jbd raid1 dm_mod ata_piix libata aic79xx sd_mod scsi_mod
Jan 2 13:56:34 g5 kernel: CPU: 0
Jan 2 13:56:34 g5 kernel: EIP: 0060:[<e03262da>] Not tainted VLI
Jan 2 13:56:34 g5 kernel: EFLAGS: 00010207 (2.6.9-42.0.3.EL)
Jan 2 13:56:34 g5 kernel: EIP is at exit_exception_table+0x2b/0x56 [dm_snapshot]
Jan 2 13:56:34 g5 kernel: eax: dba69580 ebx: e07edc00 ecx: e003e080 edx: 00000000
Jan 2 13:56:34 g5 kernel: esi: c160e4e0 edi: 00000000 ebp: 00007d80 esp: cffb1f20
Jan 2 13:56:34 g5 kernel: ds: 007b es: 007b ss: 0068
Jan 2 13:56:34 g5 kernel: Process lvremove (pid: 23833, threadinfo=cffb1000 task=df032cd0)
Jan 2 13:56:34 g5 kernel: Stack: 0003ec00 00008000 dba69580 c160e480 e01b4080 00000000 00000000 e03267f2
Jan 2 13:56:34 g5 kernel: e01b4080 c15cbd80 e0032185 c15fbe80 c15cbd80 e003de40 098d71f0 e0031798
Jan 2 13:56:34 g5 kernel: c15fbe80 e015f000 e0034258 00000004 00000000 cffb1000 e00354e3 e015f000
Jan 2 13:56:34 g5 kernel: Call Trace:
Jan 2 13:56:34 g5 kernel: [<e03267f2>] snapshot_dtr+0x27/0x58 [dm_snapshot]
Jan 2 13:56:34 g5 kernel: [<e0032185>] table_destroy+0x39/0x83 [dm_mod]
Jan 2 13:56:34 g5 kernel: [<e0031798>] dm_put+0xdf/0xeb [dm_mod]
Jan 2 13:56:34 g5 kernel: [<e0034258>] dev_remove+0xbf/0xcc [dm_mod]
Jan 2 13:56:34 g5 kernel: [<e00354e3>] ctl_ioctl+0xd9/0x13c [dm_mod]
Jan 2 13:56:35 g5 kernel: [<e0034199>] dev_remove+0x0/0xcc [dm_mod]
Jan 2 13:56:35 g5 kernel: [<c0180401>] sys_ioctl+0x297/0x336
Jan 2 13:56:35 g5 kernel: [<c0318e63>] syscall_call+0x7/0xb
Jan 2 13:56:35 g5 kernel: Code: 55 31 ed 57 56 89 c6 53 83 ec 0c 89 54 24 08 8b 00 40 89 44 24 04 39 c5 7d 2d c7 04 24 00 0
0 00 00 8b 1c 24 03 5e 04 8b 13 39 da <8b> 3a 74 0d 8b 44 24 08 e8 e2 e0 e2 df 89 fa eb ed 83 04 24 08
Jan 2 13:56:35 g5 kernel: <0>Fatal exception: panic in 5 seconds
Jan 2 13:56:38 g5 kernel: Unable to handle kernel NULL pointer dereference at virtual address 00000104
Jan 2 13:56:38 g5 kernel: printing eip:
Jan 2 13:56:38 g5 kernel: c0153ee7
Jan 2 13:56:38 g5 kernel: *pde = 00000000
Jan 2 13:56:38 g5 kernel: Oops: 0000 [#2]
Jan 2 13:56:38 g5 kernel: Modules linked in: ipt_REJECT ipt_state ip_conntrack iptable_filter ip_tables dm_snapshot parport_pc lp parport autofs4 i2c_dev i2c_core sunrpc md5 ipv6 dm_mirror button battery ac uhci_hcd ehci_hcd 8139too mii tg3 ahci ext3 jbd raid1 dm_mod ata_piix libata aic79xx sd_mod scsi_mod
Jan 2 13:56:38 g5 kernel: CPU: 0
Jan 2 13:56:38 g5 kernel: EIP: 0060:[<c0153ee7>] Not tainted VLI
Jan 2 13:56:38 g5 kernel: EFLAGS: 00010002 (2.6.9-42.0.3.EL)
Jan 2 13:56:38 g5 kernel: EIP is at free_block+0x35/0xb8
Jan 2 13:56:38 g5 kernel: eax: 00941ae0 ebx: 00000100 ecx: 0a0d7379 edx: c1000000
Jan 2 13:56:38 g5 kernel: esi: dba69580 edi: 00000001 ebp: 00000000 esp: df67cf30
Jan 2 13:56:38 g5 kernel: ds: 007b es: 007b ss: 0068
Jan 2 13:56:38 g5 kernel: Process events/0 (pid: 3, threadinfo=df67c000 task=df5b0bd0)
Jan 2 13:56:38 g5 kernel: Stack: d11fb010 d11fb010 00000001 d11fb000 dba69580 c015483c dba69580 dba69608
Jan 2 13:56:38 g5 kernel: 00000001 c042d120 c0154906 c042d160 c042d160 00000283 00000000 df5c2180
Jan 2 13:56:38 g5 kernel: c0137e50 c0154858 ffffffff ffffffff 00000001 00000000 c0120049 00010000
Jan 2 13:56:38 g5 kernel: Call Trace:
Jan 2 13:56:38 g5 kernel: [<c015483c>] drain_array_locked+0x59/0x75
Jan 2 13:56:38 g5 kernel: [<c0154906>] cache_reap+0xae/0x273
Jan 2 13:56:38 g5 kernel: [<c0137e50>] worker_thread+0x1eb/0x2f0
Jan 2 13:56:38 g5 kernel: [<c0154858>] cache_reap+0x0/0x273
Jan 2 13:56:38 g5 kernel: [<c0120049>] default_wake_function+0x0/0xc
Jan 2 13:56:38 g5 kernel: [<c031658c>] schedule+0x438/0x5f1
Jan 2 13:56:38 g5 kernel: [<c0120049>] default_wake_function+0x0/0xc
Jan 2 13:56:38 g5 kernel: [<c0137c65>] worker_thread+0x0/0x2f0
Jan 2 13:56:38 g5 kernel: [<c013cc2d>] kthread+0x69/0x91
Jan 2 13:56:38 g5 kernel: [<c013cbc4>] kthread+0x0/0x91
Jan 2 13:56:38 g5 kernel: [<c01041dd>] kernel_thread_helper+0x5/0xb
Jan 2 13:56:38 g5 kernel: Code: ed 89 14 24 01 48 24 39 fd 0f 8d 99 00 00 00 8b 04 24 8b 15 f0 32 43 c0 8b 0c a8 8d 81 00 0
0 00 40 c1 e8 0c c1 e0 05 8b 5c 10 1c <8b> 53 04 8b 03 89 50 04 89 02 31 d2 2b 4b 0c c7 03 00 01 10 00
Jan 2 13:56:38 g5 kernel: <0>Fatal exception: panic in 5 seconds

I should OK regarding the mount/umount problems: see the script I used attached as unmount-snap.sh

There is one interesting thing to note here: the server got rid of the snapvar snapshot without problem, but not of the snaphome snapshot... They are created alike, and should behave the same ! Since they do not, there really is something weird going on...

Concerning the HD, I do not think there are problem. The server is one year old, (DELL) with 2 74GB scsi disks. One of them was bought one year ago with the server, and the other was bought in September.

As for dd, I did this without any problem. Pyxel : was this the kind of dd test that you were expecting ?
[g5 ~} pwd
/home/admin
[g5 ~]$ dd if=/dev/urandom of=./TOTO bs=1M count=128
128+0 records in
128+0 records out
[g5 ~]$ md5sum ./TOTO
51b5e8a0fba8c817628c79af57b48bf2 ./TOTO
[g5 ~]$ md5sum ./TOTO
51b5e8a0fba8c817628c79af57b48bf2 ./TOTO
[g5 ~]$ md5sum ./TOTO
51b5e8a0fba8c817628c79af57b48bf2 ./TOTO

2007-01-02 19:26

 

unmount-snap.sh (1,381 bytes)
Antoine Brenner

Antoine Brenner

2007-01-02 19:32

reporter   ~0004310

Regarding my Jan 2 13:56:34 panic, what I could see when I called unmount-snap.sh was a message about snapvar beeing removed all right, then I got the kernel panic.

So I think that the kernel panic was caused by line 49 of unmount-snap.sh:
lvremove -f /dev/VolGroup00/shothome
when the volume was NOT mounted.


I do not know what would happen without the '-f'. I will give it a try if I can.
(But since the bug is not as yet 100% reproducible, and since this is a production server, I cannot do all the tests I would like to...)
Antoine Brenner

Antoine Brenner

2007-01-02 19:55

reporter   ~0004312

I do not know if it is related, but I also have a weird bug on reboot with the same server when snapshots are present. See #1635

My other servers work just fine with lvm and snapshots.
Antoine Brenner

Antoine Brenner

2007-01-03 19:13

reporter   ~0004315

Last edited: 2007-01-03 19:14

This is quite reproductible: it happened again today.

Since I was 'expecting' it, I straced it: (of course, shothome was not mounted)

[root@g5 ]# strace -o /tmp/shothome lvremove /dev/VolGroup00/shothome
Do you really want to remove active logical volume "shothome"? [y/n]: y
Read from remote host g5: Connection reset by peer
Connection to g5 closed.

I can also answer the question about the -f flag: I use it so that I do not have to confirm with 'y' since the snapshot is automatically deleted.

The last line of the strace is:
ioctl(5, DM_DEV_REMOVE
<- It dies here (or shortly later, but I have nothing more)

I will add the full strace as a note to this bug.

This bug really annoys me...


Here is what I got this time:

Jan 3 19:36:36 g5 kernel: Unable to handle kernel paging request at virtual address 0bf3dcc6
Jan 3 19:36:36 g5 kernel: printing eip:
Jan 3 19:36:36 g5 kernel: e03262da
Jan 3 19:36:36 g5 kernel: *pde = 00000000
Jan 3 19:36:36 g5 kernel: Oops: 0000 [#1]
Jan 3 19:36:36 g5 kernel: Modules linked in: ipt_REJECT ipt_state ip_conntrack iptable_filter ip_tables dm_snapshot parport
_pc lp parport autofs4 i2c_dev i2c_core sunrpc md5 ipv6 dm_mirror button battery ac uhci_hcd ehci_hcd 8139too mii tg3 ahci e
xt3 jbd raid1 dm_mod ata_piix libata aic79xx sd_mod scsi_mod
Jan 3 19:36:36 g5 kernel: CPU: 0
Jan 3 19:36:36 g5 kernel: EIP: 0060:[<e03262da>] Not tainted VLI
Jan 3 19:36:36 g5 kernel: EFLAGS: 00010203 (2.6.9-42.0.3.EL)
Jan 3 19:36:36 g5 kernel: EIP is at exit_exception_table+0x2b/0x56 [dm_snapshot]
Jan 3 19:36:36 g5 kernel: eax: dca76580 ebx: e07b65e0 ecx: e003e080 edx: 0bf3dcc6
Jan 3 19:36:36 g5 kernel: esi: c146e6e0 edi: 0bf3dcc6 ebp: 00000ebc esp: c27bff20
Jan 3 19:36:36 g5 kernel: ds: 007b es: 007b ss: 0068
Jan 3 19:36:36 g5 kernel: Process lvremove (pid: 20890, threadinfo=c27bf000 task=cb4f32a0)
Jan 3 19:36:36 g5 kernel: Stack: 000075e0 00008000 dca76580 c146e680 e01bb080 00000000 00000000 e03267f2
Jan 3 19:36:36 g5 kernel: e01bb080 dca78b80 e0032185 df677680 dca78b80 e003de40 0956a220 e0031798
Jan 3 19:36:36 g5 kernel: df677680 e0179000 e0034258 00000004 00000000 c27bf000 e00354e3 00000000
Jan 3 19:36:36 g5 kernel: Call Trace:
Jan 3 19:36:36 g5 kernel: [<e03267f2>] snapshot_dtr+0x27/0x58 [dm_snapshot]
Jan 3 19:36:36 g5 kernel: [<e0032185>] table_destroy+0x39/0x83 [dm_mod]
Jan 3 19:36:36 g5 kernel: [<e0031798>] dm_put+0xdf/0xeb [dm_mod]
Jan 3 19:36:36 g5 kernel: [<e0034258>] dev_remove+0xbf/0xcc [dm_mod]
Jan 3 19:36:36 g5 kernel: [<e00354e3>] ctl_ioctl+0xd9/0x13c [dm_mod]
Jan 3 19:36:36 g5 kernel: [<e0034199>] dev_remove+0x0/0xcc [dm_mod]
Jan 3 19:36:36 g5 kernel: [<c0180401>] sys_ioctl+0x297/0x336
Jan 3 19:36:36 g5 kernel: [<c0318e63>] syscall_call+0x7/0xb
Jan 3 19:36:36 g5 kernel: [<c031007b>] build_polexpire+0x75/0xe0
Jan 3 19:36:36 g5 kernel: Code: 55 31 ed 57 56 89 c6 53 83 ec 0c 89 54 24 08 8b 00 40 89 44 24 04 39 c5 7d 2d c7 04 24 00 0
0 00 00 8b 1c 24 03 5e 04 8b 13 39 da <8b> 3a 74 0d 8b 44 24 08 e8 e2 e0 e2 df 89 fa eb ed 83 04 24 08
Jan 3 19:36:36 g5 kernel: <0>Fatal exception: panic in 5 seconds

2007-01-03 19:15

 

lvremove-strace-beforecrash.txt (110,552 bytes)   
execve("/usr/sbin/lvremove", ["lvremove", "/dev/VolGroup00/shothome"], [/* 22 vars */]) = 0
uname({sys="Linux", node="g5", ...})    = 0
brk(0)                                  = 0x9542000
access("/etc/ld.so.preload", R_OK)      = -1 ENOENT (No such file or directory)
open("/etc/ld.so.cache", O_RDONLY)      = 3
fstat64(3, {st_mode=S_IFREG|0644, st_size=63556, ...}) = 0
old_mmap(NULL, 63556, PROT_READ, MAP_PRIVATE, 3, 0) = 0xb7f76000
close(3)                                = 0
open("/lib/libdevmapper-event.so.1.02", O_RDONLY) = 3
read(3, "\177ELF\1\1\1\0\0\0\0\0\0\0\0\0\3\0\3\0\1\0\0\0 Za\000"..., 512) = 512
fstat64(3, {st_mode=S_IFREG|0555, st_size=10336, ...}) = 0
old_mmap(0x615000, 11328, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x615000
old_mmap(0x617000, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x1000) = 0x617000
close(3)                                = 0
open("/lib/tls/libpthread.so.0", O_RDONLY) = 3
read(3, "\177ELF\1\1\1\0\0\0\0\0\0\0\0\0\3\0\3\0\1\0\0\0PHu\000"..., 512) = 512
fstat64(3, {st_mode=S_IFREG|0755, st_size=107952, ...}) = 0
old_mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0xb7f75000
old_mmap(0x750000, 70108, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x750000
old_mmap(0x75e000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0xd000) = 0x75e000
old_mmap(0x760000, 4572, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x760000
close(3)                                = 0
open("/lib/libdevmapper.so.1.02", O_RDONLY) = 3
read(3, "\177ELF\1\1\1\0\0\0\0\0\0\0\0\0\3\0\3\0\1\0\0\0\300\246"..., 512) = 512
fstat64(3, {st_mode=S_IFREG|0555, st_size=59844, ...}) = 0
old_mmap(0x628000, 60696, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x628000
old_mmap(0x635000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0xc000) = 0x635000
close(3)                                = 0
open("/usr/lib/libreadline.so.4", O_RDONLY) = 3
read(3, "\177ELF\1\1\1\0\0\0\0\0\0\0\0\0\3\0\3\0\1\0\0\0\20\216"..., 512) = 512
fstat64(3, {st_mode=S_IFREG|0755, st_size=170236, ...}) = 0
old_mmap(0x358e000, 175700, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x358e000
old_mmap(0x35b4000, 16384, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x25000) = 0x35b4000
old_mmap(0x35b8000, 3668, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x35b8000
close(3)                                = 0
open("/lib/libselinux.so.1", O_RDONLY)  = 3
read(3, "\177ELF\1\1\1\0\0\0\0\0\0\0\0\0\3\0\3\0\1\0\0\0\260\0\216"..., 512) = 512
fstat64(3, {st_mode=S_IFREG|0755, st_size=56328, ...}) = 0
old_mmap(0x8de000, 56144, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x8de000
old_mmap(0x8eb000, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0xd000) = 0x8eb000
close(3)                                = 0
open("/lib/libsepol.so.1", O_RDONLY)    = 3
read(3, "\177ELF\1\1\1\0\0\0\0\0\0\0\0\0\3\0\3\0\1\0\0\0@\332_\000"..., 512) = 512
fstat64(3, {st_mode=S_IFREG|0755, st_size=53736, ...}) = 0
old_mmap(0x5fd000, 88312, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x5fd000
old_mmap(0x60a000, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0xc000) = 0x60a000
old_mmap(0x60b000, 30968, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x60b000
close(3)                                = 0
open("/lib/libdl.so.2", O_RDONLY)       = 3
read(3, "\177ELF\1\1\1\0\0\0\0\0\0\0\0\0\3\0\3\0\1\0\0\0\260+b\000"..., 512) = 512
fstat64(3, {st_mode=S_IFREG|0755, st_size=16800, ...}) = 0
old_mmap(0x622000, 12388, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x622000
old_mmap(0x624000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x1000) = 0x624000
close(3)                                = 0
open("/usr/lib/libncurses.so.5", O_RDONLY) = 3
read(3, "\177ELF\1\1\1\0\0\0\0\0\0\0\0\0\3\0\3\0\1\0\0\0\240\221"..., 512) = 512
fstat64(3, {st_mode=S_IFREG|0755, st_size=879963, ...}) = 0
old_mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0xb7f74000
old_mmap(0x347b000, 266220, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x347b000
old_mmap(0x34b3000, 36864, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x37000) = 0x34b3000
close(3)                                = 0
open("/lib/tls/libc.so.6", O_RDONLY)    = 3
read(3, "\177ELF\1\1\1\0\0\0\0\0\0\0\0\0\3\0\3\0\1\0\0\0\320NN\000"..., 512) = 512
fstat64(3, {st_mode=S_IFREG|0755, st_size=1525004, ...}) = 0
old_mmap(0x4d0000, 1223900, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x4d0000
old_mmap(0x5f5000, 16384, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x124000) = 0x5f5000
old_mmap(0x5f9000, 7388, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x5f9000
close(3)                                = 0
old_mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0xb7f73000
mprotect(0x75e000, 4096, PROT_READ)     = 0
mprotect(0x624000, 4096, PROT_READ)     = 0
mprotect(0x5f5000, 8192, PROT_READ)     = 0
mprotect(0x4cc000, 4096, PROT_READ)     = 0
set_thread_area({entry_number:-1 -> 6, base_addr:0xb7f736c0, limit:1048575, seg_32bit:1, contents:0, read_exec_only:0, limit_in_pages:1, seg_not_present:0, useable:1}) = 0
munmap(0xb7f76000, 63556)               = 0
set_tid_address(0xb7f73708)             = 20890
rt_sigaction(SIGRTMIN, {0x754380, [], SA_RESTORER|SA_SIGINFO, 0x75b890}, NULL, 8) = 0
rt_sigaction(SIGRT_1, {0x7543f0, [], SA_RESTORER|SA_RESTART|SA_SIGINFO, 0x75b890}, NULL, 8) = 0
rt_sigprocmask(SIG_UNBLOCK, [RTMIN RT_1], NULL, 8) = 0
getrlimit(RLIMIT_STACK, {rlim_cur=10240*1024, rlim_max=RLIM_INFINITY}) = 0
_sysctl({{CTL_KERN, KERN_VERSION}, 2, 0xbfea93bc, 30, (nil), 0}) = 0
access("/etc/selinux/", F_OK)           = 0
brk(0)                                  = 0x9542000
brk(0x9563000)                          = 0x9563000
open("/etc/selinux/config", O_RDONLY)   = 3
fstat64(3, {st_mode=S_IFREG|0644, st_size=449, ...}) = 0
mmap2(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0xb7f85000
read(3, "# This file controls the state o"..., 4096) = 449
close(3)                                = 0
munmap(0xb7f85000, 4096)                = 0
open("/proc/mounts", O_RDONLY)          = 3
fstat64(3, {st_mode=S_IFREG|0444, st_size=0, ...}) = 0
mmap2(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0xb7f85000
read(3, "rootfs / rootfs rw 0 0\n/proc /pr"..., 1024) = 580
close(3)                                = 0
munmap(0xb7f85000, 4096)                = 0
getrlimit(RLIMIT_NOFILE, {rlim_cur=1024, rlim_max=1024}) = 0
close(3)                                = -1 EBADF (Bad file descriptor)
close(4)                                = -1 EBADF (Bad file descriptor)
close(5)                                = -1 EBADF (Bad file descriptor)
close(6)                                = -1 EBADF (Bad file descriptor)
close(7)                                = -1 EBADF (Bad file descriptor)
close(8)                                = -1 EBADF (Bad file descriptor)
close(9)                                = -1 EBADF (Bad file descriptor)
close(10)                               = -1 EBADF (Bad file descriptor)
close(11)                               = -1 EBADF (Bad file descriptor)
close(12)                               = -1 EBADF (Bad file descriptor)
close(13)                               = -1 EBADF (Bad file descriptor)
close(14)                               = -1 EBADF (Bad file descriptor)
close(15)                               = -1 EBADF (Bad file descriptor)
close(16)                               = -1 EBADF (Bad file descriptor)
close(17)                               = -1 EBADF (Bad file descriptor)
close(18)                               = -1 EBADF (Bad file descriptor)
close(19)                               = -1 EBADF (Bad file descriptor)
close(20)                               = -1 EBADF (Bad file descriptor)
close(21)                               = -1 EBADF (Bad file descriptor)
close(22)                               = -1 EBADF (Bad file descriptor)
close(23)                               = -1 EBADF (Bad file descriptor)
close(24)                               = -1 EBADF (Bad file descriptor)
close(25)                               = -1 EBADF (Bad file descriptor)
close(26)                               = -1 EBADF (Bad file descriptor)
close(27)                               = -1 EBADF (Bad file descriptor)
close(28)                               = -1 EBADF (Bad file descriptor)
close(29)                               = -1 EBADF (Bad file descriptor)
close(30)                               = -1 EBADF (Bad file descriptor)
close(31)                               = -1 EBADF (Bad file descriptor)
close(32)                               = -1 EBADF (Bad file descriptor)
close(33)                               = -1 EBADF (Bad file descriptor)
close(34)                               = -1 EBADF (Bad file descriptor)
close(35)                               = -1 EBADF (Bad file descriptor)
close(36)                               = -1 EBADF (Bad file descriptor)
close(37)                               = -1 EBADF (Bad file descriptor)
close(38)                               = -1 EBADF (Bad file descriptor)
close(39)                               = -1 EBADF (Bad file descriptor)
close(40)                               = -1 EBADF (Bad file descriptor)
close(41)                               = -1 EBADF (Bad file descriptor)
close(42)                               = -1 EBADF (Bad file descriptor)
close(43)                               = -1 EBADF (Bad file descriptor)
close(44)                               = -1 EBADF (Bad file descriptor)
close(45)                               = -1 EBADF (Bad file descriptor)
close(46)                               = -1 EBADF (Bad file descriptor)
close(47)                               = -1 EBADF (Bad file descriptor)
close(48)                               = -1 EBADF (Bad file descriptor)
close(49)                               = -1 EBADF (Bad file descriptor)
close(50)                               = -1 EBADF (Bad file descriptor)
close(51)                               = -1 EBADF (Bad file descriptor)
close(52)                               = -1 EBADF (Bad file descriptor)
close(53)                               = -1 EBADF (Bad file descriptor)
close(54)                               = -1 EBADF (Bad file descriptor)
close(55)                               = -1 EBADF (Bad file descriptor)
close(56)                               = -1 EBADF (Bad file descriptor)
close(57)                               = -1 EBADF (Bad file descriptor)
close(58)                               = -1 EBADF (Bad file descriptor)
close(59)                               = -1 EBADF (Bad file descriptor)
close(60)                               = -1 EBADF (Bad file descriptor)
close(61)                               = -1 EBADF (Bad file descriptor)
close(62)                               = -1 EBADF (Bad file descriptor)
close(63)                               = -1 EBADF (Bad file descriptor)
close(64)                               = -1 EBADF (Bad file descriptor)
close(65)                               = -1 EBADF (Bad file descriptor)
close(66)                               = -1 EBADF (Bad file descriptor)
close(67)                               = -1 EBADF (Bad file descriptor)
close(68)                               = -1 EBADF (Bad file descriptor)
close(69)                               = -1 EBADF (Bad file descriptor)
close(70)                               = -1 EBADF (Bad file descriptor)
close(71)                               = -1 EBADF (Bad file descriptor)
close(72)                               = -1 EBADF (Bad file descriptor)
close(73)                               = -1 EBADF (Bad file descriptor)
close(74)                               = -1 EBADF (Bad file descriptor)
close(75)                               = -1 EBADF (Bad file descriptor)
close(76)                               = -1 EBADF (Bad file descriptor)
close(77)                               = -1 EBADF (Bad file descriptor)
close(78)                               = -1 EBADF (Bad file descriptor)
close(79)                               = -1 EBADF (Bad file descriptor)
close(80)                               = -1 EBADF (Bad file descriptor)
close(81)                               = -1 EBADF (Bad file descriptor)
close(82)                               = -1 EBADF (Bad file descriptor)
close(83)                               = -1 EBADF (Bad file descriptor)
close(84)                               = -1 EBADF (Bad file descriptor)
close(85)                               = -1 EBADF (Bad file descriptor)
close(86)                               = -1 EBADF (Bad file descriptor)
close(87)                               = -1 EBADF (Bad file descriptor)
close(88)                               = -1 EBADF (Bad file descriptor)
close(89)                               = -1 EBADF (Bad file descriptor)
close(90)                               = -1 EBADF (Bad file descriptor)
close(91)                               = -1 EBADF (Bad file descriptor)
close(92)                               = -1 EBADF (Bad file descriptor)
close(93)                               = -1 EBADF (Bad file descriptor)
close(94)                               = -1 EBADF (Bad file descriptor)
close(95)                               = -1 EBADF (Bad file descriptor)
close(96)                               = -1 EBADF (Bad file descriptor)
close(97)                               = -1 EBADF (Bad file descriptor)
close(98)                               = -1 EBADF (Bad file descriptor)
close(99)                               = -1 EBADF (Bad file descriptor)
close(100)                              = -1 EBADF (Bad file descriptor)
close(101)                              = -1 EBADF (Bad file descriptor)
close(102)                              = -1 EBADF (Bad file descriptor)
close(103)                              = -1 EBADF (Bad file descriptor)
close(104)                              = -1 EBADF (Bad file descriptor)
close(105)                              = -1 EBADF (Bad file descriptor)
close(106)                              = -1 EBADF (Bad file descriptor)
close(107)                              = -1 EBADF (Bad file descriptor)
close(108)                              = -1 EBADF (Bad file descriptor)
close(109)                              = -1 EBADF (Bad file descriptor)
close(110)                              = -1 EBADF (Bad file descriptor)
close(111)                              = -1 EBADF (Bad file descriptor)
close(112)                              = -1 EBADF (Bad file descriptor)
close(113)                              = -1 EBADF (Bad file descriptor)
close(114)                              = -1 EBADF (Bad file descriptor)
close(115)                              = -1 EBADF (Bad file descriptor)
close(116)                              = -1 EBADF (Bad file descriptor)
close(117)                              = -1 EBADF (Bad file descriptor)
close(118)                              = -1 EBADF (Bad file descriptor)
close(119)                              = -1 EBADF (Bad file descriptor)
close(120)                              = -1 EBADF (Bad file descriptor)
close(121)                              = -1 EBADF (Bad file descriptor)
close(122)                              = -1 EBADF (Bad file descriptor)
close(123)                              = -1 EBADF (Bad file descriptor)
close(124)                              = -1 EBADF (Bad file descriptor)
close(125)                              = -1 EBADF (Bad file descriptor)
close(126)                              = -1 EBADF (Bad file descriptor)
close(127)                              = -1 EBADF (Bad file descriptor)
close(128)                              = -1 EBADF (Bad file descriptor)
close(129)                              = -1 EBADF (Bad file descriptor)
close(130)                              = -1 EBADF (Bad file descriptor)
close(131)                              = -1 EBADF (Bad file descriptor)
close(132)                              = -1 EBADF (Bad file descriptor)
close(133)                              = -1 EBADF (Bad file descriptor)
close(134)                              = -1 EBADF (Bad file descriptor)
close(135)                              = -1 EBADF (Bad file descriptor)
close(136)                              = -1 EBADF (Bad file descriptor)
close(137)                              = -1 EBADF (Bad file descriptor)
close(138)                              = -1 EBADF (Bad file descriptor)
close(139)                              = -1 EBADF (Bad file descriptor)
close(140)                              = -1 EBADF (Bad file descriptor)
close(141)                              = -1 EBADF (Bad file descriptor)
close(142)                              = -1 EBADF (Bad file descriptor)
close(143)                              = -1 EBADF (Bad file descriptor)
close(144)                              = -1 EBADF (Bad file descriptor)
close(145)                              = -1 EBADF (Bad file descriptor)
close(146)                              = -1 EBADF (Bad file descriptor)
close(147)                              = -1 EBADF (Bad file descriptor)
close(148)                              = -1 EBADF (Bad file descriptor)
close(149)                              = -1 EBADF (Bad file descriptor)
close(150)                              = -1 EBADF (Bad file descriptor)
close(151)                              = -1 EBADF (Bad file descriptor)
close(152)                              = -1 EBADF (Bad file descriptor)
close(153)                              = -1 EBADF (Bad file descriptor)
close(154)                              = -1 EBADF (Bad file descriptor)
close(155)                              = -1 EBADF (Bad file descriptor)
close(156)                              = -1 EBADF (Bad file descriptor)
close(157)                              = -1 EBADF (Bad file descriptor)
close(158)                              = -1 EBADF (Bad file descriptor)
close(159)                              = -1 EBADF (Bad file descriptor)
close(160)                              = -1 EBADF (Bad file descriptor)
close(161)                              = -1 EBADF (Bad file descriptor)
close(162)                              = -1 EBADF (Bad file descriptor)
close(163)                              = -1 EBADF (Bad file descriptor)
close(164)                              = -1 EBADF (Bad file descriptor)
close(165)                              = -1 EBADF (Bad file descriptor)
close(166)                              = -1 EBADF (Bad file descriptor)
close(167)                              = -1 EBADF (Bad file descriptor)
close(168)                              = -1 EBADF (Bad file descriptor)
close(169)                              = -1 EBADF (Bad file descriptor)
close(170)                              = -1 EBADF (Bad file descriptor)
close(171)                              = -1 EBADF (Bad file descriptor)
close(172)                              = -1 EBADF (Bad file descriptor)
close(173)                              = -1 EBADF (Bad file descriptor)
close(174)                              = -1 EBADF (Bad file descriptor)
close(175)                              = -1 EBADF (Bad file descriptor)
close(176)                              = -1 EBADF (Bad file descriptor)
close(177)                              = -1 EBADF (Bad file descriptor)
close(178)                              = -1 EBADF (Bad file descriptor)
close(179)                              = -1 EBADF (Bad file descriptor)
close(180)                              = -1 EBADF (Bad file descriptor)
close(181)                              = -1 EBADF (Bad file descriptor)
close(182)                              = -1 EBADF (Bad file descriptor)
close(183)                              = -1 EBADF (Bad file descriptor)
close(184)                              = -1 EBADF (Bad file descriptor)
close(185)                              = -1 EBADF (Bad file descriptor)
close(186)                              = -1 EBADF (Bad file descriptor)
close(187)                              = -1 EBADF (Bad file descriptor)
close(188)                              = -1 EBADF (Bad file descriptor)
close(189)                              = -1 EBADF (Bad file descriptor)
close(190)                              = -1 EBADF (Bad file descriptor)
close(191)                              = -1 EBADF (Bad file descriptor)
close(192)                              = -1 EBADF (Bad file descriptor)
close(193)                              = -1 EBADF (Bad file descriptor)
close(194)                              = -1 EBADF (Bad file descriptor)
close(195)                              = -1 EBADF (Bad file descriptor)
close(196)                              = -1 EBADF (Bad file descriptor)
close(197)                              = -1 EBADF (Bad file descriptor)
close(198)                              = -1 EBADF (Bad file descriptor)
close(199)                              = -1 EBADF (Bad file descriptor)
close(200)                              = -1 EBADF (Bad file descriptor)
close(201)                              = -1 EBADF (Bad file descriptor)
close(202)                              = -1 EBADF (Bad file descriptor)
close(203)                              = -1 EBADF (Bad file descriptor)
close(204)                              = -1 EBADF (Bad file descriptor)
close(205)                              = -1 EBADF (Bad file descriptor)
close(206)                              = -1 EBADF (Bad file descriptor)
close(207)                              = -1 EBADF (Bad file descriptor)
close(208)                              = -1 EBADF (Bad file descriptor)
close(209)                              = -1 EBADF (Bad file descriptor)
close(210)                              = -1 EBADF (Bad file descriptor)
close(211)                              = -1 EBADF (Bad file descriptor)
close(212)                              = -1 EBADF (Bad file descriptor)
close(213)                              = -1 EBADF (Bad file descriptor)
close(214)                              = -1 EBADF (Bad file descriptor)
close(215)                              = -1 EBADF (Bad file descriptor)
close(216)                              = -1 EBADF (Bad file descriptor)
close(217)                              = -1 EBADF (Bad file descriptor)
close(218)                              = -1 EBADF (Bad file descriptor)
close(219)                              = -1 EBADF (Bad file descriptor)
close(220)                              = -1 EBADF (Bad file descriptor)
close(221)                              = -1 EBADF (Bad file descriptor)
close(222)                              = -1 EBADF (Bad file descriptor)
close(223)                              = -1 EBADF (Bad file descriptor)
close(224)                              = -1 EBADF (Bad file descriptor)
close(225)                              = -1 EBADF (Bad file descriptor)
close(226)                              = -1 EBADF (Bad file descriptor)
close(227)                              = -1 EBADF (Bad file descriptor)
close(228)                              = -1 EBADF (Bad file descriptor)
close(229)                              = -1 EBADF (Bad file descriptor)
close(230)                              = -1 EBADF (Bad file descriptor)
close(231)                              = -1 EBADF (Bad file descriptor)
close(232)                              = -1 EBADF (Bad file descriptor)
close(233)                              = -1 EBADF (Bad file descriptor)
close(234)                              = -1 EBADF (Bad file descriptor)
close(235)                              = -1 EBADF (Bad file descriptor)
close(236)                              = -1 EBADF (Bad file descriptor)
close(237)                              = -1 EBADF (Bad file descriptor)
close(238)                              = -1 EBADF (Bad file descriptor)
close(239)                              = -1 EBADF (Bad file descriptor)
close(240)                              = -1 EBADF (Bad file descriptor)
close(241)                              = -1 EBADF (Bad file descriptor)
close(242)                              = -1 EBADF (Bad file descriptor)
close(243)                              = -1 EBADF (Bad file descriptor)
close(244)                              = -1 EBADF (Bad file descriptor)
close(245)                              = -1 EBADF (Bad file descriptor)
close(246)                              = -1 EBADF (Bad file descriptor)
close(247)                              = -1 EBADF (Bad file descriptor)
close(248)                              = -1 EBADF (Bad file descriptor)
close(249)                              = -1 EBADF (Bad file descriptor)
close(250)                              = -1 EBADF (Bad file descriptor)
close(251)                              = -1 EBADF (Bad file descriptor)
close(252)                              = -1 EBADF (Bad file descriptor)
close(253)                              = -1 EBADF (Bad file descriptor)
close(254)                              = -1 EBADF (Bad file descriptor)
close(255)                              = -1 EBADF (Bad file descriptor)
close(256)                              = -1 EBADF (Bad file descriptor)
close(257)                              = -1 EBADF (Bad file descriptor)
close(258)                              = -1 EBADF (Bad file descriptor)
close(259)                              = -1 EBADF (Bad file descriptor)
close(260)                              = -1 EBADF (Bad file descriptor)
close(261)                              = -1 EBADF (Bad file descriptor)
close(262)                              = -1 EBADF (Bad file descriptor)
close(263)                              = -1 EBADF (Bad file descriptor)
close(264)                              = -1 EBADF (Bad file descriptor)
close(265)                              = -1 EBADF (Bad file descriptor)
close(266)                              = -1 EBADF (Bad file descriptor)
close(267)                              = -1 EBADF (Bad file descriptor)
close(268)                              = -1 EBADF (Bad file descriptor)
close(269)                              = -1 EBADF (Bad file descriptor)
close(270)                              = -1 EBADF (Bad file descriptor)
close(271)                              = -1 EBADF (Bad file descriptor)
close(272)                              = -1 EBADF (Bad file descriptor)
close(273)                              = -1 EBADF (Bad file descriptor)
close(274)                              = -1 EBADF (Bad file descriptor)
close(275)                              = -1 EBADF (Bad file descriptor)
close(276)                              = -1 EBADF (Bad file descriptor)
close(277)                              = -1 EBADF (Bad file descriptor)
close(278)                              = -1 EBADF (Bad file descriptor)
close(279)                              = -1 EBADF (Bad file descriptor)
close(280)                              = -1 EBADF (Bad file descriptor)
close(281)                              = -1 EBADF (Bad file descriptor)
close(282)                              = -1 EBADF (Bad file descriptor)
close(283)                              = -1 EBADF (Bad file descriptor)
close(284)                              = -1 EBADF (Bad file descriptor)
close(285)                              = -1 EBADF (Bad file descriptor)
close(286)                              = -1 EBADF (Bad file descriptor)
close(287)                              = -1 EBADF (Bad file descriptor)
close(288)                              = -1 EBADF (Bad file descriptor)
close(289)                              = -1 EBADF (Bad file descriptor)
close(290)                              = -1 EBADF (Bad file descriptor)
close(291)                              = -1 EBADF (Bad file descriptor)
close(292)                              = -1 EBADF (Bad file descriptor)
close(293)                              = -1 EBADF (Bad file descriptor)
close(294)                              = -1 EBADF (Bad file descriptor)
close(295)                              = -1 EBADF (Bad file descriptor)
close(296)                              = -1 EBADF (Bad file descriptor)
close(297)                              = -1 EBADF (Bad file descriptor)
close(298)                              = -1 EBADF (Bad file descriptor)
close(299)                              = -1 EBADF (Bad file descriptor)
close(300)                              = -1 EBADF (Bad file descriptor)
close(301)                              = -1 EBADF (Bad file descriptor)
close(302)                              = -1 EBADF (Bad file descriptor)
close(303)                              = -1 EBADF (Bad file descriptor)
close(304)                              = -1 EBADF (Bad file descriptor)
close(305)                              = -1 EBADF (Bad file descriptor)
close(306)                              = -1 EBADF (Bad file descriptor)
close(307)                              = -1 EBADF (Bad file descriptor)
close(308)                              = -1 EBADF (Bad file descriptor)
close(309)                              = -1 EBADF (Bad file descriptor)
close(310)                              = -1 EBADF (Bad file descriptor)
close(311)                              = -1 EBADF (Bad file descriptor)
close(312)                              = -1 EBADF (Bad file descriptor)
close(313)                              = -1 EBADF (Bad file descriptor)
close(314)                              = -1 EBADF (Bad file descriptor)
close(315)                              = -1 EBADF (Bad file descriptor)
close(316)                              = -1 EBADF (Bad file descriptor)
close(317)                              = -1 EBADF (Bad file descriptor)
close(318)                              = -1 EBADF (Bad file descriptor)
close(319)                              = -1 EBADF (Bad file descriptor)
close(320)                              = -1 EBADF (Bad file descriptor)
close(321)                              = -1 EBADF (Bad file descriptor)
close(322)                              = -1 EBADF (Bad file descriptor)
close(323)                              = -1 EBADF (Bad file descriptor)
close(324)                              = -1 EBADF (Bad file descriptor)
close(325)                              = -1 EBADF (Bad file descriptor)
close(326)                              = -1 EBADF (Bad file descriptor)
close(327)                              = -1 EBADF (Bad file descriptor)
close(328)                              = -1 EBADF (Bad file descriptor)
close(329)                              = -1 EBADF (Bad file descriptor)
close(330)                              = -1 EBADF (Bad file descriptor)
close(331)                              = -1 EBADF (Bad file descriptor)
close(332)                              = -1 EBADF (Bad file descriptor)
close(333)                              = -1 EBADF (Bad file descriptor)
close(334)                              = -1 EBADF (Bad file descriptor)
close(335)                              = -1 EBADF (Bad file descriptor)
close(336)                              = -1 EBADF (Bad file descriptor)
close(337)                              = -1 EBADF (Bad file descriptor)
close(338)                              = -1 EBADF (Bad file descriptor)
close(339)                              = -1 EBADF (Bad file descriptor)
close(340)                              = -1 EBADF (Bad file descriptor)
close(341)                              = -1 EBADF (Bad file descriptor)
close(342)                              = -1 EBADF (Bad file descriptor)
close(343)                              = -1 EBADF (Bad file descriptor)
close(344)                              = -1 EBADF (Bad file descriptor)
close(345)                              = -1 EBADF (Bad file descriptor)
close(346)                              = -1 EBADF (Bad file descriptor)
close(347)                              = -1 EBADF (Bad file descriptor)
close(348)                              = -1 EBADF (Bad file descriptor)
close(349)                              = -1 EBADF (Bad file descriptor)
close(350)                              = -1 EBADF (Bad file descriptor)
close(351)                              = -1 EBADF (Bad file descriptor)
close(352)                              = -1 EBADF (Bad file descriptor)
close(353)                              = -1 EBADF (Bad file descriptor)
close(354)                              = -1 EBADF (Bad file descriptor)
close(355)                              = -1 EBADF (Bad file descriptor)
close(356)                              = -1 EBADF (Bad file descriptor)
close(357)                              = -1 EBADF (Bad file descriptor)
close(358)                              = -1 EBADF (Bad file descriptor)
close(359)                              = -1 EBADF (Bad file descriptor)
close(360)                              = -1 EBADF (Bad file descriptor)
close(361)                              = -1 EBADF (Bad file descriptor)
close(362)                              = -1 EBADF (Bad file descriptor)
close(363)                              = -1 EBADF (Bad file descriptor)
close(364)                              = -1 EBADF (Bad file descriptor)
close(365)                              = -1 EBADF (Bad file descriptor)
close(366)                              = -1 EBADF (Bad file descriptor)
close(367)                              = -1 EBADF (Bad file descriptor)
close(368)                              = -1 EBADF (Bad file descriptor)
close(369)                              = -1 EBADF (Bad file descriptor)
close(370)                              = -1 EBADF (Bad file descriptor)
close(371)                              = -1 EBADF (Bad file descriptor)
close(372)                              = -1 EBADF (Bad file descriptor)
close(373)                              = -1 EBADF (Bad file descriptor)
close(374)                              = -1 EBADF (Bad file descriptor)
close(375)                              = -1 EBADF (Bad file descriptor)
close(376)                              = -1 EBADF (Bad file descriptor)
close(377)                              = -1 EBADF (Bad file descriptor)
close(378)                              = -1 EBADF (Bad file descriptor)
close(379)                              = -1 EBADF (Bad file descriptor)
close(380)                              = -1 EBADF (Bad file descriptor)
close(381)                              = -1 EBADF (Bad file descriptor)
close(382)                              = -1 EBADF (Bad file descriptor)
close(383)                              = -1 EBADF (Bad file descriptor)
close(384)                              = -1 EBADF (Bad file descriptor)
close(385)                              = -1 EBADF (Bad file descriptor)
close(386)                              = -1 EBADF (Bad file descriptor)
close(387)                              = -1 EBADF (Bad file descriptor)
close(388)                              = -1 EBADF (Bad file descriptor)
close(389)                              = -1 EBADF (Bad file descriptor)
close(390)                              = -1 EBADF (Bad file descriptor)
close(391)                              = -1 EBADF (Bad file descriptor)
close(392)                              = -1 EBADF (Bad file descriptor)
close(393)                              = -1 EBADF (Bad file descriptor)
close(394)                              = -1 EBADF (Bad file descriptor)
close(395)                              = -1 EBADF (Bad file descriptor)
close(396)                              = -1 EBADF (Bad file descriptor)
close(397)                              = -1 EBADF (Bad file descriptor)
close(398)                              = -1 EBADF (Bad file descriptor)
close(399)                              = -1 EBADF (Bad file descriptor)
close(400)                              = -1 EBADF (Bad file descriptor)
close(401)                              = -1 EBADF (Bad file descriptor)
close(402)                              = -1 EBADF (Bad file descriptor)
close(403)                              = -1 EBADF (Bad file descriptor)
close(404)                              = -1 EBADF (Bad file descriptor)
close(405)                              = -1 EBADF (Bad file descriptor)
close(406)                              = -1 EBADF (Bad file descriptor)
close(407)                              = -1 EBADF (Bad file descriptor)
close(408)                              = -1 EBADF (Bad file descriptor)
close(409)                              = -1 EBADF (Bad file descriptor)
close(410)                              = -1 EBADF (Bad file descriptor)
close(411)                              = -1 EBADF (Bad file descriptor)
close(412)                              = -1 EBADF (Bad file descriptor)
close(413)                              = -1 EBADF (Bad file descriptor)
close(414)                              = -1 EBADF (Bad file descriptor)
close(415)                              = -1 EBADF (Bad file descriptor)
close(416)                              = -1 EBADF (Bad file descriptor)
close(417)                              = -1 EBADF (Bad file descriptor)
close(418)                              = -1 EBADF (Bad file descriptor)
close(419)                              = -1 EBADF (Bad file descriptor)
close(420)                              = -1 EBADF (Bad file descriptor)
close(421)                              = -1 EBADF (Bad file descriptor)
close(422)                              = -1 EBADF (Bad file descriptor)
close(423)                              = -1 EBADF (Bad file descriptor)
close(424)                              = -1 EBADF (Bad file descriptor)
close(425)                              = -1 EBADF (Bad file descriptor)
close(426)                              = -1 EBADF (Bad file descriptor)
close(427)                              = -1 EBADF (Bad file descriptor)
close(428)                              = -1 EBADF (Bad file descriptor)
close(429)                              = -1 EBADF (Bad file descriptor)
close(430)                              = -1 EBADF (Bad file descriptor)
close(431)                              = -1 EBADF (Bad file descriptor)
close(432)                              = -1 EBADF (Bad file descriptor)
close(433)                              = -1 EBADF (Bad file descriptor)
close(434)                              = -1 EBADF (Bad file descriptor)
close(435)                              = -1 EBADF (Bad file descriptor)
close(436)                              = -1 EBADF (Bad file descriptor)
close(437)                              = -1 EBADF (Bad file descriptor)
close(438)                              = -1 EBADF (Bad file descriptor)
close(439)                              = -1 EBADF (Bad file descriptor)
close(440)                              = -1 EBADF (Bad file descriptor)
close(441)                              = -1 EBADF (Bad file descriptor)
close(442)                              = -1 EBADF (Bad file descriptor)
close(443)                              = -1 EBADF (Bad file descriptor)
close(444)                              = -1 EBADF (Bad file descriptor)
close(445)                              = -1 EBADF (Bad file descriptor)
close(446)                              = -1 EBADF (Bad file descriptor)
close(447)                              = -1 EBADF (Bad file descriptor)
close(448)                              = -1 EBADF (Bad file descriptor)
close(449)                              = -1 EBADF (Bad file descriptor)
close(450)                              = -1 EBADF (Bad file descriptor)
close(451)                              = -1 EBADF (Bad file descriptor)
close(452)                              = -1 EBADF (Bad file descriptor)
close(453)                              = -1 EBADF (Bad file descriptor)
close(454)                              = -1 EBADF (Bad file descriptor)
close(455)                              = -1 EBADF (Bad file descriptor)
close(456)                              = -1 EBADF (Bad file descriptor)
close(457)                              = -1 EBADF (Bad file descriptor)
close(458)                              = -1 EBADF (Bad file descriptor)
close(459)                              = -1 EBADF (Bad file descriptor)
close(460)                              = -1 EBADF (Bad file descriptor)
close(461)                              = -1 EBADF (Bad file descriptor)
close(462)                              = -1 EBADF (Bad file descriptor)
close(463)                              = -1 EBADF (Bad file descriptor)
close(464)                              = -1 EBADF (Bad file descriptor)
close(465)                              = -1 EBADF (Bad file descriptor)
close(466)                              = -1 EBADF (Bad file descriptor)
close(467)                              = -1 EBADF (Bad file descriptor)
close(468)                              = -1 EBADF (Bad file descriptor)
close(469)                              = -1 EBADF (Bad file descriptor)
close(470)                              = -1 EBADF (Bad file descriptor)
close(471)                              = -1 EBADF (Bad file descriptor)
close(472)                              = -1 EBADF (Bad file descriptor)
close(473)                              = -1 EBADF (Bad file descriptor)
close(474)                              = -1 EBADF (Bad file descriptor)
close(475)                              = -1 EBADF (Bad file descriptor)
close(476)                              = -1 EBADF (Bad file descriptor)
close(477)                              = -1 EBADF (Bad file descriptor)
close(478)                              = -1 EBADF (Bad file descriptor)
close(479)                              = -1 EBADF (Bad file descriptor)
close(480)                              = -1 EBADF (Bad file descriptor)
close(481)                              = -1 EBADF (Bad file descriptor)
close(482)                              = -1 EBADF (Bad file descriptor)
close(483)                              = -1 EBADF (Bad file descriptor)
close(484)                              = -1 EBADF (Bad file descriptor)
close(485)                              = -1 EBADF (Bad file descriptor)
close(486)                              = -1 EBADF (Bad file descriptor)
close(487)                              = -1 EBADF (Bad file descriptor)
close(488)                              = -1 EBADF (Bad file descriptor)
close(489)                              = -1 EBADF (Bad file descriptor)
close(490)                              = -1 EBADF (Bad file descriptor)
close(491)                              = -1 EBADF (Bad file descriptor)
close(492)                              = -1 EBADF (Bad file descriptor)
close(493)                              = -1 EBADF (Bad file descriptor)
close(494)                              = -1 EBADF (Bad file descriptor)
close(495)                              = -1 EBADF (Bad file descriptor)
close(496)                              = -1 EBADF (Bad file descriptor)
close(497)                              = -1 EBADF (Bad file descriptor)
close(498)                              = -1 EBADF (Bad file descriptor)
close(499)                              = -1 EBADF (Bad file descriptor)
close(500)                              = -1 EBADF (Bad file descriptor)
close(501)                              = -1 EBADF (Bad file descriptor)
close(502)                              = -1 EBADF (Bad file descriptor)
close(503)                              = -1 EBADF (Bad file descriptor)
close(504)                              = -1 EBADF (Bad file descriptor)
close(505)                              = -1 EBADF (Bad file descriptor)
close(506)                              = -1 EBADF (Bad file descriptor)
close(507)                              = -1 EBADF (Bad file descriptor)
close(508)                              = -1 EBADF (Bad file descriptor)
close(509)                              = -1 EBADF (Bad file descriptor)
close(510)                              = -1 EBADF (Bad file descriptor)
close(511)                              = -1 EBADF (Bad file descriptor)
close(512)                              = -1 EBADF (Bad file descriptor)
close(513)                              = -1 EBADF (Bad file descriptor)
close(514)                              = -1 EBADF (Bad file descriptor)
close(515)                              = -1 EBADF (Bad file descriptor)
close(516)                              = -1 EBADF (Bad file descriptor)
close(517)                              = -1 EBADF (Bad file descriptor)
close(518)                              = -1 EBADF (Bad file descriptor)
close(519)                              = -1 EBADF (Bad file descriptor)
close(520)                              = -1 EBADF (Bad file descriptor)
close(521)                              = -1 EBADF (Bad file descriptor)
close(522)                              = -1 EBADF (Bad file descriptor)
close(523)                              = -1 EBADF (Bad file descriptor)
close(524)                              = -1 EBADF (Bad file descriptor)
close(525)                              = -1 EBADF (Bad file descriptor)
close(526)                              = -1 EBADF (Bad file descriptor)
close(527)                              = -1 EBADF (Bad file descriptor)
close(528)                              = -1 EBADF (Bad file descriptor)
close(529)                              = -1 EBADF (Bad file descriptor)
close(530)                              = -1 EBADF (Bad file descriptor)
close(531)                              = -1 EBADF (Bad file descriptor)
close(532)                              = -1 EBADF (Bad file descriptor)
close(533)                              = -1 EBADF (Bad file descriptor)
close(534)                              = -1 EBADF (Bad file descriptor)
close(535)                              = -1 EBADF (Bad file descriptor)
close(536)                              = -1 EBADF (Bad file descriptor)
close(537)                              = -1 EBADF (Bad file descriptor)
close(538)                              = -1 EBADF (Bad file descriptor)
close(539)                              = -1 EBADF (Bad file descriptor)
close(540)                              = -1 EBADF (Bad file descriptor)
close(541)                              = -1 EBADF (Bad file descriptor)
close(542)                              = -1 EBADF (Bad file descriptor)
close(543)                              = -1 EBADF (Bad file descriptor)
close(544)                              = -1 EBADF (Bad file descriptor)
close(545)                              = -1 EBADF (Bad file descriptor)
close(546)                              = -1 EBADF (Bad file descriptor)
close(547)                              = -1 EBADF (Bad file descriptor)
close(548)                              = -1 EBADF (Bad file descriptor)
close(549)                              = -1 EBADF (Bad file descriptor)
close(550)                              = -1 EBADF (Bad file descriptor)
close(551)                              = -1 EBADF (Bad file descriptor)
close(552)                              = -1 EBADF (Bad file descriptor)
close(553)                              = -1 EBADF (Bad file descriptor)
close(554)                              = -1 EBADF (Bad file descriptor)
close(555)                              = -1 EBADF (Bad file descriptor)
close(556)                              = -1 EBADF (Bad file descriptor)
close(557)                              = -1 EBADF (Bad file descriptor)
close(558)                              = -1 EBADF (Bad file descriptor)
close(559)                              = -1 EBADF (Bad file descriptor)
close(560)                              = -1 EBADF (Bad file descriptor)
close(561)                              = -1 EBADF (Bad file descriptor)
close(562)                              = -1 EBADF (Bad file descriptor)
close(563)                              = -1 EBADF (Bad file descriptor)
close(564)                              = -1 EBADF (Bad file descriptor)
close(565)                              = -1 EBADF (Bad file descriptor)
close(566)                              = -1 EBADF (Bad file descriptor)
close(567)                              = -1 EBADF (Bad file descriptor)
close(568)                              = -1 EBADF (Bad file descriptor)
close(569)                              = -1 EBADF (Bad file descriptor)
close(570)                              = -1 EBADF (Bad file descriptor)
close(571)                              = -1 EBADF (Bad file descriptor)
close(572)                              = -1 EBADF (Bad file descriptor)
close(573)                              = -1 EBADF (Bad file descriptor)
close(574)                              = -1 EBADF (Bad file descriptor)
close(575)                              = -1 EBADF (Bad file descriptor)
close(576)                              = -1 EBADF (Bad file descriptor)
close(577)                              = -1 EBADF (Bad file descriptor)
close(578)                              = -1 EBADF (Bad file descriptor)
close(579)                              = -1 EBADF (Bad file descriptor)
close(580)                              = -1 EBADF (Bad file descriptor)
close(581)                              = -1 EBADF (Bad file descriptor)
close(582)                              = -1 EBADF (Bad file descriptor)
close(583)                              = -1 EBADF (Bad file descriptor)
close(584)                              = -1 EBADF (Bad file descriptor)
close(585)                              = -1 EBADF (Bad file descriptor)
close(586)                              = -1 EBADF (Bad file descriptor)
close(587)                              = -1 EBADF (Bad file descriptor)
close(588)                              = -1 EBADF (Bad file descriptor)
close(589)                              = -1 EBADF (Bad file descriptor)
close(590)                              = -1 EBADF (Bad file descriptor)
close(591)                              = -1 EBADF (Bad file descriptor)
close(592)                              = -1 EBADF (Bad file descriptor)
close(593)                              = -1 EBADF (Bad file descriptor)
close(594)                              = -1 EBADF (Bad file descriptor)
close(595)                              = -1 EBADF (Bad file descriptor)
close(596)                              = -1 EBADF (Bad file descriptor)
close(597)                              = -1 EBADF (Bad file descriptor)
close(598)                              = -1 EBADF (Bad file descriptor)
close(599)                              = -1 EBADF (Bad file descriptor)
close(600)                              = -1 EBADF (Bad file descriptor)
close(601)                              = -1 EBADF (Bad file descriptor)
close(602)                              = -1 EBADF (Bad file descriptor)
close(603)                              = -1 EBADF (Bad file descriptor)
close(604)                              = -1 EBADF (Bad file descriptor)
close(605)                              = -1 EBADF (Bad file descriptor)
close(606)                              = -1 EBADF (Bad file descriptor)
close(607)                              = -1 EBADF (Bad file descriptor)
close(608)                              = -1 EBADF (Bad file descriptor)
close(609)                              = -1 EBADF (Bad file descriptor)
close(610)                              = -1 EBADF (Bad file descriptor)
close(611)                              = -1 EBADF (Bad file descriptor)
close(612)                              = -1 EBADF (Bad file descriptor)
close(613)                              = -1 EBADF (Bad file descriptor)
close(614)                              = -1 EBADF (Bad file descriptor)
close(615)                              = -1 EBADF (Bad file descriptor)
close(616)                              = -1 EBADF (Bad file descriptor)
close(617)                              = -1 EBADF (Bad file descriptor)
close(618)                              = -1 EBADF (Bad file descriptor)
close(619)                              = -1 EBADF (Bad file descriptor)
close(620)                              = -1 EBADF (Bad file descriptor)
close(621)                              = -1 EBADF (Bad file descriptor)
close(622)                              = -1 EBADF (Bad file descriptor)
close(623)                              = -1 EBADF (Bad file descriptor)
close(624)                              = -1 EBADF (Bad file descriptor)
close(625)                              = -1 EBADF (Bad file descriptor)
close(626)                              = -1 EBADF (Bad file descriptor)
close(627)                              = -1 EBADF (Bad file descriptor)
close(628)                              = -1 EBADF (Bad file descriptor)
close(629)                              = -1 EBADF (Bad file descriptor)
close(630)                              = -1 EBADF (Bad file descriptor)
close(631)                              = -1 EBADF (Bad file descriptor)
close(632)                              = -1 EBADF (Bad file descriptor)
close(633)                              = -1 EBADF (Bad file descriptor)
close(634)                              = -1 EBADF (Bad file descriptor)
close(635)                              = -1 EBADF (Bad file descriptor)
close(636)                              = -1 EBADF (Bad file descriptor)
close(637)                              = -1 EBADF (Bad file descriptor)
close(638)                              = -1 EBADF (Bad file descriptor)
close(639)                              = -1 EBADF (Bad file descriptor)
close(640)                              = -1 EBADF (Bad file descriptor)
close(641)                              = -1 EBADF (Bad file descriptor)
close(642)                              = -1 EBADF (Bad file descriptor)
close(643)                              = -1 EBADF (Bad file descriptor)
close(644)                              = -1 EBADF (Bad file descriptor)
close(645)                              = -1 EBADF (Bad file descriptor)
close(646)                              = -1 EBADF (Bad file descriptor)
close(647)                              = -1 EBADF (Bad file descriptor)
close(648)                              = -1 EBADF (Bad file descriptor)
close(649)                              = -1 EBADF (Bad file descriptor)
close(650)                              = -1 EBADF (Bad file descriptor)
close(651)                              = -1 EBADF (Bad file descriptor)
close(652)                              = -1 EBADF (Bad file descriptor)
close(653)                              = -1 EBADF (Bad file descriptor)
close(654)                              = -1 EBADF (Bad file descriptor)
close(655)                              = -1 EBADF (Bad file descriptor)
close(656)                              = -1 EBADF (Bad file descriptor)
close(657)                              = -1 EBADF (Bad file descriptor)
close(658)                              = -1 EBADF (Bad file descriptor)
close(659)                              = -1 EBADF (Bad file descriptor)
close(660)                              = -1 EBADF (Bad file descriptor)
close(661)                              = -1 EBADF (Bad file descriptor)
close(662)                              = -1 EBADF (Bad file descriptor)
close(663)                              = -1 EBADF (Bad file descriptor)
close(664)                              = -1 EBADF (Bad file descriptor)
close(665)                              = -1 EBADF (Bad file descriptor)
close(666)                              = -1 EBADF (Bad file descriptor)
close(667)                              = -1 EBADF (Bad file descriptor)
close(668)                              = -1 EBADF (Bad file descriptor)
close(669)                              = -1 EBADF (Bad file descriptor)
close(670)                              = -1 EBADF (Bad file descriptor)
close(671)                              = -1 EBADF (Bad file descriptor)
close(672)                              = -1 EBADF (Bad file descriptor)
close(673)                              = -1 EBADF (Bad file descriptor)
close(674)                              = -1 EBADF (Bad file descriptor)
close(675)                              = -1 EBADF (Bad file descriptor)
close(676)                              = -1 EBADF (Bad file descriptor)
close(677)                              = -1 EBADF (Bad file descriptor)
close(678)                              = -1 EBADF (Bad file descriptor)
close(679)                              = -1 EBADF (Bad file descriptor)
close(680)                              = -1 EBADF (Bad file descriptor)
close(681)                              = -1 EBADF (Bad file descriptor)
close(682)                              = -1 EBADF (Bad file descriptor)
close(683)                              = -1 EBADF (Bad file descriptor)
close(684)                              = -1 EBADF (Bad file descriptor)
close(685)                              = -1 EBADF (Bad file descriptor)
close(686)                              = -1 EBADF (Bad file descriptor)
close(687)                              = -1 EBADF (Bad file descriptor)
close(688)                              = -1 EBADF (Bad file descriptor)
close(689)                              = -1 EBADF (Bad file descriptor)
close(690)                              = -1 EBADF (Bad file descriptor)
close(691)                              = -1 EBADF (Bad file descriptor)
close(692)                              = -1 EBADF (Bad file descriptor)
close(693)                              = -1 EBADF (Bad file descriptor)
close(694)                              = -1 EBADF (Bad file descriptor)
close(695)                              = -1 EBADF (Bad file descriptor)
close(696)                              = -1 EBADF (Bad file descriptor)
close(697)                              = -1 EBADF (Bad file descriptor)
close(698)                              = -1 EBADF (Bad file descriptor)
close(699)                              = -1 EBADF (Bad file descriptor)
close(700)                              = -1 EBADF (Bad file descriptor)
close(701)                              = -1 EBADF (Bad file descriptor)
close(702)                              = -1 EBADF (Bad file descriptor)
close(703)                              = -1 EBADF (Bad file descriptor)
close(704)                              = -1 EBADF (Bad file descriptor)
close(705)                              = -1 EBADF (Bad file descriptor)
close(706)                              = -1 EBADF (Bad file descriptor)
close(707)                              = -1 EBADF (Bad file descriptor)
close(708)                              = -1 EBADF (Bad file descriptor)
close(709)                              = -1 EBADF (Bad file descriptor)
close(710)                              = -1 EBADF (Bad file descriptor)
close(711)                              = -1 EBADF (Bad file descriptor)
close(712)                              = -1 EBADF (Bad file descriptor)
close(713)                              = -1 EBADF (Bad file descriptor)
close(714)                              = -1 EBADF (Bad file descriptor)
close(715)                              = -1 EBADF (Bad file descriptor)
close(716)                              = -1 EBADF (Bad file descriptor)
close(717)                              = -1 EBADF (Bad file descriptor)
close(718)                              = -1 EBADF (Bad file descriptor)
close(719)                              = -1 EBADF (Bad file descriptor)
close(720)                              = -1 EBADF (Bad file descriptor)
close(721)                              = -1 EBADF (Bad file descriptor)
close(722)                              = -1 EBADF (Bad file descriptor)
close(723)                              = -1 EBADF (Bad file descriptor)
close(724)                              = -1 EBADF (Bad file descriptor)
close(725)                              = -1 EBADF (Bad file descriptor)
close(726)                              = -1 EBADF (Bad file descriptor)
close(727)                              = -1 EBADF (Bad file descriptor)
close(728)                              = -1 EBADF (Bad file descriptor)
close(729)                              = -1 EBADF (Bad file descriptor)
close(730)                              = -1 EBADF (Bad file descriptor)
close(731)                              = -1 EBADF (Bad file descriptor)
close(732)                              = -1 EBADF (Bad file descriptor)
close(733)                              = -1 EBADF (Bad file descriptor)
close(734)                              = -1 EBADF (Bad file descriptor)
close(735)                              = -1 EBADF (Bad file descriptor)
close(736)                              = -1 EBADF (Bad file descriptor)
close(737)                              = -1 EBADF (Bad file descriptor)
close(738)                              = -1 EBADF (Bad file descriptor)
close(739)                              = -1 EBADF (Bad file descriptor)
close(740)                              = -1 EBADF (Bad file descriptor)
close(741)                              = -1 EBADF (Bad file descriptor)
close(742)                              = -1 EBADF (Bad file descriptor)
close(743)                              = -1 EBADF (Bad file descriptor)
close(744)                              = -1 EBADF (Bad file descriptor)
close(745)                              = -1 EBADF (Bad file descriptor)
close(746)                              = -1 EBADF (Bad file descriptor)
close(747)                              = -1 EBADF (Bad file descriptor)
close(748)                              = -1 EBADF (Bad file descriptor)
close(749)                              = -1 EBADF (Bad file descriptor)
close(750)                              = -1 EBADF (Bad file descriptor)
close(751)                              = -1 EBADF (Bad file descriptor)
close(752)                              = -1 EBADF (Bad file descriptor)
close(753)                              = -1 EBADF (Bad file descriptor)
close(754)                              = -1 EBADF (Bad file descriptor)
close(755)                              = -1 EBADF (Bad file descriptor)
close(756)                              = -1 EBADF (Bad file descriptor)
close(757)                              = -1 EBADF (Bad file descriptor)
close(758)                              = -1 EBADF (Bad file descriptor)
close(759)                              = -1 EBADF (Bad file descriptor)
close(760)                              = -1 EBADF (Bad file descriptor)
close(761)                              = -1 EBADF (Bad file descriptor)
close(762)                              = -1 EBADF (Bad file descriptor)
close(763)                              = -1 EBADF (Bad file descriptor)
close(764)                              = -1 EBADF (Bad file descriptor)
close(765)                              = -1 EBADF (Bad file descriptor)
close(766)                              = -1 EBADF (Bad file descriptor)
close(767)                              = -1 EBADF (Bad file descriptor)
close(768)                              = -1 EBADF (Bad file descriptor)
close(769)                              = -1 EBADF (Bad file descriptor)
close(770)                              = -1 EBADF (Bad file descriptor)
close(771)                              = -1 EBADF (Bad file descriptor)
close(772)                              = -1 EBADF (Bad file descriptor)
close(773)                              = -1 EBADF (Bad file descriptor)
close(774)                              = -1 EBADF (Bad file descriptor)
close(775)                              = -1 EBADF (Bad file descriptor)
close(776)                              = -1 EBADF (Bad file descriptor)
close(777)                              = -1 EBADF (Bad file descriptor)
close(778)                              = -1 EBADF (Bad file descriptor)
close(779)                              = -1 EBADF (Bad file descriptor)
close(780)                              = -1 EBADF (Bad file descriptor)
close(781)                              = -1 EBADF (Bad file descriptor)
close(782)                              = -1 EBADF (Bad file descriptor)
close(783)                              = -1 EBADF (Bad file descriptor)
close(784)                              = -1 EBADF (Bad file descriptor)
close(785)                              = -1 EBADF (Bad file descriptor)
close(786)                              = -1 EBADF (Bad file descriptor)
close(787)                              = -1 EBADF (Bad file descriptor)
close(788)                              = -1 EBADF (Bad file descriptor)
close(789)                              = -1 EBADF (Bad file descriptor)
close(790)                              = -1 EBADF (Bad file descriptor)
close(791)                              = -1 EBADF (Bad file descriptor)
close(792)                              = -1 EBADF (Bad file descriptor)
close(793)                              = -1 EBADF (Bad file descriptor)
close(794)                              = -1 EBADF (Bad file descriptor)
close(795)                              = -1 EBADF (Bad file descriptor)
close(796)                              = -1 EBADF (Bad file descriptor)
close(797)                              = -1 EBADF (Bad file descriptor)
close(798)                              = -1 EBADF (Bad file descriptor)
close(799)                              = -1 EBADF (Bad file descriptor)
close(800)                              = -1 EBADF (Bad file descriptor)
close(801)                              = -1 EBADF (Bad file descriptor)
close(802)                              = -1 EBADF (Bad file descriptor)
close(803)                              = -1 EBADF (Bad file descriptor)
close(804)                              = -1 EBADF (Bad file descriptor)
close(805)                              = -1 EBADF (Bad file descriptor)
close(806)                              = -1 EBADF (Bad file descriptor)
close(807)                              = -1 EBADF (Bad file descriptor)
close(808)                              = -1 EBADF (Bad file descriptor)
close(809)                              = -1 EBADF (Bad file descriptor)
close(810)                              = -1 EBADF (Bad file descriptor)
close(811)                              = -1 EBADF (Bad file descriptor)
close(812)                              = -1 EBADF (Bad file descriptor)
close(813)                              = -1 EBADF (Bad file descriptor)
close(814)                              = -1 EBADF (Bad file descriptor)
close(815)                              = -1 EBADF (Bad file descriptor)
close(816)                              = -1 EBADF (Bad file descriptor)
close(817)                              = -1 EBADF (Bad file descriptor)
close(818)                              = -1 EBADF (Bad file descriptor)
close(819)                              = -1 EBADF (Bad file descriptor)
close(820)                              = -1 EBADF (Bad file descriptor)
close(821)                              = -1 EBADF (Bad file descriptor)
close(822)                              = -1 EBADF (Bad file descriptor)
close(823)                              = -1 EBADF (Bad file descriptor)
close(824)                              = -1 EBADF (Bad file descriptor)
close(825)                              = -1 EBADF (Bad file descriptor)
close(826)                              = -1 EBADF (Bad file descriptor)
close(827)                              = -1 EBADF (Bad file descriptor)
close(828)                              = -1 EBADF (Bad file descriptor)
close(829)                              = -1 EBADF (Bad file descriptor)
close(830)                              = -1 EBADF (Bad file descriptor)
close(831)                              = -1 EBADF (Bad file descriptor)
close(832)                              = -1 EBADF (Bad file descriptor)
close(833)                              = -1 EBADF (Bad file descriptor)
close(834)                              = -1 EBADF (Bad file descriptor)
close(835)                              = -1 EBADF (Bad file descriptor)
close(836)                              = -1 EBADF (Bad file descriptor)
close(837)                              = -1 EBADF (Bad file descriptor)
close(838)                              = -1 EBADF (Bad file descriptor)
close(839)                              = -1 EBADF (Bad file descriptor)
close(840)                              = -1 EBADF (Bad file descriptor)
close(841)                              = -1 EBADF (Bad file descriptor)
close(842)                              = -1 EBADF (Bad file descriptor)
close(843)                              = -1 EBADF (Bad file descriptor)
close(844)                              = -1 EBADF (Bad file descriptor)
close(845)                              = -1 EBADF (Bad file descriptor)
close(846)                              = -1 EBADF (Bad file descriptor)
close(847)                              = -1 EBADF (Bad file descriptor)
close(848)                              = -1 EBADF (Bad file descriptor)
close(849)                              = -1 EBADF (Bad file descriptor)
close(850)                              = -1 EBADF (Bad file descriptor)
close(851)                              = -1 EBADF (Bad file descriptor)
close(852)                              = -1 EBADF (Bad file descriptor)
close(853)                              = -1 EBADF (Bad file descriptor)
close(854)                              = -1 EBADF (Bad file descriptor)
close(855)                              = -1 EBADF (Bad file descriptor)
close(856)                              = -1 EBADF (Bad file descriptor)
close(857)                              = -1 EBADF (Bad file descriptor)
close(858)                              = -1 EBADF (Bad file descriptor)
close(859)                              = -1 EBADF (Bad file descriptor)
close(860)                              = -1 EBADF (Bad file descriptor)
close(861)                              = -1 EBADF (Bad file descriptor)
close(862)                              = -1 EBADF (Bad file descriptor)
close(863)                              = -1 EBADF (Bad file descriptor)
close(864)                              = -1 EBADF (Bad file descriptor)
close(865)                              = -1 EBADF (Bad file descriptor)
close(866)                              = -1 EBADF (Bad file descriptor)
close(867)                              = -1 EBADF (Bad file descriptor)
close(868)                              = -1 EBADF (Bad file descriptor)
close(869)                              = -1 EBADF (Bad file descriptor)
close(870)                              = -1 EBADF (Bad file descriptor)
close(871)                              = -1 EBADF (Bad file descriptor)
close(872)                              = -1 EBADF (Bad file descriptor)
close(873)                              = -1 EBADF (Bad file descriptor)
close(874)                              = -1 EBADF (Bad file descriptor)
close(875)                              = -1 EBADF (Bad file descriptor)
close(876)                              = -1 EBADF (Bad file descriptor)
close(877)                              = -1 EBADF (Bad file descriptor)
close(878)                              = -1 EBADF (Bad file descriptor)
close(879)                              = -1 EBADF (Bad file descriptor)
close(880)                              = -1 EBADF (Bad file descriptor)
close(881)                              = -1 EBADF (Bad file descriptor)
close(882)                              = -1 EBADF (Bad file descriptor)
close(883)                              = -1 EBADF (Bad file descriptor)
close(884)                              = -1 EBADF (Bad file descriptor)
close(885)                              = -1 EBADF (Bad file descriptor)
close(886)                              = -1 EBADF (Bad file descriptor)
close(887)                              = -1 EBADF (Bad file descriptor)
close(888)                              = -1 EBADF (Bad file descriptor)
close(889)                              = -1 EBADF (Bad file descriptor)
close(890)                              = -1 EBADF (Bad file descriptor)
close(891)                              = -1 EBADF (Bad file descriptor)
close(892)                              = -1 EBADF (Bad file descriptor)
close(893)                              = -1 EBADF (Bad file descriptor)
close(894)                              = -1 EBADF (Bad file descriptor)
close(895)                              = -1 EBADF (Bad file descriptor)
close(896)                              = -1 EBADF (Bad file descriptor)
close(897)                              = -1 EBADF (Bad file descriptor)
close(898)                              = -1 EBADF (Bad file descriptor)
close(899)                              = -1 EBADF (Bad file descriptor)
close(900)                              = -1 EBADF (Bad file descriptor)
close(901)                              = -1 EBADF (Bad file descriptor)
close(902)                              = -1 EBADF (Bad file descriptor)
close(903)                              = -1 EBADF (Bad file descriptor)
close(904)                              = -1 EBADF (Bad file descriptor)
close(905)                              = -1 EBADF (Bad file descriptor)
close(906)                              = -1 EBADF (Bad file descriptor)
close(907)                              = -1 EBADF (Bad file descriptor)
close(908)                              = -1 EBADF (Bad file descriptor)
close(909)                              = -1 EBADF (Bad file descriptor)
close(910)                              = -1 EBADF (Bad file descriptor)
close(911)                              = -1 EBADF (Bad file descriptor)
close(912)                              = -1 EBADF (Bad file descriptor)
close(913)                              = -1 EBADF (Bad file descriptor)
close(914)                              = -1 EBADF (Bad file descriptor)
close(915)                              = -1 EBADF (Bad file descriptor)
close(916)                              = -1 EBADF (Bad file descriptor)
close(917)                              = -1 EBADF (Bad file descriptor)
close(918)                              = -1 EBADF (Bad file descriptor)
close(919)                              = -1 EBADF (Bad file descriptor)
close(920)                              = -1 EBADF (Bad file descriptor)
close(921)                              = -1 EBADF (Bad file descriptor)
close(922)                              = -1 EBADF (Bad file descriptor)
close(923)                              = -1 EBADF (Bad file descriptor)
close(924)                              = -1 EBADF (Bad file descriptor)
close(925)                              = -1 EBADF (Bad file descriptor)
close(926)                              = -1 EBADF (Bad file descriptor)
close(927)                              = -1 EBADF (Bad file descriptor)
close(928)                              = -1 EBADF (Bad file descriptor)
close(929)                              = -1 EBADF (Bad file descriptor)
close(930)                              = -1 EBADF (Bad file descriptor)
close(931)                              = -1 EBADF (Bad file descriptor)
close(932)                              = -1 EBADF (Bad file descriptor)
close(933)                              = -1 EBADF (Bad file descriptor)
close(934)                              = -1 EBADF (Bad file descriptor)
close(935)                              = -1 EBADF (Bad file descriptor)
close(936)                              = -1 EBADF (Bad file descriptor)
close(937)                              = -1 EBADF (Bad file descriptor)
close(938)                              = -1 EBADF (Bad file descriptor)
close(939)                              = -1 EBADF (Bad file descriptor)
close(940)                              = -1 EBADF (Bad file descriptor)
close(941)                              = -1 EBADF (Bad file descriptor)
close(942)                              = -1 EBADF (Bad file descriptor)
close(943)                              = -1 EBADF (Bad file descriptor)
close(944)                              = -1 EBADF (Bad file descriptor)
close(945)                              = -1 EBADF (Bad file descriptor)
close(946)                              = -1 EBADF (Bad file descriptor)
close(947)                              = -1 EBADF (Bad file descriptor)
close(948)                              = -1 EBADF (Bad file descriptor)
close(949)                              = -1 EBADF (Bad file descriptor)
close(950)                              = -1 EBADF (Bad file descriptor)
close(951)                              = -1 EBADF (Bad file descriptor)
close(952)                              = -1 EBADF (Bad file descriptor)
close(953)                              = -1 EBADF (Bad file descriptor)
close(954)                              = -1 EBADF (Bad file descriptor)
close(955)                              = -1 EBADF (Bad file descriptor)
close(956)                              = -1 EBADF (Bad file descriptor)
close(957)                              = -1 EBADF (Bad file descriptor)
close(958)                              = -1 EBADF (Bad file descriptor)
close(959)                              = -1 EBADF (Bad file descriptor)
close(960)                              = -1 EBADF (Bad file descriptor)
close(961)                              = -1 EBADF (Bad file descriptor)
close(962)                              = -1 EBADF (Bad file descriptor)
close(963)                              = -1 EBADF (Bad file descriptor)
close(964)                              = -1 EBADF (Bad file descriptor)
close(965)                              = -1 EBADF (Bad file descriptor)
close(966)                              = -1 EBADF (Bad file descriptor)
close(967)                              = -1 EBADF (Bad file descriptor)
close(968)                              = -1 EBADF (Bad file descriptor)
close(969)                              = -1 EBADF (Bad file descriptor)
close(970)                              = -1 EBADF (Bad file descriptor)
close(971)                              = -1 EBADF (Bad file descriptor)
close(972)                              = -1 EBADF (Bad file descriptor)
close(973)                              = -1 EBADF (Bad file descriptor)
close(974)                              = -1 EBADF (Bad file descriptor)
close(975)                              = -1 EBADF (Bad file descriptor)
close(976)                              = -1 EBADF (Bad file descriptor)
close(977)                              = -1 EBADF (Bad file descriptor)
close(978)                              = -1 EBADF (Bad file descriptor)
close(979)                              = -1 EBADF (Bad file descriptor)
close(980)                              = -1 EBADF (Bad file descriptor)
close(981)                              = -1 EBADF (Bad file descriptor)
close(982)                              = -1 EBADF (Bad file descriptor)
close(983)                              = -1 EBADF (Bad file descriptor)
close(984)                              = -1 EBADF (Bad file descriptor)
close(985)                              = -1 EBADF (Bad file descriptor)
close(986)                              = -1 EBADF (Bad file descriptor)
close(987)                              = -1 EBADF (Bad file descriptor)
close(988)                              = -1 EBADF (Bad file descriptor)
close(989)                              = -1 EBADF (Bad file descriptor)
close(990)                              = -1 EBADF (Bad file descriptor)
close(991)                              = -1 EBADF (Bad file descriptor)
close(992)                              = -1 EBADF (Bad file descriptor)
close(993)                              = -1 EBADF (Bad file descriptor)
close(994)                              = -1 EBADF (Bad file descriptor)
close(995)                              = -1 EBADF (Bad file descriptor)
close(996)                              = -1 EBADF (Bad file descriptor)
close(997)                              = -1 EBADF (Bad file descriptor)
close(998)                              = -1 EBADF (Bad file descriptor)
close(999)                              = -1 EBADF (Bad file descriptor)
close(1000)                             = -1 EBADF (Bad file descriptor)
close(1001)                             = -1 EBADF (Bad file descriptor)
close(1002)                             = -1 EBADF (Bad file descriptor)
close(1003)                             = -1 EBADF (Bad file descriptor)
close(1004)                             = -1 EBADF (Bad file descriptor)
close(1005)                             = -1 EBADF (Bad file descriptor)
close(1006)                             = -1 EBADF (Bad file descriptor)
close(1007)                             = -1 EBADF (Bad file descriptor)
close(1008)                             = -1 EBADF (Bad file descriptor)
close(1009)                             = -1 EBADF (Bad file descriptor)
close(1010)                             = -1 EBADF (Bad file descriptor)
close(1011)                             = -1 EBADF (Bad file descriptor)
close(1012)                             = -1 EBADF (Bad file descriptor)
close(1013)                             = -1 EBADF (Bad file descriptor)
close(1014)                             = -1 EBADF (Bad file descriptor)
close(1015)                             = -1 EBADF (Bad file descriptor)
close(1016)                             = -1 EBADF (Bad file descriptor)
close(1017)                             = -1 EBADF (Bad file descriptor)
close(1018)                             = -1 EBADF (Bad file descriptor)
close(1019)                             = -1 EBADF (Bad file descriptor)
close(1020)                             = -1 EBADF (Bad file descriptor)
close(1021)                             = -1 EBADF (Bad file descriptor)
close(1022)                             = -1 EBADF (Bad file descriptor)
close(1023)                             = -1 EBADF (Bad file descriptor)
open("/usr/lib/locale/locale-archive", O_RDONLY|O_LARGEFILE) = 3
fstat64(3, {st_mode=S_IFREG|0644, st_size=48541008, ...}) = 0
mmap2(NULL, 2097152, PROT_READ, MAP_PRIVATE, 3, 0) = 0xb7d73000
close(3)                                = 0
stat64("/etc/lvm", {st_mode=S_IFDIR|0755, st_size=4096, ...}) = 0
stat64("/etc/lvm/lvm.conf", {st_mode=S_IFREG|0644, st_size=13446, ...}) = 0
stat64("/etc/lvm/lvm.conf", {st_mode=S_IFREG|0644, st_size=13446, ...}) = 0
open("/etc/lvm/lvm.conf", O_RDONLY|O_LARGEFILE) = 3
mmap2(NULL, 13446, PROT_READ, MAP_PRIVATE, 3, 0) = 0xb7d6f000
munmap(0xb7d6f000, 13446)               = 0
close(3)                                = 0
time(NULL)                              = 1167849392
open("/etc/localtime", O_RDONLY)        = 3
fstat64(3, {st_mode=S_IFREG|0644, st_size=1082, ...}) = 0
fstat64(3, {st_mode=S_IFREG|0644, st_size=1082, ...}) = 0
mmap2(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0xb7d72000
read(3, "TZif\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\f\0\0\0\f\0"..., 4096) = 1082
close(3)                                = 0
munmap(0xb7d72000, 4096)                = 0
open("/usr/lib/gconv/gconv-modules.cache", O_RDONLY) = 3
fstat64(3, {st_mode=S_IFREG|0644, st_size=21544, ...}) = 0
mmap2(NULL, 21544, PROT_READ, MAP_SHARED, 3, 0) = 0xb7d6d000
close(3)                                = 0
futex(0x5f814c, FUTEX_WAKE, 2147483647) = 0
uname({sys="Linux", node="g5", ...})    = 0
umask(077)                              = 022
stat64("/proc", {st_mode=S_IFDIR|0555, st_size=0, ...}) = 0
stat64("/dev", {st_mode=S_IFDIR|0755, st_size=4800, ...}) = 0
open("/proc/mounts", O_RDONLY|O_LARGEFILE) = 3
fstat64(3, {st_mode=S_IFREG|0444, st_size=0, ...}) = 0
mmap2(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0xb7d6c000
read(3, "rootfs / rootfs rw 0 0\n/proc /pr"..., 1024) = 580
close(3)                                = 0
munmap(0xb7d6c000, 4096)                = 0
open("/proc/devices", O_RDONLY|O_LARGEFILE) = 3
fstat64(3, {st_mode=S_IFREG|0444, st_size=0, ...}) = 0
mmap2(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0xb7d6c000
read(3, "Character devices:\n  1 mem\n  4 /"..., 1024) = 377
read(3, "", 1024)                       = 0
close(3)                                = 0
munmap(0xb7d6c000, 4096)                = 0
stat64("/etc/lvm/.cache", {st_mode=S_IFREG|0644, st_size=893, ...}) = 0
stat64("/etc/lvm/.cache", {st_mode=S_IFREG|0644, st_size=893, ...}) = 0
open("/etc/lvm/.cache", O_RDONLY|O_LARGEFILE) = 3
mmap2(NULL, 893, PROT_READ, MAP_PRIVATE, 3, 0) = 0xb7d6c000
munmap(0xb7d6c000, 893)                 = 0
close(3)                                = 0
stat64("/dev/ram11", {st_mode=S_IFBLK|0660, st_rdev=makedev(1, 11), ...}) = 0
stat64("/dev/VolGroup00/LogVol01", {st_mode=S_IFBLK|0660, st_rdev=makedev(253, 0), ...}) = 0
stat64("/dev/ram10", {st_mode=S_IFBLK|0660, st_rdev=makedev(1, 10), ...}) = 0
stat64("/dev/ram", {st_mode=S_IFBLK|0660, st_rdev=makedev(1, 1), ...}) = 0
stat64("/dev/disk/by-path/pci-0000:04:02.0-scsi-0:0:0:0-part2", {st_mode=S_IFBLK|0660, st_rdev=makedev(8, 2), ...}) = 0
stat64("/dev/VolGroup00/LogVol00", {st_mode=S_IFBLK|0660, st_rdev=makedev(253, 3), ...}) = 0
stat64("/dev/ram12", {st_mode=S_IFBLK|0660, st_rdev=makedev(1, 12), ...}) = 0
stat64("/dev/ram6", {st_mode=S_IFBLK|0660, st_rdev=makedev(1, 6), ...}) = 0
stat64("/dev/VolGroup00/LogVol02", {st_mode=S_IFBLK|0660, st_rdev=makedev(253, 1), ...}) = 0
stat64("/dev/ram13", {st_mode=S_IFBLK|0660, st_rdev=makedev(1, 13), ...}) = 0
stat64("/dev/ram14", {st_mode=S_IFBLK|0660, st_rdev=makedev(1, 14), ...}) = 0
stat64("/dev/ram5", {st_mode=S_IFBLK|0660, st_rdev=makedev(1, 5), ...}) = 0
stat64("/dev/VolGroup00/LogVol03", {st_mode=S_IFBLK|0660, st_rdev=makedev(253, 2), ...}) = 0
stat64("/dev/mapper/VolGroup00-LogVol00", {st_mode=S_IFBLK|0660, st_rdev=makedev(253, 3), ...}) = 0
lstat64("/dev", {st_mode=S_IFDIR|0755, st_size=4800, ...}) = 0
lstat64("/dev", {st_mode=S_IFDIR|0755, st_size=4800, ...}) = 0
lstat64("/dev/mapper", {st_mode=S_IFDIR|0755, st_size=200, ...}) = 0
lstat64("/dev/VolGroup00", {st_mode=S_IFDIR|0700, st_size=140, ...}) = 0
lstat64("/dev/mapper/VolGroup00-LogVol00", {st_mode=S_IFBLK|0660, st_rdev=makedev(253, 3), ...}) = 0
lstat64("/dev/VolGroup00/LogVol00", {st_mode=S_IFLNK|0777, st_size=31, ...}) = 0
stat64("/dev/dm-2", {st_mode=S_IFBLK|0640, st_rdev=makedev(253, 2), ...}) = 0
stat64("/dev/ram1", {st_mode=S_IFBLK|0660, st_rdev=makedev(1, 1), ...}) = 0
lstat64("/dev", {st_mode=S_IFDIR|0755, st_size=4800, ...}) = 0
lstat64("/dev", {st_mode=S_IFDIR|0755, st_size=4800, ...}) = 0
lstat64("/dev/ram1", {st_mode=S_IFBLK|0660, st_rdev=makedev(1, 1), ...}) = 0
lstat64("/dev/ram", {st_mode=S_IFLNK|0777, st_size=4, ...}) = 0
stat64("/dev/ramdisk", {st_mode=S_IFBLK|0660, st_rdev=makedev(1, 0), ...}) = 0
stat64("/dev/mapper/VolGroup00-LogVol01", {st_mode=S_IFBLK|0660, st_rdev=makedev(253, 0), ...}) = 0
lstat64("/dev", {st_mode=S_IFDIR|0755, st_size=4800, ...}) = 0
lstat64("/dev", {st_mode=S_IFDIR|0755, st_size=4800, ...}) = 0
lstat64("/dev/mapper", {st_mode=S_IFDIR|0755, st_size=200, ...}) = 0
lstat64("/dev/VolGroup00", {st_mode=S_IFDIR|0700, st_size=140, ...}) = 0
lstat64("/dev/mapper/VolGroup00-LogVol01", {st_mode=S_IFBLK|0660, st_rdev=makedev(253, 0), ...}) = 0
lstat64("/dev/VolGroup00/LogVol01", {st_mode=S_IFLNK|0777, st_size=31, ...}) = 0
stat64("/dev/dm-3", {st_mode=S_IFBLK|0640, st_rdev=makedev(253, 3), ...}) = 0
stat64("/dev/ram0", {st_mode=S_IFBLK|0660, st_rdev=makedev(1, 0), ...}) = 0
lstat64("/dev", {st_mode=S_IFDIR|0755, st_size=4800, ...}) = 0
lstat64("/dev", {st_mode=S_IFDIR|0755, st_size=4800, ...}) = 0
lstat64("/dev/ram0", {st_mode=S_IFBLK|0660, st_rdev=makedev(1, 0), ...}) = 0
lstat64("/dev/ramdisk", {st_mode=S_IFLNK|0777, st_size=4, ...}) = 0
stat64("/dev/mapper/VolGroup00-LogVol03", {st_mode=S_IFBLK|0660, st_rdev=makedev(253, 2), ...}) = 0
stat64("/dev/root", {st_mode=S_IFBLK|0660, st_rdev=makedev(9, 0), ...}) = 0
stat64("/dev/md0", {st_mode=S_IFBLK|0660, st_rdev=makedev(9, 0), ...}) = 0
lstat64("/dev", {st_mode=S_IFDIR|0755, st_size=4800, ...}) = 0
lstat64("/dev", {st_mode=S_IFDIR|0755, st_size=4800, ...}) = 0
lstat64("/dev/md0", {st_mode=S_IFBLK|0660, st_rdev=makedev(9, 0), ...}) = 0
lstat64("/dev/root", {st_mode=S_IFLNK|0777, st_size=8, ...}) = 0
stat64("/dev/dm-1", {st_mode=S_IFBLK|0640, st_rdev=makedev(253, 1), ...}) = 0
stat64("/dev/ram2", {st_mode=S_IFBLK|0660, st_rdev=makedev(1, 2), ...}) = 0
stat64("/dev/sda2", {st_mode=S_IFBLK|0660, st_rdev=makedev(8, 2), ...}) = 0
stat64("/dev/ram8", {st_mode=S_IFBLK|0660, st_rdev=makedev(1, 8), ...}) = 0
stat64("/dev/ram9", {st_mode=S_IFBLK|0660, st_rdev=makedev(1, 9), ...}) = 0
stat64("/dev/sdb2", {st_mode=S_IFBLK|0660, st_rdev=makedev(8, 18), ...}) = 0
stat64("/dev/mapper/VolGroup00-LogVol02", {st_mode=S_IFBLK|0660, st_rdev=makedev(253, 1), ...}) = 0
stat64("/dev/disk/by-path/pci-0000:04:02.0-scsi-0:0:1:0-part2", {st_mode=S_IFBLK|0660, st_rdev=makedev(8, 18), ...}) = 0
stat64("/dev/dm-0", {st_mode=S_IFBLK|0640, st_rdev=makedev(253, 0), ...}) = 0
stat64("/dev/md1", {st_mode=S_IFBLK|0660, st_rdev=makedev(9, 1), ...}) = 0
stat64("/dev/ram15", {st_mode=S_IFBLK|0660, st_rdev=makedev(1, 15), ...}) = 0
stat64("/dev/ram3", {st_mode=S_IFBLK|0660, st_rdev=makedev(1, 3), ...}) = 0
stat64("/dev/ram4", {st_mode=S_IFBLK|0660, st_rdev=makedev(1, 4), ...}) = 0
stat64("/dev/ram7", {st_mode=S_IFBLK|0660, st_rdev=makedev(1, 7), ...}) = 0
time(NULL)                              = 1167849392
stat64("/etc/lvm/lvm.conf", {st_mode=S_IFREG|0644, st_size=13446, ...}) = 0
stat64("/var/lock/lvm", {st_mode=S_IFDIR|0700, st_size=4096, ...}) = 0
access("/var/lock/lvm", R_OK|W_OK|X_OK) = 0
stat64("/proc/lvm/VGs/VolGroup00", 0xbfea58b0) = -1 ENOENT (No such file or directory)
rt_sigprocmask(SIG_SETMASK, ~[RTMIN RT_1], [], 8) = 0
open("/var/lock/lvm/V_VolGroup00", O_RDWR|O_APPEND|O_CREAT|O_LARGEFILE, 0777) = 3
rt_sigaction(SIGINT, {0x80a5988, [INT], SA_RESTORER|SA_RESTART, 0x4f7898}, {SIG_DFL}, 8) = 0
rt_sigprocmask(SIG_SETMASK, ~[INT RTMIN RT_1], NULL, 8) = 0
rt_sigaction(SIGINT, NULL, {0x80a5988, [INT], SA_RESTORER|SA_RESTART, 0x4f7898}, 8) = 0
rt_sigaction(SIGINT, {0x80a5988, [INT], SA_RESTORER, 0x4f7898}, NULL, 8) = 0
flock(3, LOCK_EX)                       = 0
rt_sigaction(SIGINT, NULL, {0x80a5988, [INT], SA_RESTORER, 0x4f7898}, 8) = 0
rt_sigaction(SIGINT, {0x80a5988, [INT], SA_RESTORER|SA_RESTART, 0x4f7898}, NULL, 8) = 0
rt_sigprocmask(SIG_SETMASK, ~[RTMIN RT_1], NULL, 8) = 0
rt_sigaction(SIGINT, {SIG_DFL}, {0x80a5988, [INT], SA_RESTORER|SA_RESTART, 0x4f7898}, 8) = 0
stat64("/var/lock/lvm/V_VolGroup00", {st_mode=S_IFREG|0700, st_size=0, ...}) = 0
fstat64(3, {st_mode=S_IFREG|0700, st_size=0, ...}) = 0
stat64("/dev/ramdisk", {st_mode=S_IFBLK|0660, st_rdev=makedev(1, 0), ...}) = 0
stat64("/dev/ramdisk", {st_mode=S_IFBLK|0660, st_rdev=makedev(1, 0), ...}) = 0
open("/dev/ramdisk", O_RDWR|O_DIRECT|O_LARGEFILE|O_NOATIME) = -1 EINVAL (Invalid argument)
open("/dev/ramdisk", O_RDWR|O_LARGEFILE|O_NOATIME) = 4
fstat64(4, {st_mode=S_IFBLK|0660, st_rdev=makedev(1, 0), ...}) = 0
ioctl(4, BLKBSZGET, 0x9550d78)          = 0
_llseek(4, 0, [0], SEEK_SET)            = 0
read(4, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 2048) = 2048
close(4)                                = 0
stat64("/dev/root", {st_mode=S_IFBLK|0660, st_rdev=makedev(9, 0), ...}) = 0
stat64("/dev/root", {st_mode=S_IFBLK|0660, st_rdev=makedev(9, 0), ...}) = 0
open("/dev/root", O_RDWR|O_DIRECT|O_LARGEFILE|O_NOATIME) = 4
fstat64(4, {st_mode=S_IFBLK|0660, st_rdev=makedev(9, 0), ...}) = 0
ioctl(4, BLKBSZGET, 0x9550ec0)          = 0
_llseek(4, 0, [0], SEEK_SET)            = 0
read(4, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 4096) = 4096
close(4)                                = 0
stat64("/dev/dm-0", {st_mode=S_IFBLK|0640, st_rdev=makedev(253, 0), ...}) = 0
stat64("/dev/dm-0", {st_mode=S_IFBLK|0640, st_rdev=makedev(253, 0), ...}) = 0
open("/dev/dm-0", O_RDWR|O_DIRECT|O_LARGEFILE|O_NOATIME) = 4
fstat64(4, {st_mode=S_IFBLK|0640, st_rdev=makedev(253, 0), ...}) = 0
ioctl(4, BLKBSZGET, 0x9550578)          = 0
_llseek(4, 0, [0], SEEK_SET)            = 0
read(4, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 4096) = 4096
close(4)                                = 0
stat64("/dev/ram", {st_mode=S_IFBLK|0660, st_rdev=makedev(1, 1), ...}) = 0
stat64("/dev/ram", {st_mode=S_IFBLK|0660, st_rdev=makedev(1, 1), ...}) = 0
open("/dev/ram", O_RDWR|O_DIRECT|O_LARGEFILE|O_NOATIME) = -1 EINVAL (Invalid argument)
open("/dev/ram", O_RDWR|O_LARGEFILE|O_NOATIME) = 4
fstat64(4, {st_mode=S_IFBLK|0660, st_rdev=makedev(1, 1), ...}) = 0
ioctl(4, BLKBSZGET, 0x95506b8)          = 0
_llseek(4, 0, [0], SEEK_SET)            = 0
read(4, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 2048) = 2048
close(4)                                = 0
stat64("/dev/md1", {st_mode=S_IFBLK|0660, st_rdev=makedev(9, 1), ...}) = 0
stat64("/dev/md1", {st_mode=S_IFBLK|0660, st_rdev=makedev(9, 1), ...}) = 0
open("/dev/md1", O_RDWR|O_DIRECT|O_LARGEFILE|O_NOATIME) = 4
fstat64(4, {st_mode=S_IFBLK|0660, st_rdev=makedev(9, 1), ...}) = 0
ioctl(4, BLKBSZGET, 0x95512b8)          = 0
_llseek(4, 0, [0], SEEK_SET)            = 0
read(4, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 4096) = 4096
_llseek(4, 4096, [4096], SEEK_SET)      = 0
read(4, "\256\202x\212 LVM2 x[5A%r0N*>\1\0\0\0\0\20\0\0\0\0\0\0"..., 4096) = 4096
_llseek(4, 155648, [155648], SEEK_SET)  = 0
read(4, "_count = 1\t# linear\n\nstripes = ["..., 4096) = 4096
_llseek(4, 155648, [155648], SEEK_SET)  = 0
read(4, "_count = 1\t# linear\n\nstripes = ["..., 4096) = 4096
stat64("/dev/dm-1", {st_mode=S_IFBLK|0640, st_rdev=makedev(253, 1), ...}) = 0
stat64("/dev/dm-1", {st_mode=S_IFBLK|0640, st_rdev=makedev(253, 1), ...}) = 0
open("/dev/dm-1", O_RDWR|O_DIRECT|O_LARGEFILE|O_NOATIME) = 5
fstat64(5, {st_mode=S_IFBLK|0640, st_rdev=makedev(253, 1), ...}) = 0
ioctl(5, BLKBSZGET, 0x95509e8)          = 0
_llseek(5, 0, [0], SEEK_SET)            = 0
read(5, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 4096) = 4096
close(5)                                = 0
stat64("/dev/ram2", {st_mode=S_IFBLK|0660, st_rdev=makedev(1, 2), ...}) = 0
stat64("/dev/ram2", {st_mode=S_IFBLK|0660, st_rdev=makedev(1, 2), ...}) = 0
open("/dev/ram2", O_RDWR|O_DIRECT|O_LARGEFILE|O_NOATIME) = -1 EINVAL (Invalid argument)
open("/dev/ram2", O_RDWR|O_LARGEFILE|O_NOATIME) = 5
fstat64(5, {st_mode=S_IFBLK|0660, st_rdev=makedev(1, 2), ...}) = 0
ioctl(5, BLKBSZGET, 0x9550f98)          = 0
_llseek(5, 0, [0], SEEK_SET)            = 0
read(5, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 2048) = 2048
close(5)                                = 0
stat64("/dev/sda2", {st_mode=S_IFBLK|0660, st_rdev=makedev(8, 2), ...}) = 0
stat64("/dev/sda2", {st_mode=S_IFBLK|0660, st_rdev=makedev(8, 2), ...}) = 0
open("/dev/sda2", O_RDWR|O_DIRECT|O_LARGEFILE|O_NOATIME) = 5
fstat64(5, {st_mode=S_IFBLK|0660, st_rdev=makedev(8, 2), ...}) = 0
ioctl(5, BLKBSZGET, 0x9550750)          = 0
_llseek(5, 0, [0], SEEK_SET)            = 0
read(5, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 4096) = 4096
close(5)                                = 0
stat64("/dev/dm-2", {st_mode=S_IFBLK|0640, st_rdev=makedev(253, 2), ...}) = 0
stat64("/dev/dm-2", {st_mode=S_IFBLK|0640, st_rdev=makedev(253, 2), ...}) = 0
open("/dev/dm-2", O_RDWR|O_DIRECT|O_LARGEFILE|O_NOATIME) = 5
fstat64(5, {st_mode=S_IFBLK|0640, st_rdev=makedev(253, 2), ...}) = 0
ioctl(5, BLKBSZGET, 0x9550c58)          = 0
_llseek(5, 0, [0], SEEK_SET)            = 0
read(5, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 4096) = 4096
close(5)                                = 0
stat64("/dev/ram3", {st_mode=S_IFBLK|0660, st_rdev=makedev(1, 3), ...}) = 0
stat64("/dev/ram3", {st_mode=S_IFBLK|0660, st_rdev=makedev(1, 3), ...}) = 0
open("/dev/ram3", O_RDWR|O_DIRECT|O_LARGEFILE|O_NOATIME) = -1 EINVAL (Invalid argument)
open("/dev/ram3", O_RDWR|O_LARGEFILE|O_NOATIME) = 5
fstat64(5, {st_mode=S_IFBLK|0660, st_rdev=makedev(1, 3), ...}) = 0
ioctl(5, BLKBSZGET, 0x95513e8)          = 0
_llseek(5, 0, [0], SEEK_SET)            = 0
read(5, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 2048) = 2048
close(5)                                = 0
stat64("/dev/dm-3", {st_mode=S_IFBLK|0640, st_rdev=makedev(253, 3), ...}) = 0
stat64("/dev/dm-3", {st_mode=S_IFBLK|0640, st_rdev=makedev(253, 3), ...}) = 0
open("/dev/dm-3", O_RDWR|O_DIRECT|O_LARGEFILE|O_NOATIME) = 5
fstat64(5, {st_mode=S_IFBLK|0640, st_rdev=makedev(253, 3), ...}) = 0
ioctl(5, BLKBSZGET, 0x9550810)          = 0
_llseek(5, 0, [0], SEEK_SET)            = 0
read(5, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 4096) = 4096
close(5)                                = 0
stat64("/dev/ram4", {st_mode=S_IFBLK|0660, st_rdev=makedev(1, 4), ...}) = 0
stat64("/dev/ram4", {st_mode=S_IFBLK|0660, st_rdev=makedev(1, 4), ...}) = 0
open("/dev/ram4", O_RDWR|O_DIRECT|O_LARGEFILE|O_NOATIME) = -1 EINVAL (Invalid argument)
open("/dev/ram4", O_RDWR|O_LARGEFILE|O_NOATIME) = 5
fstat64(5, {st_mode=S_IFBLK|0660, st_rdev=makedev(1, 4), ...}) = 0
ioctl(5, BLKBSZGET, 0x9551480)          = 0
_llseek(5, 0, [0], SEEK_SET)            = 0
read(5, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 2048) = 2048
close(5)                                = 0
stat64("/dev/ram5", {st_mode=S_IFBLK|0660, st_rdev=makedev(1, 5), ...}) = 0
stat64("/dev/ram5", {st_mode=S_IFBLK|0660, st_rdev=makedev(1, 5), ...}) = 0
open("/dev/ram5", O_RDWR|O_DIRECT|O_LARGEFILE|O_NOATIME) = -1 EINVAL (Invalid argument)
open("/dev/ram5", O_RDWR|O_LARGEFILE|O_NOATIME) = 5
fstat64(5, {st_mode=S_IFBLK|0660, st_rdev=makedev(1, 5), ...}) = 0
ioctl(5, BLKBSZGET, 0x9550bc0)          = 0
_llseek(5, 0, [0], SEEK_SET)            = 0
read(5, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 2048) = 2048
close(5)                                = 0
stat64("/dev/ram6", {st_mode=S_IFBLK|0660, st_rdev=makedev(1, 6), ...}) = 0
stat64("/dev/ram6", {st_mode=S_IFBLK|0660, st_rdev=makedev(1, 6), ...}) = 0
open("/dev/ram6", O_RDWR|O_DIRECT|O_LARGEFILE|O_NOATIME) = -1 EINVAL (Invalid argument)
open("/dev/ram6", O_RDWR|O_LARGEFILE|O_NOATIME) = 5
fstat64(5, {st_mode=S_IFBLK|0660, st_rdev=makedev(1, 6), ...}) = 0
ioctl(5, BLKBSZGET, 0x9550950)          = 0
_llseek(5, 0, [0], SEEK_SET)            = 0
read(5, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 2048) = 2048
close(5)                                = 0
stat64("/dev/ram7", {st_mode=S_IFBLK|0660, st_rdev=makedev(1, 7), ...}) = 0
stat64("/dev/ram7", {st_mode=S_IFBLK|0660, st_rdev=makedev(1, 7), ...}) = 0
open("/dev/ram7", O_RDWR|O_DIRECT|O_LARGEFILE|O_NOATIME) = -1 EINVAL (Invalid argument)
open("/dev/ram7", O_RDWR|O_LARGEFILE|O_NOATIME) = 5
fstat64(5, {st_mode=S_IFBLK|0660, st_rdev=makedev(1, 7), ...}) = 0
ioctl(5, BLKBSZGET, 0x9551518)          = 0
_llseek(5, 0, [0], SEEK_SET)            = 0
read(5, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 2048) = 2048
close(5)                                = 0
stat64("/dev/ram8", {st_mode=S_IFBLK|0660, st_rdev=makedev(1, 8), ...}) = 0
stat64("/dev/ram8", {st_mode=S_IFBLK|0660, st_rdev=makedev(1, 8), ...}) = 0
open("/dev/ram8", O_RDWR|O_DIRECT|O_LARGEFILE|O_NOATIME) = -1 EINVAL (Invalid argument)
open("/dev/ram8", O_RDWR|O_LARGEFILE|O_NOATIME) = 5
fstat64(5, {st_mode=S_IFBLK|0660, st_rdev=makedev(1, 8), ...}) = 0
ioctl(5, BLKBSZGET, 0x9551050)          = 0
_llseek(5, 0, [0], SEEK_SET)            = 0
read(5, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 2048) = 2048
close(5)                                = 0
stat64("/dev/ram9", {st_mode=S_IFBLK|0660, st_rdev=makedev(1, 9), ...}) = 0
stat64("/dev/ram9", {st_mode=S_IFBLK|0660, st_rdev=makedev(1, 9), ...}) = 0
open("/dev/ram9", O_RDWR|O_DIRECT|O_LARGEFILE|O_NOATIME) = -1 EINVAL (Invalid argument)
open("/dev/ram9", O_RDWR|O_LARGEFILE|O_NOATIME) = 5
fstat64(5, {st_mode=S_IFBLK|0660, st_rdev=makedev(1, 9), ...}) = 0
ioctl(5, BLKBSZGET, 0x95510e8)          = 0
_llseek(5, 0, [0], SEEK_SET)            = 0
read(5, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 2048) = 2048
close(5)                                = 0
stat64("/dev/ram10", {st_mode=S_IFBLK|0660, st_rdev=makedev(1, 10), ...}) = 0
stat64("/dev/ram10", {st_mode=S_IFBLK|0660, st_rdev=makedev(1, 10), ...}) = 0
open("/dev/ram10", O_RDWR|O_DIRECT|O_LARGEFILE|O_NOATIME) = -1 EINVAL (Invalid argument)
open("/dev/ram10", O_RDWR|O_LARGEFILE|O_NOATIME) = 5
fstat64(5, {st_mode=S_IFBLK|0660, st_rdev=makedev(1, 10), ...}) = 0
ioctl(5, BLKBSZGET, 0x9550620)          = 0
_llseek(5, 0, [0], SEEK_SET)            = 0
read(5, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 2048) = 2048
close(5)                                = 0
stat64("/dev/ram11", {st_mode=S_IFBLK|0660, st_rdev=makedev(1, 11), ...}) = 0
stat64("/dev/ram11", {st_mode=S_IFBLK|0660, st_rdev=makedev(1, 11), ...}) = 0
open("/dev/ram11", O_RDWR|O_DIRECT|O_LARGEFILE|O_NOATIME) = -1 EINVAL (Invalid argument)
open("/dev/ram11", O_RDWR|O_LARGEFILE|O_NOATIME) = 5
fstat64(5, {st_mode=S_IFBLK|0660, st_rdev=makedev(1, 11), ...}) = 0
ioctl(5, BLKBSZGET, 0x95504e0)          = 0
_llseek(5, 0, [0], SEEK_SET)            = 0
read(5, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 2048) = 2048
close(5)                                = 0
stat64("/dev/ram12", {st_mode=S_IFBLK|0660, st_rdev=makedev(1, 12), ...}) = 0
stat64("/dev/ram12", {st_mode=S_IFBLK|0660, st_rdev=makedev(1, 12), ...}) = 0
open("/dev/ram12", O_RDWR|O_DIRECT|O_LARGEFILE|O_NOATIME) = -1 EINVAL (Invalid argument)
open("/dev/ram12", O_RDWR|O_LARGEFILE|O_NOATIME) = 5
fstat64(5, {st_mode=S_IFBLK|0660, st_rdev=makedev(1, 12), ...}) = 0
ioctl(5, BLKBSZGET, 0x95508b8)          = 0
_llseek(5, 0, [0], SEEK_SET)            = 0
read(5, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 2048) = 2048
close(5)                                = 0
stat64("/dev/ram13", {st_mode=S_IFBLK|0660, st_rdev=makedev(1, 13), ...}) = 0
stat64("/dev/ram13", {st_mode=S_IFBLK|0660, st_rdev=makedev(1, 13), ...}) = 0
open("/dev/ram13", O_RDWR|O_DIRECT|O_LARGEFILE|O_NOATIME) = -1 EINVAL (Invalid argument)
open("/dev/ram13", O_RDWR|O_LARGEFILE|O_NOATIME) = 5
fstat64(5, {st_mode=S_IFBLK|0660, st_rdev=makedev(1, 13), ...}) = 0
ioctl(5, BLKBSZGET, 0x9550a90)          = 0
_llseek(5, 0, [0], SEEK_SET)            = 0
read(5, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 2048) = 2048
close(5)                                = 0
stat64("/dev/ram14", {st_mode=S_IFBLK|0660, st_rdev=makedev(1, 14), ...}) = 0
stat64("/dev/ram14", {st_mode=S_IFBLK|0660, st_rdev=makedev(1, 14), ...}) = 0
open("/dev/ram14", O_RDWR|O_DIRECT|O_LARGEFILE|O_NOATIME) = -1 EINVAL (Invalid argument)
open("/dev/ram14", O_RDWR|O_LARGEFILE|O_NOATIME) = 5
fstat64(5, {st_mode=S_IFBLK|0660, st_rdev=makedev(1, 14), ...}) = 0
ioctl(5, BLKBSZGET, 0x9550b28)          = 0
_llseek(5, 0, [0], SEEK_SET)            = 0
read(5, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 2048) = 2048
close(5)                                = 0
stat64("/dev/ram15", {st_mode=S_IFBLK|0660, st_rdev=makedev(1, 15), ...}) = 0
stat64("/dev/ram15", {st_mode=S_IFBLK|0660, st_rdev=makedev(1, 15), ...}) = 0
open("/dev/ram15", O_RDWR|O_DIRECT|O_LARGEFILE|O_NOATIME) = -1 EINVAL (Invalid argument)
open("/dev/ram15", O_RDWR|O_LARGEFILE|O_NOATIME) = 5
fstat64(5, {st_mode=S_IFBLK|0660, st_rdev=makedev(1, 15), ...}) = 0
ioctl(5, BLKBSZGET, 0x9551350)          = 0
_llseek(5, 0, [0], SEEK_SET)            = 0
read(5, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 2048) = 2048
close(5)                                = 0
stat64("/dev/sdb2", {st_mode=S_IFBLK|0660, st_rdev=makedev(8, 18), ...}) = 0
stat64("/dev/sdb2", {st_mode=S_IFBLK|0660, st_rdev=makedev(8, 18), ...}) = 0
open("/dev/sdb2", O_RDWR|O_DIRECT|O_LARGEFILE|O_NOATIME) = 5
fstat64(5, {st_mode=S_IFBLK|0660, st_rdev=makedev(8, 18), ...}) = 0
ioctl(5, BLKBSZGET, 0x9551180)          = 0
_llseek(5, 0, [0], SEEK_SET)            = 0
read(5, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 4096) = 4096
close(5)                                = 0
_llseek(4, 0, [0], SEEK_SET)            = 0
read(4, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 4096) = 4096
_llseek(4, 4096, [4096], SEEK_SET)      = 0
read(4, "\256\202x\212 LVM2 x[5A%r0N*>\1\0\0\0\0\20\0\0\0\0\0\0"..., 4096) = 4096
_llseek(4, 155648, [155648], SEEK_SET)  = 0
read(4, "_count = 1\t# linear\n\nstripes = ["..., 4096) = 4096
_llseek(4, 155648, [155648], SEEK_SET)  = 0
read(4, "_count = 1\t# linear\n\nstripes = ["..., 4096) = 4096
_llseek(4, 4096, [4096], SEEK_SET)      = 0
read(4, "\256\202x\212 LVM2 x[5A%r0N*>\1\0\0\0\0\20\0\0\0\0\0\0"..., 4096) = 4096
_llseek(4, 155648, [155648], SEEK_SET)  = 0
read(4, "_count = 1\t# linear\n\nstripes = ["..., 4096) = 4096
_llseek(4, 155648, [155648], SEEK_SET)  = 0
read(4, "_count = 1\t# linear\n\nstripes = ["..., 4096) = 4096
_llseek(4, 0, [0], SEEK_SET)            = 0
read(4, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 4096) = 4096
_llseek(4, 4096, [4096], SEEK_SET)      = 0
read(4, "\256\202x\212 LVM2 x[5A%r0N*>\1\0\0\0\0\20\0\0\0\0\0\0"..., 4096) = 4096
_llseek(4, 155648, [155648], SEEK_SET)  = 0
read(4, "_count = 1\t# linear\n\nstripes = ["..., 4096) = 4096
brk(0x9586000)                          = 0x9586000
_llseek(4, 155648, [155648], SEEK_SET)  = 0
read(4, "_count = 1\t# linear\n\nstripes = ["..., 4096) = 4096
brk(0x9582000)                          = 0x9582000
brk(0x957e000)                          = 0x957e000
open("/proc/devices", O_RDONLY|O_LARGEFILE) = 5
fstat64(5, {st_mode=S_IFREG|0444, st_size=0, ...}) = 0
mmap2(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0xb7d6c000
read(5, "Character devices:\n  1 mem\n  4 /"..., 1024) = 377
close(5)                                = 0
munmap(0xb7d6c000, 4096)                = 0
open("/proc/misc", O_RDONLY|O_LARGEFILE) = 5
fstat64(5, {st_mode=S_IFREG|0444, st_size=0, ...}) = 0
mmap2(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0xb7d6c000
read(5, " 63 device-mapper\n135 rtc\n", 1024) = 26
close(5)                                = 0
munmap(0xb7d6c000, 4096)                = 0
stat64("/dev/mapper/control", {st_mode=S_IFCHR|0600, st_rdev=makedev(10, 63), ...}) = 0
open("/dev/mapper/control", O_RDWR|O_LARGEFILE) = 5
open("/proc/devices", O_RDONLY|O_LARGEFILE) = 6
fstat64(6, {st_mode=S_IFREG|0444, st_size=0, ...}) = 0
mmap2(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0xb7d6c000
read(6, "Character devices:\n  1 mem\n  4 /"..., 1024) = 377
read(6, "", 1024)                       = 0
close(6)                                = 0
munmap(0xb7d6c000, 4096)                = 0
ioctl(5, DM_VERSION, 0x955d7b0)         = 0
ioctl(5, DM_DEV_STATUS, 0x955d7b0)      = 0
fstat64(1, {st_mode=S_IFCHR|0620, st_rdev=makedev(136, 2), ...}) = 0
mmap2(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0xb7d6c000
fstat64(0, {st_mode=S_IFCHR|0620, st_rdev=makedev(136, 2), ...}) = 0
mmap2(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0xb7d6b000
write(1, "Do you really want to remove act"..., 70) = 70
read(0, "y\n", 1024)                    = 2
stat64("/etc/lvm/archive", {st_mode=S_IFDIR|0755, st_size=4096, ...}) = 0
access("/etc/lvm/archive", R_OK|W_OK|X_OK) = 0
uname({sys="Linux", node="g5", ...})    = 0
open("/etc/lvm/archive/.lvm_g5_20890_608694199", O_WRONLY|O_APPEND|O_CREAT|O_EXCL|O_LARGEFILE, 0666) = 6
fcntl64(6, F_SETLK64, {type=F_WRLCK, whence=SEEK_SET, start=0, len=0}, 0xbfea3790) = 0
fcntl64(6, F_GETFL)                     = 0x8401 (flags O_WRONLY|O_APPEND|O_LARGEFILE)
fstat64(6, {st_mode=S_IFREG|0600, st_size=0, ...}) = 0
mmap2(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0xb7d6a000
_llseek(6, 0, [0], SEEK_CUR)            = 0
uname({sys="Linux", node="g5", ...})    = 0
time(NULL)                              = 1167849396
write(6, "# Generated by LVM2: Wed Jan  3 "..., 2544) = 2544
close(6)                                = 0
munmap(0xb7d6a000, 4096)                = 0
open("/etc/lvm/archive", O_RDONLY|O_NONBLOCK|O_LARGEFILE|O_DIRECTORY) = 6
fstat64(6, {st_mode=S_IFDIR|0755, st_size=4096, ...}) = 0
fcntl64(6, F_SETFD, FD_CLOEXEC)         = 0
getdents64(6, /* 102 entries */, 4096)  = 4064
getdents64(6, /* 38 entries */, 4096)   = 1512
getdents64(6, /* 0 entries */, 4096)    = 0
close(6)                                = 0
link("/etc/lvm/archive/.lvm_g5_20890_608694199", "/etc/lvm/archive/VolGroup00_00169.vg") = 0
stat64("/etc/lvm/archive/.lvm_g5_20890_608694199", {st_mode=S_IFREG|0600, st_size=2544, ...}) = 0
unlink("/etc/lvm/archive/.lvm_g5_20890_608694199") = 0
time(NULL)                              = 1167849396
stat64("/etc/lvm/archive/VolGroup00_00032.vg", {st_mode=S_IFREG|0600, st_size=3144, ...}) = 0
_llseek(4, 0, [0], SEEK_SET)            = 0
read(4, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 4096) = 4096
_llseek(4, 4096, [4096], SEEK_SET)      = 0
read(4, "\256\202x\212 LVM2 x[5A%r0N*>\1\0\0\0\0\20\0\0\0\0\0\0"..., 4096) = 4096
_llseek(4, 155648, [155648], SEEK_SET)  = 0
read(4, "_count = 1\t# linear\n\nstripes = ["..., 4096) = 4096
_llseek(4, 155648, [155648], SEEK_SET)  = 0
read(4, "_count = 1\t# linear\n\nstripes = ["..., 4096) = 4096
_llseek(4, 4096, [4096], SEEK_SET)      = 0
read(4, "\256\202x\212 LVM2 x[5A%r0N*>\1\0\0\0\0\20\0\0\0\0\0\0"..., 4096) = 4096
_llseek(4, 155648, [155648], SEEK_SET)  = 0
read(4, "_count = 1\t# linear\n\nstripes = ["..., 4096) = 4096
_llseek(4, 155648, [155648], SEEK_SET)  = 0
read(4, "_count = 1\t# linear\n\nstripes = ["..., 4096) = 4096
_llseek(4, 0, [0], SEEK_SET)            = 0
read(4, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 4096) = 4096
_llseek(4, 4096, [4096], SEEK_SET)      = 0
read(4, "\256\202x\212 LVM2 x[5A%r0N*>\1\0\0\0\0\20\0\0\0\0\0\0"..., 4096) = 4096
_llseek(4, 155648, [155648], SEEK_SET)  = 0
read(4, "_count = 1\t# linear\n\nstripes = ["..., 4096) = 4096
_llseek(4, 155648, [155648], SEEK_SET)  = 0
read(4, "_count = 1\t# linear\n\nstripes = ["..., 4096) = 4096
ioctl(5, DM_DEV_STATUS, 0x9562218)      = 0
mlockall(MCL_CURRENT|MCL_FUTURE)        = 0
brk(0x9d83000)                          = 0x9d83000
brk(0x9f6b000)                          = 0x9f6b000
getpriority(PRIO_PROCESS, 0)            = 20
setpriority(PRIO_PROCESS, 0, -18)       = 0
ioctl(5, DM_DEV_STATUS, 0x956a220)      = 0
ioctl(5, DM_TABLE_DEPS, 0x956a220)      = 0
ioctl(5, DM_TABLE_DEPS, 0x956e228)      = 0
ioctl(5, DM_TABLE_DEPS, 0x956e228)      = 0
ioctl(5, DM_DEV_STATUS, 0x956a220)      = -1 ENXIO (No such device or address)
ioctl(5, DM_DEV_STATUS, 0x956a220)      = -1 ENXIO (No such device or address)
ioctl(5, DM_DEV_STATUS, 0x956a220)      = -1 ENXIO (No such device or address)
ioctl(5, DM_DEV_STATUS, 0x956a220)      = 0
ioctl(5, DM_DEV_STATUS, 0x956a220)      = -1 ENXIO (No such device or address)
ioctl(5, DM_DEV_STATUS, 0x956a220)      = -1 ENXIO (No such device or address)
ioctl(5, DM_DEV_STATUS, 0x956a220)      = -1 ENXIO (No such device or address)
ioctl(5, DM_DEV_STATUS, 0x956a220)      = 0
ioctl(5, DM_DEV_REMOVE
lvremove-strace-beforecrash.txt (110,552 bytes)   
Antoine Brenner

Antoine Brenner

2007-01-04 09:47

reporter   ~0004320

I removed the 'snaphome' snapshot this morning (when almost no mail activitiy had taken place) without any problems.
This really looks related to the amount of changes on the volume.
JohnnyHughes

JohnnyHughes

2007-01-04 11:58

administrator   ~0004324

I use the -f option as well for the same reason in scripts ... I am not using LVM on top of software RAID though.

This could well be a real bug ... the snapshot functionality did not really work well until about the 4.3 release cycle.

Does this look like the bug:
https://bugzilla.redhat.com/bugzilla/show_bug.cgi?id=204791

If so,
we have 2 versions of test kernels that might fix it here (newer than 2.6.9-42.21 when upstream fix was rolled in):

http://dev.centos.org/centos/4/testing/i386/RPMS/
JohnnyHughes

JohnnyHughes

2007-01-04 11:59

administrator   ~0004325

NOTE: test kernels are TEST :P

They may eat small children and breathe fire ... yada yada yada :P
JohnnyHughes

JohnnyHughes

2007-01-04 12:09

administrator   ~0004326

Last edited: 2007-01-04 12:10

https://bugzilla.redhat.com/bugzilla/show_bug.cgi?id=180285

(the second set of panics from there look very close to your scenario)

Our 2.6.9-42.35 kernel might fix that ...

JohnnyHughes

JohnnyHughes

2007-01-04 12:29

administrator   ~0004327

I am currently building the 42.37 kernel as the .36 patch added much that might be relevant to dm devices ....
Antoine Brenner

Antoine Brenner

2007-01-04 13:49

reporter   ~0004328

Thanks for the information. I'll try the 42.37 kernel.

For my information, can you tell me where you grab your patches from ?

Regards,
Antoine
JohnnyHughes

JohnnyHughes

2007-01-05 07:39

administrator   ~0004330

yes ... sorry :)

http://people.redhat.com/~jbaron/rhel4/

That is where the RHEL4 test kernels live before they are distributed in updates ... obviously not all kernels get released.

Also, some of these have broken stuff that subsequently gets removed.

We take those and do the standard CentOS things to the SRPMS (make the module key say centos and not RHEL, etc.) and build distribute in our test repo.
JohnnyHughes

JohnnyHughes

2007-01-05 11:10

administrator   ~0004331

OK ... the 2.6.9-42.37 kernel is built and in the testing repository.
Antoine Brenner

Antoine Brenner

2007-01-05 18:12

reporter   ~0004332

Thanks.

I am now running this kernel (I hate to do this on a production server, but I have no spare server with an identical configuration...)

$ uname -a
Linux g5 2.6.9-42.37.EL.c4test #1 Thu Jan 4 07:55:37 EST 2007 i686 i686 i386 GNU/Linux

I could create the snapshots and remove them all right within a minute. Now let's wait and see if I get the panic again...

Many thanks,
Antoine
greg

greg

2007-05-15 12:26

reporter   ~0005173

Last edited: 2007-05-15 12:27

I've just stumbled onto this issue. In my case a snapshot volume of /var was created and inadvertently never removed. The snapshot was correctly made inactive when the COW reached capacity. I unmounted the snapshot and got a kernel panic when I attempted to lvremove the volume.

On reboot the volume was still there but I was able to lvremove it correctly. This seems to reflect the issue here of the kernel panic being related to a large number of changes to the underlying volume. In this case, lvm is used on top of a software (md) raid 1 mirror, as the original poster.

Is this issue fixed by the mentioned patch? Does it make it into the next errata?

greg

greg

2007-05-15 12:36

reporter   ~0005174

For the record, here is my panic log.

May 15 09:07:14 mailr-w kernel: Buffer I/O error on device dm-7, logical block 0
May 15 09:07:14 mailr-w kernel: lost page write due to I/O error on dm-7
May 15 09:07:30 mailr-w kernel: cdrom: open failed.
May 15 09:07:34 mailr-w sshd(pam_unix)[20026]: session opened for user nagios by (uid=0)
May 15 09:07:35 mailr-w sshd(pam_unix)[20026]: session closed for user nagios
May 15 09:07:38 mailr-w kernel: cdrom: open failed.
May 15 09:07:40 mailr-w kernel: Unable to handle kernel paging request at virtual address 2e303532
May 15 09:07:40 mailr-w kernel: printing eip:
May 15 09:07:40 mailr-w kernel: f887f2b5
May 15 09:07:40 mailr-w kernel: *pde = 2a935001
May 15 09:07:40 mailr-w kernel: Oops: 0000 [#1]
May 15 09:07:40 mailr-w kernel: SMP
May 15 09:07:40 mailr-w kernel: Modules linked in: ipmi_devintf vfat fat parport_pc lp parport autofs4 i2c_dev i2c_core sunrpc md5 ipv6 ipmi_poweroff ipmi_si ipmi_msghandler button battery ac uhci_hcd hw_random e1000 floppy sg dm_snapshot dm_zero dm_mirror ext3 jbd raid1 dm_mod aic79xx sd_mod scsi_mod
May 15 09:07:40 mailr-w kernel: CPU: 1
May 15 09:07:40 mailr-w kernel: EIP: 0060:[<f887f2b5>] Not tainted VLI
May 15 09:07:40 mailr-w kernel: EFLAGS: 00010203 (2.6.9-42.0.10.ELsmp)
May 15 09:07:40 mailr-w kernel: EIP is at exit_exception_table+0x2b/0x56 [dm_snapshot]
May 15 09:07:40 mailr-w kernel: eax: 00000000 ebx: f8a6b000 ecx: f70add80 edx: 2e303532
May 15 09:07:40 mailr-w kernel: esi: f7e417d0 edi: 2e303532 ebp: 00000000 esp: da840f1c
May 15 09:07:40 mailr-w kernel: ds: 007b es: 007b ss: 0068
May 15 09:07:40 mailr-w kernel: Process lvremove (pid: 20055, threadinfo=da840000 task=d839e930)
May 15 09:07:40 mailr-w kernel: Stack: 00000000 00002000 f70add80 f7e41780 f8a69080 00000000 00000000 f887f7af
May 15 09:07:41 mailr-w kernel: f8a69080 f6c6c580 f885cb6d f6c6c780 f6c6c580 f8868240 0812f6c8 f885c190
May 15 09:07:41 mailr-w kernel: f6c6c780 f8a62000 f885ec76 00000004 00000000 da840000 f885ff16 f8a62000
May 15 09:07:42 mailr-w kernel: Call Trace:
May 15 09:07:43 mailr-w kernel: [<f887f7af>] snapshot_dtr+0x27/0x58 [dm_snapshot]
May 15 09:07:43 mailr-w kernel: [<f885cb6d>] table_destroy+0x39/0x83 [dm_mod]
May 15 09:07:43 mailr-w kernel: [<f885c190>] dm_put+0x7b/0x87 [dm_mod]
May 15 09:07:43 mailr-w kernel: [<f885ec76>] dev_remove+0xc2/0xcf [dm_mod]
May 15 09:07:43 mailr-w kernel: [<f885ff16>] ctl_ioctl+0xd9/0x13c [dm_mod]
May 15 09:07:43 mailr-w kernel: [<f885ebb4>] dev_remove+0x0/0xcf [dm_mod]
May 15 09:07:43 mailr-w kernel: [<c016ada2>] sys_ioctl+0x227/0x269
May 15 09:07:43 mailr-w kernel: [<c02d4903>] syscall_call+0x7/0xb
May 15 09:07:43 mailr-w kernel: Code: 55 31 ed 57 56 89 c6 53 83 ec 0c 89 54 24 08 8b 00 40 89 44 24 04 39 c5 7d 2d c7 04 24 00 00 00 00 8b 1c 24 03 5e 04 8b 13 39 da <8b> 3a 74 0d 8b 44 24 08 e8 72 8c 8c c7 89 fa eb ed 83 04 24 08
NeoGenesis

NeoGenesis

2007-06-18 11:14

reporter   ~0005423

Hey,

I have never used snapshots with LVM, but it looks to me that you have some process accessing the LV while you are removing it forcibly...

For debugging purposes could you add this snippet before the unmount and lvremove command and really see if there are no open file handles to the LV or the mountpoint:

fuser -av /<the mount point>

Issue History

Date Modified Username Field Change
2006-12-31 16:49 Antoine Brenner New Issue
2006-12-31 16:49 Antoine Brenner Status new => assigned
2007-01-01 03:32 pyxel Note Added: 0004298
2007-01-01 16:47 JohnnyHughes Note Added: 0004301
2007-01-02 19:21 Antoine Brenner Note Added: 0004309
2007-01-02 19:26 Antoine Brenner File Added: unmount-snap.sh
2007-01-02 19:32 Antoine Brenner Note Added: 0004310
2007-01-02 19:55 Antoine Brenner Note Added: 0004312
2007-01-03 19:13 Antoine Brenner Note Added: 0004315
2007-01-03 19:14 Antoine Brenner Note Edited: 0004315
2007-01-03 19:15 Antoine Brenner File Added: lvremove-strace-beforecrash.txt
2007-01-04 09:47 Antoine Brenner Note Added: 0004320
2007-01-04 11:58 JohnnyHughes Note Added: 0004324
2007-01-04 11:59 JohnnyHughes Note Added: 0004325
2007-01-04 12:09 JohnnyHughes Note Added: 0004326
2007-01-04 12:10 JohnnyHughes Note Edited: 0004326
2007-01-04 12:29 JohnnyHughes Note Added: 0004327
2007-01-04 13:49 Antoine Brenner Note Added: 0004328
2007-01-05 07:39 JohnnyHughes Note Added: 0004330
2007-01-05 11:10 JohnnyHughes Note Added: 0004331
2007-01-05 18:12 Antoine Brenner Note Added: 0004332
2007-05-15 12:26 greg Note Added: 0005173
2007-05-15 12:27 greg Note Edited: 0005173
2007-05-15 12:36 greg Note Added: 0005174
2007-06-18 11:14 NeoGenesis Note Added: 0005423