inode aliases, inode count wrapped and kernel paging request/iput problems
I've been seeing inode aliases, inode count wrapped and
kernel paging request/iput problems lately and I'm not even sure
what an inode is but these problems often lock the system up.
These are excerpted from logs so you can see symptoms at least.
Any explainations or suggestions would be appreciated.
This is a Woody system on /dev/hdc8
Linux playground 2.2.20-idepci #1 Sat Apr 20 12:45:19 EST 2002 i586 unknown
These clipped from dmesg:
CPU: Intel Pentium MMX stepping 03
Memory: 257652k/262144k available
hda: WDC AC24300L, 4112MB w/256kB Cache, CHS=524/255/63
hdc: WDC WD400BB-00CAA0, 38166MB w/2048kB Cache, CHS=4865/255/63
hdb: ATAPI 52X CD-ROM CD-R/RW drive, 2048kB Cache
Adding Swap: 2048276k swap-space (priority -1)
swap was a smaller partition at the end of the drive
but I moved it after the crash on Dec. 7 thinking that might be the problem
The only thing I know of that's happening at 3Am is 'secure' a security script
of mine running out of /etc/crontab, it's been running nightly since 2004.
/etc/cron.d/anacron runs at 03:30
from /var/log/syslog: 132 like this
Dec 24 03:35-46:xx playground kernel: \
iput: device {00:00,16:0{1-5,7-a,c} inode xxxxxx still has aliases!
from /var/log/kern.log:
Dec 23 03:35:06 playground kernel: eth0: Setting promiscuous mode.
Dec 23 03:35:06 playground kernel: device eth0 entered promiscuous mode
Dec 23 03:40:16 playground kernel: iput: inode 00:00/0 count wrapped
Dec 23 06:49:01 playground kernel: VFS: Busy inodes after unmount.
Self-destruct in 5 seconds. Have a nice day...
from /var/log/syslog.0:
Dec 23 03:35:09 playground snort: Snort initialization completed successfully
Snort running
Dec 23 03:38:02 playground /USR/SBIN/CRON[7772]: (mail) CMD
( if [ -x /usr/sbin/exim -a -f /etc/exim/exim.conf ];
then /usr/sbin/exim -q ; fi)
Dec 23 03:40:16 playground kernel: iput: inode 00:00/0 count wrapped
from /var/log/kern.log half hour after secure ran
Dec 19 03:37:43 playground kernel: Unable to handle kernel NULL pointer dereference at virtual address 00000020
Dec 19 03:37:43 playground kernel: current->tss.cr3 = 0d4dd000, %%cr3 = 0d4dd000
Dec 19 03:37:43 playground kernel: *pde = 00000000
Dec 19 03:37:43 playground kernel: Oops: 0000
Dec 19 03:37:43 playground kernel: CPU: 0
Dec 19 03:37:43 playground kernel: EIP: 0010:[iput+24/488]
Dec 19 03:37:43 playground kernel: EFLAGS: 00010202
Dec 19 03:37:43 playground kernel: eax: 00000008 ebx: 00000000 ecx: cd379708 edx: cdffbbc8
Dec 19 03:37:43 playground kernel: esi: cdb796f8 edi: cdffbb90 ebp: 00000000 esp: ccadfe68
Dec 19 03:37:43 playground kernel: ds: 0018 es: 0018 ss: 0018
Dec 19 03:37:43 playground kernel: Process find (pid: 6593, process nr: 23, stackpage=ccadf000)
Dec 19 03:37:43 playground kernel: Stack: cdffbb90 c0132f36 cdb796f8 ccadfeac 00038c83 00001004 cf6ab600 00001004
Dec 19 03:37:43 playground kernel: c0133ed0 fffffd87 00000d8b c0229128 00038c83 c0255da4 cf6ab600 c8fe3501
Dec 19 03:37:43 playground kernel: c013e9f4 ccadfeac ccadfeac c0133f38 00001004 c0229128 00038c83 c0255da4
Dec 19 03:37:43 playground kernel: Call Trace: [prune_dcache+198/308] [try_to_free_inodes+188/252] [ext2_find_entry+416/684] [grow_inodes+32/408] [get_new_inode+185/292] [iget4+109/120] [iget+17/24]
Dec 19 03:37:43 playground kernel: [ext2_lookup+90/140] [real_lookup+77/160] [lookup_dentry+292/452] [__namei+38/88] [sys_newlstat+13/96] [system_call+52/56]
Dec 19 03:37:43 playground kernel: Code: 8b 40 18 85 c0 74 02 89 c3 85 db 74 0d 8b 43 08 85 c0 74 06
These are clippings from /var/log/syslog:
Dec 14 03:01:01 playground /USR/SBIN/CRON[7729]: (root) CMD ( /mc/bin/secure deb)
Dec 14 03:01:54 playground kernel: Unable to handle kernel paging request at virtual address 6e65698a
Dec 14 03:01:54 playground kernel: current->tss.cr3 = 09901000, %%cr3 = 09901000
Dec 14 03:01:54 playground kernel: *pde = 00000000
Dec 14 03:01:54 playground kernel: Oops: 0000
Dec 14 03:01:54 playground kernel: CPU: 0
Dec 14 03:01:54 playground kernel: EIP: 0010:[iput+24/488]
Dec 14 03:01:54 playground kernel: EFLAGS: 00010206
Dec 14 03:01:54 playground kernel: eax: 6e656972 ebx: 00000000 ecx: c96f2ac8 edx: c708c408
Dec 14 03:01:54 playground kernel: esi: c9ef2ab8 edi: c708c3d0 ebp: 00000000 esp: c4ddbe68
Dec 14 03:01:54 playground kernel: ds: 0018 es: 0018 ss: 0018
Dec 14 03:01:54 playground kernel: Process find (pid: 7763, process nr: 63, stackpage=c4ddb000)
Dec 14 03:01:54 playground kernel: Stack: c708c3d0 c0132f36 c9ef2ab8 c4ddbeac 00000134 00001004 cffd0800 00001004
Dec 14 03:01:54 playground kernel: c0133ed0 fffff111 00000118 c0229128 00000134 c0255d84 cffd0800 c01290df
Dec 14 03:01:54 playground kernel: cd462670 c4ddbeac c4ddbeac c0133f38 00001004 c0229128 00000134 c0255d84
Dec 14 03:01:54 playground kernel: Call Trace: [prune_dcache+198/308] [try_to_free_inodes+188/252] [__brelse+19/52] [grow_inodes+32/408] [get_new_inode+185/292] [iget4+109/120] [iget+17/24]
Dec 14 03:01:54 playground kernel: [ext2_lookup+90/140] [real_lookup+77/160] [lookup_dentry+292/452] [__namei+38/88] [sys_newlstat+13/96] [system_call+52/56]
Dec 14 03:01:54 playground kernel: Code: 8b 40 18 85 c0 74 02 89 c3 85 db 74 0d 8b 43 08 85 c0 74 06
These are clippings from /var/log/kern.log:
Dec 7 03:01:06 playground kernel: Unable to handle kernel paging request at virtual address ff1a7408
Dec 7 03:01:06 playground kernel: current->tss.cr3 = 032c3000, %%cr3 = 032c3000
Dec 7 03:01:06 playground kernel: *pde = 00000000
Dec 7 03:01:06 playground kernel: Oops: 0000
Dec 7 03:01:06 playground kernel: CPU: 0
Dec 7 03:01:06 playground kernel: EIP: 0010:[iput+37/488]
Dec 7 03:01:06 playground kernel: EFLAGS: 00010286
Dec 7 03:01:06 playground kernel: eax: ff1a7400 ebx: ff1a7400 ecx: c09a18f8 edx: cd928ae8
Dec 7 03:01:06 playground kernel: esi: ce8e36f8 edi: cd928ab0 ebp: 00000000 esp: c3f7fe68
Dec 7 03:01:06 playground kernel: ds: 0018 es: 0018 ss: 0018
Dec 7 03:01:06 playground kernel: Process find (pid: 16679, process nr: 57, stackpage=c3f7f000)
Dec 7 03:01:06 playground kernel: Stack: cd928ab0 c0132f36 ce8e36f8 c3f7feac 00037554 00001004 cffd0800 00001004
Dec 7 03:01:06 playground kernel: c0133ed0 ffffff5b 00000f6f c0229128 00037554 c0256224 cffd0800 cf6472c5
Dec 7 03:01:06 playground kernel: c013e9f4 c3f7feac c3f7feac c0133f38 00001004 c0229128 00037554 c0256224
Dec 7 03:01:06 playground kernel: Call Trace: [prune_dcache+198/308] [try_to_free_inodes+188/252] [ext2_find_entry+416/684] [grow_inodes+32/408] [get_new_inode+185/292] [iget4+109/120] [iget+17/24]
Dec 7 03:01:06 playground kernel: [ext2_lookup+90/140] [real_lookup+77/160] [lookup_dentry+292/452] [__namei+38/88] [sys_newlstat+13/96] [system_call+52/56]
Dec 7 03:01:06 playground kernel: Code: 8b 43 08 85 c0 74 06 56 ff d0 83 c4 04 8b 46 1c 8d 78 ff 89
Dec 1 09:50:15 playground kernel: Unable to handle kernel paging request at virtual address eaaec9bc
Dec 1 09:50:15 playground kernel: current->tss.cr3 = 0901e000, %%cr3 = 0901e000
Dec 1 09:50:15 playground kernel: *pde = 00000000
Dec 1 09:50:15 playground kernel: Oops: 0000
Dec 1 09:50:15 playground kernel: CPU: 0
Dec 1 09:50:15 playground kernel: EIP: 0010:[sys_newlstat+38/96]
Dec 1 09:50:15 playground kernel: EFLAGS: 00010282
Dec 1 09:50:15 playground kernel: eax: eaaec970 ebx: c17c5060 ecx: 00000000 edx: c035bfe8
Dec 1 09:50:15 playground kernel: esi: c17c5060 edi: 0805658c ebp: bfffed7c esp: c0a01fc0
Dec 1 09:50:15 playground kernel: ds: 0018 es: 0018 ss: 0018
Dec 1 09:50:15 playground kernel: Process find (pid: 3179, process nr: 30, stackpage=c0a01000)
Dec 1 09:50:15 playground kernel: Stack: c010a1dc 0805658c bfffed3c 0805658c 401354ec 0805658c bfffed7c 0000006b
Dec 1 09:50:15 playground kernel: 0000002b 0000002b 0000006b 400db70e 00000023 00000202 bfffed10 0000002b
Dec 1 09:50:15 playground kernel: Call Trace: [system_call+52/56]
Dec 1 09:50:15 playground kernel: Code: 8b 40 4c 85 c0 74 0b 53 ff d0 89 c3 83 c4 04 eb 03 90 31 db
This is a Woody system on /dev/hdc6
Sat Nov 25 2006 9:51
several crashes, last 22 Nov - kernel paging request,
reboot failing requiring fsck to repair disk hdc6
========================================================================
Mon Nov 27 2006 10:42
re-installed Deb3.0
Mar 10 07:35:02 playground anacron[6691]: Job `cron.daily' started
Mar 10 07:35:02 playground anacron[6695]: Updated timestamp for job `cron.daily' to 2006-03-10
Mar 10 07:37:58 playground kernel: Unable to handle kernel paging request at virtual address e8e8e900
Mar 10 07:37:58 playground kernel: current->tss.cr3 = 0482c000, %%cr3 = 0482c000
Mar 10 07:37:58 playground kernel: *pde = 00000000
Mar 10 07:37:58 playground kernel: Oops: 0000
Mar 10 07:37:58 playground kernel: CPU: 0
Mar 10 07:37:58 playground kernel: EIP: 0010:[iput+24/488]
Mar 10 07:37:58 playground kernel: EFLAGS: 00010286
Mar 10 07:37:58 playground kernel: eax: e8e8e8e8 ebx: 00000000 ecx: c927f708 edx: cfbdc208
Mar 10 07:37:58 playground kernel: esi: c9a7f6f8 edi: cfbdc1d0 ebp: 00000000 esp: ca939e68
Mar 10 07:37:58 playground kernel: ds: 0018 es: 0018 ss: 0018
Mar 10 07:37:58 playground kernel: Process find (pid: 6740, process nr: 74, stackpage=ca939000)
Mar 10 07:37:58 playground kernel: Stack: cfbdc1d0 c0132f36 c9a7f6f8 ca939eac 0003e432 00001004 cffd0200 00001004
Mar 10 07:37:58 playground kernel: c0133ed0 fffff33d 00000341 c0229128 0003e432 c0255c5c cffd0200 c01290df
Mar 10 07:37:58 playground kernel: cce297d0 ca939eac ca939eac c0133f38 00001004 c0229128 0003e432 c0255c5c
Mar 10 07:37:58 playground kernel: Call Trace: [prune_dcache+198/308] [try_to_free_inodes+188/252] [__brelse+19/52] [grow_inodes+32/408] [get_new_inode+185/292] [iget4+109/120] [iget+17/24]
Mar 10 07:37:58 playground kernel: [ext2_lookup+90/140] [real_lookup+77/160] [lookup_dentry+292/452] [__namei+38/88] [sys_newlstat+13/96] [system_call+52/56]
Mar 10 07:37:58 playground kernel: Code: 8b 40 18 85 c0 74 02 89 c3 85 db 74 0d 8b 43 08 85 c0 74 06
Mar 6 07:30:01 playground anacron[19671]: Anacron 2.3 started on 2006-03-06
Mar 6 07:30:02 playground anacron[19671]: Will run job `cron.daily' in 5 min.
Mar 6 07:30:02 playground anacron[19671]: Jobs will be executed sequentially
Mar 6 07:35:01 playground anacron[19671]: Job `cron.daily' started
Mar 6 07:35:01 playground anacron[19675]: Updated timestamp for job `cron.dail
Mar 6 07:43:08 playground kernel: Unable to handle kernel paging request at virtual address 56026b10
Mar 6 07:43:08 playground kernel: current->tss.cr3 = 0873b000, %%cr3 = 0873b000
Mar 6 07:43:08 playground kernel: *pde = 00000000
Mar 6 07:43:08 playground kernel: Oops: 0000
Mar 6 07:43:08 playground kernel: CPU: 0
Mar 6 07:43:08 playground kernel: EIP: 0010:[iput+24/488]
Mar 6 07:43:08 playground kernel: EFLAGS: 00010202
Mar 6 07:43:08 playground kernel: eax: 56026af8 ebx: 00000000 ecx: ca2b3708 edx: cf96e248
Mar 6 07:43:08 playground kernel: esi: caab36f8 edi: cf96e210 ebp: 00000000 esp: c8d95e68
Mar 6 07:43:08 playground kernel: ds: 0018 es: 0018 ss: 0018
Mar 6 07:43:08 playground kernel: Process find (pid: 19809, process nr: 73, stackpage=c8d95000)
Mar 6 07:43:08 playground kernel: Stack: cf96e210 c0132f36 caab36f8 c8d95eac 0000c89c 00001004 cf5cb400 00001004
Mar 6 07:43:08 playground kernel: c0133ed0 fffff9d1 000009d5 c0229128 0000c89c c025605c cf5cb400 c01290df
Mar 6 07:43:08 playground kernel: c6c03f10 c8d95eac c8d95eac c0133f38 00001004 c0229128 0000c89c c025605c
Mar 6 07:43:08 playground kernel: Call Trace: [prune_dcache+198/308] [try_to_free_inodes+188/252] [__brelse+19/52] [grow_inodes+32/408] [get_new_inode+185/292] [iget4+109/120] [iget+17/24]
Mar 6 07:43:08 playground kernel: [ext2_lookup+90/140] [real_lookup+77/160] [lookup_dentry+292/452] [__namei+38/88] [sys_newlstat+13/96] [system_call+52/56]
Mar 6 07:43:08 playground kernel: Code: 8b 40 18 85 c0 74 02 89 c3 85 db 74 0d 8b 43 08 85 c0 74 06
Feb 9 00:05:01 playground /USR/SBIN/CRON[23639]: (root) CMD (/mc/bin/secure de
Feb 9 00:05:35 playground kernel: Unable to handle kernel paging request at vi
Feb 9 00:05:35 playground kernel: current->tss.cr3 = 0c629000, %%cr3 = 0c62900
Feb 9 00:05:35 playground kernel: *pde = 00000000
Feb 9 00:05:35 playground kernel: Oops: 0000
Feb 9 00:05:35 playground kernel: CPU: 0
Feb 9 00:05:35 playground kernel: EIP: 0010:[iput+24/488]
Feb 9 00:05:35 playground kernel: EFLAGS: 00010202
Feb 9 00:05:35 playground kernel: eax: 07200720 ebx: 00000000 ecx: ce07b708 edx: c7eeebe8
Feb 9 00:05:35 playground kernel: esi: ce87b6f8 edi: c7eeebb0 ebp: 00000000 esp: c14bde68
Feb 9 00:05:35 playground kernel: ds: 0018 es: 0018 ss: 0018
Feb 9 00:05:35 playground kernel: Process find (pid: 23670, process nr: 63, stackpage=c14bd000)
Feb 9 00:05:35 playground kernel: Stack: c7eeebb0 c0132f36 ce87b6f8 c14bdeac 00037ca9 00001004 cffd0800 00001004
Feb 9 00:05:35 playground kernel: c0133ed0 fffff23f 00000243 c0229128 00037ca9 c0255cc4 cffd0800 c00460b5
Feb 9 00:05:35 playground kernel: c013e9f4 c14bdeac c14bdeac c0133f38 00001004 c0229128 00037ca9 c0255cc4
Feb 9 00:05:35 playground kernel: Call Trace: [prune_dcache+198/308] [try_to_free_inodes+188/252] [ext2_find_entry+416/684] [grow_inodes+32/408] [get_new_inode+185/292] [iget4+109/120] [iget+17/24]
Feb 9 00:05:35 playground kernel: [ext2_lookup+90/140] [real_lookup+77/160] [lookup_dentry+292/452] [__namei+38/88] [sys_newlstat+13/96] [system_call+52/56]
Feb 9 00:05:35 playground kernel: Code: 8b 40 18 85 c0 74 02 89 c3 85 db 74 0d 8b 43 08 85 c0 74 06
Reply to: