[Date Prev][Date Next] [Thread Prev][Thread Next] [Date Index] [Thread Index]

Bug#851471: linux-image-4.8.0-2-686-pae: premature oom killer invocation running 4.8.15



On Sun 2017-01-15, Florian Siegesmund <sonny@cottman.toppoint.de> wrote:
> On Sun 2017-01-15, Ben Hutchings <ben@decadent.org.uk> wrote:
>> On Sun, 2017-01-15 at 11:05 +0100, Florian Siegesmund wrote:
> 
>>> Package: src:linux
>>> Version: 4.8.15-2
>>> Severity: critical
>>> Tags: upstream
>>> Justification: breaks the whole system

[...]

>> Linux 4.9 is said to have better OOM behaviour and is now available in
>> unstable.  Can you test whether it works better on this system?
> 
> We will see:
> 
> HOSTNAME:~# uname -a ; uptime
> Linux kyrrdis 4.9.0-1-686-pae #1 SMP Debian 4.9.2-2 (2017-01-12) i686 GNU/Linux
>  22:35:41 up 10:53,  2 users,  load average: 0.28, 0.11, 0.04
> HOSTNAME:~#

Looks better on first sight, but not good (still one major kill):

LOGHOST:~ # egrep '(HOSTNAME|LXCONTAINER).*kernel' /var/log/syslog
Jan 16 02:06:28 LXCONTAINER kernel: [51885.810272] perf: interrupt took too long (4940 > 4937), lowering kernel.perf_event_max_sample_rate to 40250
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447647] find invoked oom-killer: gfp_mask=0x2420848(GFP_NOFS|__GFP_NOFAIL|__GFP_HARDWALL|__GFP_MOVABLE), nodemask=0, order=0, oom_score_adj=0
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447652] find cpuset=/ mems_allowed=0
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447660] CPU: 0 PID: 4949 Comm: find Not tainted 4.9.0-1-686-pae #1 Debian 4.9.2-2
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447661] Hardware name: Hewlett-Packard HP dx5150 MT(PE679AV)/09AC, BIOS 1.09 11/22/2005
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447663]  c16c5b38 db2f17c2 c16c5c30 f1b312c0 db1d4dd0 00000000 00000206 00000206
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447669]  db2f788f c16c5b3c ef30d0c0 ef256000 f1b317b0 c16c5c30 f1b312c0 c16c5b7c
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447673]  db16bec1 db070e8a c16c5b68 db16bb27 00000003 00000000 00000000 0000000e
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447677] Call Trace:
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447688]  [<db2f17c2>] ? dump_stack+0x55/0x73
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447693]  [<db1d4dd0>] ? dump_header+0x64/0x1ab
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447697]  [<db2f788f>] ? ___ratelimit+0x9f/0x100
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447700]  [<db16bec1>] ? oom_kill_process+0x221/0x3e0
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447704]  [<db070e8a>] ? has_capability_noaudit+0x1a/0x30
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447706]  [<db16bb27>] ? oom_badness.part.13+0xd7/0x150
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447709]  [<db16c374>] ? out_of_memory+0xe4/0x290
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447711]  [<db170905>] ? __alloc_pages_nodemask+0xbe5/0xca0
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447717]  [<db167fea>] ? pagecache_get_page+0xba/0x270
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447721]  [<db20dc89>] ? __getblk_gfp+0x109/0x310
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447724]  [<db1bb31d>] ? fixup_slab_list.isra.48+0x4d/0x70
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447727]  [<db20e8ee>] ? __bread_gfp+0x1e/0x100
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447735]  [<f9c8bfa4>] ? udf_tread+0x44/0x50 [udf]
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447739]  [<f9c8c294>] ? udf_read_tagged+0x24/0x140 [udf]
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447743]  [<db1f3372>] ? inode_sb_list_add+0x32/0x50
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447747]  [<f9c8063e>] ? __udf_iget+0x16e/0xa40 [udf]
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447752]  [<f9c84eb9>] ? udf_lookup+0xa9/0xd0 [udf]
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447754]  [<db1e40ec>] ? lookup_slow+0x7c/0x140
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447756]  [<db1e4784>] ? walk_component+0x1e4/0x300
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447760]  [<db1e2d5d>] ? path_init+0x14d/0x330
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447762]  [<db1e582b>] ? path_lookupat+0x5b/0x110
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447764]  [<db1e7e83>] ? filename_lookup+0xd3/0x190
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447766]  [<db1e7e49>] ? filename_lookup+0x99/0x190
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447769]  [<db1d4ced>] ? __check_object_size+0x9d/0x11c
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447773]  [<db322799>] ? strncpy_from_user+0x39/0x140
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447775]  [<db1e7aa5>] ? getname_flags+0x55/0x1a0
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447778]  [<db1dd450>] ? vfs_fstatat+0x60/0xb0
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447780]  [<db1ddf0a>] ? SyS_fstatat64+0x2a/0x50
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447784]  [<db0036fa>] ? do_fast_syscall_32+0x8a/0x150
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447788]  [<db59d98a>] ? sysenter_past_esp+0x47/0x75
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447790] Mem-Info:
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447796] active_anon:14770 inactive_anon:22166 isolated_anon:0
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447796]  active_file:179810 inactive_file:399831 isolated_file:0
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447796]  unevictable:1825 dirty:0 writeback:0 unstable:0
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447796]  slab_reclaimable:32628 slab_unreclaimable:71435
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447796]  mapped:26191 shmem:10602 pagetables:807 bounce:0
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447796]  free:28495 free_pcp:97 free_cma:0
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447802] Node 0 active_anon:59080kB inactive_anon:88664kB active_file:719240kB inactive_file:1599324kB unevictable:7300kB isolated(anon):0kB isolated(file):0kB mapped:104764kB dirty:0kB writeback:0kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 42408kB writeback_tmp:0kB unstable:0kB pages_scanned:39836878 all_unreclaimable? yes
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447808] DMA free:4044kB min:788kB low:984kB high:1180kB active_anon:0kB inactive_anon:0kB active_file:6540kB inactive_file:0kB unevictable:0kB writepending:0kB present:15992kB managed:15916kB mlocked:0kB slab_reclaimable:1416kB slab_unreclaimable:3908kB kernel_stack:8kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Jan 16 02:14:20 LXCONTAINER kernel: lowmem_reserve[]: 0 815 2932 2932
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447816] Normal free:41484kB min:41488kB low:51860kB high:62232kB active_anon:2312kB inactive_anon:96kB active_file:390236kB inactive_file:136kB unevictable:276kB writepending:0kB present:894968kB managed:857360kB mlocked:276kB slab_reclaimable:129096kB slab_unreclaimable:281832kB kernel_stack:2656kB pagetables:40kB bounce:0kB free_pcp:336kB local_pcp:336kB free_cma:0kB
Jan 16 02:14:20 LXCONTAINER kernel: lowmem_reserve[]: 0 0 16935 16935
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447824] HighMem free:68452kB min:512kB low:27428kB high:54344kB active_anon:56768kB inactive_anon:88568kB active_file:322464kB inactive_file:1599188kB unevictable:7024kB writepending:0kB present:2167752kB managed:2167752kB mlocked:7024kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:3188kB bounce:0kB free_pcp:52kB local_pcp:52kB free_cma:0kB
Jan 16 02:14:20 LXCONTAINER kernel: lowmem_reserve[]: 0 0 0 0
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447828] DMA: 19*4kB (UME) 18*8kB (UE) 11*16kB (UE) 10*32kB (UME) 14*64kB (UME) 13*128kB (UME) 3*256kB (UM) 0*512kB 0*1024kB 0*2048kB 0*4096kB = 4044kB
Jan 16 02:14:20 LXCONTAINER kernel: Normal: 441*4kB (ME) 515*8kB (UME) 531*16kB (ME) 701*32kB (UME) 69*64kB (UM) 2*128kB (U) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 41484kB
Jan 16 02:14:20 LXCONTAINER kernel: HighMem: 1027*4kB (UM) 1377*8kB (UM) 791*16kB (UM) 247*32kB (UM) 88*64kB (UM) 42*128kB (UM) 3*256kB (UM) 1*512kB (U) 2*1024kB (UM) 1*2048kB (M) 4*4096kB (UM) = 68452kB
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447869] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447870] 591589 total pagecache pages
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447873] 609 pages in swap cache
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447874] Swap cache stats: add 4224, delete 3615, find 597/670
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447875] Free swap  = 1033368kB
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447876] Total swap = 1048572kB
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447877] 769678 pages RAM
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447877] 541938 pages HighMem/MovableOnly
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447878] 9421 pages reserved
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447879] 0 pages hwpoisoned
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447880] [ pid ]   uid  tgid total_vm      rss nr_ptes nr_pmds swapents oom_score_adj name
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447893] [  352]     0   352     7771     2225      13       3        0             0 systemd-journal
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447897] [  370]     0   370     5467      328       8       3        0             0 lvmetad
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447900] [  390]     0   390     4038      845       9       3        0         -1000 systemd-udevd
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447904] [  544]     0   544      835      463       5       3        0             0 mdadm
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447909] [  669]     0   669     1754      775       7       3        0             0 rpcbind
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447912] [  691]   116   691     1672      964       7       3        0          -900 dbus-daemon
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447915] [  701]   134   701     1561      707       7       3        0             0 avahi-daemon
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447918] [  704]     0   704      555        3       5       3       12             0 atopacctd
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447921] [  707]     0   707     1864     1090       7       3        0             0 systemd-logind
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447924] [  708]     0   708     1108      414       6       3        0             0 irexec
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447927] [  712]     0   712    12718     1749      15       3        1             0 ModemManager
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447930] [  715]   134   715     1561       74       7       3        0             0 avahi-daemon
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447932] [  717]     0   717     1459      978       6       3        0             0 smartd
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447936] [  718]     0   718    26082      617      20       3        1             0 lxcfs
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447938] [  719]     0   719     1390      386       7       3        0             0 inetd
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447941] [  720]     0   720     4242     1618      13       3        0             0 cupsd
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447944] [  731]     0   731     1128      388       7       3        0             0 lircmd
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447947] [  741]     0   741     1800      615       7       3        0             0 cron
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447950] [  744]     0   744     5724      759       8       3        0             0 rsyslogd
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447953] [  745]     0   745    21541     3016      23       3        0             0 NetworkManager
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447956] [  746]     0   746    10093     1503      14       3        0             0 accounts-daemon
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447959] [  753]     0   753     9218     1460      12       3        0             0 polkitd
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447962] [  755]     0   755     8886     1698      15       3        0             0 cups-browsed
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447965] [  907]   125   907    11663     2891      16       3       27             0 colord
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447968] [ 1058]     7  1058     3013     1224      10       3        0             0 dbus
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447971] [ 1504]     0  1504     2027      622       8       3        0             0 dhclient
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447973] [ 1556]   121  1556      769      484       5       3        0             0 ntpd
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447976] [ 1557]   121  1557      875      571       5       3        0             0 ntpd
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447979] [ 1558]     0  1558      733       50       5       3        0             0 ntpd
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447982] [ 1560]     1  1560      563      173       5       3        0             0 uptimed
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447985] [ 1654]     0  1654     2621     1379       8       3        0         -1000 sshd
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447988] [ 1665]     0  1665     1207      730       6       3        0             0 lircd
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447991] [ 1669]     0  1669     1129      407       6       3        0             0 lircd-uinput
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447995] [ 1747]     0  1747     1050      558       6       3        0             0 lxc-autostart
Jan 16 02:14:20 LXCONTAINER kernel: [52357.447998] [ 1755]     0  1755     2370      850       8       3        0             0 systemd
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448001] [ 1821]     0  1821     3791      999       9       3        0             0 systemd-journal
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448061] [ 1823]     0  1823    12726     3505      19       3       42             0 fail2ban-server
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448065] [ 1856]     0  1856      895      569       5       3        0             0 cron
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448068] [ 1857]   109  1857     1564      606       7       3        0          -900 dbus-daemon
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448071] [ 1867]     0  1867     1764       91       7       3        0             0 systemd-logind
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448074] [ 1869]     0  1869     5656      609      10       3        0             0 rsyslogd
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448077] [ 1883]     8  1883     1059      389       6       3        0             0 nullmailer-send
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448081] [ 1961]     0  1961     1202      366       6       3        0             0 agetty
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448084] [ 2062]   104  2062     5970     3808      15       3        0             0 nsd
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448087] [ 2088]   102  2088     5273      406       7       3        0             0 ippl
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448090] [ 2095]     0  2095      634      419       5       3        0             0 agetty
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448093] [ 2096]     0  2096      634      375       5       3        0             0 agetty
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448096] [ 2098]     0  2098      634      434       5       3        0             0 agetty
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448099] [ 2101]     0  2101      634      364       5       3        0             0 agetty
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448102] [ 2102]     0  2102      634      396       5       3        0             0 agetty
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448105] [ 2103]     0  2103      634      430       5       3        0             0 agetty
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448109] [ 2118]     0  2118    11323      180      15       3        0             0 sensord
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448112] [ 2213]   133  2213     5455     2495      14       3        5             0 timidity
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448115] [ 2347]     0  2347     1530       90       5       3        0             0 hddtemp
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448117] [ 2362]     0  2362     2783     1809       9       3        0             0 munin-node
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448120] [ 2398]   104  2398     8621     7331      20       3        0             0 nsd
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448123] [ 2431]   104  2431     8695      451      17       3        0             0 nsd
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448126] [ 2434]   103  2434     5065     2065      12       3        0             0 unbound
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448129] [ 2697]   101  2697     2816      781       9       3        0             0 exim4
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448132] [ 2779]   200  2779   112830    17215     124       3       28             0 mythbackend
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448136] [ 3270]  1002  3270     2393     1479       8       3        1             0 systemd
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448139] [ 3271]  1002  3271     7447      460      12       3       10             0 (sd-pam)
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448142] [ 3275]     0  3275     8276     1557      13       3        0             0 console-kit-dae
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448145] [ 6539]  1002  6539     4976      665      10       3        0             0 dirmngr
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448148] [10916]     0 10916    11996     2418      18       3        0             0 packagekitd
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448151] [30746]  1002 30746     1564      840       6       3        0             0 dbus-daemon
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448154] [  488]     0   488     1968     1827       7       3        0             0 atop
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448157] [32326]   300 32326     2145      376       8       3        0             0 uuidd
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448161] [ 4572]     0  4572     2635      871       8       3        0             0 cron
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448163] [ 4574]     0  4574      582      148       5       3        0             0 sh
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448166] [ 4578]     0  4578      582      366       5       3        0             0 tigercron
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448169] [ 4695]     0  4695      582      274       5       3        0             0 tigercron
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448172] [ 4696]     0  4696      582       38       5       3        0             0 tigercron
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448175] [ 4701]     0  4701      583      343       5       3        0             0 check_accounts
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448178] [ 4896]     0  4896      583      276       4       3        0             0 check_accounts
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448181] [ 4948]     0  4948      583       40       4       3        0             0 check_accounts
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448184] [ 4949]     0  4949      896      326       6       3        0             0 find
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448187] [ 4950]     0  4950      563      145       5       3        0             0 wc
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448189] Out of memory: Kill process 2779 (mythbackend) score 16 or sacrifice child
Jan 16 02:14:20 LXCONTAINER kernel: [52357.448361] Killed process 2779 (mythbackend) total-vm:451320kB, anon-rss:29180kB, file-rss:39680kB, shmem-rss:0kB
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931104] kthreadd: page allocation stalls for 10216ms, order:1, mode:0x27000c0(GFP_KERNEL_ACCOUNT|__GFP_NOTRACK)
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931119] CPU: 0 PID: 2 Comm: kthreadd Not tainted 4.9.0-1-686-pae #1 Debian 4.9.2-2
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931120] Hardware name: Hewlett-Packard HP dx5150 MT(PE679AV)/09AC, BIOS 1.09 11/22/2005
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931122]  f7507df0 db2f17c2 db6a73b0 00000000 db16fc96 db6ab872 027000c0 f7507df8
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931128]  f7507e00 db6a73b0 f7507dd4 e9279996 00000001 00000001 00000000 f7507eb4
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931133]  db1707e0 027000c0 db6a73b0 000027e8 00000001 f75012c0 00000010 000009c4
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931138] Call Trace:
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931150]  [<db2f17c2>] ? dump_stack+0x55/0x73
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931155]  [<db16fc96>] ? warn_alloc+0xf6/0x110
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931158]  [<db1707e0>] ? __alloc_pages_nodemask+0xac0/0xca0
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931164]  [<db0646a8>] ? copy_process.part.41+0xd8/0x14f0
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931167]  [<db0646cd>] ? copy_process.part.41+0xfd/0x14f0
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931170]  [<db083f70>] ? kthread_park+0x50/0x50
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931173]  [<db083f70>] ? kthread_park+0x50/0x50
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931175]  [<db065c9d>] ? _do_fork+0xed/0x3d0
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931180]  [<db599143>] ? __schedule+0x263/0x760
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931184]  [<db099e37>] ? set_curr_task_fair+0x27/0x60
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931186]  [<db083f70>] ? kthread_park+0x50/0x50
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931188]  [<db065fb5>] ? kernel_thread+0x35/0x40
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931191]  [<db084d44>] ? kthreadd+0x104/0x150
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931194]  [<db084c40>] ? kthread_create_worker_on_cpu+0x30/0x30
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931197]  [<db59d903>] ? ret_from_fork+0x1b/0x28
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931198] Mem-Info:
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931204] active_anon:13904 inactive_anon:15676 isolated_anon:0
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931204]  active_file:130154 inactive_file:213505 isolated_file:0
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931204]  unevictable:1911 dirty:9 writeback:0 unstable:0
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931204]  slab_reclaimable:35705 slab_unreclaimable:98694
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931204]  mapped:18632 shmem:10605 pagetables:683 bounce:0
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931204]  free:241784 free_pcp:0 free_cma:0
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931210] Node 0 active_anon:55616kB inactive_anon:62704kB active_file:520616kB inactive_file:854020kB unevictable:7644kB isolated(anon):0kB isolated(file):0kB mapped:74528kB dirty:36kB writeback:0kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 42420kB writeback_tmp:0kB unstable:0kB pages_scanned:0 all_unreclaimable? no
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931215] DMA free:4044kB min:788kB low:984kB high:1180kB active_anon:0kB inactive_anon:0kB active_file:4160kB inactive_file:0kB unevictable:0kB writepending:0kB present:15992kB managed:15916kB mlocked:0kB slab_reclaimable:1900kB slab_unreclaimable:5812kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Jan 16 02:20:48 LXCONTAINER kernel: lowmem_reserve[]: 0 815 2932 2932
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931223] Normal free:41972kB min:41488kB low:51860kB high:62232kB active_anon:668kB inactive_anon:84kB active_file:272636kB inactive_file:888kB unevictable:276kB writepending:36kB present:894968kB managed:857360kB mlocked:276kB slab_reclaimable:140920kB slab_unreclaimable:388964kB kernel_stack:2456kB pagetables:32kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Jan 16 02:20:48 LXCONTAINER kernel: lowmem_reserve[]: 0 0 16935 16935
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931231] HighMem free:921120kB min:512kB low:27428kB high:54344kB active_anon:54948kB inactive_anon:62620kB active_file:243788kB inactive_file:853164kB unevictable:7368kB writepending:0kB present:2167752kB managed:2167752kB mlocked:7368kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:2700kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Jan 16 02:20:48 LXCONTAINER kernel: lowmem_reserve[]: 0 0 0 0
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931235] DMA: 3*4kB (UM) 6*8kB (UME) 7*16kB (UME) 23*32kB (UME) 15*64kB (UM) 9*128kB (UME) 4*256kB (UM) 0*512kB 0*1024kB 0*2048kB 0*4096kB = 4044kB
Jan 16 02:20:48 LXCONTAINER kernel: Normal: 253*4kB (ME) 1459*8kB (UMEH) 1251*16kB (UMEH) 210*32kB (UMEH) 30*64kB (UMEH) 3*128kB (UM) 1*256kB (H) 0*512kB 0*1024kB 0*2048kB 0*4096kB = 41980kB
Jan 16 02:20:48 LXCONTAINER kernel: HighMem: 184*4kB (U) 94*8kB (U) 7025*16kB (UM) 8234*32kB (UM) 4118*64kB (UM) 1083*128kB (UM) 233*256kB (UM) 70*512kB (UM) 25*1024kB (UM) 2*2048kB (M) 4*4096kB (UM) = 921120kB
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931277] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931277] 355609 total pagecache pages
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931280] 605 pages in swap cache
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931282] Swap cache stats: add 4224, delete 3619, find 598/671
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931283] Free swap  = 1033488kB
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931283] Total swap = 1048572kB
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931284] 769678 pages RAM
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931285] 541938 pages HighMem/MovableOnly
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931286] 9421 pages reserved
Jan 16 02:20:48 LXCONTAINER kernel: [52745.931286] 0 pages hwpoisoned
Jan 16 09:40:14 LXCONTAINER kernel: [79111.436042] usb 2-2: new low-speed USB device number 3 using ohci-pci
Jan 16 09:40:14 LXCONTAINER kernel: [79111.651057] usb 2-2: New USB device found, idVendor=046a, idProduct=0001
Jan 16 09:40:14 LXCONTAINER kernel: [79111.651061] usb 2-2: New USB device strings: Mfr=0, Product=0, SerialNumber=0
Jan 16 09:40:14 LXCONTAINER kernel: [79111.663344] input: HID 046a:0001 as /devices/pci0000:00/0000:00:13.0/usb2/2-2/2-2:1.0/0003:046A:0001.0002/input/input8
Jan 16 09:40:14 LXCONTAINER kernel: [79111.720461] hid-generic 0003:046A:0001.0002: input,hidraw0: USB HID v1.00 Keyboard [HID 046a:0001] on usb-0000:00:13.0-2/input0
Jan 16 09:46:40 LXCONTAINER kernel: [79497.487849] usb 2-2: USB disconnect, device number 3
LOGHOST:~ #

It is confusing that this time the kernel errors were logged by the LXC
container. The killed process (mythbackend) lives outside the container
and the triggering find process was running from the host context most
likely, too:

Jan 16 02:00:01 HOSTNAME CRON[4574]: (root) CMD (   test -x /usr/sbin/tigercron && { [ -r "$DEFAULT" ] && . "$DEFAULT" ; nice -n$NICETIGER /usr/sbin/tigercron -q ; })

Florian

-- 
:wq


Reply to: