Bug#695839: lintian: Long-running instances reserves 2.5+ GBs, but avg RES is < 1G MB
Package: lintian
Version: 2.5.10.2
Severity: normal
Currently Lintian on lintian.d.o is doing a full run and top says:
[...] VIRT RES SHR S %CPU %MEM TIME+ COMMAND
[...] 2567m 818m 1528 R 81 40.6 432:36.97 lintian
The run started on the 11th and I remember seeing it at 900ish VIRT/RES.
Yesterday, it was at 2.5 G VIRT (don't remember the RES). Today, we are
still at 2.5 G VIRT and RES has been 800-1000 MB for the past 30 minutes.
We could be looking at a leak, because the VIRT is still growing a
bit. Though, if so, only a subset of the packages triggers the leak.
I am more inclined to believe it is long-living objects that we no
longer have use, but still have a reference to.
L::Tags keeps a table of statistics for each file processed that is
not cleaned (afaict), so a slow grow is expected I guess. However,
I have a feeling this is not the (only) cause of grow.
During the write up of this email the stats has changed to:
[...] VIRT RES SHR S %CPU %MEM TIME+ COMMAND
[...] 2699m 977m 1484 S 0 48.6 442:20.99 lintian
If it is not a leak and just Perl not releasing memory back
(regardless of reason), I think we should look at splitting
full runs into smaller "short" lived processes.
~Niels
Reply to: