Re: Package Pool Proposal
On Tue, 23 Nov 1999, Joey Hess wrote:
> With a mere 111 buckets. Seems reasonable. Otoh, if you don't subdivide x
> and g, you get:
> 382 x
> 347 g
> In just 56 buckets. Not significantly worse dir size, and a much easier
> special case to remember.
I like that, so that would be using a largest prefix match set of
{[a-z],lib[a-z]}, only the single special case in the hash function.
> (Personally, I don't care what we use too much:
> joey@kite:/home/mirror/debian/all>ls -1 *.deb |wc -l
> 4416
> And it's acceptably fast for random single file accesses.)
Mirroring tools become slower and consume more memory the larger the
single directory. Primarily because they do need to stat every file and
they need to perform an in-memory diff of the directory contents.
I've heard tell that ls -l on the bugs db (40k files?) takes over 8 mins
on master :>
Jason
Reply to: