[Date Prev][Date Next] [Thread Prev][Thread Next] [Date Index] [Thread Index]

Re: Bug#1063673: ITP: llama.cpp -- Inference of Meta's LLaMA model (and others) in pure C/C++



On Sat, 2025-02-01 at 19:34 +0100, Christian Kastner wrote:
> 
> Using this new approach, I was elated to see that it doesn't just work
> perfectly, it also works with non-standard library paths (lacking
> stability, llama.cpp's libraries are kept private, for now). And the
> baseline build should work fine for any other dynamic linker
> implementation, so there is really no meaningful downside to using
> hwcaps.

Thanks for looking into it. The result looks not only effective but
actually really perfect, and is the first example (as far as I know)
where hwcap is very suitable for Debian package. Good job! My concern
on Debian ISA and performance is gone.


Reply to: