[Date Prev][Date Next] [Thread Prev][Thread Next] [Date Index] [Thread Index]

Re: Building llama.cpp for AMD GPU using only Debian packages?



[Jamie Bainbridge]
> I wonder if you can reproduce these results? I tried with Q80 and Q6KL
> models which all fit into VRAM.

I can at least do a test build if you provide the recipe.  If you
provide me with the apt install and cmake lines, I will give it a go. :)

> I am not sure of steps to compile llama.cpp for Vulkan using only
> Debian libraries.

It is my preferred scenario, and I am running Debian 13/Trixie with
regular updates. :)

-- 
Happy hacking
Petter Reinholdtsen


Reply to: