Re: Building llama.cpp for AMD GPU using only Debian packages?
[Jamie Bainbridge]
> I wonder if you can reproduce these results? I tried with Q80 and Q6KL
> models which all fit into VRAM.
I can at least do a test build if you provide the recipe. If you
provide me with the apt install and cmake lines, I will give it a go. :)
> I am not sure of steps to compile llama.cpp for Vulkan using only
> Debian libraries.
It is my preferred scenario, and I am running Debian 13/Trixie with
regular updates. :)
--
Happy hacking
Petter Reinholdtsen
Reply to: