Re: llama-cpp with AMD GPUs
On 2024-02-10 22:17, Cordell Bloor wrote:
> I was playing around with llama-cpp yesterday. I thought I'd share
> instructions for building and running with AMD GPU acceleration on
> Debian Testing and Unstable (or Ubuntu 23.10). I believe this should
> work on most discrete AMD GPUs with sufficient VRAM released between
> 2017 and 2022, specifically Vega, RDNA 1, RDNA 2, CDNA 1 and CDNA 2 GPUs:
> I'm not familiar enough with llama-cpp to file an RFS yet. Still, I
> thought this was interesting and wanted to share.
Oh that's neat!
Given its popularity, llama-cpp would be a big win, I think. I expected
the build to would be somewhat more complicated.
I'm happy to help with the packaging, if you need it.
Best,
Christian
Reply to: