Re: Building llama.cpp for AMD GPU using only Debian packages?
- To: debian-ai@lists.debian.org
- Subject: Re: Building llama.cpp for AMD GPU using only Debian packages?
- From: Petter Reinholdtsen <pere@hungry.com>
- Date: Mon, 27 Jan 2025 23:30:02 +0100
- Message-id: <[🔎] sa6sep3dh5h.fsf@hjemme.reinholdtsen.name>
- In-reply-to: <sa64j96q4gg.fsf@hjemme.reinholdtsen.name>
- References: <sa6sewtv5km.fsf@hjemme.reinholdtsen.name> <a2e3c24b-6459-41cb-995f-93bb4bdfee97@slerp.xyz> <sa6wmm5s28m.fsf@hjemme.reinholdtsen.name> <sa6r0cds1br.fsf@hjemme.reinholdtsen.name> <af3fa2a8-63f0-44ec-bb0e-5105a3235f6b@slerp.xyz> <a6840953-4656-47ed-96f7-ee7fe2f5b247@slerp.xyz> <sa6tth8p2rk.fsf@hjemme.reinholdtsen.name> <sa6a5izpnvp.fsf@hjemme.reinholdtsen.name> <sa64j96q4gg.fsf@hjemme.reinholdtsen.name>
Here is a small update on building llama.cpp with support for (at least
my) AMD GPU. The cmake arguments for the latest github edition (commit
d6d24cd9ed6d0b9558643dcc28f2124bef488c52) have changed slightly since
the first recipe in this thread, so here is the one I used to
successfully build
HIPCXX=clang-17 cmake -H. -Bbuild -DCMAKE_BUILD_TYPE=Release \
-DGGML_HIP=ON -DAMDGPU_TARGETS=gfx1100 && \
make -C build -j32
I picked the cmake arguments from docs/build.md, but the ones listed
there had to be modified to use clang-17 instead of clang (ie v19), and
I did not need to specify HIP_PATH.
--
Happy hacking
Petter Reinholdtsen
Reply to: