Re: AI and NPUs? AMD AI Max+ 395? Relation betwene ROCm and NPU?
On Wed, 15 Jan 2025 at 12:55, M. Zhou <lumin@debian.org> wrote:
>
> Hi folks,
>
> It seems that NPUs are more and more a thing following the trend of "AI PC".
> AMD has released the AMD AI Max+ 395 which seems to be able to use some
> unified memory like Apple's M* series, taking up to 96GB RAM as VRAM.
>
> However I'm very unfamiliar to the NPUs from the software side.
> https://www.amd.com/en/technologies/xdna.html
> Is seems irrelevant to ROCm right?
> What is the software stack for NPU support?
There is a discussion with library and upstream driver details on llama.cpp:
[Feature request] Any plans for AMD XDNA AI Engine support on Ryzen
7x40 processors? #1499
https://github.com/ggerganov/llama.cpp/issues/1499
J
Reply to: