AI and NPUs? AMD AI Max+ 395? Relation betwene ROCm and NPU?
Hi folks,
It seems that NPUs are more and more a thing following the trend of "AI PC".
AMD has released the AMD AI Max+ 395 which seems to be able to use some
unified memory like Apple's M* series, taking up to 96GB RAM as VRAM.
However I'm very unfamiliar to the NPUs from the software side.
https://www.amd.com/en/technologies/xdna.html
Is seems irrelevant to ROCm right?
What is the software stack for NPU support?
Cory, do you know something about the NPU support in Debian?
Since every new CPUs in the future is going to ship an NPU module, I'd say
such NPU device will be more popular than discrete GPUs in the future.
Intel also have their own NPUs, e.g., the one shipped in U9-285K:
https://www.intel.com/content/www/us/en/products/sku/241060/intel-core-ultra-9-processor-285k-36m-cache-up-to-5-70-ghz/specifications.html
Reply to: