Re: ROCm benchmark clients?
On 2024-07-04 00:16, Cordell Bloor wrote:
> Just about every ROCm library has an associated benchmark client.
> There's rocblas-bench, rocsolver-bench, rocfft-bench, rocsparse-bench,
> etc. These benchmark clients are used during development for comparing
> the performance of library functions with different versions of the
> library, different versions of their dependencies, different compiler
> options, on different sizes of input data, or on different hardware.
>
> I think we may want to start packaging these clients. We need tools to
> help us to understand how changes to the library build options affect
> performance.
Agreed. (FWIW, I always expected us to do this eventually, once we had
finished all more important stuff.)
I think it makes sense to introduce new -bench packages for this.
We could also consider "abusing" autopkgtest for this: create an
autopkgtest for the -bench packages that is always skipped unless some
condition is met (eg: envvar RUNBENCH=1). This would allow us to use our
CI to periodically run them and collect data.
When we do this, I suggest we do this once across the board, in one big
push. Otherwise things will get missed.
Best,
Christian
Reply to: