Re: OpenAI Whisper in Debian?

[Petter Reinholdtsen <pere@hungry.com>]

The three packages needed to get OpenAI Whisper working in Debian
bookworm are now available in the deeplearning team git repositories:

 * <URL: https://salsa.debian.org/deeplearning-team/tiktoken >.
 * <URL: https://salsa.debian.org/deeplearning-team/triton >.
 * <URL: https://salsa.debian.org/deeplearning-team/openai-whisper >.

The package is tested on a machine without relevant GPU and found to be
working.  My initial tests used around 2.2 GiB RAM for the 'small' model
and 5.0 GiB RAM for the 'medium' model.  My test machine lack enough ram
to run the 'full' model, but I assume it will use even more memory.

There is not yet a model package available.  The whisper binary will try
to download the requested model (model 'small' by default) from the
Internet on first invocation and store it in ~/.cache/whisper/.

I suspect a good next step would be to upload tiktoken and triton to
experimental.  I am unsure I got capascity to properly maintain more
packages myself, and thus unsure if I want to do so.  I am barely able
to maintain the packages in my list as it is.

-- 
Happy hacking
Petter Reinholdtsen