Bug#1034307: RFP: tiktoken -- fast BPE tokeniser for use with OpenAI's models

To: 1034307@bugs.debian.org
Subject: Bug#1034307: RFP: tiktoken -- fast BPE tokeniser for use with OpenAI's models
From: Petter Reinholdtsen <pere@hungry.com>
Date: Mon, 17 Apr 2023 19:13:36 +0200
Message-id: <[🔎] sa6y1mqsa7z.fsf@hjemme.reinholdtsen.name>
Reply-to: Petter Reinholdtsen <pere@hungry.com>, 1034307@bugs.debian.org
In-reply-to: <handler.1034307.B.16813251592081237.ack@bugs.debian.org>
References: <[🔎] sa6jzyhym5e.fsf@hjemme.reinholdtsen.name> <handler.1034307.B.16813251592081237.ack@bugs.debian.org> <[🔎] sa6jzyhym5e.fsf@hjemme.reinholdtsen.name>

Control: retitle -1 ITP: tiktoken -- fast BPE tokeniser for use with OpenAI's models

I've decided to upload this package to experimental under the umbrella
of the Deep Learning Team.

-- 
Happy hacking
Petter Reinholdtsen

Reply to:

References:
- Bug#1034307: RFP: tiktoken -- fast BPE tokeniser for use with OpenAI's models
  - From: Petter Reinholdtsen <pere@hungry.com>

Prev by Date: Processed: Re: Bug#1034144: RFP: openai triton -- fast BPE tokeniser for use with OpenAI's models
Next by Date: Processed: Re: Bug#1034307: RFP: tiktoken -- fast BPE tokeniser for use with OpenAI's models
Previous by thread: Bug#1034307: RFP: tiktoken -- fast BPE tokeniser for use with OpenAI's models
Next by thread: Processed: Re: Bug#1034307: RFP: tiktoken -- fast BPE tokeniser for use with OpenAI's models
Index(es):
- Date
- Thread