Re: debian-ai proposals for upcoming GSoC
On Wed, 2025-02-05 at 09:59 +0530, Abhijith PA wrote:
> Hello Debian ai team,
>
> Interested to submit Debian AI related project proposals for the
> upcoming GSoC program like last year. Proposals window will be closing
> on February 11th.
>
> https://lists.debian.org/debian-devel-announce/2025/01/msg00005.html
>
Thank you for letting me know.
I think vLLM will be a good project for GSoC.
It is on my radar, but I do not have enough time to deal with it
https://github.com/vllm-project/vllm
I'll add the project info later.
vLLM is more suitable for serving LLMs at scale, with reportedly
better concurrency, while ollama/llama.cpp is easier to use locally.
It will be good to have both.
Reply to: