Re: debian-ai proposals for upcoming GSoC
I put vLLM into the project list. This will probably be an eye-attracting project:
https://wiki.debian.org/SummerOfCode2025/Projects#SummerOfCode2025.2FPendingProjects.2FPackageLLMInferenceLibraries.Package_LLM_Inference_Libraries
I need co-mentor for this project, any volunteer?
On Tue, 2025-02-04 at 23:54 -0500, M. Zhou wrote:
> On Wed, 2025-02-05 at 09:59 +0530, Abhijith PA wrote:
> > Hello Debian ai team,
> >
> > Interested to submit Debian AI related project proposals for the
> > upcoming GSoC program like last year. Proposals window will be closing
> > on February 11th.
> >
> > https://lists.debian.org/debian-devel-announce/2025/01/msg00005.html
> >
>
> Thank you for letting me know.
>
> I think vLLM will be a good project for GSoC.
> It is on my radar, but I do not have enough time to deal with it
> https://github.com/vllm-project/vllm
> I'll add the project info later.
>
> vLLM is more suitable for serving LLMs at scale, with reportedly
> better concurrency, while ollama/llama.cpp is easier to use locally.
>
> It will be good to have both.
>
Reply to: