Re: Document for my GSoC Tasks and want some advice.
Hi Kohei,
On 2025-05-15 18:40, 千代航平 wrote:
> Also, I will send my progress bi-weekly to you and discuss next steps.
Sounds good. If you run into any problem, do reach out sooner. On this
list, there is always someone that can help.
> Now, I want to decide the vllm version to package during this GSoC project.
> I think there are two options.
> First is to follow the latest and catch up on every dependency for that.
>
> Second, and I think this might be much easier, is to follow the v0.8.4.
> v0.8.5 (latest version) requires tokenizers >= 0.21.1 and tokenizers
> v0.21.1 requires pyo3 24.0 and numpy-rust 0.24.0; however, the rust team
> says that backporting to pyo3 0.22 (currently in Debian unstable) or
> upgrading pyo3 to 0.24 after the current Debian release is done in a few
> months is required.
> In contrast, vllm v0.8.4 requires tokenizers >= 0.19.1 and tokenizers
> v0.20.3 requires pyo3 22.0 and numpy-rst 0.22.0 which seems to be good
> for avoiding repackaging pyo3 crate.
>
> I also think it’s important to keep up with the latest developments in
> LLMs since the field is evolving so quickly. How do you think about this?
I suggest you go for the simpler route, v0.8.4, and keep an eventual
upgrade to v0.8.5 in the back of your mind.
Getting that first package ready, accepted, and then iterating on that,
is often much easier than trying to get everything perfect on the first
try, especially when some of the problems stem not from your package but
from dependencies.
Best,
Christian
Reply to: