Hi Kohei,
Thanks for the updates! This is a great progress!
I've noted the python packages ready for review some time ago. Will process them and provide feedback when I'm available through the salsa issues. After dealing with the python packages, I'll look at the rust ones.
As for the rest dependencies, while they look smaller, they are not necessarily simple. Some questions to investigate regarding those dependencies:
1. ray does not look like a simple package as it is a distributed compute engine. Is this dependency optional to vllm? What would happen if we remove ray from vllm's dependency tree?
2. xformers being a transformer library... does it build in cpu-only mode? If not, how to strip the xformers dependency from vllm for the cpu-only vllm build?
3. mistral_common looks like a library specific to Mistral models. Is that the case for vllm? If the "common" function are common enough to be used by non-Mistral models, we should take this dependency by default. If it is specific to Mistral models, we should be able to strip it and list it in Recommends: field instead of Depends: field.
4. We plan to create two versions of vllm, one is cpu-only, and another is the cuda version. I believe the dependency tree of the cpu-only version would be slightly different from the cuda version. Please investigate this in advance. https://docs.vllm.ai/en/latest/getting_started/installation/cpu.html BTW, the dependency may also differ between amd64 and arm64. The two platforms are what we are looking at.
Hi, this is a bi-weekly update of my GSoC project!I finished packaging,* irregular* prometheus-fastapi-instrumentor* (almost finished) airportsdataThere is an error on the test.required transformers for autopkgtest
Now, I've gotten familiar with the Python / Rust packaging. However, one of the big problems is rust crates.I sent some MRs https://salsa.debian.org/rust-team/debcargo-conf/-/merge_requests, but I haven't gotten even a comment.
Now, I'm tackling an outline-core, https://salsa.debian.org/python-team/packages/outlines-core/-/tree/master/tests, which also requires some additional Rust crates.
I will continue packaging by using ---extra-package.
(The rest of the dependencies become much smaller !vllm==0.8.1
├── outlines [required: ==0.1.11, installed: 0.1.11]
│ └── outlines_core [required: ==0.1.26, installed: 0.1.26]
├── xgrammar [required: ==0.1.16, installed: 0.1.16]
├── f-json-parser [required: Any, installed: 0.2.1.1.post5]
├── pyzmq [required: Any, installed: 26.3.0]
├── gguf [required: ==0.10.0, installed: 0.10.0]
├── mistral_common [required: >=1.5.4, installed: 1.5.4]
├── compressed-tensors [required: ==0.9.2, installed: 0.9.2]
├── depyf [required: ==0.18.0, installed: 0.18.0]
├── watchfiles [required: Any, installed: 1.0.4]
├── ray [required: >=2.43.0, installed: 2.44.0]
└── xformers [required: ==0.0.29.post2, installed: 0.0.29.post2])
------------------------------------------------------------------------------------------------------Kohei Sendai.
-------------------------------------------------------------------------------------------