Skip to content

Pull requests: vllm-project/vllm

New pull request New
760 Open 9,580 Closed
760 Open 9,580 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

fix[Docs]: link anchor is incorrect #20309 documentation Improvements or additions to documentation structured-output
#20315 opened Jul 1, 2025 by yyzxw Loading…
4 tasks
12
[Kernel] Optimize Prefill Attention in Unified Triton Attention Kernel
#20308 opened Jul 1, 2025 by jvlunteren Loading…
4
Add support for Prithvi geospatial model in serving mode documentation Improvements or additions to documentation frontend multi-modality Related to multi-modality (#4194) needs-rebase structured-output v1
#20307 opened Jul 1, 2025 by mgazz • Draft
1 of 4 tasks
6
[doc] quark_mxfp4_introduction documentation Improvements or additions to documentation
#20306 opened Jul 1, 2025 by lihaoyang-amd • Draft
4
[CUDA graphs] Enable full cuda graphs with FA3 AoT scheduling ci/build ready ONLY add when PR is ready to merge/full CI is needed v1
#20301 opened Jul 1, 2025 by WoosukKwon Loading…
5
[Misc] Minor refactoring for scheduler ready ONLY add when PR is ready to merge/full CI is needed v1
#20299 opened Jul 1, 2025 by WoosukKwon Loading…
6
[Feature] Support Minimax-M1 function calls features documentation Improvements or additions to documentation frontend tool-calling
#20297 opened Jul 1, 2025 by qscqesze Loading…
7
Enable fp8 kv cache on rocm aiter backend. rocm Related to AMD ROCm v1
#20295 opened Jul 1, 2025 by fsx950223 • Draft
4 tasks
5
[Hardware][RISC-V] Add RISC-V architecture cpu inference support ci/build
#20292 opened Jul 1, 2025 by huangzhengx Loading…
9
[Optimization] Cache sampled token ids in model runner ready ONLY add when PR is ready to merge/full CI is needed v1
#20291 opened Jul 1, 2025 by WoosukKwon Loading…
11
Enable group size 64 for Machete
#20290 opened Jul 1, 2025 by czhu-cohere Loading…
3 of 4 tasks
5
[Model] Adds support for SlimMoE models Phi-tiny-MoE-instruct
#20286 opened Jun 30, 2025 by zichongli5 Loading…
3 of 4 tasks
4
[Misc][Doc] Add missing comment for LLM frontend
#20285 opened Jun 30, 2025 by draftbk Loading…
1 of 4 tasks
3
Support DeepSeekV3-style block FP8 quantization with CT
#20279 opened Jun 30, 2025 by mgoin Loading…
21
[TPU] Temporary fix vmem oom for long model len by reducing page size tpu Related to Google TPUs v1
#20278 opened Jun 30, 2025 by Chenyaaang Loading…
4
[Docs] use uv in GPU installation docs documentation Improvements or additions to documentation
#20277 opened Jun 30, 2025 by davidxia Loading…
8
[Bugfix][Frontend]: Fix API server connection refused on wsl2 frontend
#20275 opened Jun 30, 2025 by Chen-zexi Loading…
3 of 4 tasks
5
Dummy commit
#20273 opened Jun 30, 2025 by dhonnappa-amd Loading…
4
[Bugfix] Fix None value handling in trace span creation for cancelled requests
#20272 opened Jun 30, 2025 by br4mm Loading…
3 of 4 tasks
5
[Docs] Update transcriptions API to use openai client with stream=True documentation Improvements or additions to documentation frontend ready ONLY add when PR is ready to merge/full CI is needed
#20271 opened Jun 30, 2025 by NickLucche Loading…
7
[V1] [ROCm] Enable EP with AITER Fused MoE rocm Related to AMD ROCm
#20270 opened Jun 30, 2025 by tjtanaa Loading…
3 of 4 tasks
3
[Refactor] Refactor import utils frontend multi-modality Related to multi-modality (#4194) performance Performance-related issues speculative-decoding structured-output tool-calling v1
#20269 opened Jun 30, 2025 by yewentao256 Loading…
1
10
[Benchmark] Add benchmark tool for multi turn conversations performance Performance-related issues
#20267 opened Jun 30, 2025 by pliops-daniels Loading…
2
[misc]refactor Platform.set_device method rocm Related to AMD ROCm tpu Related to Google TPUs v1
#20262 opened Jun 30, 2025 by jikunshang Loading…
4 tasks
4
[WIP][Model][VLM] Support JinaVL Reranker documentation Improvements or additions to documentation frontend
#20260 opened Jun 30, 2025 by shineran96 • Draft
1
7
ProTip! Filter pull requests by the default branch with base:main.