Skip to content

Pull requests: vllm-project/vllm

New pull request New
338 Open 2,556 Closed
338 Open 2,556 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[TPU] Support collective communications in XLA devices ready tpu Related to Google TPUs
#6813 opened Jul 26, 2024 by WoosukKwon Loading…
2
[Misc] Support TPU in initialize_ray_cluster ready tpu Related to Google TPUs
#6812 opened Jul 26, 2024 by WoosukKwon Loading…
2
[Build/CI][ROCm] Minor simplification to Dockerfile.rocm ready rocm
#6811 opened Jul 26, 2024 by WoosukKwon Loading…
1
[Core] Get KV from Block, add KV to Block
#6808 opened Jul 26, 2024 by KrishnaM251 Loading…
1
[Bugfix] Make defaulting OMP_NUM_THREADS to 1 have the desired impact
#6802 opened Jul 25, 2024 by tjohnson31415 • Draft
3
3
[BugFix] skip loading lm_head for llama if word embeddings are tied
#6796 opened Jul 25, 2024 by prashantgupta24 Loading…
1
[Kernel] Increase precision of GPTQ/AWQ Marlin kernel ready
#6795 opened Jul 25, 2024 by alexm-neuralmagic Loading…
2
2
[CI] Reproduce SGLANG benchmark results nightly-benchmarks
#6794 opened Jul 25, 2024 by KuntaiDu Loading…
1
Fix ReplicatedLinear weight loading ready
#6793 opened Jul 25, 2024 by qingquansong Loading…
3
[Bugfix] Allow vllm to still work if triton is not installed.
#6786 opened Jul 25, 2024 by tdoublep Loading…
5
[Bugfix][Model] Jamba assertions and no chunked prefill by default for Jamba ready
#6784 opened Jul 25, 2024 by tomeras91 Loading…
2
[BugFix][Speculative Decoding] Fixes the generation token numbers with sps
#6782 opened Jul 25, 2024 by sighingnow Loading…
1
5
[Core] Use array to speedup padding ready
#6779 opened Jul 25, 2024 by peng1999 Loading…
9
[wip] spmd delta optimization ready
#6771 opened Jul 25, 2024 by rkooo567 Loading…
3
[Bugfix] [Easy] Fixed a bug in the multiprocessing GPU executor.
#6770 opened Jul 25, 2024 by eaplatanios Loading…
3
[ Kernel ] Add Fused Layernorm + Dynamic-Per-Token Quant Kernels ready
#6763 opened Jul 24, 2024 by varun-sundar-rabindranath Loading…
3
[Bugfix][Model] Skip loading lm_head weights if using tie_word_embeddings
#6758 opened Jul 24, 2024 by tjohnson31415 Loading…
1
[Frontend] New allowed_token_ids decoding request parameter
#6753 opened Jul 24, 2024 by njhill Loading…
@DarkLight1337
12
[Bugfix]: use PretrainedConfig to communicate config objects with trust remote code
#6751 opened Jul 24, 2024 by tjohnson31415 • Draft
2
3
(Dont Merge) Add rwkv6
#6749 opened Jul 24, 2024 by uniartisan • Draft
1
[Model][Jamba] Mamba cache single buffer ready
#6739 opened Jul 24, 2024 by mzusman Loading…
2
Update logits processor with tensor caching
#6715 opened Jul 24, 2024 by lynkz-matt-psaltis • Draft
2
[CI/Build] Build wheel in release model when sccache is not enabled ready
#6710 opened Jul 23, 2024 by zifeitong Loading…
3
[CORE] support for *.pt type prompt adapters
#6709 opened Jul 23, 2024 by prashantgupta24 Loading…
2
[CI] [nightly benchmark] Do not re-download sharegpt dataset if exists nightly-benchmarks ready
#6706 opened Jul 23, 2024 by cadedaniel Loading…
2
ProTip! Filter pull requests by the default branch with base:main.