Skip to content

Pull requests: huggingface/text-generation-inference

New pull request New
Clear current search query, filters, and sorts
22 Open 875 Closed
22 Open 875 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Cpu tgi
#1936 opened May 23, 2024 by sywangyi Loading…
5 tasks
18
[Major Change][Undecided yet] Move to FlashDecoding instead of PagedAttention kernel.
#1940 opened May 23, 2024 by Narsil Loading…
5 tasks
2
Enable multiple LoRa adapters
#2010 opened Jun 4, 2024 by drbh Loading…
63
feat: re-allocate pages dynamically
#2024 opened Jun 5, 2024 by OlivierDehaene Loading…
19
[WIP] Add kvcache fp8 support
#2028 opened Jun 6, 2024 by mht-sharma • Draft
29
Enabling CI for AMD with new runner..
#2034 opened Jun 6, 2024 by Narsil Loading…
5 tasks
1
use xpu-smi to dump used memory
#2047 opened Jun 11, 2024 by sywangyi Loading…
5 tasks
7
fix: set sharded true if WORLD_SIZE is set
#2062 opened Jun 12, 2024 by drbh Loading…
Add support for Docker Compose
#2063 opened Jun 12, 2024 by StefanDanielSchwarz Loading…
1 of 5 tasks
1
Support HF_TOKEN environment variable
#2066 opened Jun 13, 2024 by Wauplin Loading…
1
Fix local installation after Rust 1.79 and transformers 4.41.2
#2071 opened Jun 16, 2024 by rYoussefAli Loading…
Add OTLP Service Name Environment Variable
#2076 opened Jun 17, 2024 by KevinDuffy94 Loading…
3 of 5 tasks
1
Fix missing rope scaling option for YaRN
#2078 opened Jun 17, 2024 by calycekr Loading…
5 tasks
1
1
Idefics2: sync added image tokens with transformers
#2080 opened Jun 17, 2024 by danieldk Loading…
1 of 5 tasks
1
CI Login to dockerhub
#2086 opened Jun 18, 2024 by glegendre01 • Draft
5 tasks
fix ChatCompletion and ChatCompletionChunk object string not compatible with standard openai api
#2089 opened Jun 19, 2024 by sunxichen Loading…
2 of 5 tasks
1
feat: add simple tests for weights
#2092 opened Jun 19, 2024 by drbh Loading…
15
corrected Pydantic warning.
#2095 opened Jun 20, 2024 by yukiman76 Loading…
1 task
1
3
Fix LLaVA-NeXT handling of non-square images
#2097 opened Jun 20, 2024 by danieldk • Draft
5 tasks
1
Fix nccl regression on PyTorch 2.3 upgrade
#2099 opened Jun 20, 2024 by fxmarty Loading…
1
1
Fix cargo-chef prepare
#2101 opened Jun 21, 2024 by ur4t Loading…
5 tasks
Add support for Marlin 2:4 sparsity
#2102 opened Jun 21, 2024 by danieldk Loading…
1 of 5 tasks
1
ProTip! Updated in the last three days: updated:>2024-06-19.