Skip to content

Pull requests: huggingface/text-generation-inference

New pull request New
Clear current search query, filters, and sorts
37 Open 1,669 Closed
37 Open 1,669 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

feat: support logit bias in chat request
#3186 opened Apr 22, 2025 by drbh Loading…
29
Enable qwen2vl video
#2756 opened Nov 18, 2024 by drbh Loading…
9 tasks done
24
Update Dockerfile to use devel image for compatibility
#2848 opened Dec 16, 2024 by YaserJaradeh Loading…
2 of 5 tasks
10
Fix CPU and memory affinity under external resource management
#3012 opened Feb 11, 2025 by askervin Loading…
1
6
Support xccl distributed backend
#3034 opened Feb 18, 2025 by dvrogozh Loading…
4
wip: comment out prepend full_text
#3079 opened Mar 7, 2025 by jrc2139 • Draft
1 of 5 tasks
1
4
support qwen3 on nvidia
#3302 opened Jul 23, 2025 by icyxp Loading…
4
Expose the real-time internal state of the batcher through SSE
#3065 opened Feb 27, 2025 by mfuntowicz • Draft
3
feat: allow json_schema in response format and add test
#3276 opened Jun 25, 2025 by drbh Loading…
3
Set uv UV_PYTHON_INSTALL_DIR explicitly
#3197 opened Apr 27, 2025 by sebastianliebscher Loading…
1 of 5 tasks
2
2
[WIP] Add gfx1100 support to AMD pytorch build
#2642 opened Oct 13, 2024 by cazlo • Draft
1 of 5 tasks
1
2
display available cached versions in TGI server error message of Neuron backend
#3063 opened Feb 26, 2025 by jimburtoft Loading…
4 tasks
2
Add model_load_time metric
#2311 opened Jul 26, 2024 by Edwinhr716 Loading…
2 of 5 tasks
2
Kvrouter that will increase the kv-cache hits in case of multiple routing strategy
#2965 opened Jan 29, 2025 by Narsil Loading…
5 tasks
1
Update links Inferentia refer docs
#3154 opened Apr 9, 2025 by guspan-tanadi Loading…
1 of 5 tasks
1
Fix flashinfer plan call to use positional arguments for #3165
#3166 opened Apr 11, 2025 by ruckc Loading…
2 of 5 tasks
1
1
feat: expose GPU energy consumption (mJ) in responses
#3315 opened Aug 28, 2025 by JulienDelavande Loading…
2 of 5 tasks
1
fix: enable defs references in tool calls
#3291 opened Jul 7, 2025 by drbh Loading…
fix: bump flake and update grammar logit processor
#3338 opened Nov 6, 2025 by drbh • Draft
[Backend] Introduce vLLM backend
#2976 opened Jan 31, 2025 by mfuntowicz Loading…
Add chunked attn for L4
#3162 opened Apr 10, 2025 by mht-sharma • Draft
2 of 7 tasks
Update quantization kernels
#3288 opened Jul 7, 2025 by danieldk • Draft
5 tasks
Attempt to fix CI errors
#3292 opened Jul 8, 2025 by danieldk Loading…
5 tasks
Remove once_cell dependency from multiple Cargo.toml files and update usage in validation.rs to use std::sync::LazyLock instead of once_cell::sync::Lazy.
#3334 opened Sep 28, 2025 by htiennv Loading…
5 tasks
Disable mamba in CPU platform
#3266 opened Jun 13, 2025 by casassg Loading…
3 of 5 tasks
ProTip! no:milestone will show everything without a milestone.