Skip to content

Pull requests: huggingface/text-generation-inference

New pull request New
41 Open 1,671 Closed
41 Open 1,671 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Remove dead bitsandbytes CxB code from 8-bit inference path
#3356 opened Feb 16, 2026 by TimDettmers Loading…
1 task
docs: add AWS (EC2/SageMaker) deployment + benchmarking guide
#3352 opened Jan 31, 2026 by KOKOSde Loading…
test(config): add comprehensive tests for router config utilities
#3349 opened Dec 27, 2025 by yurekami Loading…
2 tasks
Upgrade GitHub Actions to latest versions
#3348 opened Dec 20, 2025 by salmanmkc Loading…
Upgrade GitHub Actions for Node 24 compatibility
#3347 opened Dec 20, 2025 by salmanmkc Loading…
fix: don't use kernel layernorm on Blackwell architecture to avoid "no kernel image" error
#3343 opened Dec 11, 2025 by AdamPalaxo Loading…
1 of 5 tasks
feat: prefer latest outlines core and compile grammar in router
#3340 opened Nov 14, 2025 by drbh • Draft
fix: bump flake and update grammar logit processor
#3338 opened Nov 6, 2025 by drbh • Draft
Remove once_cell dependency from multiple Cargo.toml files and update usage in validation.rs to use std::sync::LazyLock instead of once_cell::sync::Lazy.
#3334 opened Sep 28, 2025 by htiennv Loading…
5 tasks
feat: expose GPU energy consumption (mJ) in responses
#3315 opened Aug 28, 2025 by JulienDelavande Loading…
2 of 5 tasks
1
**Add dedicated CPU-only Dockerfile and update documentation for CPU/…
#3310 opened Aug 7, 2025 by jakubgajski Loading…
2 of 5 tasks
support qwen3 on nvidia
#3302 opened Jul 23, 2025 by icyxp Loading…
4
Retrieve the correct cached model batch size in Neuron config checker for Neuron Backend
#3300 opened Jul 19, 2025 by jimburtoft Loading…
3 tasks
Attempt to fix CI errors
#3292 opened Jul 8, 2025 by danieldk Loading…
5 tasks
fix: enable defs references in tool calls
#3291 opened Jul 7, 2025 by drbh Loading…
Update quantization kernels
#3288 opened Jul 7, 2025 by danieldk • Draft
5 tasks
feat: allow json_schema in response format and add test
#3276 opened Jun 25, 2025 by drbh Loading…
3
Disable mamba in CPU platform
#3266 opened Jun 13, 2025 by casassg Loading…
3 of 5 tasks
feat: improve llava next pooling for granite vision
#3255 opened Jun 4, 2025 by drbh Loading…
Trtllm backend improvements
#3231 opened May 17, 2025 by leejuyuu Loading…
1 of 5 tasks
1
3
Fix typos
#3210 opened May 6, 2025 by omahs Loading…
1 of 5 tasks
feat: lock updated kernel versions
#3201 opened Apr 29, 2025 by drbh Loading…
Set uv UV_PYTHON_INSTALL_DIR explicitly
#3197 opened Apr 27, 2025 by sebastianliebscher Loading…
1 of 5 tasks
2
2
README: minimum Python version is 3.10
#3194 opened Apr 25, 2025 by Frenzie Loading…
1 of 5 tasks
feat: support logit bias in chat request
#3186 opened Apr 22, 2025 by drbh Loading…
29
ProTip! Adding no:label will show everything without a label.