uv-scripts/transformers-inference download history

uv-scripts/transformers-inference is a dataset on the Hugging Face Hub. In the last 30 days it was downloaded 15 times (6 in the last 7 days), and 218 times in total. It ranks #451,834 among datasets by monthly downloads.

Transformers Continuous Batching Scripts GPU inference scripts using transformers' native continuous batching (CB). No vLLM dependency required. Why transformers CB? Instant new model support - works with any model supported by transformers, including newly released architectu

Open uv-scripts/transformers-inference on Hugging Face

Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.