CatalogWantedMirrorsLedgerOperating StatementDocsStudio statusCard system
alt.freeweights.tools / vLLM
From: vllm-project <github.com/vllm-project>Newsgroups: alt.freeweights.toolsSubject:

vLLM

Release: v0.33.0rc3 (2026-11-02)Commit: 4ba787eLicense: Apache-2.0

A high-throughput and memory-efficient inference and serving engine for LLMs

inferencev0.33.0rc3releasevLLMPythonApache-2.0
FactsLicenseApache-2.0LanguagePythonKindinferenceRelease2026-11-02PlatformsLinux (GPU)Links to the projectpermissive
$ pip install vllm
# use with Freeweights
$ HF_ENDPOINT=https://freeweights.allternit.com vllm serve <id>
OverviewInstallUse with FreeweightsLicenseProvenance

Overview

High-throughput server for language models on GPUs.

Kind
inference
License
Apache-2.0
Language
Python
Platforms
Linux (GPU)
Latest release
v0.33.0rc3 (2026-11-02)
Repository
vllm-project/vllm
Topicsamdblackwellcudadeepseekdeepseek-v3gptgpt-ossinferencekimillamallmllm-serving

Freeweights links to the project and does not host tool binaries.

Install

$ pip install vllm
# use with Freeweights
$ HF_ENDPOINT=https://freeweights.allternit.com vllm serve <id>
$ pip install vllm

Checked against the project's README on 2026-11-14. The project's own instructions win when they differ: install docs

Freeweights links to the project and does not host tool binaries.

Use with Freeweights

Run a catalog model
$ HF_ENDPOINT=https://freeweights.allternit.com vllm serve <id>

Download the weights from Freeweights first (HF_ENDPOINT or fw.py), then point the tool at the folder.

Catalog models it can run (33)

YuE2DeepSeek-V4-Flash-0731DeepSeek-V4.1-Flash-1017gemma-4-26B-A4B-itgemma-4-31B-itGLM-4.7-FlashGLM-5.3GLM-5.3-Flashgpt-oss-120bgpt-oss-20bKimi-K3.1-Dflash2-PreviewKimi-K3.1-ProKimi-Linear-48B-A3B-BaseKimi-Linear-48B-A3B-InstructMiMo-V2.6-Distill-Qwen-9BMiMo-V2.6-Flash-RLMiniMax-M3.1-FlashMinistral-3-14B-Reasoning-2512NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16Olmo-3-1025-7BOlmo-3.1-32B-Instructphi-4Qwen-AgentWorld-35B-A3BQwen3-TTS-12Hz-1.7B-BaseQwen3-VL-8B-InstructQwen3.5-4B-BaseQwen3.5-9BQwen3.5-9B-BaseQwen3.6-27BQwen3.6-35B-A3BQwen3.8-27BQwen3.8-Flash-NextUnlimited-OCR-2

License

License
Apache-2.0
Class
Permissive

Read the license

Freeweights links to the project and does not host tool binaries.

Provenance

From: vllm-project <github.com/vllm-project>Newsgroups: alt.freeweights.toolsSubject: vLLMRelease: v0.33.0rc3 (2026-11-02)Commit: 4ba787eLicense: Apache-2.0
Repository
vllm-project/vllm
Pinned release
v0.33.0rc3, 2026-11-02
Release commit
4ba787ec9959e566d3b587a796dff07673324da5
Default branch
main d2f92859b4c62434a2c111036ebe62cb0e9de243
Fetched
2026-11-14
Takedowns
None.

Freeweights links to the project and does not host tool binaries.

Get it
InstallProject repository
Works with

33 catalog models. See the list