CatalogWantedMirrorsLedgerOperating StatementDocsStudio statusCard system
alt.freeweights.tools / SGLang
From: sgl-project <github.com/sgl-project>Newsgroups: alt.freeweights.toolsSubject:

SGLang

Release: v0.5.23 (2026-11-02)Commit: 297e54fLicense: Apache-2.0

SGLang is a high-performance serving framework for large language models and multimodal models.

inferencev0.5.23releaseSGLangPythonApache-2.0
FactsLicenseApache-2.0LanguagePythonKindinferenceRelease2026-11-02PlatformsLinux (GPU)Links to the projectpermissive
$ uv pip install --prerelease=allow sglang
# use with Freeweights
$ HF_ENDPOINT=https://freeweights.allternit.com python3 -m sglang.launch_server --model-path <id>
OverviewInstallUse with FreeweightsLicenseProvenance

Overview

Fast serving framework for language and vision-language models.

Kind
inference
License
Apache-2.0
Language
Python
Platforms
Linux (GPU)
Latest release
v0.5.23 (2026-11-02)
Repository
sgl-project/sglang
Topicsattentionblackwellcudadeepseekdiffusionglmgpt-ossinferencellamallmminimaxmoe

Freeweights links to the project and does not host tool binaries.

Install

$ uv pip install --prerelease=allow sglang
# use with Freeweights
$ HF_ENDPOINT=https://freeweights.allternit.com python3 -m sglang.launch_server --model-path <id>
$ uv pip install --prerelease=allow sglang

Checked against the project's README on 2026-11-14. The project's own instructions win when they differ: install docs

Freeweights links to the project and does not host tool binaries.

Use with Freeweights

Run a catalog model
$ HF_ENDPOINT=https://freeweights.allternit.com python3 -m sglang.launch_server --model-path <id>

Download the weights from Freeweights first (HF_ENDPOINT or fw.py), then point the tool at the folder.

Catalog models it can run (33)

YuE2DeepSeek-V4-Flash-0731DeepSeek-V4.1-Flash-1017gemma-4-26B-A4B-itgemma-4-31B-itGLM-4.7-FlashGLM-5.3GLM-5.3-Flashgpt-oss-120bgpt-oss-20bKimi-K3.1-Dflash2-PreviewKimi-K3.1-ProKimi-Linear-48B-A3B-BaseKimi-Linear-48B-A3B-InstructMiMo-V2.6-Distill-Qwen-9BMiMo-V2.6-Flash-RLMiniMax-M3.1-FlashMinistral-3-14B-Reasoning-2512NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16Olmo-3-1025-7BOlmo-3.1-32B-Instructphi-4Qwen-AgentWorld-35B-A3BQwen3-TTS-12Hz-1.7B-BaseQwen3-VL-8B-InstructQwen3.5-4B-BaseQwen3.5-9BQwen3.5-9B-BaseQwen3.6-27BQwen3.6-35B-A3BQwen3.8-27BQwen3.8-Flash-NextUnlimited-OCR-2

License

License
Apache-2.0
Class
Permissive

Read the license

Freeweights links to the project and does not host tool binaries.

Provenance

From: sgl-project <github.com/sgl-project>Newsgroups: alt.freeweights.toolsSubject: SGLangRelease: v0.5.23 (2026-11-02)Commit: 297e54fLicense: Apache-2.0
Repository
sgl-project/sglang
Pinned release
v0.5.23, 2026-11-02
Release commit
297e54fd105e974cdf401e5b4d20253a22c16f90
Default branch
main 999a6fa3dc7cb4f9e10d7be8fab9ce5853ae2d4d
Fetched
2026-11-14
Takedowns
None.

Freeweights links to the project and does not host tool binaries.

Get it
InstallProject repository
Works with

33 catalog models. See the list