Model overview
> [!Note] > This model works with vLLM. It also works with SGLang, but only with the v0.5.19, because the `lm_head` is FP8 rather than 4-bit. This NVFP4 quant uses Unsloth Dynamic V3.0 (preview) for SOTA quantization performance. Developer Role Support so Qwen3.8 can work in agentic tools like Codex and more! MTP for fast inference is available. Qwen3.8 can now be run and fine-tuned in Unsloth Desktop . Read our guide . Tool calling improvements: Makes parsing nested objects to make tool calling succeed more. See below for 4-bit Qwen3.8-27B run inside of Unsloth Desktop:
The summary below is compiled from sources by an AI model, not our own testing. Verify selection decisions against original sources and your workload.
Key features
- 支持 vLLM 和特定版本 SGLang(v0.5.19)推理,因 lm_head 采用 FP8 而非 4-bit
- 基于 Unsloth Dynamic V3.0(preview)的 NVFP4 量化方案,宣称具备当前最优(SOTA)量化性能
- 增强工具调用能力,改进嵌套对象解析以提升工具调用成功率;支持开发者角色与智能体(agentic)工具集成(如 Codex)
Limitations & considerations
- 仅兼容 SGLang v0.5.19,更高版本可能不支持(因 lm_head 精度不匹配)
- 需依赖 Unsloth 生态(如 Unsloth Desktop)实现运行与微调,通用框架兼容性未明确说明
- NVFP4 为预览版量化技术,动态量化稳定性与泛化性未提供实证数据
Source prices & cost analysis
Prices vary by channel, region and configuration. Channel quotes are listed independently and are not treated as a single official provider price.
| Source / channel | Input | Output | Billing unit | Collected at |
|---|---|---|---|---|
| No verified prices yet. Check the source channel. | ||||
Estimate monthly base token costs
Estimates exclude cache discounts, tiered pricing, multimodal surcharges, web search, taxes and additional reasoning output.
Public benchmarks & run configuration
暂无已采集的可核验公开评分。模型未上榜不代表能力较低。
View full indexed rankings →Frequently asked questions
该模型是否支持标准 4-bit 量化推理?
不支持标准 4-bit;其 lm_head 为 FP8,NVFP4 是 Unsloth Dynamic V3.0 的专用量化格式。
能否在非 Unsloth 环境中部署 Qwen3.8-27B-NVFP4?
可在 vLLM 中直接部署;SGLang 仅限 v0.5.19 版本;其他框架未提及支持,需自行验证兼容性。
工具调用改进具体指哪些能力提升?
优化了对嵌套 JSON 结构的解析能力,使模型生成的工具调用参数更易被解析器正确提取,从而提高调用成功率。
Do open weights permit free commercial use?
Not necessarily. Check the version license, commercial conditions and usage policies. Self-hosting incurs compute and maintenance costs.
Are these real-time billing prices?
These are timestamped source snapshots, not live billing prices. Check the channel for current versions, regions, discounts and billing methods.
Sources & traceability
许可证:apache-2.0。模型介绍与第三方评测均以原来源的具体版本和方法为准。