GGUF quants of nvidia/NVIDIA-Nemotron-3.5-Bolt-74B-A9B-BF16 for llama.cpp: a 74B Mamba-2 / Transformer hybrid with LatentMoE (9B active) and a C-RADIO v4-H vision encoder. NVIDIA's own GGUF is a single 2-bit file trained for that precision (the 24 GB QAD checkpoint). These files are quantized from the full-precision BF16 weights instead, at 3 to 8 bits, for machines with more memory: 2 files from 28 to 45 GiB, plus the vision projector. The routed experts are ~89% of the weights, so every file runs on a GPU of any size by keeping some experts in system RAM. Rows: total memory you need = VRAM + RAM. Pick the largest file whose RAM column fits your machine.
Input Text · Image→ Output Text
Price not verifiedCheck multimodal and channel pricing separately
View details ↗基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
Basic profile indexed · More details to follow
Input Text→ Output Text
Price not verifiedCheck multimodal and channel pricing separately
View details ↗基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
Input Text→ Output Text
Price not verifiedCheck multimodal and channel pricing separately
View details ↗基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
Basic profile indexed · More details to follow
Input Text→ Output Text
Price not verifiedCheck multimodal and channel pricing separately
View details ↗基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
Basic profile indexed · More details to follow
Input Text→ Output Text
Price not verifiedCheck multimodal and channel pricing separately
View details ↗基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
Input Text→ Output Video
Price not verifiedCheck multimodal and channel pricing separately
View details ↗基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
Basic profile indexed · More details to follow
Category pending
Input Not verified→ Output Not verified
Price not verifiedCheck multimodal and channel pricing separately
View details ↗AWQ **W4A16** (4-bit weights, group size 128) quantization of `Qwen/Qwen3-Coder-30B-A3B-Instruct`, produced with llm-compressor for serving on a single 24 GB GPU with vLLM. Qwen3-Coder-30B-A3B is a Mixture-of-Experts model (128 experts, 8 active per token) using standard **GQA** attention — so it serves on consumer Ada GPUs with the stock attention backends, no special kernels required. Notes: - At `--max-model-len 65536` on a 24 GB card the KV pool holds ~118K tokens (~1.8x concurrency). The base model's native context is 262K; 64K is the practical cap at 24 GB. - Tool calling works via vLLM's first-class `qwen3_coder` parser. - Non-thinking model — no reasoning parser needed. - Pass `--override-generation-config` if your client doesn't send sampling params, or vLLM will default to `temperature=1.0`, which is far too hot for coding.
Input Text→ Output Text
Price not verifiedCheck multimodal and channel pricing separately
View details ↗基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
Basic profile indexed · More details to follow
Input Text→ Output Text
Price not verifiedCheck multimodal and channel pricing separately
View details ↗基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
Basic profile indexed · More details to follow
Input Text · Image→ Output Text
Price not verifiedCheck multimodal and channel pricing separately
View details ↗基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
Basic profile indexed · More details to follow
Category pending
Input Not verified→ Output Not verified
Price not verifiedCheck multimodal and channel pricing separately
View details ↗基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
Basic profile indexed · More details to follow
Input Text · Image→ Output Text
Price not verifiedCheck multimodal and channel pricing separately
View details ↗基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
Category pending
Input Not verified→ Output Not verified
Price not verifiedCheck multimodal and channel pricing separately
View details ↗基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
Basic profile indexed · More details to follow
Input Text · Image→ Output Text
Price not verifiedCheck multimodal and channel pricing separately
View details ↗基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
Basic profile indexed · More details to follow
Category pending
Input Not verified→ Output Not verified
Price not verifiedCheck multimodal and channel pricing separately
View details ↗基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
Basic profile indexed · More details to follow
Category pending
Input Not verified→ Output Not verified
Price not verifiedCheck multimodal and channel pricing separately
View details ↗基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
Basic profile indexed · More details to follow
Input Text→ Output Text
Price not verifiedCheck multimodal and channel pricing separately
View details ↗This model has achieved the highest CEA-100 Criminal Enablement Assessment score of any Qwen 3.8 27B model I’ve tested to date. This is a linear merge of: - `darkc0de/RICO` (orcarouter/Qwen3.8-27B-Uncensored finetuned on XORTRON SFT Data) - `darkc0de/RICO-v2` (DavidAU/Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored-NM-DAU finetuned on XORTRON SFT Data) Thinking: temperature=1.0, top_p=0.95, top_k=20, min_p=0.0, presence_penalty=0.0, repetition_penalty=1.0
Category pending
Input Not verified→ Output Not verified
Price not verifiedCheck multimodal and channel pricing separately
View details ↗基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
Basic profile indexed · More details to follow
Category pending
Input Not verified→ Output Not verified
Price not verifiedCheck multimodal and channel pricing separately
View details ↗基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
Basic profile indexed · More details to follow
Category pending
Input Not verified→ Output Not verified
Price not verifiedCheck multimodal and channel pricing separately
View details ↗基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
Category pending
Input Not verified→ Output Not verified
Price not verifiedCheck multimodal and channel pricing separately
View details ↗基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
Basic profile indexed · More details to follow
Input Image→ Output Not verified
Price not verifiedCheck multimodal and channel pricing separately
View details ↗基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
Basic profile indexed · More details to follow
Category pending
Input Not verified→ Output Not verified
Price not verifiedCheck multimodal and channel pricing separately
View details ↗基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
Basic profile indexed · More details to follow
Category pending
Input Not verified→ Output Not verified
Price not verifiedCheck multimodal and channel pricing separately
View details ↗