DeepSeek-V4.1-Flash-1017-REAP192-GGUF
patrickbdevaney基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
基础资料已收录 · 缺失资料后续补充
从语言到影像,从开源到 API。读懂模型能力、比较真实成本,
为你的下一个想法,找到合适的智能引擎。
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
基础资料已收录 · 缺失资料后续补充
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
基础资料已收录 · 缺失资料后续补充
**50% expert-pruned `zai-org/GLM-5.3-Flash` (301B → 157B total, 12.5B active) in GGUF (`IQ3_M` to `Q4_K_M`, 72.9–94.8 GiB) with preserved `Q8_0` MLA + Indexer attention.** **GLM-5.3-Flash-REAP50-GGUF** provides single-file GGUF quantizations of `zai-org/GLM-5.3-Flash` compressed with **REAP-50** (Router-weighted Expert Activation Pruning, retaining **128 of 256 routed experts per MoE layer**). Total parameters drop from **301B to 157B** while active parameters per token remain **12.5B** (top-8 of 128 routed experts + 1 shared expert + Multi-head Latent Attention + Dynamic Sparse Attention Indexer), fitting comfortably inside a single **128 GB unified-memory system** (NVIDIA Jetson AGX Thor, DGX Spark, Mac Studio, or Strix Halo) with up to 202K context. - **50% Routed-Expert Compression (301B → 157B Total, 12.5B Active):** Retains 128 of 256 routed experts across all 75 MoE layers (`layers 3..77`) using a 5-pool domain-balanced REAP saliency calibration (`general`, `code`, `math`, `Chinese`, `tool-use`) with union top-16 specialist protection and frequency-floor guards (`f_j >= 40`). - **Two Weight Vintages Disclosed Transparently (`v2` vs `v3`):** - **`Q4_K_M` (94.8 GiB) & `Q3_K_M` (77.3 GiB) are `v3`** (uploaded 2026-10-20): include the **layer-78 MTP draft head** (`nextn.*` tensors) and the **layer-77 shared-expert output-scale correction (`0.7209x`)** that removes high-entropy tail collapse (`kl_full` reduced from `0.506` to `0.388`). - **`Q4_K_S` (90.0 GiB), `IQ4_XS` (85.6 GiB), & `IQ3_M` (72.9 GiB) are `v2`** (uploaded 2026-10-16): 78-layer (`0..77`) builds without the layer-77 shared-expert scale or layer-78 MTP tensors. - **Uncompromised `Q8_0` Attention & DSA Indexer Path:** Every quantization preserves **all MLA (`wq_a`, `wq_b`, `wkv_a_mqa`, `wkv_b`, `wo`), DSA Indexer (`indexer.wq_b`, `indexer.wk`, `indexer.k_norm`, `indexer.weights_proj`), shared experts (`ffn_*_shexp`), and dense layers (`0..2`) at `Q8_0` or `F32`**, quantizing only the routed expert banks (`ffn_gate_exps`, `ffn_up_exps`, `ffn_down_exps`). - **Paired Held-Out Teacher Evaluation (`262,144` Tokens across 64 Prompts × 4,096 Context):** Evaluates directly against the unpruned 301B `zai-org/GLM-5.3-Flash` teacher: `Q4_K_M` achieves **`0.3204` top-32 KL divergence** and **`83.39%` top-1 argmax agreement** (`88.2%` on math, `86.7%` on Chinese, `86.5%` on code).
译文排队中 · 当前显示来源原文
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
基础资料已收录 · 缺失资料后续补充
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
基础资料已收录 · 缺失资料后续补充
**GGUF quantizations (`MXFP4_MOE` 86.7 GiB, `Q3_K_S` 77.7 GiB, `Q2_K` 64.8 GiB) + multimodal projector (`mmproj`) + 3-layer MTP draft head of 50%-pruned `XiaomiMiMo/MiMo-V2.6-Flash` (315B → 164B total, 11B active).** GGUF quantizations of **`patrickbdevaney/MiMo-V2.6-Flash-REAP50`** — a **50% REAP expert-pruned** derivative of `XiaomiMiMo/MiMo-V2.6-Flash` (**315B → 164B total parameters**, **11B active parameters** per token, **256 → 128 routed experts** per MoE layer across all 59 MoE layers). 1. **`Q3_K_S` and `Q2_K` were quantised with the custom Python/CUDA converter (`scripts/quantize_gguf_variants.py`), not `llama-quantize --imatrix`.** - Because stock `llama.cpp` does not yet support the `mimo2` hybrid-MLA architecture (see Runtime Compatibility below), `llama-quantize` could not be used to produce `Q3_K_S` or `Q2_K`. - Instead, `scripts/quantize_gguf_variants.py` dequantised the `MXFP4_MOE` expert tensors (`blk.*.ffn_{gate,up,down}_exps.weight`) and packed them directly into `GGML_TYPE_Q3_K` (`3.4375 bpw`) and `GGML_TYPE_Q2_K` (`2.625 bpw`) using standard min-max / absmax block scales on GPU. - The file `MiMo-V2.6-Flash-REAP50.imatrix` (`75.8 MiB`, 357 entries) is published in this repository for downstream use once `llama.cpp` lands `mimo2` support, and contains real activation $\mathbb{E}[x^2]$ statistics collected during the 610,304-token REAP calibration pass — **however, those importance weights were NOT used when computing the scales inside the currently uploaded `Q3_K_S.gguf` and `Q2_K.gguf` files.** An earlier bullet on this card described `MiMo-V2.6-Flash-REAP50.imatrix` as "used for Q3_K/Q2_K quantization"; that was inaccurate and has been corrected here. 2. **No post-pruning router or weight "healing" was applied.** - Every surviving expert tensor in `MiMo-V2.6-Flash-REAP50-MXFP4_MOE.gguf` is a lossless repack of the upstream `XiaomiMiMo/MiMo-V2.6-Flash` OCP MXFP4 nibbles and `E8M0` scales, and every router `ffn_gate_inp.weight` (`[128, 4096]`) and `exp_probs_b.bias` (`[128]`) is an exact unmodified slice of the 128 kept experts per layer. 3. **Held-out teacher-vs-student KL / NLL benchmark status: not yet evaluated.** - Unlike `GLM-5.3-Flash-
译文排队中 · 当前显示来源原文
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
基础资料已收录 · 缺失资料后续补充
可以调整厂商、分类或输入输出条件;新模型正持续收录。
调整月度 Token 用量,直观比较不同模型的预估 API 开支。
使用已采集且单位可比的 USD / 百万 Token 渠道报价。报价为采集时快照;不计缓存优惠、阶梯价、推理额外输出与税费,请以来源的当前报价为准。
先区分输入、输出和缓存价格,再使用同一任务和用量估算总费用。图像、音频和视频可能按张、时长或分辨率计费,不能直接与 Token 单价比较。
不一定。必须逐一核对具体模型版本的许可证、商用限制及使用政策。自己部署还需要考虑显存、推理资源和运维费用。
榜单取决于测试任务、版本与评测方法。建议用实际业务样本比较准确性、时延、稳定性和成本,再选择模型。