DeepSeek-V4.1-Flash-ROCMFP23-GGUF

모델 소개

Lucebox builds of DeepSeek V4.1 Flash for the Lucebox DS4.1 engine (AMD R9700 + Strix Halo). Routed experts in the engine's ROCMFP block formats; attention, shared experts and head in Q8_0; both Engram tables embedded. Calibrated with the published 262,144-token imatrix (`smalinin/DeepSeek-V4.1-Flash-GGUF`, converted in `imatrix/`). Formats: `Q2_0_ROCMFP2` (ggml type 107, 10 bytes per 32 weights, 2.5 bits, codebook {-1, 0, 1, 2} x a ue4m3 scale per 16 weights), `Q3_0_ROCMFPX` (type 104, 14 bytes per 32, 3.5 bits). **fp2s** files use type 107 with bit 7 of a half-block's scale byte meaning "mirror the codebook"; a reader that ignores that bit produces garbage, so use an engine build that honors it. KL is measured on 8,184 held-out fineweb-edu tokens against the unquantized model through the same reference forward pass (`eval/` holds the teacher log-probs and the tokens). Recipe, converter patches and harness: Lucebox repo, `lucebox_training/quantization`. `DeepSeek-V4.1-Flash-mmproj-BF16.gguf` (0.90 GiB): this checkpoint's vision encoder (32-layer ViT and the aligner into the 5120-wide model), its 266 tensors copied byte for byte in BF16 by the engine's `server/tools/export_ds4v_mmproj.py`, with the checkpoint revision recorded (sha256 in `vision/`). Pass it with `--mmproj` to an engine build with V4.1 image input, next to these September files only: the October 17 checkpoint retrained its encoder and ships its own in `Lucebox/DeepSeek-V4.1-Flash-1017-ROCMFP-GGUF`. The engine refuses an encoder from another checkpoint than the target's.

주요 특징

特点摘要待依据来源补齐，不凭模型名称推断能力。

한계 및 유의 사항

구체적 한계를 판단할 출처가 부족합니다. 실제 성능, 지연, 데이터 정책, 라이선스와 버전 수명을 확인하세요.

출처별 요금 및 비용 분석

요금은 채널, 지역, 설정에 따라 다릅니다. 각 채널 요금은 개별 표시되며 제공사의 통일 공식 요금이 아닙니다.

공개 평가 및 실행 설정

暂无已采集的可核验公开评分。模型未上榜不代表能力较低。

자주 묻는 질문

출처 및 추적 기록

许可证：mit。模型介绍与第三方评测均以原来源的具体版本和方法为准。