gemma-4-26B-A4B-it-assistant-GGUF
AtomicChat基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
언어부터 이미지, 오픈 웨이트부터 API까지. 기능과 실제 비용을 비교하세요.
다음 아이디어에 맞는 AI를 찾아보세요.
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
**Gemma 4 26B A4B**, self-quantized to GGUF by Atomic Chat. Built straight from Google's original weights with a per-tensor importance matrix, so this is not a repack of somebody else's files. Runs fully offline. > [!NOTE] > These GGUFs are **self-quantized from the original weights**, not a repack. The importance matrix keeps low-bit quants closer to the full-precision model. > [!IMPORTANT] > Always pass `--jinja` so the **Gemma 4 26B A4B chat template** is applied. Without it the model can emit malformed turns.
번역 대기 중 · 원문 표시
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
기본 정보 등록 · 상세 정보 보완 예정
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
**Gemma 4 E2B**, self-quantized to GGUF by Atomic Chat. Built straight from Google's original weights with a per-tensor importance matrix, so this is not a repack of somebody else's files. Runs fully offline. > [!NOTE] > These GGUFs are **self-quantized from the original weights**, not a repack. The importance matrix keeps low-bit quants closer to the full-precision model. > [!IMPORTANT] > Always pass `--jinja` so the **Gemma 4 E2B chat template** is applied. Without it the model can emit malformed turns.
번역 대기 중 · 원문 표시
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
기본 정보 등록 · 상세 정보 보완 예정
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
기본 정보 등록 · 상세 정보 보완 예정
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
기본 정보 등록 · 상세 정보 보완 예정
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
기본 정보 등록 · 상세 정보 보완 예정
Liquid's refusal behaviour projected out of the original weights, in the second two thirds of the network only. Shipped two ways: six baked GGUF builds, and a 24 MB LoRA adapter for the LFM2.5-24B-A2B quants you already have. The measurements behind this card are public. Built by the team behind Atomic Chat , the app that runs open-weight models locally and offline. On held-out prompts, refusals fall from 96.3% to 1.2% in English, and from 30 of 30 to none with thinking. MMLU stays where it was: 64.40% before, 65.55% after (inside the noise). No empty or looping replies. Only blocks 14-39 are edited. The same edit across all 40 blocks also removed the refusals, but cost 4 MMLU points; the first 14 blocks carry the damage, not the refusal. Already running our LFM2.5-24B-A2B quants ? Add the adapter with --lora-scaled instead of downloading a new model. **`AD-Q4_K_M` is the one to take** on a 24 GB machine. With 32 GB, `AD-Q6_K` is nearly as close to the original as `AD-Q8_0` at 5 GB less; `AD-IQ3_M` is the smallest build here. Refusals were measured on `AD-Q8_0` and `AD-Q4_K_M`; neither gave an empty or looping reply. A smaller `AD-IQ3_XXS` (11.1 GB) was made too and is held back: it matched the original's token choice only 74.5% of the time and refused 3.7% of English prompts.
번역 대기 중 · 원문 표시
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
기본 정보 등록 · 상세 정보 보완 예정
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
기본 정보 등록 · 상세 정보 보완 예정
Ling 3.0 flash is a 124B MoE with 5.1B active parameters; its GGUF chat template includes thinking mode and tool calling. Our AD layouts have 31–41% lower mean KL than stock llama.cpp presets at comparable sizes. The raw measurements and controls are public. From the team behind Atomic Chat , the local AI app for chat and agents. These Ling files require our TurboQuant build; use the CLI instructions below . The tests documented below cover the CLI workflow, not app compatibility. Quantizations of `inclusionAI/Ling-3.0-flash`: 124B total, 5.1B active, hybrid linear attention (35 KDA blocks interleaved 5:1 with 7 gated MLA blocks) over a 512-expert MoE. Bits are placed by hand rather than by the default rules, and the controls that prove it is worth something are published next to the files. At the same size, our layout sits 31 to 41 % closer to BF16 than what `llama-quantize` produces on its own
번역 대기 중 · 원문 표시
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
기본 정보 등록 · 상세 정보 보완 예정
Built from inclusionAI's original weights with our own importance matrix. The calibration corpora behind our builds are public. You can now run Ling in Atomic Chat . See our quantization analysis below for measurements and instructions. Every number below is measured, not estimated. How we measured it is at the bottom, and the raw logs are in the metrics repo so you can check any of it yourself.
번역 대기 중 · 원문 표시
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
기본 정보 등록 · 상세 정보 보완 예정
GGUF quants of Nanbeige's Nanbeige4.3-33B, built from Nanbeige's original BF16 weights on release day. Nanbeige4.3-33B is Nanbeige's 33B dense agent and reasoning model (Llama architecture, 512K context, thinking on by default), Apache-2.0. You can now run Nanbeige4.3-33B in Atomic Chat , with thinking on by default. Atomic Dynamic (AD) files with our own importance matrix, from 13.7 GB to 30.1 GB on disk, plus plain Q8_0 and Q5_K_M ; every one measured against the BF16 original on one stand. > [!NOTE] > **Built on release day, 25 October.** `Q8_0` and `Q5_K_M` are llama.cpp's own > presets, made without an importance matrix; its `Q6_K` and `Q4_K_M` were up > for the first hours and are removed now that `AD-` files beat them at the same > size (their numbers stay below as the baseline). The `AD-` files > use our own importance matrix, collected on the BF16 weights (`--parse-special`) > over 8,000 chunks of 512 tokens of our calibration corpus. The corpus build was > rendered for Qwen3.8-27B, whose chat format (ChatML) Nanbeige4.3 shares; it is > `imatrix/imatrix.gguf` in the metrics repo.
번역 대기 중 · 원문 표시
Atomic Dynamic (AD) quants of NVIDIA's Nemotron 3.5 Bolt E4B, built from NVIDIA's original BF16 weights. From 4.0 GB to 8.0 GB on disk. Bolt E4B is NVIDIA's small reasoning and chat model, post-trained from Google's Gemma-4-E4B-it . You can now run Nemotron 3.5 Bolt E4B, NVIDIA's on-device model, in Atomic Chat . Every file here was measured against the BF16 original on one stand, next to the other publishers' files. > [!NOTE] > **Built on release day, 23 October.** Every `AD-` file below `AD-Q6_K` was > rebuilt the same evening with a better layout (below). `AD-Q4_K_M` uses our own > importance matrix, collected on the BF16 weights over a corpus rendered through > this model's chat template (`imatrix/imatrix.gguf` in the metrics repo). The > other files use Unsloth's published one (`imatrix_unsloth.gguf` from > unsloth/NVIDIA-Nemotron-3.5-Bolt-E4B-GGUF): > we built `AD-Q5_K_M` to `AD-IQ3_S` with both, and on held-out code the two > came out within noise of each other, slightly ahead with Unsloth's at 3 bits. > `AD-IQ3_XXS` (3.82 GB) was taken down the same evening: it picked the > original's next word only 74.6% of the time, below the 75% we publish at.
번역 대기 중 · 원문 표시
NVIDIA's refusal behaviour projected out of the released weights, baked into Atomic Dynamic GGUF builds and shipped as a 3.5 MB LoRA, measured against the original. On held-out JailbreakBench prompts refusals fall from 93.8% to 1.2%, on the safe XSTest prompts from 9.2% to 0.4%, and with thinking on from 29 of 30 to none. MMLU: 68.50% before, 67.85% after (2000 questions, McNemar p = 0.21). Tool calls and long context are unaffected. You can now run the Uncensored Nemotron 3.5 Bolt E4B in Atomic Chat , locally on your own machine. One release-gate is not met, and we say so: on harmless prompts the first token moves further from the original than our 0.10 limit (KL 0.141). On this model even a random direction edited the same way moves neutral text noticeably ( limitations ). Gemma 4 normalises every write into the residual stream with its own weights before adding it, so the edit is computed through those norms: each matrix stops writing the refusal direction as it lands in the stream, not before the norm. Built on the same weights as our Nemotron 3.5 Bolt E4B quants ; the LoRA loads on top of any of those files. KLD and top-1 are against the **original, unmodified** BF16 model on our held-out neutral text (24 chunks of 4096 tokens), so they hold the edit and the quantization together. The edit alone, on the BF16 weights, is 0.159; the plain `AD-Q6_K` of the original model is 0.026 and `AD-Q4_K_M` 0.091 on the same text, so at `AD-Q6_K` almost all of the distance is the edit itself.
번역 대기 중 · 원문 표시
제공사, 분류, 입출력 조건을 조정하세요. 새 모델이 계속 등록됩니다.
월간 토큰 사용량으로 예상 API 비용을 비교하세요.
수집된 백만 토큰당 USD 요금입니다. 캐시 할인, 구간 요금, 추가 추론 출력, 세금은 제외됩니다. 최신 요금은 출처에서 확인하세요.
입력, 출력, 캐시 요금을 구분하고 동일 작업량으로 비교하세요. 이미지, 음성, 영상은 개수, 시간, 해상도로 과금될 수 있습니다.
반드시 그렇지는 않습니다. 버전별 라이선스, 상업 이용 제한, 정책을 확인하세요. 자체 호스팅에는 연산 및 유지 비용도 듭니다.
순위는 작업, 버전, 평가 방식에 따라 다릅니다. 실제 업무로 정확도, 지연, 안정성, 비용을 비교하세요.