**Gemma 4 31B**, self-quantized to GGUF by Atomic Chat. Built straight from Google's original weights with a per-tensor importance matrix, so this is not a repack of somebody else's files. Runs fully offline. > [!NOTE] > These GGUFs are **self-quantized from the original weights**, not a repack. The importance matrix keeps low-bit quants closer to the full-precision model. > [!IMPORTANT] > Always pass `--jinja` so the **Gemma 4 31B chat template** is applied. Without it the model can emit malformed turns.
번역 대기 중 · 원문 표시
입력 텍스트 · 이미지→ 출력 텍스트
**Gemma 4 E4B**, self-quantized to GGUF by Atomic Chat. Built straight from Google's original weights with a per-tensor importance matrix, so this is not a repack of somebody else's files. Runs fully offline. - **4.5B effective (8B with embeddings) parameters**: the weights this repo quantizes. - **Context length**: 128K tokens, as published by Google. - **42 layers**: Dense decoder, hybrid sliding-window (512) and global attention. - **Modalities**: Text, Image, Audio. - **Full imatrix ladder**: every quant is calibrated with an importance matrix, published here alongside the quants. - **Reasoning**: All models in the family are designed as highly capable reasoners, with configurable thinking modes. - **Diverse & Efficient Architectures**: Offers Dense and Mixture-of-Experts (MoE) variants of different sizes for scalable deployment. > [!NOTE] > These GGUFs are **self-quantized from the original weights**, not a repack. The importance matrix keeps low-bit quants closer to the full-precision model.
번역 대기 중 · 원문 표시
입력 텍스트 · 이미지→ 출력 텍스트
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
기본 정보 등록 · 상세 정보 보완 예정
입력 텍스트 · 이미지→ 출력 텍스트
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
입력 텍스트 · 이미지→ 출력 텍스트
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
기본 정보 등록 · 상세 정보 보완 예정
입력 텍스트 · 이미지→ 출력 텍스트
Built from openbmb's original weights with our own importance matrix. The calibration corpora behind our builds are public. You can now run MiniCPM in Atomic Chat . See our quantization analysis below for measurements and instructions. Every number below is measured, not estimated. How we measured it is at the bottom, and the raw logs are in the metrics repo so you can check any of it yourself.
번역 대기 중 · 원문 표시
입력 텍스트 · 이미지→ 출력 텍스트
Built from openbmb's original weights with our own importance matrix. The calibration corpora behind our builds are public. You can now run MiniCPM in Atomic Chat . See our quantization analysis below for measurements and instructions. Every number below is measured, not estimated. How we measured it is at the bottom, and the raw logs are in the metrics repo so you can check any of it yourself.
번역 대기 중 · 원문 표시
입력 텍스트 · 이미지→ 출력 텍스트
One refusal direction projected out of OpenBMB's original weights, shipped two ways: three baked GGUF builds, and a 106 MB LoRA adapter for the MiniCPM-V 4.7 quants you already have. The measurements behind this card are public. On held-out prompts, refusals fall from 96.3% to 0% in English, and from 13 of 30 to none with thinking on. MMLU moves by 0.25 points, inside the noise. You can now run the Uncensored MiniCPM-V 4.7 in Atomic Chat , locally on your own machine. The 20.1 GB build matches the original's token choice 94.5% of the time; our quant of the unmodified model at the same size does 94.9%. Already running our MiniCPM-V 4.7 quants ? Add the adapter with --lora-scaled instead of downloading a new model. *28 Oct 2026: each build is now a single file instead of 11 to 16 shards of 2 GB. The weights are unchanged (tensor-for-tensor identical).*
번역 대기 중 · 원문 표시
입력 텍스트 · 이미지→ 출력 텍스트
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
입력 텍스트 · 이미지→ 출력 텍스트
GGUF builds of Meta's Muse Glimmer 30B, made from the original BF16 weights with a calibrated importance matrix and a bit layout chosen by measurement. > [!NOTE] > Support was merged into llama.cpp master in > #26841 (commit `62bf73d`). > You need a build from master — the last tagged release predates it. > [!TIP] > `AD-Q6_K` at 28.3 GB is dominated by plain `Q8_0` at 29.6 GB, which is 1.3 GB larger > and 31 % more accurate. Take `Q8_0` instead unless you need exactly that size.
번역 대기 중 · 원문 표시
입력 텍스트 · 이미지→ 출력 텍스트
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
기본 정보 등록 · 상세 정보 보완 예정
입력 텍스트 · 이미지→ 출력 텍스트
Atomic Dynamic (AD) quants, built from NVIDIA's original BF16 weights with our own importance matrix. At 21.9 GB, AD-IQ1_M_S stays closer to the original than NVIDIA's own 22.0 GB 2-bit file, measured side by side on one stand. The calibration corpora behind our builds are public. Every file here was measured against the BF16 original on the same stand as the other publishers' files. You can now run Nemotron 3.5 Bolt in Atomic Chat : 74B total parameters, 9B active per token. See our quantization analysis below for measurements and instructions. Lower is closer to the original. Each purple point is a file in this repo; the grey ones are other GGUF files of this model, downloaded and measured with exactly the same reference, text and llama.cpp build. NVIDIA's 2-bit file (the one Unsloth and LM Studio ship too) is a quantization-aware-trained checkpoint, so its distance to the BF16 weights also includes what that training changed; see below.
번역 대기 중 · 원문 표시
입력 텍스트 · 이미지→ 출력 텍스트
NVIDIA's refusal behaviour projected out of the released weights, baked into Atomic Dynamic GGUF builds and measured against the original. On held-out JailbreakBench prompts refusals fall from 97.5% to 0%, and with thinking on from 30 of 30 to none (2 of 30 on the 22 and 29 GB files). MMLU stays where it was: 81.35% before, 81.75% after (2000 questions, McNemar p = 0.29). Tool calls and long context are unaffected. You can now run the Uncensored Nemotron 3.5 Bolt in Atomic Chat , locally on your own machine. Made from the full-precision release, not from NVIDIA's 24 GB file, and measured on one stand against the other public Bolt abliterations: at 22 GB ours is the closest to the original and the only one that neither refuses with thinking off nor breaks into repeated text ( table ). The refusal is written into the residual stream by every kind of block: the edit covers the Mamba-2 outputs, the attention outputs, the shared experts and the latent projection through which all routed experts write. Same Atomic Dynamic layouts and importance matrix as our Nemotron 3.5 Bolt quants ; each file is the size of the original build with the same name. *28 Oct 2026: re-split from 2 GB shards: `AD-IQ2_XS` and `AD-IQ1_M_S` are now a single file each, `AD-Q4_K_M` two files cut at 45 GB. The weights are unchanged (tensor-for-tensor identical).*
번역 대기 중 · 원문 표시
입력 텍스트 · 이미지→ 출력 텍스트
Atomic Dynamic (AD) quants, built from NVIDIA's original BF16 weights with our own importance matrix. Every file here matches or beats the other GGUF builds of the same size or larger, measured side by side on one stand. The calibration corpora behind our builds are public. Every file here was measured against the BF16 original on the same stand as the other publishers' files, and each one beats or ties the file of theirs that is the same size or larger. You can now run Nemotron 3.5 Super in Atomic Chat : 120B total parameters, 12B active per token. See our quantization analysis below for measurements and instructions. Lower is closer to the original. Each purple point is a file in this repo; the grey ones are the other publishers' files, downloaded and measured with exactly the same reference, text and llama.cpp build. At 75 GB, `AD-IQ4_NL` drifts about half as much as both NVFP4 builds, which are the same size or up to 3 GB larger. At 70 GB, `AD-IQ3_M` drifts about half as much as LM Studio's `Q4_K_M` of the same size. At 65 GB, `AD-IQ3_XXS` drifts 20% less than Unsloth's `UD-Q3_K_XL`, and from 46 to 58 GB the `AD-Q2_0_*` files drift 6 to 18% less than the Unsloth file of each size, and at 87 GB `AD-Q4_K_S` drifts 13% less than `UD-Q4_K_XL`.
번역 대기 중 · 원문 표시
입력 텍스트 · 이미지→ 출력 텍스트
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
기본 정보 등록 · 상세 정보 보완 예정
입력 텍스트 · 이미지→ 출력 텍스트
Built from ornith-ai's original weights with our own importance matrix. The calibration corpora behind our builds are public. You can now run Ornith in Atomic Chat . See our quantization analysis below for measurements and instructions. Every number below is measured, not estimated. How we measured it is at the bottom, and the raw logs are in the metrics repo so you can check any of it yourself.
번역 대기 중 · 원문 표시
입력 텍스트 · 이미지→ 출력 텍스트
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
입력 텍스트 · 이미지→ 출력 텍스트
Built from Ornith's original weights with our own importance matrix. The calibration corpora and raw eval logs behind this card are public. See our quantization analysis below for measurements and instructions. You can now run Ornith 1.5 in Atomic Chat with toggles for thinking. GGUF builds of ornith-ai/Ornith-1.5-35B-A3B, converted and measured by AtomicChat.
번역 대기 중 · 원문 표시
입력 텍스트 · 이미지→ 출력 텍스트
Built from Ornith's original weights with our own importance matrix. The calibration corpora and raw eval logs behind this card are public. Learn how to run Ornith 1.5 9B locally - read our guide . You can now run Ornith 1.5 in Atomic Chat with toggles for thinking. See our quantization analysis below for measurements and instructions. GGUF builds of ornith-ai/Ornith-1.5-9B, converted and measured by AtomicChat.
번역 대기 중 · 원문 표시
입력 텍스트 · 이미지→ 출력 텍스트
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
기본 정보 등록 · 상세 정보 보완 예정
입력 텍스트 · 이미지→ 출력 텍스트
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
입력 텍스트 · 이미지→ 출력 텍스트
Built from Qwen's original weights with our own importance matrix. The calibration corpora behind our builds are public. Learn how to run Qwen3.8 27B locally - read our guide . You can now run Qwen3.8 in Atomic Chat with toggles for thinking. See our quantization analysis below for measurements and instructions. Every quantization of this model we could find, ours and everyone else's, measured against the original weights on the same held-out text. The dashed line is the best file available at each size from anyone but us.
번역 대기 중 · 원문 표시
입력 텍스트 · 이미지→ 출력 텍스트
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
기본 정보 등록 · 상세 정보 보완 예정
입력 텍스트 · 이미지→ 출력 텍스트
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
입력 텍스트 · 이미지→ 출력 텍스트