> **Join the Discord** for updates, roadmaps, projects, or just to chat. No changes to datasets or capabilities. Fully functional, 100% of what the original authors intended - just without the refusals. Stronger uncensoring — model is fully unlocked and won't refuse prompts. May occasionally append short disclaimers (baked into base model training, not refusals) but full content is always generated.
번역 대기 중 · 원문 표시
입력 텍스트 · 이미지→ 출력 텍스트
> **Join the Discord** for updates, roadmaps, projects, or just to chat. > **Not sure which variant to pick?** 99.9%+ of users should use **Balanced** — same 0/465 refusal rate, more stable sampling, great for agentic coding / tool-use / reasoning / creative writing. Pick **Aggressive** only if you specifically want the model to skip its preamble on hardcore prompts. > **HuggingFace's "Hardware Compatibility" widget doesn't recognize K_P quants** — it may show fewer files than actually exist. Click **"View +X variants"** or go to **Files and versions** to see all available downloads.
번역 대기 중 · 원문 표시
입력 텍스트 · 이미지→ 출력 텍스트
> **Join the Discord** for updates, roadmaps, projects, or just to chat. > **HuggingFace's "Hardware Compatibility" widget doesn't recognize K_P quants** — it may show fewer files than actually exist. Click **"View +X variants"** or go to **Files and versions** to see all available downloads. No changes to datasets or capabilities. Fully functional, 100% of what the original authors intended — just without the refusals.
번역 대기 중 · 원문 표시
입력 텍스트 · 이미지→ 출력 텍스트
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
기본 정보 등록 · 상세 정보 보완 예정
입력 텍스트 · 이미지→ 출력 텍스트
> [!IMPORTANT] > ### MTP Layers Grafted on Unsloth UD XL Quantizations > > The GGUF files in this repo are **Unsloth Dynamic 2.0 XL (UD XL) quantizations** of Qwen3.6-35B-A3B > with **Multi-Token Prediction (MTP) layers grafted on top**. > > - **Base quantization:** Unsloth UD XL — see > Unsloth Dynamic 2.0 GGUFs for benchmarks. > - **MTP layers:** Taken from > am17an/Qwen3.6-35BA3B-MTP-GGUF > and stored in **Q8_0** precision, then merged into the UD XL GGUFs. > - **Why Q8 for MTP?** The draft heads are small relative to the base model, so Q8_0 keeps them > near-lossless while avoiding the overhead of full-requantizing the entire stack. > - **`convert.py`:** The script used to graft MTP layers into the UD XL GGUFs. Adapted from > this gist. > - **`35BA3B-MTP.gguf`:** The raw Q8_0 MTP layer source file (extracted only) used as input to `convert.py`. > > To run these files with MTP you need a custom build of **llama.cpp** that includes the MTP/speculative > decoding support from PR #22673. Follow the steps below. > > --- > > ### 🐳 Or Use Pre-built Docker Images (Recommended) > > Don't want to build from source? Ready-to-use Docker images with MTP support are available for multiple backends: > > > | Image | Backend | > |---|---| > | `havenoammo/llama:cuda13-server` | CUDA 13 | > | `havenoammo/llama:cuda12-server` | CUDA 12 | > | `havenoammo/llama:vulkan-server` | Vulkan | > | `havenoammo/llama:intel-server` | Intel (CPU/Xe) | > | `havenoammo/llama:rocm-server` | ROCm (AMD) | > > Quick start — running this model via Docker: > > The two flags that matter most for MTP are `--spec-type mtp` and `--spec-draft-n-max 3`. > See the Reddit post for more details and discussion. > > --- > > ### Building llama.cpp with MTP Support — Step by Step > > #### 1. Clone and enter the repo > > > #### 2. Fetch the latest remote changes > > This pulls all new refs from the upstream repository so you're working off the current tip of master. > > #### 3. Fetch PR #22673 as a local branch > > PR #22673 ("llama + spec: MTP Support") adds the speculative-decoding / MTP infrastructure that > lets `llama-server` consume multi-token prediction heads. We pull it directly without waiting for > i
번역 대기 중 · 원문 표시
입력 텍스트 · 이미지→ 출력 텍스트
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
기본 정보 등록 · 상세 정보 보완 예정
입력 텍스트 · 이미지→ 출력 텍스트
This is an uncensored version of Qwen/Qwen3.8-27B created with abliteration (see remove-refusals-with-transformers to know more about it). This is a crude, proof-of-concept implementation to remove refusals from an LLM model without using TransformerLens. The newly added **Huihui-Qwen3.8-27B-abliterated-Underdog-Saluki** series come from ConwayResearch/Underdog-Saluki-27B-1.0 and ukisai/Swift-1.5-Qwen3.8-27B-GSQ-RCO-GGUF. Only layers **22 to 52 (0-based indexing)** have been ablated, while the other layers remain unablated. It may come with a small disclaimer warning. Due to ConwayResearch/Underdog-Saluki-27B-1.0 not providing an imatrix file, we will attempt to perform ablation by mixing the GGUF weights of Swift-1.5 and ConwayResearch/Underdog-Saluki-27B-1.0.
번역 대기 중 · 원문 표시
입력 텍스트 · 이미지→ 출력 텍스트
**Holo3.1** is our latest family of Vision-Language Models (VLMs) for computer use agents. Building on Holo3, it expands support beyond browser and desktop automation to mobile environments, introduces native function-calling support for seamless integration with agent frameworks, and enables local deployment through optimized quantized checkpoints. The Holo3.1 family spans model sizes from 0.8B to 35B-A3B parameters. Across computer use, UI grounding, mobile automation, and business workflows, Holo3.1 delivers strong performance while improving deployment flexibility and cost efficiency. * **Developed by:** **H Company** * **Model type:** Vision-Language Models for Navigation and Computer Use Agents * **Available models:** Holo3.1-0.8B, Holo3.1-4B, Holo3.1-9B, Holo3.1-35B-A3B * **Base models:** Qwen 3.5 family * **Supported environments:** Web, Desktop, Mobile * **Available quantizations for Holo3.1-35B-A3B:** BF16, FP8, NVFP4, Q4 GGUF * **Blog Post:** hcompany.ai/holo3.1 * **Quickstart:** hub.hcompany.ai/quickstart * **License:** Apache 2.0 License The figure below compares the overall performance and inference cost of the Holo3.1 and Qwen 3.5 families. Overall performance averages computer use, mobile automation, enterprise workflows, and UI grounding benchmarks.
번역 대기 중 · 원문 표시
입력 텍스트 · 이미지→ 출력 텍스트
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
기본 정보 등록 · 상세 정보 보완 예정
입력 텍스트 · 이미지→ 출력 텍스트
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
기본 정보 등록 · 상세 정보 보완 예정
입력 텍스트 · 이미지→ 출력 텍스트
**Holo3.1** is our latest family of Vision-Language Models (VLMs) for computer use agents. Building on Holo3, it expands support beyond browser and desktop automation to mobile environments, introduces native function-calling support for seamless integration with agent frameworks, and enables local deployment through optimized quantized checkpoints. The Holo3.1 family spans model sizes from 0.8B to 35B-A3B parameters. Across computer use, UI grounding, mobile automation, and business workflows, Holo3.1 delivers strong performance while improving deployment flexibility and cost efficiency. * **Developed by:** **H Company** * **Model type:** Vision-Language Models for Navigation and Computer Use Agents * **Available models:** Holo3.1-0.8B, Holo3.1-4B, Holo3.1-9B, Holo3.1-35B-A3B * **Base models:** Qwen 3.5 family * **Supported environments:** Web, Desktop, Mobile * **Available quantizations for Holo3.1-35B-A3B:** BF16, FP8, NVFP4, Q4 GGUF * **Blog Post:** hcompany.ai/holo3.1 * **Quickstart:** hub.hcompany.ai/quickstart * **License:** Apache 2.0 License The figure below compares the overall performance and inference cost of the Holo3.1 and Qwen 3.5 families. Overall performance averages computer use, mobile automation, enterprise workflows, and UI grounding benchmarks.
번역 대기 중 · 원문 표시
입력 텍스트 · 이미지→ 출력 텍스트
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
기본 정보 등록 · 상세 정보 보완 예정
입력 텍스트 · 이미지→ 출력 텍스트
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
입력 텍스트 · 이미지→ 출력 텍스트
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
기본 정보 등록 · 상세 정보 보완 예정
입력 텍스트 · 이미지→ 출력 텍스트
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
기본 정보 등록 · 상세 정보 보완 예정
입력 텍스트 · 이미지→ 출력 텍스트
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
기본 정보 등록 · 상세 정보 보완 예정
입력 텍스트 · 이미지→ 출력 텍스트
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
기본 정보 등록 · 상세 정보 보완 예정
입력 텍스트 · 이미지→ 출력 텍스트
**Holo2** represents the next major step in developing large-scale Vision-Language Models (VLMs) for **multi-domain GUI Agents**. These agents can operate real digital environments specifically web, desktop, and mobile by interpreting interfaces, reasoning over content, and executing actions. Our **Holo2** family emphasizes **navigation and task execution** across diverse real and simulated environments, extending beyond static perception to **multi-step, goal-directed behavior**. It builds upon the strengths of **Holo1.5** in UI localization and screen content understanding, with major improvements in **policy learning**, **action grounding**, and **cross-environment generalization**.
번역 대기 중 · 원문 표시
입력 텍스트 · 이미지→ 출력 텍스트
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
기본 정보 등록 · 상세 정보 보완 예정
입력 텍스트 · 이미지→ 출력 텍스트
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
입력 텍스트 · 이미지→ 출력 텍스트
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
기본 정보 등록 · 상세 정보 보완 예정
입력 텍스트 · 이미지→ 출력 텍스트
> [!IMPORTANT] > *Holo4* family: > > - Holo4-27B: Qwen3.8 dense architecture. BF16, FP8, NVFP4, and Q4 GGUF [current]. > - Holo4-35B-A3B: Qwen3.6 MoE architecture. BF16, FP8, NVFP4, and Q4 GGUF. > - Holotron4-30B-A3B: NemotronH Nano Omni architecture. BF16 and FP8. *Holo4*-27B-GGUF is a vision-language model (VLM) for Computer Use, built on Qwen3.8-27B and developed by H Company. Used with the hai-agents harness, it can send screenshots and tool results to the model, then execute its requested clicks, typing, code, and tool calls. Parameters 27B dense Maximum context length in config 262,144 tokens Model type Visual Language Model (VLM) Architecture Qwen3.8 dense Interfaces Graphical interface, code, and tool calls Target environments Web, desktop, and mobile
번역 대기 중 · 원문 표시
입력 텍스트 · 이미지→ 출력 텍스트
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
기본 정보 등록 · 상세 정보 보완 예정
입력 텍스트 · 이미지→ 출력 텍스트
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
입력 텍스트 · 이미지→ 출력 텍스트