A 4B model with thinking, image input and tool calling, small enough for most laptops. GGUF builds of Qwen3.5-4B by Qwen for llama.cpp and SoAI, calibrated on real chat, code and tool calls. > [!TIP] > `Q4_K_M` suits most machines. It is about a third of the size of the original 16-bit weights and stays > close to them in quality. If `Q8_0` fits in your memory, it keeps output closest to the original. SoAI > does not publish quants below 4 bits because their quality loss is rarely worth the saved space.

Visual QA

Input Text · Image→ Output Text

Price not verifiedCheck multimodal and channel pricing separately

View details ↗

CompareSource / docs ↗

Qwen3.5-9B-GGUF

SoAIHQ

GGUF builds of Qwen3.5-9B by Qwen for llama.cpp and SoAI, calibrated on real chat, code and tool calls. > [!TIP] > `Q4_K_M` suits most machines. It is about a third of the size of the original 16-bit weights and stays > close to them in quality. If `Q8_0` fits in your memory, it keeps output closest to the original. SoAI > does not publish quants below 4 bits because their quality loss is rarely worth the saved space. The model needs memory for the file and for the context, and the context part grows with the context length you set. llama.cpp can run the model on the GPU, on the CPU, or with its layers split between them.

Visual QA

Input Text · Image→ Output Text

Price not verifiedCheck multimodal and channel pricing separately

View details ↗

CompareSource / docs ↗

Qwen3.8-27B-GGUF

SoAIHQ

基础档案已收录，详细介绍后续补充。可先查看厂商、分类与来源。

Visual QA

Input Text · Image→ Output Text

Price not verifiedCheck multimodal and channel pricing separately

View details ↗

CompareSource / docs ↗

COST EXPLORER

Great models. Clear costs.

Cost analysis

Adjust monthly token usage to compare estimated API costs.

Monthly input tokens 10 MMonthly output tokens 2 M1 M = 1 million tokens · USD
Compares base text-token rates within the same channel

Uses collected, comparable USD-per-million-token rates. Snapshots exclude cache discounts, tiers, extra reasoning output and taxes. Check current source prices.

MODEL HANDBOOK

Understand before you choose

Selection guide & FAQ

How should API prices be compared?+

Separate input, output and cache rates, then estimate the same workload. Image, audio and video rates may use items, duration or resolution rather than tokens.

Do open weights mean free commercial use?+

Not necessarily. Check each version’s license, commercial restrictions and policies. Self-hosting also incurs compute and maintenance costs.

Is the top-ranked model the best for me?+

Rankings depend on tasks, versions and methods. Compare accuracy, latency, reliability and costs on your own workload.

Find your ideal AI model.

Explore AI models 13

gemma-4-12B-it-GGUF

gemma-4-26B-A4B-it-GGUF

gemma-4-31B-it-GGUF

gemma-4-E2B-it-GGUF

gemma-4-E4B-it-GGUF

gpt-oss-120b-VISION-GGUF

gpt-oss-120b-VISION-v2-GGUF

gpt-oss-20b-VISION-GGUF

gpt-oss-20b-VISION-v2-GGUF

Qwen3.5-2B-GGUF

Qwen3.5-4B-GGUF

Qwen3.5-9B-GGUF

Qwen3.8-27B-GGUF

No matching models

Great models. Clear costs.

Understand before you choose

Follow trends. Find tools. Explore models.