基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
Explore AI models 84991
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
Some of these quants (Q3_K_XL, Q4_K_L etc) are the standard quantization method with the embeddings and output weights quantized to Q8_0 instead of what they would normally default to. If the model is bigger than 50GB, it will have been split into multiple files. In order to download them all to a local folder, run: You can either specify a new local-dir (mistralai_Mistral-Small-3.1-24B-Instruct-2503-Q8_0) or download them all in place (./)
Original model: https://huggingface.co/mistralai/Mistral-Small-3.2-24B-Instruct-2506 All quants made using imatrix option with dataset from here Run them directly with llama.cpp, or any other llama.cpp based project
All quants made using imatrix option with dataset from here - llama.cpp - LM Studio - koboldcpp - Jan AI - Text Generation Web UI - LoLLMs Note: if it's a newly supported model, you may need to wait for an update from the developers.
mistralai_Voxtral-Mini-3B-2507-GGUF
bartowskiSome of these quants (Q3_K_XL, Q4_K_L etc) are the standard quantization method with the embeddings and output weights quantized to Q8_0 instead of what they would normally default to. If the model is bigger than 50GB, it will have been split into multiple files. In order to download them all to a local folder, run: You can either specify a new local-dir (mistralai_Voxtral-Mini-3B-2507-Q8_0) or download them all in place (./)
Some of these quants (Q3_K_XL, Q4_K_L etc) are the standard quantization method with the embeddings and output weights quantized to Q8_0 instead of what they would normally default to. If the model is bigger than 50GB, it will have been split into multiple files. In order to download them all to a local folder, run: You can either specify a new local-dir (mistralai_Voxtral-Small-24B-2507-Q8_0) or download them all in place (./)
Mixtral-8x22B-v0.1-GGUF
bartowski基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
Basic profile indexed · More details to follow
Some of these quants (Q3_K_XL, Q4_K_L etc) are the standard quantization method with the embeddings and output weights quantized to Q8_0 instead of what they would normally default to. If the model is bigger than 50GB, it will have been split into multiple files. In order to download them all to a local folder, run: You can either specify a new local-dir (mlabonne_gemma-3-12b-it-abliterated-Q8_0) or download them all in place (./)
Some of these quants (Q3_K_XL, Q4_K_L etc) are the standard quantization method with the embeddings and output weights quantized to Q8_0 instead of what they would normally default to. If the model is bigger than 50GB, it will have been split into multiple files. In order to download them all to a local folder, run: You can either specify a new local-dir (mlabonne_gemma-3-27b-it-abliterated-Q8_0) or download them all in place (./)
Some of these quants (Q3_K_XL, Q4_K_L etc) are the standard quantization method with the embeddings and output weights quantized to Q8_0 instead of what they would normally default to. If the model is bigger than 50GB, it will have been split into multiple files. In order to download them all to a local folder, run: You can either specify a new local-dir (mlabonne_gemma-3-4b-it-abliterated-Q8_0) or download them all in place (./)
mlabonne_Qwen3-0.6B-abliterated-GGUF
bartowski基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
mlabonne_Qwen3-1.7B-abliterated-GGUF
bartowskiSome of these quants (Q3_K_XL, Q4_K_L etc) are the standard quantization method with the embeddings and output weights quantized to Q8_0 instead of what they would normally default to. If the model is bigger than 50GB, it will have been split into multiple files. In order to download them all to a local folder, run: You can either specify a new local-dir (mlabonne_Qwen3-1.7B-abliterated-Q8_0) or download them all in place (./)
mlabonne_Qwen3-14B-abliterated-GGUF
bartowskiAll quants made using imatrix option with dataset from here Run them directly with llama.cpp, or any other llama.cpp based project Some of these quants (Q3_K_XL, Q4_K_L etc) are the standard quantization method with the embeddings and output weights quantized to Q8_0 instead of what they would normally default to.
mlabonne_Qwen3-4B-abliterated-GGUF
bartowskiSome of these quants (Q3_K_XL, Q4_K_L etc) are the standard quantization method with the embeddings and output weights quantized to Q8_0 instead of what they would normally default to. If the model is bigger than 50GB, it will have been split into multiple files. In order to download them all to a local folder, run: You can either specify a new local-dir (mlabonne_Qwen3-4B-abliterated-Q8_0) or download them all in place (./)
mlabonne_Qwen3-8B-abliterated-GGUF
bartowskiAll quants made using imatrix option with dataset from here Run them directly with llama.cpp, or any other llama.cpp based project Some of these quants (Q3_K_XL, Q4_K_L etc) are the standard quantization method with the embeddings and output weights quantized to Q8_0 instead of what they would normally default to.
MN-12B-Celeste-V1.9-GGUF
bartowskiSome of these quants (Q3_K_XL, Q4_K_L etc) are the standard quantization method with the embeddings and output weights quantized to Q8_0 instead of what they would normally default to. Some say that this improves the quality, others don't notice any difference. If you use these models PLEASE COMMENT with your findings. I would like feedback that these are actually used and useful so I don't keep uploading quants no one is using. If the model is bigger than 50GB, it will have been split into multiple files. In order to download them all to a local folder, run:
MN-12B-Lyra-v1-GGUF
bartowski基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
Basic profile indexed · More details to follow
MN-12B-Lyra-v4-GGUF
bartowski基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
MN-12B-Mag-Mell-R1-GGUF
bartowskiSome of these quants (Q3_K_XL, Q4_K_L etc) are the standard quantization method with the embeddings and output weights quantized to Q8_0 instead of what they would normally default to. If the model is bigger than 50GB, it will have been split into multiple files. In order to download them all to a local folder, run: Previously, you would download Q4_0_4_4/4_8/8_8, and these would have their weights interleaved in memory in order to improve performance on ARM and AVX machines by loading up more data in one pass.
MN-12b-RP-Ink-GGUF
bartowski基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
Basic profile indexed · More details to follow
MN-12B-Starcannon-v3-GGUF
bartowski基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
Basic profile indexed · More details to follow
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
Basic profile indexed · More details to follow
No matching models
Adjust provider, category or input/output filters. New models are added continuously.
Great models. Clear costs.
Adjust monthly token usage to compare estimated API costs.
Compares base text-token rates within the same channel
Uses collected, comparable USD-per-million-token rates. Snapshots exclude cache discounts, tiers, extra reasoning output and taxes. Check current source prices.
Understand before you choose
How should API prices be compared?+
Separate input, output and cache rates, then estimate the same workload. Image, audio and video rates may use items, duration or resolution rather than tokens.
Do open weights mean free commercial use?+
Not necessarily. Check each version’s license, commercial restrictions and policies. Self-hosting also incurs compute and maintenance costs.
Is the top-ranked model the best for me?+
Rankings depend on tasks, versions and methods. Compare accuracy, latency, reliability and costs on your own workload.