Some of these quants (Q3_K_XL, Q4_K_L etc) are the standard quantization method with the embeddings and output weights quantized to Q8_0 instead of what they would normally default to. If the model is bigger than 50GB, it will have been split into multiple files. In order to download them all to a local folder, run: You can either specify a new local-dir (huihui-ai_gemma-3-1b-it-abliterated-Q8_0) or download them all in place (./)
Explore AI models 84991
No chat template specified so default is used. This may be incorrect, check original model card for details. Some of these quants (Q3_K_XL, Q4_K_L etc) are the standard quantization method with the embeddings and output weights quantized to Q8_0 instead of what they would normally default to. If the model is bigger than 50GB, it will have been split into multiple files. In order to download them all to a local folder, run:
Some of these quants (Q3_K_XL, Q4_K_L etc) are the standard quantization method with the embeddings and output weights quantized to Q8_0 instead of what they would normally default to. If the model is bigger than 50GB, it will have been split into multiple files. In order to download them all to a local folder, run: You can either specify a new local-dir (huihui-ai_Huihui-gpt-oss-20b-BF16-abliterated-Q8_0) or download them all in place (./)
Some of these quants (Q3_K_XL, Q4_K_L etc) are the standard quantization method with the embeddings and output weights quantized to Q8_0 instead of what they would normally default to. If the model is bigger than 50GB, it will have been split into multiple files. In order to download them all to a local folder, run: You can either specify a new local-dir (huihui-ai_Mistral-Small-24B-Instruct-2501-abliterated-Q8_0) or download them all in place (./)
huihui-ai_Qwen3-14B-abliterated-GGUF
bartowskiAll quants made using imatrix option with dataset from here Run them directly with llama.cpp, or any other llama.cpp based project No chat template specified so default is used. This may be incorrect, check original model card for details.
Original model: https://huggingface.co/huihui-ai/Huihui-Qwen3-Coder-Next-abliterated All quants made using imatrix option with dataset from here - llama.cpp - LM Studio - koboldcpp - Jan AI - Text Generation Web UI - LoLLMs
huihui-ai_QwQ-32B-abliterated-GGUF
bartowskiSome of these quants (Q3_K_XL, Q4_K_L etc) are the standard quantization method with the embeddings and output weights quantized to Q8_0 instead of what they would normally default to. If the model is bigger than 50GB, it will have been split into multiple files. In order to download them all to a local folder, run: You can either specify a new local-dir (huihui-ai_QwQ-32B-abliterated-Q8_0) or download them all in place (./)
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
Basic profile indexed · More details to follow
Human-Like-LLama3-8B-Instruct-GGUF
bartowski基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
Basic profile indexed · More details to follow
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
Human-Like-Qwen2.5-7B-Instruct-GGUF
bartowski基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
Hy3-GGUF
bartowski基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
Hyperion-2.0-Mistral-7B-GGUF
bartowski基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
Basic profile indexed · More details to follow
Hyperion-2.1-Mistral-7B-GGUF
bartowski基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
Basic profile indexed · More details to follow
Hyperion-3.0-Mistral-7B-alpha-GGUF
bartowski基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
Basic profile indexed · More details to follow
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
ibm-granite_granite-4.0-h-micro-GGUF
bartowski基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
Basic profile indexed · More details to follow
ibm-granite_granite-4.0-h-small-GGUF
bartowski基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
ibm-granite_granite-4.0-h-tiny-GGUF
bartowskiAll quants made using imatrix option with dataset from here combined with a subset of combined_all_small.parquet from Ed Addario here Some of these quants (Q3_K_XL, Q4_K_L etc) are the standard quantization method with the embeddings and output weights quantized to Q8_0 instead of what they would normally default to. If the model is bigger than 50GB, it will have been split into multiple files. In order to download them all to a local folder, run:
ibm-granite_granite-4.0-micro-GGUF
bartowski基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
Basic profile indexed · More details to follow
No matching models
Adjust provider, category or input/output filters. New models are added continuously.
Great models. Clear costs.
Adjust monthly token usage to compare estimated API costs.
Compares base text-token rates within the same channel
Uses collected, comparable USD-per-million-token rates. Snapshots exclude cache discounts, tiers, extra reasoning output and taxes. Check current source prices.
Understand before you choose
How should API prices be compared?+
Separate input, output and cache rates, then estimate the same workload. Image, audio and video rates may use items, duration or resolution rather than tokens.
Do open weights mean free commercial use?+
Not necessarily. Check each version’s license, commercial restrictions and policies. Self-hosting also incurs compute and maintenance costs.
Is the top-ranked model the best for me?+
Rankings depend on tasks, versions and methods. Compare accuracy, latency, reliability and costs on your own workload.