Athene-70B-IMat-GGUF
legraphista基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
From language to images, open weights to APIs. Understand capabilities and compare real costs.
Find the right engine for your next idea.
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
Basic profile indexed · More details to follow
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
Original Model: CohereForAI/c4ai-command-r-plus-08-2024 Original dtype: `FP16` (`float16`) Quantized by: llama.cpp b3645 IMatrix dataset: here If the model file is big, it has been split into multiple files. In order to download them all to a local folder, run: According to this investigation, it appears that lower quantizations are the only ones that benefit from the imatrix input (as per hellaswag results).
Original Model: THUDM/codegeex4-all-9b Original dtype: `BF16` (`bfloat16`) Quantized by: https://github.com/ggerganov/llama.cpp/pull/8031 IMatrix dataset: here If the model file is big, it has been split into multiple files. In order to download them all to a local folder, run: According to this investigation, it appears that lower quantizations are the only ones that benefit from the imatrix input (as per hellaswag results).
_Llama.cpp imatrix quantization of mistralai/Codestral-22B-v0.1 (legraphista/Codestral-22B-v0.1-hf-FIM-fix)_ Original model: mistralai/Codestral-22B-v0.1 Quantized HF Model: legraphista/Codestral-22B-v0.1-hf-FIM-fix Original dtype: `BF16` (`bfloat16`) Quantized by: llama.cpp b3046 IMatrix dataset: here If the model file is big, it has been split into multiple files. In order to download them all to a local folder, run:
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
Original Model: google/datagemma-rig-27b-it Original dtype: `BF16` (`bfloat16`) Quantized by: llama.cpp b3750 IMatrix dataset: here If the model file is big, it has been split into multiple files. In order to download them all to a local folder, run: According to this investigation, it appears that lower quantizations are the only ones that benefit from the imatrix input (as per hellaswag results).
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
Basic profile indexed · More details to follow
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
Original Model: deepseek-ai/DeepSeek-V2.5 Original dtype: `BF16` (`bfloat16`) Quantized by: llama.cpp b3675 IMatrix dataset: here If the model file is big, it has been split into multiple files. In order to download them all to a local folder, run: According to this investigation, it appears that lower quantizations are the only ones that benefit from the imatrix input (as per hellaswag results).
Original Model: deepseek-ai/DeepSeek-V2-Lite-Chat Original dtype: `BF16` (`bfloat16`) Quantized by: llama.cpp fork PR 7519 IMatrix dataset: here If the model is bigger than 50GB, it will have been split into multiple files. In order to download them all to a local folder, run: According to this investigation, it appears that lower quantizations are the only ones that benefit from the imatrix input (as per hellaswag results).
Original Model: deepseek-ai/DeepSeek-V2-Lite Original dtype: `BF16` (`bfloat16`) Quantized by: llama.cpp https://github.com/ggerganov/llama.cpp/pull/7519 IMatrix dataset: here If the model file is big, it has been split into multiple files. In order to download them all to a local folder, run: According to this investigation, it appears that lower quantizations are the only ones that benefit from the imatrix input (as per hellaswag results).
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
Original Model: cognitivecomputations/dolphin-2.9.1-llama-3-8b Original dtype: `BF16` (`bfloat16`) Quantized by: llama.cpp b3006 IMatrix dataset: here If the model file is big, it has been split into multiple files. In order to download them all to a local folder, run: According to this investigation, it appears that lower quantizations are the only ones that benefit from the imatrix input (as per hellaswag results).
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
Basic profile indexed · More details to follow
Original Model: cognitivecomputations/dolphin-2.9.2-Phi-3-Medium Original dtype: `BF16` (`bfloat16`) Quantized by: llama.cpp b3072 IMatrix dataset: here If the model file is big, it has been split into multiple files. In order to download them all to a local folder, run: According to this investigation, it appears that lower quantizations are the only ones that benefit from the imatrix input (as per hellaswag results).
Original Model: google/gemma-2-27b-it Original dtype: `BF16` (`bfloat16`) Quantized by: llama.cpp b3790 IMatrix dataset: here If the model file is big, it has been split into multiple files. In order to download them all to a local folder, run: According to this investigation, it appears that lower quantizations are the only ones that benefit from the imatrix input (as per hellaswag results).
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
Adjust provider, category or input/output filters. New models are added continuously.
Adjust monthly token usage to compare estimated API costs.
Uses collected, comparable USD-per-million-token rates. Snapshots exclude cache discounts, tiers, extra reasoning output and taxes. Check current source prices.
Separate input, output and cache rates, then estimate the same workload. Image, audio and video rates may use items, duration or resolution rather than tokens.
Not necessarily. Check each version’s license, commercial restrictions and policies. Self-hosting also incurs compute and maintenance costs.
Rankings depend on tasks, versions and methods. Compare accuracy, latency, reliability and costs on your own workload.