言語から画像、オープンウェイトからAPIまで。能力と実際の費用を比較。
次のアイデアに合うAIを見つけましょう。
All quants made using imatrix option with dataset from here Run them directly with llama.cpp, or any other llama.cpp based project This model has vision capabilities, more details here: https://github.com/ggml-org/llama.cpp/pull/12344
翻訳待ち・原文を表示
基础档案已收录，详细介绍后续补充。可先查看厂商、分类与来源。
All quants made using imatrix option with dataset from here Run them directly with llama.cpp, or any other llama.cpp based project Some of these quants (Q3_K_XL, Q4_K_L etc) are the standard quantization method with the embeddings and output weights quantized to Q8_0 instead of what they would normally default to.
翻訳待ち・原文を表示
基础档案已收录，详细介绍后续补充。可先查看厂商、分类与来源。
基础档案已收录，详细介绍后续补充。可先查看厂商、分类与来源。
基础档案已收录，详细介绍后续补充。可先查看厂商、分类与来源。
This model has vision capabilities, more details here: https://github.com/ggml-org/llama.cpp/pull/12344 Some of these quants (Q3_K_XL, Q4_K_L etc) are the standard quantization method with the embeddings and output weights quantized to Q8_0 instead of what they would normally default to. If the model is bigger than 50GB, it will have been split into multiple files. In order to download them all to a local folder, run:
翻訳待ち・原文を表示
*ONLY* Q4_0 is expected to be better, but figured while I'm at it I might as well make others to see what happens? gemma-3-27b-it-qat-Q4_0.gguf | Q4_0 | 15.62GB | Should be improved due to QAT, offers online repacking for ARM and AVX CPU inference. Some of these quants (Q3_K_XL, Q4_K_L etc) are the standard quantization method with the embeddings and output weights quantized to Q8_0 instead of what they would normally default to.
翻訳待ち・原文を表示
All quants made using imatrix option with dataset from here Run them directly with llama.cpp, or any other llama.cpp based project This model has vision capabilities, more details here: https://github.com/ggml-org/llama.cpp/pull/12344
翻訳待ち・原文を表示
*ONLY* Q4_0 is expected to be better, but figured while I'm at it I might as well make others to see what happens? gemma-3-4b-it-qat-Q4_0.gguf | Q4_0 | 2.37GB | false | Should be improved due to QAT, offers online repacking for ARM and AVX CPU inference. Some of these quants (Q3_K_XL, Q4_K_L etc) are the standard quantization method with the embeddings and output weights quantized to Q8_0 instead of what they would normally default to.
翻訳待ち・原文を表示
No chat template specified so default is used. This may be incorrect, check original model card for details. Some of these quants (Q3_K_XL, Q4_K_L etc) are the standard quantization method with the embeddings and output weights quantized to Q8_0 instead of what they would normally default to. If the model is bigger than 50GB, it will have been split into multiple files. In order to download them all to a local folder, run:
翻訳待ち・原文を表示
No chat template specified so default is used. This may be incorrect, check original model card for details. Some of these quants (Q3_K_XL, Q4_K_L etc) are the standard quantization method with the embeddings and output weights quantized to Q8_0 instead of what they would normally default to. If the model is bigger than 50GB, it will have been split into multiple files. In order to download them all to a local folder, run:
翻訳待ち・原文を表示
All quants made using imatrix option with dataset from here - llama.cpp - ramalama - LM Studio - koboldcpp - Jan AI - Text Generation Web UI - LoLLMs Note: if it's a newly supported model, you may need to wait for an update from the developers.
翻訳待ち・原文を表示
All quants made using imatrix option with dataset from here - llama.cpp - ramalama - LM Studio - koboldcpp - Jan AI - Text Generation Web UI - LoLLMs Note: if it's a newly supported model, you may need to wait for an update from the developers.
翻訳待ち・原文を表示
All quants made using imatrix option with dataset from here - llama.cpp - ramalama - LM Studio - koboldcpp - Jan AI - Text Generation Web UI - LoLLMs Note: if it's a newly supported model, you may need to wait for an update from the developers.
翻訳待ち・原文を表示
All quants made using imatrix option with dataset from here - llama.cpp - ramalama - LM Studio - koboldcpp - Jan AI - Text Generation Web UI - LoLLMs Note: if it's a newly supported model, you may need to wait for an update from the developers.
翻訳待ち・原文を表示
Some of these quants (Q3_K_XL, Q4_K_L etc) are the standard quantization method with the embeddings and output weights quantized to Q8_0 instead of what they would normally default to. If the model is bigger than 50GB, it will have been split into multiple files. In order to download them all to a local folder, run: You can either specify a new local-dir (google_medgemma-27b-it-Q8_0) or download them all in place (./)
翻訳待ち・原文を表示
Some of these quants (Q3_K_XL, Q4_K_L etc) are the standard quantization method with the embeddings and output weights quantized to Q8_0 instead of what they would normally default to. If the model is bigger than 50GB, it will have been split into multiple files. In order to download them all to a local folder, run: You can either specify a new local-dir (google_medgemma-4b-it-Q8_0) or download them all in place (./)
翻訳待ち・原文を表示
基础档案已收录，详细介绍后续补充。可先查看厂商、分类与来源。
基本情報を収録・詳細は順次追加
基础档案已收录，详细介绍后续补充。可先查看厂商、分类与来源。
基础档案已收录，详细介绍后续补充。可先查看厂商、分类与来源。
基本情報を収録・詳細は順次追加
If you're using an ARM chip, the Q4_0_X_X quants will have a substantial speedup. Check out Q4_0_4_4 speed comparisons on the original pull request To check which one would work best for your ARM chip, you can check AArch64 SoC features(thanks EloyOn!). Some of these quants (Q3_K_XL, Q4_K_L etc) are the standard quantization method with the embeddings and output weights quantized to Q8_0 instead of what they would normally default to.
翻訳待ち・原文を表示
基础档案已收录，详细介绍后续补充。可先查看厂商、分类与来源。
基础档案已收录，详细介绍后续补充。可先查看厂商、分类与来源。
基本情報を収録・詳細は順次追加
提供元・分類・入出力の条件を変更してください。新しいモデルを随時追加しています。
月間トークン数を調整してAPI費用を比較。
収集済みの比較可能な100万トークン当たり米ドル料金です。キャッシュ割引、段階料金、追加推論出力、税金は含みません。最新料金は出典で確認してください。
入力・出力・キャッシュ料金を分け、同じ用途と使用量で総費用を比較します。画像・音声・動画は枚数、時間、解像度で課金される場合があります。
必ずしもそうではありません。バージョンごとのライセンス、商用制限、ポリシーを確認してください。自前運用には計算資源と保守費用も必要です。
順位はテスト、バージョン、評価方法によります。実際の業務データで精度、遅延、安定性、費用を比較してください。
