All quants made using imatrix option with dataset from here - llama.cpp - ramalama - LM Studio - koboldcpp - Jan AI - Text Generation Web UI - LoLLMs Note: if it's a newly supported model, you may need to wait for an update from the developers.
翻訳待ち・原文を表示
入力 テキスト · 画像→ 出力 テキスト
All quants made using imatrix option with dataset from here - llama.cpp - ramalama - LM Studio - koboldcpp - Jan AI - Text Generation Web UI - LoLLMs Note: if it's a newly supported model, you may need to wait for an update from the developers.
翻訳待ち・原文を表示
入力 テキスト · 画像→ 出力 テキスト
All quants made using imatrix option with dataset from here - llama.cpp - ramalama - LM Studio - koboldcpp - Jan AI - Text Generation Web UI - LoLLMs Note: if it's a newly supported model, you may need to wait for an update from the developers.
翻訳待ち・原文を表示
入力 テキスト · 画像→ 出力 テキスト
Some of these quants (Q3_K_XL, Q4_K_L etc) are the standard quantization method with the embeddings and output weights quantized to Q8_0 instead of what they would normally default to. If the model is bigger than 50GB, it will have been split into multiple files. In order to download them all to a local folder, run: You can either specify a new local-dir (google_medgemma-27b-it-Q8_0) or download them all in place (./)
翻訳待ち・原文を表示
入力 テキスト · 画像→ 出力 テキスト
Some of these quants (Q3_K_XL, Q4_K_L etc) are the standard quantization method with the embeddings and output weights quantized to Q8_0 instead of what they would normally default to. If the model is bigger than 50GB, it will have been split into multiple files. In order to download them all to a local folder, run: You can either specify a new local-dir (google_medgemma-4b-it-Q8_0) or download them all in place (./)
翻訳待ち・原文を表示
入力 テキスト · 画像→ 出力 テキスト
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
基本情報を収録・詳細は順次追加
入力 テキスト→ 出力 テキスト
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
入力 テキスト→ 出力 テキスト
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
基本情報を収録・詳細は順次追加
入力 テキスト→ 出力 テキスト
If you're using an ARM chip, the Q4_0_X_X quants will have a substantial speedup. Check out Q4_0_4_4 speed comparisons on the original pull request To check which one would work best for your ARM chip, you can check AArch64 SoC features(thanks EloyOn!). Some of these quants (Q3_K_XL, Q4_K_L etc) are the standard quantization method with the embeddings and output weights quantized to Q8_0 instead of what they would normally default to.
翻訳待ち・原文を表示
入力 テキスト→ 出力 テキスト
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
入力 テキスト→ 出力 テキスト
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
基本情報を収録・詳細は順次追加
入力 テキスト→ 出力 テキスト
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
入力 テキスト→ 出力 テキスト
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
入力 テキスト→ 出力 テキスト
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
入力 テキスト→ 出力 テキスト
Some of these quants (Q3_K_XL, Q4_K_L etc) are the standard quantization method with the embeddings and output weights quantized to Q8_0 instead of what they would normally default to. If the model is bigger than 50GB, it will have been split into multiple files. In order to download them all to a local folder, run: You can either specify a new local-dir (granite-3.1-1b-a400m-instruct-Q8_0) or download them all in place (./)
翻訳待ち・原文を表示
入力 テキスト→ 出力 テキスト
Some of these quants (Q3_K_XL, Q4_K_L etc) are the standard quantization method with the embeddings and output weights quantized to Q8_0 instead of what they would normally default to. If the model is bigger than 50GB, it will have been split into multiple files. In order to download them all to a local folder, run: You can either specify a new local-dir (granite-3.1-2b-instruct-Q8_0) or download them all in place (./)
翻訳待ち・原文を表示
入力 テキスト→ 出力 テキスト
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
入力 テキスト→ 出力 テキスト
Some of these quants (Q3_K_XL, Q4_K_L etc) are the standard quantization method with the embeddings and output weights quantized to Q8_0 instead of what they would normally default to. If the model is bigger than 50GB, it will have been split into multiple files. In order to download them all to a local folder, run: You can either specify a new local-dir (granite-3.1-8b-instruct-Q8_0) or download them all in place (./)
翻訳待ち・原文を表示
入力 テキスト→ 出力 テキスト
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
基本情報を収録・詳細は順次追加
入力 テキスト→ 出力 テキスト
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
入力 テキスト→ 出力 テキスト
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
入力 テキスト→ 出力 テキスト
**Model details:** - Parameter count: 9B - Input support: text - Speculative decoding: no - imatrix: yes - details **Don't know which to choose?** Grab Q4_K_M (5.54GB) - usually a good mix of size and performance. Download instructions available here These quants were made with llama.cpp release b10603 - if this model's architecture is newly supported, you'll need that release or newer to run them.
翻訳待ち・原文を表示
入力 テキスト→ 出力 テキスト
Some of these quants (Q3_K_XL, Q4_K_L etc) are the standard quantization method with the embeddings and output weights quantized to Q8_0 instead of what they would normally default to. If the model is bigger than 50GB, it will have been split into multiple files. In order to download them all to a local folder, run: You can either specify a new local-dir (granite-embedding-107m-multilingual-Q8_0) or download them all in place (./)
翻訳待ち・原文を表示
入力 テキスト→ 出力 テキスト
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
入力 テキスト→ 出力 テキスト