_Llama.cpp imatrix quantization of mistralai/Codestral-22B-v0.1 (legraphista/Codestral-22B-v0.1-hf-FIM-fix)_ Original model: mistralai/Codestral-22B-v0.1 Quantized HF Model: legraphista/Codestral-22B-v0.1-hf-FIM-fix Original dtype: `BF16` (`bfloat16`) Quantized by: llama.cpp b3046 IMatrix dataset: here If the model file is big, it has been split into multiple files. In order to download them all to a local folder, run:
번역 대기 중 · 원문 표시
입력 텍스트→ 출력 텍스트
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
입력 텍스트→ 출력 텍스트
Original Model: google/datagemma-rig-27b-it Original dtype: `BF16` (`bfloat16`) Quantized by: llama.cpp b3750 IMatrix dataset: here If the model file is big, it has been split into multiple files. In order to download them all to a local folder, run: According to this investigation, it appears that lower quantizations are the only ones that benefit from the imatrix input (as per hellaswag results).
번역 대기 중 · 원문 표시
입력 텍스트→ 출력 텍스트
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
기본 정보 등록 · 상세 정보 보완 예정
입력 텍스트→ 출력 텍스트
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
입력 텍스트→ 출력 텍스트
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
입력 텍스트→ 출력 텍스트
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
입력 텍스트→ 출력 텍스트
Original Model: deepseek-ai/DeepSeek-V2.5 Original dtype: `BF16` (`bfloat16`) Quantized by: llama.cpp b3675 IMatrix dataset: here If the model file is big, it has been split into multiple files. In order to download them all to a local folder, run: According to this investigation, it appears that lower quantizations are the only ones that benefit from the imatrix input (as per hellaswag results).
번역 대기 중 · 원문 표시
입력 텍스트→ 출력 텍스트
Original Model: deepseek-ai/DeepSeek-V2-Lite-Chat Original dtype: `BF16` (`bfloat16`) Quantized by: llama.cpp fork PR 7519 IMatrix dataset: here If the model is bigger than 50GB, it will have been split into multiple files. In order to download them all to a local folder, run: According to this investigation, it appears that lower quantizations are the only ones that benefit from the imatrix input (as per hellaswag results).
번역 대기 중 · 원문 표시
입력 텍스트→ 출력 텍스트
Original Model: deepseek-ai/DeepSeek-V2-Lite Original dtype: `BF16` (`bfloat16`) Quantized by: llama.cpp https://github.com/ggerganov/llama.cpp/pull/7519 IMatrix dataset: here If the model file is big, it has been split into multiple files. In order to download them all to a local folder, run: According to this investigation, it appears that lower quantizations are the only ones that benefit from the imatrix input (as per hellaswag results).
번역 대기 중 · 원문 표시
입력 텍스트→ 출력 텍스트
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
입력 텍스트→ 출력 텍스트
Original Model: cognitivecomputations/dolphin-2.9.1-llama-3-8b Original dtype: `BF16` (`bfloat16`) Quantized by: llama.cpp b3006 IMatrix dataset: here If the model file is big, it has been split into multiple files. In order to download them all to a local folder, run: According to this investigation, it appears that lower quantizations are the only ones that benefit from the imatrix input (as per hellaswag results).
번역 대기 중 · 원문 표시
입력 텍스트→ 출력 텍스트
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
입력 텍스트→ 출력 텍스트
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
기본 정보 등록 · 상세 정보 보완 예정
입력 텍스트→ 출력 텍스트
Original Model: cognitivecomputations/dolphin-2.9.2-Phi-3-Medium Original dtype: `BF16` (`bfloat16`) Quantized by: llama.cpp b3072 IMatrix dataset: here If the model file is big, it has been split into multiple files. In order to download them all to a local folder, run: According to this investigation, it appears that lower quantizations are the only ones that benefit from the imatrix input (as per hellaswag results).
번역 대기 중 · 원문 표시
입력 텍스트→ 출력 텍스트
Original Model: google/gemma-2-27b-it Original dtype: `BF16` (`bfloat16`) Quantized by: llama.cpp b3790 IMatrix dataset: here If the model file is big, it has been split into multiple files. In order to download them all to a local folder, run: According to this investigation, it appears that lower quantizations are the only ones that benefit from the imatrix input (as per hellaswag results).
번역 대기 중 · 원문 표시
입력 텍스트→ 출력 텍스트
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
입력 텍스트→ 출력 텍스트
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
기본 정보 등록 · 상세 정보 보완 예정
입력 텍스트→ 출력 텍스트
Original Model: google/gemma-2-9b-it Original dtype: `BF16` (`bfloat16`) Quantized by: llama.cpp b3266 IMatrix dataset: here If the model file is big, it has been split into multiple files. In order to download them all to a local folder, run: According to this investigation, it appears that lower quantizations are the only ones that benefit from the imatrix input (as per hellaswag results).
번역 대기 중 · 원문 표시
입력 텍스트→ 출력 텍스트
Original Model: UCLA-AGI/Gemma-2-9B-It-SPPO-Iter3 Original dtype: `BF16` (`bfloat16`) Quantized by: llama.cpp b3311 IMatrix dataset: here If the model file is big, it has been split into multiple files. In order to download them all to a local folder, run: According to this investigation, it appears that lower quantizations are the only ones that benefit from the imatrix input (as per hellaswag results).
번역 대기 중 · 원문 표시
입력 텍스트→ 출력 텍스트
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
기본 정보 등록 · 상세 정보 보완 예정
입력 텍스트→ 출력 텍스트
Original Model: THUDM/glm-4-9b-chat Original dtype: `BF16` (`bfloat16`) Quantized by: https://github.com/ggerganov/llama.cpp/pull/6999 IMatrix dataset: here If the model file is big, it has been split into multiple files. In order to download them all to a local folder, run: According to this investigation, it appears that lower quantizations are the only ones that benefit from the imatrix input (as per hellaswag results).
번역 대기 중 · 원문 표시
입력 텍스트→ 출력 텍스트
Original Model: THUDM/glm-4-9b-chat Original dtype: `BF16` (`bfloat16`) Quantized by: https://github.com/ggerganov/llama.cpp/pull/6999 IMatrix dataset: here If the model file is big, it has been split into multiple files. In order to download them all to a local folder, run: According to this investigation, it appears that lower quantizations are the only ones that benefit from the imatrix input (as per hellaswag results).
번역 대기 중 · 원문 표시
입력 텍스트→ 출력 텍스트
Original Model: ibm-granite/granite-20b-code-instruct Original dtype: `BF16` (`bfloat16`) Quantized by: llama.cpp b3649 IMatrix dataset: here If the model file is big, it has been split into multiple files. In order to download them all to a local folder, run: According to this investigation, it appears that lower quantizations are the only ones that benefit from the imatrix input (as per hellaswag results).
번역 대기 중 · 원문 표시
입력 텍스트→ 출력 텍스트