Athene-70B-IMat-GGUF
legraphista基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
언어부터 이미지, 오픈 웨이트부터 API까지. 기능과 실제 비용을 비교하세요.
다음 아이디어에 맞는 AI를 찾아보세요.
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
기본 정보 등록 · 상세 정보 보완 예정
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
Original Model: CohereForAI/c4ai-command-r-plus-08-2024 Original dtype: `FP16` (`float16`) Quantized by: llama.cpp b3645 IMatrix dataset: here If the model file is big, it has been split into multiple files. In order to download them all to a local folder, run: According to this investigation, it appears that lower quantizations are the only ones that benefit from the imatrix input (as per hellaswag results).
번역 대기 중 · 원문 표시
Original Model: THUDM/codegeex4-all-9b Original dtype: `BF16` (`bfloat16`) Quantized by: https://github.com/ggerganov/llama.cpp/pull/8031 IMatrix dataset: here If the model file is big, it has been split into multiple files. In order to download them all to a local folder, run: According to this investigation, it appears that lower quantizations are the only ones that benefit from the imatrix input (as per hellaswag results).
번역 대기 중 · 원문 표시
_Llama.cpp imatrix quantization of mistralai/Codestral-22B-v0.1 (legraphista/Codestral-22B-v0.1-hf-FIM-fix)_ Original model: mistralai/Codestral-22B-v0.1 Quantized HF Model: legraphista/Codestral-22B-v0.1-hf-FIM-fix Original dtype: `BF16` (`bfloat16`) Quantized by: llama.cpp b3046 IMatrix dataset: here If the model file is big, it has been split into multiple files. In order to download them all to a local folder, run:
번역 대기 중 · 원문 표시
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
Original Model: google/datagemma-rig-27b-it Original dtype: `BF16` (`bfloat16`) Quantized by: llama.cpp b3750 IMatrix dataset: here If the model file is big, it has been split into multiple files. In order to download them all to a local folder, run: According to this investigation, it appears that lower quantizations are the only ones that benefit from the imatrix input (as per hellaswag results).
번역 대기 중 · 원문 표시
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
기본 정보 등록 · 상세 정보 보완 예정
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
Original Model: deepseek-ai/DeepSeek-V2.5 Original dtype: `BF16` (`bfloat16`) Quantized by: llama.cpp b3675 IMatrix dataset: here If the model file is big, it has been split into multiple files. In order to download them all to a local folder, run: According to this investigation, it appears that lower quantizations are the only ones that benefit from the imatrix input (as per hellaswag results).
번역 대기 중 · 원문 표시
Original Model: deepseek-ai/DeepSeek-V2-Lite-Chat Original dtype: `BF16` (`bfloat16`) Quantized by: llama.cpp fork PR 7519 IMatrix dataset: here If the model is bigger than 50GB, it will have been split into multiple files. In order to download them all to a local folder, run: According to this investigation, it appears that lower quantizations are the only ones that benefit from the imatrix input (as per hellaswag results).
번역 대기 중 · 원문 표시
Original Model: deepseek-ai/DeepSeek-V2-Lite Original dtype: `BF16` (`bfloat16`) Quantized by: llama.cpp https://github.com/ggerganov/llama.cpp/pull/7519 IMatrix dataset: here If the model file is big, it has been split into multiple files. In order to download them all to a local folder, run: According to this investigation, it appears that lower quantizations are the only ones that benefit from the imatrix input (as per hellaswag results).
번역 대기 중 · 원문 표시
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
Original Model: cognitivecomputations/dolphin-2.9.1-llama-3-8b Original dtype: `BF16` (`bfloat16`) Quantized by: llama.cpp b3006 IMatrix dataset: here If the model file is big, it has been split into multiple files. In order to download them all to a local folder, run: According to this investigation, it appears that lower quantizations are the only ones that benefit from the imatrix input (as per hellaswag results).
번역 대기 중 · 원문 표시
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
기본 정보 등록 · 상세 정보 보완 예정
Original Model: cognitivecomputations/dolphin-2.9.2-Phi-3-Medium Original dtype: `BF16` (`bfloat16`) Quantized by: llama.cpp b3072 IMatrix dataset: here If the model file is big, it has been split into multiple files. In order to download them all to a local folder, run: According to this investigation, it appears that lower quantizations are the only ones that benefit from the imatrix input (as per hellaswag results).
번역 대기 중 · 원문 표시
Original Model: google/gemma-2-27b-it Original dtype: `BF16` (`bfloat16`) Quantized by: llama.cpp b3790 IMatrix dataset: here If the model file is big, it has been split into multiple files. In order to download them all to a local folder, run: According to this investigation, it appears that lower quantizations are the only ones that benefit from the imatrix input (as per hellaswag results).
번역 대기 중 · 원문 표시
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
제공사, 분류, 입출력 조건을 조정하세요. 새 모델이 계속 등록됩니다.
월간 토큰 사용량으로 예상 API 비용을 비교하세요.
수집된 백만 토큰당 USD 요금입니다. 캐시 할인, 구간 요금, 추가 추론 출력, 세금은 제외됩니다. 최신 요금은 출처에서 확인하세요.
입력, 출력, 캐시 요금을 구분하고 동일 작업량으로 비교하세요. 이미지, 음성, 영상은 개수, 시간, 해상도로 과금될 수 있습니다.
반드시 그렇지는 않습니다. 버전별 라이선스, 상업 이용 제한, 정책을 확인하세요. 자체 호스팅에는 연산 및 유지 비용도 듭니다.
순위는 작업, 버전, 평가 방식에 따라 다릅니다. 실제 업무로 정확도, 지연, 안정성, 비용을 비교하세요.