Kimi-K3-INT4
RedHatAI基础档案已收录，详细介绍后续补充。可先查看厂商、分类与来源。
基础资料已收录 · 缺失资料后续补充
输入 文本 · 图像→ 输出 文本
价格待核验多模态与渠道费用须分别核对
查看详情 ↗DISCOVER & COMPARE
探索 AI 模型 271
Kimi-K3-NVFP4
RedHatAI基础档案已收录，详细介绍后续补充。可先查看厂商、分类与来源。
输入 文本 · 图像→ 输出 文本
价格待核验多模态与渠道费用须分别核对
查看详情 ↗Kimi-K3-speculator.dspark
RedHatAI基础档案已收录，详细介绍后续补充。可先查看厂商、分类与来源。
输入 待核验→ 输出 待核验
价格待核验多模态与渠道费用须分别核对
查看详情 ↗Laguna-S-2.1
RedHatAI基础档案已收录，详细介绍后续补充。可先查看厂商、分类与来源。
基础资料已收录 · 缺失资料后续补充
输入 文本→ 输出 文本
价格待核验多模态与渠道费用须分别核对
查看详情 ↗Laguna-S-2.1-FP8
RedHatAI基础档案已收录，详细介绍后续补充。可先查看厂商、分类与来源。
基础资料已收录 · 缺失资料后续补充
输入 文本→ 输出 文本
价格待核验多模态与渠道费用须分别核对
查看详情 ↗Laguna-S-2.1-NVFP4
RedHatAI基础档案已收录，详细介绍后续补充。可先查看厂商、分类与来源。
基础资料已收录 · 缺失资料后续补充
输入 文本→ 输出 文本
价格待核验多模态与渠道费用须分别核对
查看详情 ↗Laguna-XS.2-FP8
RedHatAI基础档案已收录，详细介绍后续补充。可先查看厂商、分类与来源。
基础资料已收录 · 缺失资料后续补充
输入 文本→ 输出 文本
价格待核验多模态与渠道费用须分别核对
查看详情 ↗Laguna-XS.2-NVFP4
RedHatAI基础档案已收录，详细介绍后续补充。可先查看厂商、分类与来源。
输入 文本→ 输出 文本
价格待核验多模态与渠道费用须分别核对
查看详情 ↗Llama-3.1-8B-Instruct
RedHatAI基础档案已收录，详细介绍后续补充。可先查看厂商、分类与来源。
输入 文本→ 输出 文本
价格待核验多模态与渠道费用须分别核对
查看详情 ↗Llama-3.1-8B-Instruct-NVFP4
RedHatAIThis model is a quantized version of Meta-Llama-3.1-8B-Instruct. It was evaluated on a several tasks to assess the its quality in comparison to the unquatized model. This model was obtained by quantizing the weights and activations of Meta-Llama-3.1-8B-Instruct to FP4 data type, ready for inference with vLLM>=0.9.1 This optimization reduces the number of bits per parameter from 16 to 4, reducing the disk size and GPU memory requirements by approximately 75%. Only the weights and activations of the linear operators within transformers blocks are quantized using LLM Compressor.
译文排队中 · 当前显示来源原文
输入 文本→ 输出 文本
价格待核验多模态与渠道费用须分别核对
查看详情 ↗基础档案已收录，详细介绍后续补充。可先查看厂商、分类与来源。
输入 文本→ 输出 文本
价格待核验多模态与渠道费用须分别核对
查看详情 ↗Llama-3.2-1B-FP8
RedHatAI基础档案已收录，详细介绍后续补充。可先查看厂商、分类与来源。
输入 待核验→ 输出 待核验
价格待核验多模态与渠道费用须分别核对
查看详情 ↗Llama-3.2-1B-Instruct-FP8
RedHatAIQuantized version of Llama-3.2-1B-Instruct. It achieves scores within 1.0% of the scores of the unquantized model for MMLU, ARC-Challenge, GSM-8k, Hellaswag, Winogrande and TruthfulQA. This model was obtained by quantizing the weights of Llama-3.2-1B-Instruct to FP8 data type. This optimization reduces the number of bits used to represent weights and activations from 16 to 8, reducing GPU memory requirements (by approximately 50%) and increasing matrix-multiply compute throughput (by approximately 2x). Weight quantization also reduces disk size requirements by approximately 50%. Only weights and activations of the linear operators within transformers blocks are quantized. Weights are quantized with a symmetric static per-channel scheme, where a fixed linear scaling factor is applied between FP8 and floating point representations for each output channel dimension. Activations are quantized with a symmetric per-tensor scheme, where a fixed linear scaling factor is applied between FP8 and floating point representations for the entire activation tensor. Weights are quantized by rounding to nearest FP8 representation. The llm-compressor library was applied to quantize the model, usin 512 sequences sequences taken from Neural Magic's LLM compression calibration dataset.
译文排队中 · 当前显示来源原文
输入 文本→ 输出 文本
价格待核验多模态与渠道费用须分别核对
查看详情 ↗- **Model Architecture:** Meta-Llama-3.2 - **Input:** Text - **Output:** Text - **Model Optimizations:** - **Weight quantization:** FP8 - **Activation quantization:** FP8 - **Intended Use Cases:** Intended for commercial and research use in multiple languages. Similarly to Llama-3.2-1B-Instruct, this models is intended for assistant-like chat. - **Out-of-scope:** Use in any manner that violates applicable laws or regulations (including trade compliance laws). Use in languages other than English. - **Release Date:** 9/25/2024 - **Version:** 1.0 - **License(s):** llama3.2 - **Model Developers:** Neural Magic Quantized version of Llama-3.2-1B-Instruct. It achieves an average score of 50.88 on a subset of task from the OpenLLM benchmark (version 1), whereas the unquantized model achieves 51.70. This model was obtained by quantizing the weights and activations of Llama-3.2-1B-Instruct to FP8 data type, ready for inference with vLLM built from source. This optimization reduces the number of bits per parameter from 16 to 8, reducing the disk size and GPU memory requirements by approximately 50%.
译文排队中 · 当前显示来源原文
输入 文本→ 输出 文本
价格待核验多模态与渠道费用须分别核对
查看详情 ↗Quantized version of Llama-3.2-1B-Instruct. It achieves scores within 5% of the scores of the unquantized model for MMLU, ARC-Challenge, GSM-8k, Hellaswag, Winogrande and TruthfulQA. This model was obtained by quantizing the weights of Llama-3.2-1B-Instruct to INT8 data type. This optimization reduces the number of bits used to represent weights and activations from 16 to 8, reducing GPU memory requirements (by approximately 50%) and increasing matrix-multiply compute throughput (by approximately 2x). Weight quantization also reduces disk size requirements by approximately 50%. Only weights and activations of the linear operators within transformers blocks are quantized. Weights are quantized with a symmetric static per-channel scheme, where a fixed linear scaling factor is applied between INT8 and floating point representations for each output channel dimension. Activations are quantized with a symmetric dynamic per-token scheme, computing a linear scaling factor at runtime for each token between INT8 and floating point representations. The SmoothQuant algorithm is used to alleviate outliers in the activations, whereas rhe GPTQ algorithm is applied for quantization. Both algorithms are implemented in the llm-compressor library. GPTQ used a 1% damping factor and 512 sequences sequences taken from Neural Magic's LLM compression calibration dataset.
译文排队中 · 当前显示来源原文
输入 文本→ 输出 文本
价格待核验多模态与渠道费用须分别核对
查看详情 ↗Llama-3.2-1B-quantized.w8a8
RedHatAI基础档案已收录，详细介绍后续补充。可先查看厂商、分类与来源。
输入 待核验→ 输出 待核验
价格待核验多模态与渠道费用须分别核对
查看详情 ↗Llama-3.2-3B-Instruct-FP8
RedHatAIQuantized version of Llama-3.2-3B-Instruct. It achieves scores within 0.7% of the scores of the unquantized model for MMLU, ARC-Challenge, GSM-8k, Hellaswag, Winogrande and TruthfulQA. This model was obtained by quantizing the weights of Llama-3.2-3B-Instruct to FP8 data type. This optimization reduces the number of bits used to represent weights and activations from 16 to 8, reducing GPU memory requirements (by approximately 50%) and increasing matrix-multiply compute throughput (by approximately 2x). Weight quantization also reduces disk size requirements by approximately 50%. Only weights and activations of the linear operators within transformers blocks are quantized. Weights are quantized with a symmetric static per-channel scheme, where a fixed linear scaling factor is applied between FP8 and floating point representations for each output channel dimension. Activations are quantized with a symmetric per-tensor scheme, where a fixed linear scaling factor is applied between FP8 and floating point representations for the entire activation tensor. Weights are quantized by rounding to nearest FP8 representation. The llm-compressor library was applied to quantize the model, usin 512 sequences sequences taken from Neural Magic's LLM compression calibration dataset.
译文排队中 · 当前显示来源原文
输入 文本→ 输出 文本
价格待核验多模态与渠道费用须分别核对
查看详情 ↗- **Model Architecture:** Meta-Llama-3.2 - **Input:** Text - **Output:** Text - **Model Optimizations:** - **Weight quantization:** FP8 - **Activation quantization:** FP8 - **Intended Use Cases:** Intended for commercial and research use in multiple languages. Similarly to Llama-3.2-3B-Instruct, this models is intended for assistant-like chat. - **Out-of-scope:** Use in any manner that violates applicable laws or regulations (including trade compliance laws). Use in languages other than English. - **Release Date:** 9/25/2024 - **Version:** 1.0 - **License(s):** llama3.2 - **Model Developers:** Neural Magic Quantized version of Llama-3.2-3B-Instruct. It achieves an average score of 50.88 on a subset of task from the OpenLLM benchmark (version 1), whereas the unquantized model achieves 51.70. This model was obtained by quantizing the weights and activations of Llama-3.2-3B-Instruct to FP8 data type, ready for inference with vLLM built from source. This optimization reduces the number of bits per parameter from 16 to 8, reducing the disk size and GPU memory requirements by approximately 50%.
译文排队中 · 当前显示来源原文
输入 文本→ 输出 文本
价格待核验多模态与渠道费用须分别核对
查看详情 ↗基础档案已收录，详细介绍后续补充。可先查看厂商、分类与来源。
基础资料已收录 · 缺失资料后续补充
输入 文本→ 输出 文本
价格待核验多模态与渠道费用须分别核对
查看详情 ↗Llama-3.2-3B-quantized.w8a8
RedHatAI基础档案已收录，详细介绍后续补充。可先查看厂商、分类与来源。
输入 待核验→ 输出 待核验
价格待核验多模态与渠道费用须分别核对
查看详情 ↗Llama-3.3-70B-Instruct
RedHatAI基础档案已收录，详细介绍后续补充。可先查看厂商、分类与来源。
基础资料已收录 · 缺失资料后续补充
输入 文本→ 输出 文本
价格待核验多模态与渠道费用须分别核对
查看详情 ↗- **Model Architecture:** Meta-Llama-3.1 - **Input:** Text - **Output:** Text - **Model Optimizations:** - **Weight quantization:** FP8 - **Activation quantization:** FP8 - **Intended Use Cases:** Intended for commercial and research use in multiple languages. Instruction tuned text only models are intended for assistant-like chat, whereas pretrained models can be adapted for a variety of natural language generation tasks. The Llama 3.3 model also supports the ability to leverage the outputs of its models to improve other models including synthetic data generation and distillation. The Llama 3.3 Community License allows for these use cases. - **Out-of-scope:** Use in any manner that violates applicable laws or regulations (including trade compliance laws). Use in any other way that is prohibited by the Acceptable Use Policy and Llama 3.3 Community License. Use in languages beyond English, German, French, Italian, Portuguese, Hindi, Spanish, and Thai. - **Release Date:** 12/11/2024 - **Version:** 1.0 - **Validated on:** RHOAI 2.20, RHAIIS 3.0, RHELAI 1.5 - **License(s):** llama3.3 - **Model Developers:** RedHat (Neural Magic) This model was obtained by quantizing activation and weights of Llama-3.3-70B-Instruct to FP8 data type. This optimization reduces the number of bits used to represent weights and activations from 16 to 8, reducing GPU memory requirements (by approximately 50%) and increasing matrix-multiply compute throughput (by approximately 2x). Weight quantization also reduces disk size requirements by approximately 50%. Only weights and activations of the linear operators within transformers blocks are quantized. Weights are quantized with a symmetric static per-channel scheme, whereas activations are quantized with a symmetric dynamic per-token scheme. The llm-compressor library is used for quantization.
译文排队中 · 当前显示来源原文
输入 文本→ 输出 文本
价格待核验多模态与渠道费用须分别核对
查看详情 ↗Llama-3.3-70B-Instruct-NVFP4
RedHatAIThis model is a quantized version of Meta-Llama-3.3-70B-Instruct. It was evaluated on a several tasks to assess the its quality in comparison to the unquatized model. This model was obtained by quantizing the weights and activations of Meta-Llama-3.3-70B-Instruct to FP4 data type, ready for inference with vLLM>=0.9.1 This optimization reduces the number of bits per parameter from 16 to 4, reducing the disk size and GPU memory requirements by approximately 75%. Only the weights and activations of the linear operators within transformers blocks are quantized using LLM Compressor.
译文排队中 · 当前显示来源原文
输入 文本→ 输出 文本
价格待核验多模态与渠道费用须分别核对
查看详情 ↗This model was obtained by quantizing the weights of Llama-3.3-70B-Instruct to INT4 data type. This optimization reduces the number of bits per parameter from 16 to 4, reducing the disk size and GPU memory requirements by approximately 75%. Only the weights of the linear operators within transformers blocks are quantized. Weights are quantized using a symmetric per-group scheme, with group size 128. The GPTQ algorithm is applied for quantization, as implemented in the llm-compressor library. This model was evaluated on the well-known OpenLLM v1, HumanEval, and HumanEval+ benchmarks. In all cases, model outputs were generated with the vLLM engine.
译文排队中 · 当前显示来源原文
输入 文本→ 输出 文本
价格待核验多模态与渠道费用须分别核对
查看详情 ↗暂未找到匹配模型
可以调整厂商、分类或输入输出条件；新模型正持续收录。
COST EXPLORER
好模型，也要算好成本。
调整月度 Token 用量，直观比较不同模型的预估 API 开支。
1 M = 100 万 Token · 美元计价
仅比较同一渠道的基础文本 Token 报价
仅比较同一渠道的基础文本 Token 报价
使用已采集且单位可比的 USD / 百万 Token 渠道报价。报价为采集时快照；不计缓存优惠、阶梯价、推理额外输出与税费，请以来源的当前报价为准。
MODEL HANDBOOK
读懂模型，再做选择
API 价格应该怎么比较？+
先区分输入、输出和缓存价格，再使用同一任务和用量估算总费用。图像、音频和视频可能按张、时长或分辨率计费，不能直接与 Token 单价比较。
开放权重，就代表可以免费商用吗？+
不一定。必须逐一核对具体模型版本的许可证、商用限制及使用政策。自己部署还需要考虑显存、推理资源和运维费用。
排行榜第一，就是最适合我的模型吗？+
榜单取决于测试任务、版本与评测方法。建议用实际业务样本比较准确性、时延、稳定性和成本，再选择模型。