gemma-3-1b-it-quantized.w8a8
RedHatAI基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
기본 정보 등록 · 상세 정보 보완 예정
언어부터 이미지, 오픈 웨이트부터 API까지. 기능과 실제 비용을 비교하세요.
다음 아이디어에 맞는 AI를 찾아보세요.
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
기본 정보 등록 · 상세 정보 보완 예정
- **Model Architecture:** gemma-3-27b-it - **Input:** Vision-Text - **Output:** Text - **Model Optimizations:** - **Weight quantization:** FP8 - **Activation quantization:** FP8 - **Release Date:** 2/24/2025 - **Version:** 1.0 - **Model Developers:** Neural Magic Quantized version of google/gemma-3-27b-it. This model was obtained by quantizing the weights of google/gemma-3-27b-it to FP8 data type, ready for inference with vLLM >= 0.5.2.
번역 대기 중 · 원문 표시
--- tags: - vllm - vision - w4a16 license: gemma base_model: google/gemma-3-27b-it library_name: transformers --- - **Model Architecture:** google/gemma-3-27b-it - **Input:** Vision-Text - **Output:** Text - **Model Optimizations:** - **Weight quantization:** INT4 - **Activation quantization:** FP16 - **Release Date:** 6/4/2025 - **Version:** 1.0 - **Model Developers:** RedHatAI Quantized version of google/gemma-3-27b-it.
번역 대기 중 · 원문 표시
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
기본 정보 등록 · 상세 정보 보완 예정
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
기본 정보 등록 · 상세 정보 보완 예정
This is a preliminary version (and subject to change) of FP8_Dynamic quantized google/gemma-4-12B-it model. The model has both weights and activations quantized to FP8_Dynamic format with vllm-project/llm-compressor. Run this script with this LLM Compressor PR and latest transformers to quantize the model using iMatrix quantization Evals: | model_name | flexible-extract | strict-match | bits_per_byte | byte_ppl | |---------------|------------------|--------------|---------------|----------| | baseline-bf16 | 0.9082 | 0.8958 | 1.9125 | 3.7645 | | FP8-RTN | 0.9115 | 0.8999 | 1.9368 | 3.8285 | | *FP8-iMatrix* | 0.9198 | 0.9032 | 1.9056 | 3.7465 | | FP8-GPTQ | 0.9098 | 0.8950 | 1.9357 | 3.8257 |
번역 대기 중 · 원문 표시
This is a preliminary version (and subject to change) of NVFP4 quantized google/gemma-4-12B-it model. The model has both weights and activations quantized to NVFP4 format with vllm-project/llm-compressor. Run this script with this LLM Compressor PR and latest transformers to quantize the model using GPTQ
번역 대기 중 · 원문 표시
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
- **Model Architecture:** Gemma4ForConditionalGeneration - **Input:** Text / Image - **Output:** Text - **Model Optimizations:** - **Weight quantization:** FP8 - **Activation quantization:** FP8 - **Release Date:** 2026-04-04 - **Version:** 1.0 - **Model Developers:** RedHatAI This model is a quantized version of google/gemma-4-26B-A4B-it. It was evaluated on several tasks to assess its quality in comparison to the unquantized model. This model was obtained by quantizing the weights and activations of google/gemma-4-26B-A4B-it to FP8 data type using dynamic per-token quantization, ready for inference with vLLM. This optimization reduces the number of bits per parameter from 16 to 8, reducing the disk size and GPU memory requirements by approximately 50%.
번역 대기 중 · 원문 표시
- **Model Architecture:** Gemma4ForConditionalGeneration - **Input:** Text / Image - **Output:** Text - **Model Optimizations:** - **Weight quantization:** FP4 - **Activation quantization:** FP4 - **Release Date:** 2026-04-04 - **Version:** 1.0 - **Model Developers:** RedHatAI This model is a quantized version of google/gemma-4-26B-A4B-it. It was evaluated on several tasks to assess its quality in comparison to the unquantized model. This model was obtained by quantizing the weights and activations of google/gemma-4-26B-A4B-it to NVFP4 data type, ready for inference with vLLM. This optimization reduces the number of bits per parameter from 16 to 4, reducing the disk size and GPU memory requirements by approximately 75%.
번역 대기 중 · 원문 표시
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
기본 정보 등록 · 상세 정보 보완 예정
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
- **Model Architecture:** Gemma4ForConditionalGeneration - **Input:** Text / Image - **Output:** Text - **Model Optimizations:** - **Weight quantization:** FP8 - **Activation quantization:** FP8 - **Release Date:** 2026-04-04 - **Version:** 1.0 - **Model Developers:** RedHatAI This model is a quantized version of google/gemma-4-31B-it. It was evaluated on several tasks to assess its quality in comparison to the unquantized model. This model was obtained by quantizing the weights and activations of google/gemma-4-31B-it to FP8 data type, ready for inference with vLLM. This optimization reduces the number of bits per parameter from 16 to 8, reducing the disk size and GPU memory requirements by approximately 50%.
번역 대기 중 · 원문 표시
- **Model Architecture:** Gemma4ForConditionalGeneration - **Input:** Text / Image - **Output:** Text - **Model Optimizations:** - **Weight quantization:** FP8 - **Activation quantization:** FP8 - **Release Date:** 2026-04-04 - **Version:** 1.0 - **Model Developers:** RedHatAI This model is a quantized version of google/gemma-4-31B-it. It was evaluated on several tasks to assess its quality in comparison to the unquantized model. This model was obtained by quantizing the weights and activations of google/gemma-4-31B-it to FP8 data type using dynamic per-token quantization, ready for inference with vLLM. This optimization reduces the number of bits per parameter from 16 to 8, reducing the disk size and GPU memory requirements by approximately 50%.
번역 대기 중 · 원문 표시
- **Model Architecture:** Gemma4ForConditionalGeneration - **Input:** Text / Image - **Output:** Text - **Model Optimizations:** - **Weight quantization:** FP4 - **Activation quantization:** FP4 - **Release Date:** 2026-04-04 - **Version:** 1.0 - **Model Developers:** RedHatAI This model is a quantized version of google/gemma-4-31B-it. It was evaluated on several tasks to assess its quality in comparison to the unquantized model. This model was obtained by quantizing the weights and activations of google/gemma-4-31B-it to FP4 data type using the NVFP4 format, ready for inference with vLLM. This optimization reduces the number of bits per parameter from 16 to 4, reducing the disk size and GPU memory requirements by approximately 75%.
번역 대기 중 · 원문 표시
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
기본 정보 등록 · 상세 정보 보완 예정
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
기본 정보 등록 · 상세 정보 보완 예정
This is a preliminary model release, we will continue to train the model and improve the acceptance rates in the next few days. This is a speculator model designed for use with google/gemma-4-31b-it, based on the EAGLE-3 speculative decoding algorithm. It was trained using the Speculators library on a combination of the Magpie-Align/Magpie-Llama-3.1-Pro-300K-Filtered dataset and the `train_sft` split of the HuggingFaceH4/ultrachat_200k dataset. Training data used **Magpie + UltraChat with responses from the gemma-4-31B-it model (no reasoning)**. This model should be used with the google/gemma-4-31b-it chat template, specifically through the `/chat/completions` endpoint.
번역 대기 중 · 원문 표시
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
기본 정보 등록 · 상세 정보 보완 예정
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
기본 정보 등록 · 상세 정보 보완 예정
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
기본 정보 등록 · 상세 정보 보완 예정
제공사, 분류, 입출력 조건을 조정하세요. 새 모델이 계속 등록됩니다.
월간 토큰 사용량으로 예상 API 비용을 비교하세요.
수집된 백만 토큰당 USD 요금입니다. 캐시 할인, 구간 요금, 추가 추론 출력, 세금은 제외됩니다. 최신 요금은 출처에서 확인하세요.
입력, 출력, 캐시 요금을 구분하고 동일 작업량으로 비교하세요. 이미지, 음성, 영상은 개수, 시간, 해상도로 과금될 수 있습니다.
반드시 그렇지는 않습니다. 버전별 라이선스, 상업 이용 제한, 정책을 확인하세요. 자체 호스팅에는 연산 및 유지 비용도 듭니다.
순위는 작업, 버전, 평가 방식에 따라 다릅니다. 실제 업무로 정확도, 지연, 안정성, 비용을 비교하세요.