AI NEWS.ccAI는 지금, 미래는 업데이트 중
♡ 저장한 도구 0
AI NEWS · 모델 정보기능을 이해하고 근거 있게 선택하세요. ↗기본 정보 우선 등록 · 상세 정보 지속 보완
THE AI MODEL DIRECTORY 모델 탐색을 시작하세요

나에게 맞는 AI 모델을 찾아보세요.

언어부터 이미지, 오픈 웨이트부터 API까지. 기능과 실제 비용을 비교하세요.
다음 아이디어에 맞는 AI를 찾아보세요.

인기 검색
84,991 개 모델13202 개 제공사 / 게시자45 개 기능 분류465개 비교 가능 요금 · 30개 공개 평가
T텍스트 생성▧이미지 생성▷영상 생성⌘코드 생성◖음성 합성♫음악 생성⬡3D 모델링▤문서 분석
DISCOVER & COMPARE

AI 모델 탐색 271

주목할 모델을 찾아보세요

The Llama 4 collection of models are natively multimodal AI models that enable text and multimodal experiences. These models leverage a mixture-of-experts architecture to offer industry-leading performance in text and image understanding. These Llama 4 models mark the beginning of a new era for the Llama ecosystem. We are launching two efficient models in the Llama 4 series, Llama 4 Scout, a 17 billion parameter model with 16 experts, and Llama 4 Maverick, a 17 billion parameter model with 128 experts. **Model Architecture:** The Llama 4 models are auto-regressive language models that use a mixture-of-experts (MoE) architecture and incorporate early fusion for native multimodality.

번역 대기 중 · 원문 표시

시각 질의응답
입력 텍스트 · 이미지→ 출력 텍스트
요금 미확인멀티모달 및 채널 요금 별도 확인
자세히 보기 ↗
출처 / 문서 ↗

This model was obtained by quantizing weights of Llama-4-Scout-17B-16E-Instruct to INT4 data type. This optimization reduces the number of bits used to represent weights from 16 to 4, reducing GPU memory requirements by approximately 75%. Weight quantization also reduces disk size requirements by approximately 75%. The llm-compressor library is used for quantization. This model can be deployed efficiently on vLLM, Red Hat Enterprise Linux AI, and Openshift AI, as shown in the example below. The model was evaluated on the OpenLLM leaderboard tasks (v1 and v2), long context RULER, multimodal MMMU, and multimodal ChartQA. All evaluations are obtained through lm-evaluation-harness.

번역 대기 중 · 원문 표시

시각 질의응답
입력 텍스트 · 이미지→ 출력 텍스트
요금 미확인멀티모달 및 채널 요금 별도 확인
자세히 보기 ↗
출처 / 문서 ↗

- **Model Architecture:** Meta-Llama-3.1 - **Input:** Text - **Output:** Text - **Model Optimizations:** - **Weight quantization:** FP8 - **Activation quantization:** FP8 - **Intended Use Cases:** Intended for commercial and research use in multiple languages. Similarly to Meta-Llama-3.1-8B-Instruct, this models is intended for assistant-like chat. - **Out-of-scope:** Use in any manner that violates applicable laws or regulations (including trade compliance laws). Use in languages other than English. - **Release Date:** 7/23/2024 - **Version:** 1.0 - **License(s):** llama3.1 - **Model Developers:** Neural Magic Quantized version of Meta-Llama-3.1-70B-Instruct. It achieves an average score of 84.29 on the OpenLLM benchmark (version 1), whereas the unquantized model achieves 84.40. This model was obtained by quantizing the weights and activations of Meta-Llama-3.1-70B-Instruct to FP8 data type. This optimization reduces the number of bits per parameter from 16 to 8, reducing the disk size and GPU memory requirements by approximately 50%.

번역 대기 중 · 원문 표시

텍스트 생성
입력 텍스트→ 출력 텍스트
요금 미확인멀티모달 및 채널 요금 별도 확인
자세히 보기 ↗
출처 / 문서 ↗

This model is a quantized version of Meta-Llama-3.1-70B-Instruct. It was evaluated on a several tasks to assess the its quality in comparison to the unquatized model, including multiple-choice, math reasoning, and open-ended text generation. Meta-Llama-3.1-70B-Instruct-quantized.w4a16 achieves 100.0% recovery for the Arena-Hard evaluation, 99.4% for OpenLLM v1 (using Meta's prompting when available), 97.4% for OpenLLM v2, 101.0% for HumanEval pass@1, and 99.2% for HumanEval+ pass@1. This model was obtained by quantizing the weights of Meta-Llama-3.1-70B-Instruct to INT4 data type. This optimization reduces the number of bits per parameter from 16 to 4, reducing the disk size and GPU memory requirements by approximately 75%. Only the weights of the linear operators within transformers blocks are quantized. Symmetric per-group quantization is applied, in which a linear scaling per group of 128 parameters maps the INT4 and floating point representations of the quantized weights. The GPTQ algorithm is applied for quantization, as implemented in the AutoGPTQ library. GPTQ used a 1% damping factor and 512 sequences of 8,192 random tokens.

번역 대기 중 · 원문 표시

텍스트 생성
입력 텍스트→ 출력 텍스트
요금 미확인멀티모달 및 채널 요금 별도 확인
자세히 보기 ↗
출처 / 문서 ↗

Quantized version of Meta-Llama-3.1-8B. It achieves an average score of 65.90 on the OpenLLM benchmark (version 1), whereas the unquantized model achieves 66.47. This model was obtained by quantizing the weights and activations of Meta-Llama-3.1-8B to FP8 data type, ready for inference with vLLM built from source. This optimization reduces the number of bits per parameter from 16 to 8, reducing the disk size and GPU memory requirements by approximately 50%. Only the weights and activations of the linear operators within transformers blocks are quantized. Symmetric per-tensor quantization is applied, in which a single linear scaling maps the FP8 representations of the quantized weights and activations. LLM Compressor is used for quantization with 512 sequences of UltraChat.

번역 대기 중 · 원문 표시

텍스트 생성
입력 텍스트→ 출력 텍스트
요금 미확인멀티모달 및 채널 요금 별도 확인
자세히 보기 ↗
출처 / 문서 ↗

- **Model Architecture:** Meta-Llama-3.1 - **Input:** Text - **Output:** Text - **Model Optimizations:** - **Weight quantization:** FP8 - **Activation quantization:** FP8 - **Intended Use Cases:** Intended for commercial and research use in multiple languages. Similarly to Meta-Llama-3.1-8B-Instruct, this models is intended for assistant-like chat. - **Out-of-scope:** Use in any manner that violates applicable laws or regulations (including trade compliance laws). Use in languages other than English. - **Release Date:** 7/23/2024 - **Version:** 1.0 - **License(s):** llama3.1 - **Model Developers:** Neural Magic Quantized version of Meta-Llama-3.1-8B-Instruct. It achieves an average score of 73.44 on the OpenLLM benchmark (version 1), whereas the unquantized model achieves 73.79. This model was obtained by quantizing the weights and activations of Meta-Llama-3.1-8B-Instruct to FP8 data type, ready for inference with vLLM built from source. This optimization reduces the number of bits per parameter from 16 to 8, reducing the disk size and GPU memory requirements by approximately 50%.

번역 대기 중 · 원문 표시

텍스트 생성
입력 텍스트→ 출력 텍스트
요금 미확인멀티모달 및 채널 요금 별도 확인
자세히 보기 ↗
출처 / 문서 ↗

This model is a quantized version of Meta-Llama-3.1-8B-Instruct. It was evaluated on a several tasks to assess the its quality in comparison to the unquatized model, including multiple-choice, math reasoning, and open-ended text generation. Meta-Llama-3.1-8B-Instruct-FP8-dynamic achieves 105.4% recovery for the Arena-Hard evaluation, 99.7% for OpenLLM v1 (using Meta's prompting when available), 101.2% for OpenLLM v2, 100.0% for HumanEval pass@1, and 101.0% for HumanEval+ pass@1. This model was obtained by quantizing the weights and activations of Meta-Llama-3.1-8B-Instruct to FP8 data type, ready for inference with vLLM built from source. This optimization reduces the number of bits per parameter from 16 to 8, reducing the disk size and GPU memory requirements by approximately 50%. Only the weights and activations of the linear operators within transformers blocks are quantized. Symmetric per-channel quantization is applied, in which a linear scaling per output dimension maps the FP8 representations of the quantized weights and activations. Activations are also quantized on a per-token dynamic basis. LLM Compressor is used for quantization.

번역 대기 중 · 원문 표시

텍스트 생성
입력 텍스트→ 출력 텍스트
요금 미확인멀티모달 및 채널 요금 별도 확인
자세히 보기 ↗
출처 / 문서 ↗

- **Model Architecture:** LlamaForCausalLM - **Input:** Text - **Output:** Text - **Model Optimizations:** - **Weight quantization:** INT4 - **Intended Use Cases:** Intended for commercial and research use in English. Similarly to Meta-Llama-3.1-8B-Instruct, this models is intended for assistant-like chat. - **Out-of-scope:** Use in any manner that violates applicable laws or regulations (including trade compliance laws). Use in languages other than English. - **Release Date:** 7/26/2024 - **Version:** 1.0 - **Validated on:** RHOAI 2.20, RHAIIS 3.0, RHELAI 1.5 - **License(s):** Llama3.1 - **Model Developers:** Neural Magic This model is a quantized version of Meta-Llama-3.1-8B-Instruct. It was evaluated on a several tasks to assess the its quality in comparison to the unquatized model, including multiple-choice, math reasoning, and open-ended text generation. Meta-Llama-3.1-8B-Instruct-quantized.w4a16 achieves 93.0% recovery for the Arena-Hard evaluation, 98.9% for OpenLLM v1 (using Meta's prompting when available), 96.1% for OpenLLM v2, 99.7% for HumanEval pass@1, and 97.4% for HumanEval+ pass@1. This model was obtained by quantizing the weights of Meta-Llama-3.1-8B-Instruct to INT4 data type. This optimization reduces the number of bits per parameter from 16 to 4, reducing the disk size and GPU memory requirements by approximately 75%.

번역 대기 중 · 원문 표시

텍스트 생성
입력 텍스트→ 출력 텍스트
요금 미확인멀티모달 및 채널 요금 별도 확인
자세히 보기 ↗
출처 / 문서 ↗
COST EXPLORER

좋은 모델, 명확한 비용.

비용 분석

월간 토큰 사용량으로 예상 API 비용을 비교하세요.

1 M = 100만 토큰 · USD
동일 채널의 기본 텍스트 토큰 요금 비교

수집된 백만 토큰당 USD 요금입니다. 캐시 할인, 구간 요금, 추가 추론 출력, 세금은 제외됩니다. 최신 요금은 출처에서 확인하세요.

MODEL HANDBOOK

이해하고 선택하세요

선택 가이드 및 FAQ
API 요금은 어떻게 비교하나요?+

입력, 출력, 캐시 요금을 구분하고 동일 작업량으로 비교하세요. 이미지, 음성, 영상은 개수, 시간, 해상도로 과금될 수 있습니다.

오픈 웨이트는 무료 상업 이용을 뜻하나요?+

반드시 그렇지는 않습니다. 버전별 라이선스, 상업 이용 제한, 정책을 확인하세요. 자체 호스팅에는 연산 및 유지 비용도 듭니다.

1위 모델이 나에게 가장 적합한가요?+

순위는 작업, 버전, 평가 방식에 따라 다릅니다. 실제 업무로 정확도, 지연, 안정성, 비용을 비교하세요.

AI NEWS · 정보에서 선택으로

뉴스로 흐름을, 도구로 효율을, 모델로 가능성을.

AI 뉴스 탐색 ↗AI 도구 찾기 ↗