- **Model Architecture:** SmolLM-135M-Instruct - **Input:** Text - **Output:** Text - **Model Optimizations:** - **Weight quantization:** INT4 - **Intended Use Cases:** Intended for commercial and research use in English. Similarly to SmolLM-135M-Instruct, this models is intended for assistant-like chat. - **Out-of-scope:** Use in any manner that violates applicable laws or regulations (including trade compliance laws). Use in languages other than English. - **Release Date:** 8/23/2024 - **Version:** 1.0 - **License(s)**: Apache-2.0 - **Model Developers:** Neural Magic Quantized version of SmolLM-135M-Instruct. It achieves an average score of 31.91 on the OpenLLM benchmark (version 1), whereas the unquantized model achieves 31.55. This model was obtained by quantizing the weights of SmolLM-135M-Instruct to INT4 data type. This optimization reduces the number of bits per parameter from 16 to 4, reducing the disk size and GPU memory requirements by approximately 75%.

Text generation

Input Text→ Output Text

Price not verifiedCheck multimodal and channel pricing separately

View details ↗

CompareSource / docs ↗

Speculator-Qwen3-8B-Eagle3

nm-testing

基础档案已收录，详细介绍后续补充。可先查看厂商、分类与来源。

Basic profile indexed · More details to follow

Category pending

Input Not verified→ Output Not verified

Price not verifiedCheck multimodal and channel pricing separately

View details ↗

CompareSource / docs ↗

Speculator-Qwen3-8B-Eagle3-converted-071-quantized

nm-testing

基础档案已收录，详细介绍后续补充。可先查看厂商、分类与来源。

Basic profile indexed · More details to follow

Category pending

Input Not verified→ Output Not verified

Price not verifiedCheck multimodal and channel pricing separately

View details ↗

CompareSource / docs ↗

Speculator-Qwen3-8B-Eagle3-converted-071-quantized-w4a16

nm-testing

基础档案已收录，详细介绍后续补充。可先查看厂商、分类与来源。

Basic profile indexed · More details to follow

Category pending

Input Not verified→ Output Not verified

Price not verifiedCheck multimodal and channel pricing separately

View details ↗

CompareSource / docs ↗

SpeculatorLlama3-1-8B-Eagle3-converted-0717-quantized

nm-testing

基础档案已收录，详细介绍后续补充。可先查看厂商、分类与来源。

Basic profile indexed · More details to follow

Category pending

Input Not verified→ Output Not verified

Price not verifiedCheck multimodal and channel pricing separately

View details ↗

CompareSource / docs ↗

COST EXPLORER

Great models. Clear costs.

Cost analysis

Adjust monthly token usage to compare estimated API costs.

Monthly input tokens 10 MMonthly output tokens 2 M1 M = 1 million tokens · USD
Compares base text-token rates within the same channel

Uses collected, comparable USD-per-million-token rates. Snapshots exclude cache discounts, tiers, extra reasoning output and taxes. Check current source prices.

MODEL HANDBOOK

Understand before you choose

Selection guide & FAQ

How should API prices be compared?+

Separate input, output and cache rates, then estimate the same workload. Image, audio and video rates may use items, duration or resolution rather than tokens.

Do open weights mean free commercial use?+

Not necessarily. Check each version’s license, commercial restrictions and policies. Self-hosting also incurs compute and maintenance costs.

Is the top-ranked model the best for me?+

Rankings depend on tasks, versions and methods. Compare accuracy, latency, reliability and costs on your own workload.

Find your ideal AI model.

Explore AI models 75

llama2.c-stories42M-gsm8k-stacked-uncompressed

llama2.c-stories42M-pruned2.4

Llama3_2_1B_speculator.eagle3

Meta-Llama-3-8B-FP8-compressed-tensors-test

Meta-Llama-3-8B-Instruct-nonuniform-test

Meta-Llama-3-8B-Instruct-W8-Channel-A8-Dynamic-Asym-Per-Token-Test

model_free_nvfp4a16-e2e

multiple_modifiers_gptq_awq-e2e

nvfp4_fp8_mixed-e2e

nvfp4_moe-e2e

pixtral-12b-FP8-dynamic

Qwen1.5-MoE-A2.7B-Chat-quantized.w4a16

Qwen2-1.5B-Instruct-FP8W8

Qwen3-30B-A3B-FP8-block

Qwen3-30B-A3B-MXFP4A16

Qwen3-30B-A3B-NVFP4-AWQ-e2e

qwen3-8b-peagle-speculators

Qwen3-Coder-30B-A3B-Instruct-W4A16-awq

Qwen3-VL-8B-Instruct-W4A16

SmolLM-1.7B-Instruct-quantized.w4a16

Speculator-Qwen3-8B-Eagle3

Speculator-Qwen3-8B-Eagle3-converted-071-quantized

Speculator-Qwen3-8B-Eagle3-converted-071-quantized-w4a16

SpeculatorLlama3-1-8B-Eagle3-converted-0717-quantized

No matching models

Great models. Clear costs.

Understand before you choose

Follow trends. Find tools. Explore models.