Model overview
EAI-Distill-0.5b is a fine-tuned version of Qwen2.5-0.5B-Instruct designed for document classification across 12 taxonomic categories. This model is optimized for high-throughput classification of web documents and produces structured metadata for large-scale dataset curation. The model classifies documents across the following dimensions: - **📚 Free Decimal Correspondence (FDC)**: Subject matter classification based on the Dewey Decimal System - **🧠 Bloom's Taxonomy**: Cognitive process (Remember/Understand/Apply/Analyze/Evaluate/Create) and knowledge domain (Factual/Conceptual/Procedural/Metacognitive) - **📄 Document Type**: Web page categorization (News, Academic, Reference, Code, Social, etc.) - **🔍 Content Quality**: Extraction artifacts, missing content detection - **🎓 Educational Metadata**: Reasoning depth, technical correctness, educational level - **🤖 Base Model**: Qwen2.5-0.5B-Instruct - **📊 Training Data**: 82B synthetic tokens generated by Qwen2.5-32B-Instruct (teacher model) on 104M Common Crawl documents - **⚙️ Optimizer**: AdamW (β₁=0.9, β₂=0.95, weight_decay=0.1) - **📈 Learning Rate**: 1×10⁻⁴ with linear warmup (2B tokens), cosine decay to 1×10⁻⁵, then linear anneal to 0 - **📦 Batch Size**: 2M tokens - **📏 Sequence Length**: 16,384 tokens - **💻 Hardware**: Trained on AMD MI300x GPUs
Key features
特点摘要待依据来源补齐，不凭模型名称推断能力。
Limitations & considerations
Sources are insufficient to establish specific limitations. Verify task performance, latency, data policies, licensing and version lifecycle.
Source prices & cost analysis
Prices vary by channel, region and configuration. Channel quotes are listed independently and are not treated as a single official provider price.
| Source / channel | Input | Output | Billing unit | Collected at |
|---|---|---|---|---|
| No verified prices yet. Check the source channel. | ||||
Estimate monthly base token costs
Estimates exclude cache discounts, tiered pricing, multimodal surcharges, web search, taxes and additional reasoning output.
Public benchmarks & run configuration
暂无已采集的可核验公开评分。模型未上榜不代表能力较低。
View full indexed rankings →Frequently asked questions
Do open weights permit free commercial use?
Not necessarily. Check the version license, commercial conditions and usage policies. Self-hosting incurs compute and maintenance costs.
Are these real-time billing prices?
These are timestamped source snapshots, not live billing prices. Check the channel for current versions, regions, discounts and billing methods.
Sources & traceability
许可证：apache-2.0。模型介绍与第三方评测均以原来源的具体版本和方法为准。