flan_t5_large-coqa
lorahub基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
Basic profile indexed · More details to follow
From language to images, open weights to APIs. Understand capabilities and compare real costs.
Find the right engine for your next idea.
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
Basic profile indexed · More details to follow
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
Basic profile indexed · More details to follow
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
Basic profile indexed · More details to follow
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
Basic profile indexed · More details to follow
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
Basic profile indexed · More details to follow
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
Basic profile indexed · More details to follow
A **W4A16 (INT4 weight, FP16 activation) quantization** of `Qwen/Qwen3.6-27B`, produced with Intel's AutoRound. - **Base**: Qwen3.6-27B (27B dense VLM, Apr 21 2026) - **Quant**: INT4 W4A16, group_size 128, symmetric - **Tool**: `auto-round` (default recipe, 200 iters, torch.compile) - **Size**: 18 GB (down from ~54 GB BF16) — **3x reduction** - **MTP preserved**: The native Multi-Token Prediction head is kept in BF16, enabling **native speculative decoding** in vLLM (≈90% draft acceptance in our tests, ~2x throughput) - **Accuracy**: Default AutoRound recipe preserves quality well; layer-norm weights, router layers, RMSNorm, `linear_attn.in_proj_a/b`, and MTP's fusion `fc` are kept unquantized (they're small and benefit from full precision) Requires vLLM that supports Qwen3_5 MTP (most recent nightlies — tested with `eugr/spark-vllm-docker` fork `0.19.1rc1.dev39+g7055d32a7`):
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
Basic profile indexed · More details to follow
A 2-bit **ROCmFPX** GGUF of a distilled Qwen3.6-35B-A3B (MoE, 256 experts / ~3B active), sized to run on a **16GB consumer GPU**. Ships with the MTP (`nextn`) head and build instructions for the matching runtime. > **Honest status:** this is a proof-of-concept. On the internal 10-task smoke eval the distilled > model **tied its base** (6/10 vs 6/10) — no regression, no measurable gain yet — and it is now > quantized to 2-bit, which trades quality for fit. Publishing it as a reproducible artifact of the > pipeline (distill → graft MTP → ROCmFPX 2-bit GGUF), **not** as a benchmark-winning coder. > The quality fix is a larger, tool-calling-heavy corpus — a separate follow-up run. 16GB card: context and concurrency share one KV pool — pick single-stream long context (`-c 32768 -np 1`) **or** many short sessions (`-c 8192 -np 8`).
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
Single-GPU llama.cpp GGUF package for `deepreinforce-ai/Ornith-1.0-35B`. The supported serving policy is `tp=1` — one model copy per GPU. Multi-GPU tensor-parallel serving is intentionally out of scope for this version. This release ships six body quants (Q3_K_M → Q8_0) plus an **integrated IQ4_XS-MTP graft** that adds a native multi-token-prediction (MTP) draft head for low-concurrency speculative decode. Quant quality is measured against the upstream BF16 GGUF with a native llama.cpp next-token top-64 KL-divergence probe over 32 coding prompts. > **MTP graft note:** active MTP is byte-for-byte identical to target-only at the > next-token (API-visible) level, and gives ~1.3× single-stream decode. It is > **not** bit-exact to target-only over long deterministic sequences — see > MTP. Use target-only for strict reproduction, > MTP for throughput on open-ended work.
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
Basic profile indexed · More details to follow
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
Basic profile indexed · More details to follow
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
Basic profile indexed · More details to follow
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
Basic profile indexed · More details to follow
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
Basic profile indexed · More details to follow
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
Basic profile indexed · More details to follow
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
Basic profile indexed · More details to follow
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
Basic profile indexed · More details to follow
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
Basic profile indexed · More details to follow
A reasoning-distilled variant of **Qwen3.6-35B-A3B** taught to imitate the chain-of-thought style of **Claude Opus 4.7**, the frontier reasoning model from Anthropic. The goal: port Claude-grade reasoning behavior into a permissively-licensed Mixture-of-Experts model that an individual can actually run. Built for hard reasoning: graduate-level STEM, competition math (AIME / MATH), code reasoning with explicit walk-through, multi-step logic puzzles, and agentic planning where explicit ` ` helps correctness. For short-turn conversational latency-sensitive workloads the thinking budget can be large; cap `max_new_tokens` or post-process to strip ` … ` blocks if you only want final answers in production.
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
Basic profile indexed · More details to follow
Adjust provider, category or input/output filters. New models are added continuously.
Adjust monthly token usage to compare estimated API costs.
Uses collected, comparable USD-per-million-token rates. Snapshots exclude cache discounts, tiers, extra reasoning output and taxes. Check current source prices.
Separate input, output and cache rates, then estimate the same workload. Image, audio and video rates may use items, duration or resolution rather than tokens.
Not necessarily. Check each version’s license, commercial restrictions and policies. Self-hosting also incurs compute and maintenance costs.
Rankings depend on tasks, versions and methods. Compare accuracy, latency, reliability and costs on your own workload.