**Lythri** is a family of on-device language models built for emotional companionship. Instead of chasing math and coding scores, Lythri is trained to understand how people feel and to hold natural, multi-turn conversations, while staying small enough to run locally on a laptop or phone. Zero-shot comparison between Lythri-4B-A2B and Gemma 4 instruction-tuned baselines on three emotion benchmarks. Despite having only 2.3B active parameters, **Lythri-4B-A2B(4.6B, base on Gemma4-E2B-PT) comparable to Gemma4-E4B-IT(8B) on all three EQ benchmarks.** All benchmarks are evaluated with their official standard settings and in generative mode with chat template applied, reflecting real-world inference conditions. Think-tag outputs from model are stripped before answer extraction.

Text generation

Input Text→ Output Text

Price not verifiedCheck multimodal and channel pricing separately

View details ↗

CompareSource / docs ↗

Lythri-7B-A4B-GGUF

Lythri

This repository contains GGUF quantizations of Lythri-7B-A4B for use with llama.cpp and compatible apps. For model details, evaluation results and limitations, see the original model card. > **Note:** Lythri models are highly sensitive to quantization. We recommend using the highest-precision quantization your hardware allows. Lower-bit quantizations still work but are not recommended. To use a specific quantization, append its type to the repository name, for example `Lythri/Lythri-7B-A4B-GGUF:Q8_0`.

Text generation

Input Text→ Output Text

Price not verifiedCheck multimodal and channel pricing separately

View details ↗

CompareSource / docs ↗

Lythri-7B-A4B-Q4_0_8-GGUF

Lythri

基础档案已收录，详细介绍后续补充。可先查看厂商、分类与来源。

Basic profile indexed · More details to follow

Text generation

Input Text→ Output Text

Price not verifiedCheck multimodal and channel pricing separately

View details ↗

CompareSource / docs ↗

COST EXPLORER

Great models. Clear costs.

Cost analysis

Adjust monthly token usage to compare estimated API costs.

Monthly input tokens 10 MMonthly output tokens 2 M1 M = 1 million tokens · USD
Compares base text-token rates within the same channel

Uses collected, comparable USD-per-million-token rates. Snapshots exclude cache discounts, tiers, extra reasoning output and taxes. Check current source prices.

MODEL HANDBOOK

Understand before you choose

Selection guide & FAQ

How should API prices be compared?+

Separate input, output and cache rates, then estimate the same workload. Image, audio and video rates may use items, duration or resolution rather than tokens.

Do open weights mean free commercial use?+

Not necessarily. Check each version’s license, commercial restrictions and policies. Self-hosting also incurs compute and maintenance costs.

Is the top-ranked model the best for me?+

Rankings depend on tasks, versions and methods. Compare accuracy, latency, reliability and costs on your own workload.

Find your ideal AI model.

Explore AI models 6

Lythri-4B-A2B

Lythri-4B-A2B-GGUF

Lythri-4B-A2B-Q4_0_8-GGUF

Lythri-7B-A4B

Lythri-7B-A4B-GGUF

Lythri-7B-A4B-Q4_0_8-GGUF

No matching models

Great models. Clear costs.

Understand before you choose

Follow trends. Find tools. Explore models.