MODEL PROFILE

Jev-alpha-26B-A4B

chenz53 · Jev-alpha-26B-A4B

A standalone decision model derived from Google Gemma 4 26B A4B IT. It reads a state and typed questions, then exposes probabilities over the allowed options. This repository contains full merged BF16 weights. It does not require a LoRA adapter at inference. The model retains the upstream Gemma4ForConditionalGeneration architecture and tokenizer. Only text decision behavior is fine-tuned and evaluated; other modalities and general chat are not validated here. This is seed 42, KL weight 0.1, checkpoint 2100. It is not an average of three adapters. The development screen selects the KL weight. The final test does not select this seed. Training uses 8,400 questions, two epochs, LoRA rank 8, alpha 16, and dropout zero. The loss is option-token cross-entropy plus 0.1 times conditional reference-to-model KL. The reference top 64 tokens exclude the question's valid option tokens at the answer position. Base revision: `4d7ae4984b7db7de8f8457170b3f1a419ee76d52`. The 26B/A4B name follows the upstream size class; all base weights remain required in memory. These measurements reload the saved merged model with Transformers, without PEFT or an adapter. Equal-type final accuracy: **79.50%** on 1,100 questions. Each source contributes 100 final questions. The aggregate gives equal weight to noul, choice, and score. The merged model has its own fitted temperature: **1.736507**, from 300 separate calibration questions. BF16 merging changes numerical behavior. Use these release results instead of the earlier adapter or three-seed mean. Calibration error uses ten equal-width confidence bins. Lower Brier and calibration error are better.

Visual QAlicense:apache-2.0
Context windowNot disclosed
Input → OutputText、Image → Text
Model weightsNot verified
Profile updated2026/11/2 19:17:18
OVERVIEW

Model overview

A standalone decision model derived from Google Gemma 4 26B A4B IT. It reads a state and typed questions, then exposes probabilities over the allowed options. This repository contains full merged BF16 weights. It does not require a LoRA adapter at inference. The model retains the upstream Gemma4ForConditionalGeneration architecture and tokenizer. Only text decision behavior is fine-tuned and evaluated; other modalities and general chat are not validated here. This is seed 42, KL weight 0.1, checkpoint 2100. It is not an average of three adapters. The development screen selects the KL weight. The final test does not select this seed. Training uses 8,400 questions, two epochs, LoRA rank 8, alpha 16, and dropout zero. The loss is option-token cross-entropy plus 0.1 times conditional reference-to-model KL. The reference top 64 tokens exclude the question's valid option tokens at the answer position. Base revision: `4d7ae4984b7db7de8f8457170b3f1a419ee76d52`. The 26B/A4B name follows the upstream size class; all base weights remain required in memory. These measurements reload the saved merged model with Transformers, without PEFT or an adapter. Equal-type final accuracy: **79.50%** on 1,100 questions. Each source contributes 100 final questions. The aggregate gives equal weight to noul, choice, and score. The merged model has its own fitted temperature: **1.736507**, from 300 separate calibration questions. BF16 merging changes numerical behavior. Use these release results instead of the earlier adapter or three-seed mean. Calibration error uses ten equal-width confidence bins. Lower Brier and calibration error are better.

Key features

特点摘要待依据来源补齐,不凭模型名称推断能力。

Limitations & considerations

Sources are insufficient to establish specific limitations. Verify task performance, latency, data policies, licensing and version lifecycle.

PRICING & COST

Source prices & cost analysis

Prices vary by channel, region and configuration. Channel quotes are listed independently and are not treated as a single official provider price.

Source / channelInputOutputBilling unitCollected at
No verified prices yet. Check the source channel.

Estimate monthly base token costs

—

Estimates exclude cache discounts, tiered pricing, multimodal surcharges, web search, taxes and additional reasoning output.

INDEPENDENT BENCHMARKS

Public benchmarks & run configuration

暂无已采集的可核验公开评分。模型未上榜不代表能力较低。

View full indexed rankings →

Frequently asked questions

Do open weights permit free commercial use?

Not necessarily. Check the version license, commercial conditions and usage policies. Self-hosting incurs compute and maintenance costs.

Are these real-time billing prices?

These are timestamped source snapshots, not live billing prices. Check the channel for current versions, regions, discounts and billing methods.

Sources & traceability

许可证:apache-2.0。模型介绍与第三方评测均以原来源的具体版本和方法为准。