pico-decoder-tiny

**pico-decoder-tiny** is the smallest (11M) model in the `pico-decoder` suite — a lightweight, LLaMA-style decoder-only transformer trained from scratch using `pico-train`. It is designed for transparent and reproducible research into the learning dynamics of language models, and is fully compatible with the `pico-analyze` toolkit for detailed interpretability analysis. This model supports fine-grained analysis using `pico-analyze`. This tool enables researchers to understand how learning unfolds over training, even at very small scales.

译文尚未就绪，显示来源原文