Main Model Card: google/gemma-4-E2B-it This model card provides the Gemma 4 E2B model in a way that is ready for deployment on Android, iOS, Desktop, IoT and Web. Gemma is a family of lightweight, state-of-the-art open models from Google, built from the same research and technology used to create the Gemini models. This particular Gemma 4 model is small so it is ideal for on-device use cases. By running this model on device, users can have private access to Generative AI technology without even requiring an internet connection.
번역 대기 중 · 원문 표시
입력 텍스트→ 출력 텍스트
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
입력 텍스트→ 출력 텍스트
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
입력 텍스트→ 출력 텍스트
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
기본 정보 등록 · 상세 정보 보완 예정
입력 텍스트→ 출력 텍스트
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
기본 정보 등록 · 상세 정보 보완 예정
입력 텍스트→ 출력 텍스트
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
기본 정보 등록 · 상세 정보 보완 예정
입력 텍스트→ 출력 텍스트
LiteRT is Google's on-device runtime, the new name for TensorFlow Lite (Android: `com.google.ai.edge.litert:litert`), and `litert-torch`, the renamed `ai-edge-torch`, is its PyTorch converter: a PyTorch model converted unmodified with `litert_torch.convert` matched the original to 4e-7 on a Galaxy S26 (measured, LiteRT 2.2.0, Android 16, 2026-09-05). Measured on device (edge-compat, lfm2.5-1.2b-instruct-int4): Galaxy S26 · LiteRT-LM 0.16.0 · GPU · did not run: engine_create_failed (2026-08-23); Raspberry Pi 5 · LiteRT-LM 0.16.1 · CPU, 4 threads · decode 9.3 tok/s · prefill 54 tok/s · TTFT 4.84 s (2026-09-01). Record: https://github.com/john-rocky/edge-compat/blob/main/cards/lfm2.5-1.2b-instruct-int4/CARD.md Measured on device (edge-compat, lfm2.5-1.2b-instruct-int8): Galaxy S26 · LiteRT-LM 0.16.0 · CPU · decode 41.0 tok/s · prefill 491 tok/s · TTFT 440 ms (2026-09-05); Pixel 8a · LiteRT-LM 0.16.0 · CPU · decode 20.4 tok/s · prefill 143 tok/s · TTFT 1.48 s (2026-09-05); Raspberry Pi 5 · LiteRT-LM 0.16.1 · CPU, 4 threads · decode 7.0 tok/s · prefill 75 tok/s · TTFT 3.56 s (2026-09-01). Record: https://github.com/john-rocky/edge-compat/blob/main/cards/lfm2.5-1.2b-instruct-int8/CARD.md
번역 대기 중 · 원문 표시
입력 텍스트→ 출력 텍스트
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
입력 텍스트→ 출력 텍스트
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
입력 텍스트→ 출력 텍스트
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
기본 정보 등록 · 상세 정보 보완 예정
입력 텍스트→ 출력 텍스트
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
기본 정보 등록 · 상세 정보 보완 예정
입력 텍스트→ 출력 텍스트
LiteRT is Google's on-device runtime, the new name for TensorFlow Lite (Android: `com.google.ai.edge.litert:litert`), and `litert-torch`, the renamed `ai-edge-torch`, is its PyTorch converter: a PyTorch model converted unmodified with `litert_torch.convert` matched the original to 4e-7 on a Galaxy S26 (measured, LiteRT 2.2.0, Android 16, 2026-09-05). Measured on device (edge-compat): Galaxy S26 · LiteRT-LM prebuilt-adac974b · GPU · decode 22.1 tok/s · prefill 338 tok/s · TTFT 3.07 s · all 1210 ops delegated (2026-10-05); Pixel 8a · LiteRT-LM 0.16.0 · GPU · decode 6.8 tok/s · prefill 8 tok/s · TTFT 1.68 s · all 1187 ops delegated (2026-08-17); Mac Studio M4 Max · LiteRT-LM 0.17.1 · GPU · decode 129.5 tok/s · prefill 1340 tok/s · TTFT 201 ms · all 1210 ops delegated (2026-10-05). Record: https://github.com/john-rocky/edge-compat/blob/main/cards/ministral3-3b/CARD.md mistralai/Ministral-3-3B-Instruct-2512 converted to the **LiteRT-LM** (`.litertlm`) format for on-device inference with Google's LiteRT-LM runtime (the engine behind the official `litert-community/*` models).
번역 대기 중 · 원문 표시
입력 텍스트→ 출력 텍스트
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
기본 정보 등록 · 상세 정보 보완 예정
입력 텍스트→ 출력 텍스트
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
기본 정보 등록 · 상세 정보 보완 예정
입력 텍스트→ 출력 텍스트
This model provides a few variants of microsoft/Phi-4-mini-instruct that are ready for deployment on Android using the LiteRT (fka TFLite) stack, MediaPipe LLM Inference API (in maintenance-only mode) and LiteRT-LM. *Disclaimer: The target deployment surface for the LiteRT models is Android/iOS/Web and the stack has been optimized for performance on these targets. Trying out the system in Colab is an easier way to familiarize yourself with the LiteRT stack, with the caveat that the performance (memory and latency) on Colab could be much worse than on a local device.* * Download or build the app from GitHub.
번역 대기 중 · 원문 표시
입력 텍스트→ 출력 텍스트
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
기본 정보 등록 · 상세 정보 보완 예정
입력 텍스트→ 출력 텍스트
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
입력 텍스트→ 출력 텍스트
This model provides a few variants of Qwen/Qwen2.5-0.5B-Instruct that are ready for deployment on Android using the LiteRT (fka TFLite) stack and MediaPipe LLM Inference API (in maintenance-only mode). *Disclaimer: The target deployment surface for the LiteRT models is Android/iOS/Web and the stack has been optimized for performance on these targets. Trying out the system in Colab is an easier way to familiarize yourself with the LiteRT stack, with the caveat that the performance (memory and latency) on Colab could be much worse than on a local device.* The source of this demo app has been removed from the MediaPipe samples repository. This repository has no `.litertlm` file for LiteRT-LM.
번역 대기 중 · 원문 표시
입력 텍스트→ 출력 텍스트
This model provides a few variants of Qwen/Qwen2.5-1.5B-Instruct that are ready for deployment on Android using the LiteRT (fka TFLite) stack, MediaPipe LLM Inference API (in maintenance-only mode) and LiteRT-LM. *Disclaimer: The target deployment surface for the LiteRT models is Android/iOS/Web and the stack has been optimized for performance on these targets. Trying out the system in Colab is an easier way to familiarize yourself with the LiteRT stack, with the caveat that the performance (memory and latency) on Colab could be much worse than on a local device.* * Download or build the app from GitHub.
번역 대기 중 · 원문 표시
입력 텍스트→ 출력 텍스트
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
기본 정보 등록 · 상세 정보 보완 예정
입력 텍스트→ 출력 텍스트
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
입력 텍스트→ 출력 텍스트
This repository contains LiteRT-LM variants of Qwen3-0.6B for Android and desktop deployment. The mixed INT4 `.litertlm` artifact was produced with a TorchAO-based quantize-first recipe from the original Hugging Face checkpoint. This is a mixed quantization layout rather than a uniform all-INT4 model: eligible linear projection weights are stored as blockwise INT4 with group size 32 and floating-point scales, token embedding weights use weight-only INT8 quantization, and normalization/reduction paths plus KV cache tensors remain floating point. The mixed INT4 bundle also uses LiteRT-LM StableHLO composite ops for attention/cache execution, including `odml.runtime_bmm` and `odml.cache_update`.
번역 대기 중 · 원문 표시
입력 텍스트→ 출력 텍스트
On-device **INT4** builds of Qwen/Qwen3-0.6B in the **`.litertlm`** format for Google's LiteRT-LM runtime (Android / iOS / desktop / embedded). At ~332 MB each (≈7× smaller than the fp32 source), these load fast and keep a small memory footprint on phones. Qwen3 is a hybrid reasoning model. Because LiteRT-LM bakes the prompt format into the file, the thinking mode is fixed per file, so this repo ships **both**:
번역 대기 중 · 원문 표시
입력 텍스트→ 출력 텍스트
This repository contains LiteRT-LM variants of Qwen/Qwen3-1.7B optimized for on-device text generation. `Qwen3-1.7B_dynamic_wi4b32_afp32.litertlm` is a dynamic INT4 variant (block-32 weights, FP32 activations). It was converted through the LiteRT Torch (`litert-torch`) path and quantized with AI Edge Quantizer. This artifact incorporates LiteRT-LM GPU graph optimizations, including composite ops for RoPE, fused QKV, and fused Gate/Up projections, and is configured with static prefill memory allocation. Both files: Need litert-lm 0.18.0 or newer (tested on 0.18.0) and carry LiteRT-LM's official qwen3 configuration, so thinking is on unless `enable_thinking` is false, the reasoning arrives on the thought channel, and tool calls are parsed by the runtime.
번역 대기 중 · 원문 표시
입력 텍스트→ 출력 텍스트