This is a decision model, to be used via `/v1/systemone` API. See https://github.com/ggml-org/llama.cpp/pull/30383 > [!IMPORTANT] > This model is automatically converted using https://github.com/ggml-org/convert
This is a decision model, to be used via `/v1/systemone` API. See https://github.com/ggml-org/llama.cpp/pull/30383 > [!IMPORTANT] > This model is automatically converted using https://github.com/ggml-org/convert
Runs on **SparkInfer, SGLang and vLLM** unmodified — configs for all three are below. Serving many users at once? See concurrency. **SparkInfer × this NVFP4 build × the DSpark v2 drafter** — an engine, a checkpoint, and a speculative drafter optimized against each other, compounding to **4.3×**. The drafter never changes what the model says: the target verifies every drafted token. **GeForce RTX 5090–specific** NVFP4 checkpoint of `Qwen/Qwen3.8-27B`, quantized with NVIDIA Model Optimizer. Serves the **full native 262,144-token context** on 32 GB.
> ## ⚠️ Superseded > > The main checkpoint now has the NVFP4 `lm_head` **and** the MTP head removed — it is strictly better than this variant (17.92 GB, 2 shards). > > **Use `Qwen3.8-27B-NVFP4-RTX5090` instead.** This repo stays up so existing pins keep working. `Qwen3.8-27B-NVFP4-RTX5090` with **`lm_head` quantized to NVFP4** instead of left in BF16. Every other tensor is bit-identical to the parent. At concurrency 1 this model is **weight-bandwidth bound, not compute bound**. Measured on the parent: 18.80 GiB of resident weights at 81.6 tok/s implies a **1.65 TB/s** read rate against the RTX 5090's 1.79 TB/s spec — about **92% of peak**. Decode is streaming the whole model once per token.
0. TL;DR 1. Using the model 2. Contribution 3. Citation > Visual language such as charts and plots is ubiquitous in the human world. Comprehending plots and charts requires strong reasoning skills. Prior state-of-the-art (SOTA) models require at least tens of thousands of training examples and their reasoning capabilities are still much limited, especially on complex human-written queries. This paper presents the first one-shot solution to visual language reasoning. We decompose the challenge of visual language reasoning into two steps: (1) plot-to-text translation, and (2) reasoning over the translated text. The key in this method is a modality conversion module, named as DePlot, which translates the image of a plot or chart to a linearized table. The output of DePlot can then be directly used to prompt a pretrained large language model (LLM), exploiting the few-shot reasoning capabilities of LLMs. To obtain DePlot, we standardize the plot-to-table task by establishing unified task formats and metrics, and train DePlot end-to-end on this task. DePlot can then be used off-the-shelf together with LLMs in a plug-and-play fashion. Compared with a SOTA model finetuned on more than >28k data points, DePlot+LLM with just one-shot prompting achieves a 24.0% improvement over finetuned SOTA on human-written queries from the task of chart QA. You can run a prediction by querying an input image together with a question as follows: