colpali
vidore基础档案已收录，详细介绍后续补充。可先查看厂商、分类与来源。
基础资料已收录 · 缺失资料后续补充
输入 待核验→ 输出 待核验
价格待核验多模态与渠道费用须分别核对
查看详情 ↗DISCOVER & COMPARE
探索 AI 模型 13
colpali-v1.2
vidoreColPali is a model based on a novel model architecture and training strategy based on Vision Language Models (VLMs) to efficiently index documents from their visual features. It is a PaliGemma-3B extension that generates ColBERT- style multi-vector representations of text and images. It was introduced in the paper ColPali: Efficient Document Retrieval with Vision Language Models and first released in this repository This version is trained with `colpali-engine==0.2.0` but can be loaded for any version `>=0.2.0`. Compared to `vidore/colpali`, this version is trained with right padding for queries to fix unwanted tokens in the query encoding. It also stems from the fixed `vidore/colpaligemma-3b-pt-448-base` to guarantee deterministic projection layer initialization. It was trained for 5 epochs, with in-batch negatives and hard mined negatives and a warmup of 1000 steps (10x longer) to help reduce non-english language collapse.
译文排队中 · 当前显示来源原文
输入 待核验→ 输出 待核验
价格待核验多模态与渠道费用须分别核对
查看详情 ↗colpali-v1.2-hf
vidore基础档案已收录，详细介绍后续补充。可先查看厂商、分类与来源。
输入 待核验→ 输出 待核验
价格待核验多模态与渠道费用须分别核对
查看详情 ↗colpali-v1.3
vidoreColPali is a model based on a novel model architecture and training strategy based on Vision Language Models (VLMs) to efficiently index documents from their visual features. It is a PaliGemma-3B extension that generates ColBERT- style multi-vector representations of text and images. It was introduced in the paper ColPali: Efficient Document Retrieval with Vision Language Models and first released in this repository Compared to `vidore/colpali`, this version is trained with right padding for queries to fix unwanted tokens in the query encoding. It also stems from the fixed `vidore/colpaligemma-3b-pt-448-base` to guarantee deterministic projection layer initialization. It was trained for 5 epochs, with in-batch negatives and hard mined negatives and a warmup of 1000 steps (10x longer) to help reduce non-english language collapse. This model is built iteratively starting from an off-the-shelf SigLIP model. We finetuned it to create BiSigLIP and fed the patch-embeddings output by SigLIP to an LLM, PaliGemma-3B to create BiPali.
译文排队中 · 当前显示来源原文
输入 待核验→ 输出 待核验
价格待核验多模态与渠道费用须分别核对
查看详情 ↗colpali-v1.3-hf
vidore> [!IMPORTANT] > This version of ColPali should be loaded with the `transformers 🤗` release or Sentence Transformers, not with `colpali-engine`. > It was converted using the `convert_colpali_weights_to_hf.py` script > from the `vidore/colpali-v1.3-merged` checkpoint. ColPali is a model based on a novel model architecture and training strategy based on Vision Language Models (VLMs) to efficiently index documents from their visual features. It is a PaliGemma-3B extension that generates ColBERT- style multi-vector representations of text and images. It was introduced in the paper ColPali: Efficient Document Retrieval with Vision Language Models and first released in this repository The HuggingFace `transformers` 🤗 implementation was contributed by Tony Wu (@tonywu71) and Yoni Gozlan (@yonigozlan).
译文排队中 · 当前显示来源原文
输入 待核验→ 输出 待核验
价格待核验多模态与渠道费用须分别核对
查看详情 ↗colpali-v1.3-merged
vidore基础档案已收录，详细介绍后续补充。可先查看厂商、分类与来源。
输入 待核验→ 输出 待核验
价格待核验多模态与渠道费用须分别核对
查看详情 ↗colqwen2.5-v0.2
vidoreColQwen is a model based on a novel model architecture and training strategy based on Vision Language Models (VLMs) to efficiently index documents from their visual features. It is a Qwen2.5-VL-3B extension that generates ColBERT- style multi-vector representations of text and images. It was introduced in the paper ColPali: Efficient Document Retrieval with Vision Language Models and first released in this repository This model takes dynamic image resolutions in input and does not resize them, changing their aspect ratio as in ColPali. Maximal resolution is set so that 768 image patches are created at most. Experiments show clear improvements with larger amounts of image patches, at the cost of memory requirements. Our training dataset of 127,460 query-page pairs is comprised of train sets of openly available academic datasets (63%) and a synthetic dataset made up of pages from web-crawled PDF documents and augmented with VLM-generated (Claude-3 Sonnet) pseudo-questions (37%). Our training set is fully English by design, enabling us to study zero-shot generalization to non-English languages. We explicitly verify no multi-page PDF document is used both *ViDoRe* and in the train set to prevent evaluation contamination. A validation set is created with 2% of the samples to tune hyperparameters.
译文排队中 · 当前显示来源原文
输入 待核验→ 输出 待核验
价格待核验多模态与渠道费用须分别核对
查看详情 ↗colqwen2-v0.1
vidore基础档案已收录，详细介绍后续补充。可先查看厂商、分类与来源。
输入 待核验→ 输出 待核验
价格待核验多模态与渠道费用须分别核对
查看详情 ↗colqwen2-v1.0
vidoreColQwen2 is a model based on a novel model architecture and training strategy based on Vision Language Models (VLMs) to efficiently index documents from their visual features. It is a Qwen2-VL-2B extension that generates ColBERT- style multi-vector representations of text and images. It was introduced in the paper ColPali: Efficient Document Retrieval with Vision Language Models and first released in this repository This model takes dynamic image resolutions in input and does not resize them, changing their aspect ratio as in ColPali. Maximal resolution is set so that 768 image patches are created at most. Experiments show clear improvements with larger amounts of image patches, at the cost of memory requirements. Our training dataset of 127,460 query-page pairs is comprised of train sets of openly available academic datasets (63%) and a synthetic dataset made up of pages from web-crawled PDF documents and augmented with VLM-generated (Claude-3 Sonnet) pseudo-questions (37%). Our training set is fully English by design, enabling us to study zero-shot generalization to non-English languages. We explicitly verify no multi-page PDF document is used both *ViDoRe* and in the train set to prevent evaluation contamination. A validation set is created with 2% of the samples to tune hyperparameters.
译文排队中 · 当前显示来源原文
输入 待核验→ 输出 待核验
价格待核验多模态与渠道费用须分别核对
查看详情 ↗colqwen2-v1.0-hf
vidore> [!IMPORTANT] > This version of ColQwen2 should be loaded with the `transformers 🤗` release or Sentence Transformers, not with `colpali-engine`. > It was converted using the `convert_colqwen2_weights_to_hf.py` script > from the `vidore/colqwen2-v1.0-merged` checkpoint. ColQwen2 is a model based on a novel model architecture and training strategy based on Vision Language Models (VLMs) to efficiently index documents from their visual features. It is a Qwen2-VL-2B extension that generates ColBERT- style multi-vector representations of text and images. It was introduced in the paper ColPali: Efficient Document Retrieval with Vision Language Models and first released in this repository The HuggingFace `transformers` 🤗 implementation was contributed by Tony Wu (@tonywu71) and Yoni Gozlan (@yonigozlan).
译文排队中 · 当前显示来源原文
输入 待核验→ 输出 待核验
价格待核验多模态与渠道费用须分别核对
查看详情 ↗colSmol-256M
vidoreColSmolVLM is a model based on a novel model architecture and training strategy based on Vision Language Models (VLMs) to efficiently index documents from their visual features. It is a SmolVLM extension that generates ColBERT- style multi-vector representations of text and images. It was introduced in the paper ColPali: Efficient Document Retrieval with Vision Language Models and first released in this repository This version is trained with the commit b983e40 of the Colpali repository. (main branch from the repo) Our training dataset of 127,460 query-page pairs is comprised of train sets of openly available academic datasets (63%) and a synthetic dataset made up of pages from web-crawled PDF documents and augmented with VLM-generated (Claude-3 Sonnet) pseudo-questions (37%). Our training set is fully English by design, enabling us to study zero-shot generalization to non-English languages. We explicitly verify no multi-page PDF document is used both *ViDoRe* and in the train set to prevent evaluation contamination. A validation set is created with 2% of the samples to tune hyperparameters.
译文排队中 · 当前显示来源原文
输入 待核验→ 输出 待核验
价格待核验多模态与渠道费用须分别核对
查看详情 ↗colSmol-500M
vidoreColSmolVLM is a model based on a novel model architecture and training strategy based on Vision Language Models (VLMs) to efficiently index documents from their visual features. It is a SmolVLM extension that generates ColBERT- style multi-vector representations of text and images. It was introduced in the paper ColPali: Efficient Document Retrieval with Vision Language Models and first released in this repository This version is trained with the commit b983e40 of the Colpali repository. (main branch from the repo) Our training dataset of 127,460 query-page pairs is comprised of train sets of openly available academic datasets (63%) and a synthetic dataset made up of pages from web-crawled PDF documents and augmented with VLM-generated (Claude-3 Sonnet) pseudo-questions (37%). Our training set is fully English by design, enabling us to study zero-shot generalization to non-English languages. We explicitly verify no multi-page PDF document is used both *ViDoRe* and in the train set to prevent evaluation contamination. A validation set is created with 2% of the samples to tune hyperparameters.
译文排队中 · 当前显示来源原文
输入 待核验→ 输出 待核验
价格待核验多模态与渠道费用须分别核对
查看详情 ↗colsmolvlm-v0.1
vidore基础档案已收录，详细介绍后续补充。可先查看厂商、分类与来源。
基础资料已收录 · 缺失资料后续补充
输入 待核验→ 输出 待核验
价格待核验多模态与渠道费用须分别核对
查看详情 ↗暂未找到匹配模型
可以调整厂商、分类或输入输出条件；新模型正持续收录。
COST EXPLORER
好模型，也要算好成本。
调整月度 Token 用量，直观比较不同模型的预估 API 开支。
1 M = 100 万 Token · 美元计价
仅比较同一渠道的基础文本 Token 报价
仅比较同一渠道的基础文本 Token 报价
使用已采集且单位可比的 USD / 百万 Token 渠道报价。报价为采集时快照；不计缓存优惠、阶梯价、推理额外输出与税费，请以来源的当前报价为准。
MODEL HANDBOOK
读懂模型，再做选择
API 价格应该怎么比较？+
先区分输入、输出和缓存价格，再使用同一任务和用量估算总费用。图像、音频和视频可能按张、时长或分辨率计费，不能直接与 Token 单价比较。
开放权重，就代表可以免费商用吗？+
不一定。必须逐一核对具体模型版本的许可证、商用限制及使用政策。自己部署还需要考虑显存、推理资源和运维费用。
排行榜第一，就是最适合我的模型吗？+
榜单取决于测试任务、版本与评测方法。建议用实际业务样本比较准确性、时延、稳定性和成本，再选择模型。