colpali
vidore基础档案已收录，详细介绍后续补充。可先查看厂商、分类与来源。
基本情報を収録・詳細は順次追加
入力 未確認→ 出力 未確認
料金未確認マルチモーダル・チャネル料金は個別に確認
詳細を見る ↗DISCOVER & COMPARE
AIモデルを探す 13
colpali-v1.2
vidoreColPali is a model based on a novel model architecture and training strategy based on Vision Language Models (VLMs) to efficiently index documents from their visual features. It is a PaliGemma-3B extension that generates ColBERT- style multi-vector representations of text and images. It was introduced in the paper ColPali: Efficient Document Retrieval with Vision Language Models and first released in this repository This version is trained with `colpali-engine==0.2.0` but can be loaded for any version `>=0.2.0`. Compared to `vidore/colpali`, this version is trained with right padding for queries to fix unwanted tokens in the query encoding. It also stems from the fixed `vidore/colpaligemma-3b-pt-448-base` to guarantee deterministic projection layer initialization. It was trained for 5 epochs, with in-batch negatives and hard mined negatives and a warmup of 1000 steps (10x longer) to help reduce non-english language collapse.
翻訳待ち・原文を表示
入力 未確認→ 出力 未確認
料金未確認マルチモーダル・チャネル料金は個別に確認
詳細を見る ↗colpali-v1.2-hf
vidore基础档案已收录，详细介绍后续补充。可先查看厂商、分类与来源。
入力 未確認→ 出力 未確認
料金未確認マルチモーダル・チャネル料金は個別に確認
詳細を見る ↗colpali-v1.3
vidoreColPali is a model based on a novel model architecture and training strategy based on Vision Language Models (VLMs) to efficiently index documents from their visual features. It is a PaliGemma-3B extension that generates ColBERT- style multi-vector representations of text and images. It was introduced in the paper ColPali: Efficient Document Retrieval with Vision Language Models and first released in this repository Compared to `vidore/colpali`, this version is trained with right padding for queries to fix unwanted tokens in the query encoding. It also stems from the fixed `vidore/colpaligemma-3b-pt-448-base` to guarantee deterministic projection layer initialization. It was trained for 5 epochs, with in-batch negatives and hard mined negatives and a warmup of 1000 steps (10x longer) to help reduce non-english language collapse. This model is built iteratively starting from an off-the-shelf SigLIP model. We finetuned it to create BiSigLIP and fed the patch-embeddings output by SigLIP to an LLM, PaliGemma-3B to create BiPali.
翻訳待ち・原文を表示
入力 未確認→ 出力 未確認
料金未確認マルチモーダル・チャネル料金は個別に確認
詳細を見る ↗colpali-v1.3-hf
vidore> [!IMPORTANT] > This version of ColPali should be loaded with the `transformers 🤗` release or Sentence Transformers, not with `colpali-engine`. > It was converted using the `convert_colpali_weights_to_hf.py` script > from the `vidore/colpali-v1.3-merged` checkpoint. ColPali is a model based on a novel model architecture and training strategy based on Vision Language Models (VLMs) to efficiently index documents from their visual features. It is a PaliGemma-3B extension that generates ColBERT- style multi-vector representations of text and images. It was introduced in the paper ColPali: Efficient Document Retrieval with Vision Language Models and first released in this repository The HuggingFace `transformers` 🤗 implementation was contributed by Tony Wu (@tonywu71) and Yoni Gozlan (@yonigozlan).
翻訳待ち・原文を表示
入力 未確認→ 出力 未確認
料金未確認マルチモーダル・チャネル料金は個別に確認
詳細を見る ↗colpali-v1.3-merged
vidore基础档案已收录，详细介绍后续补充。可先查看厂商、分类与来源。
入力 未確認→ 出力 未確認
料金未確認マルチモーダル・チャネル料金は個別に確認
詳細を見る ↗colqwen2.5-v0.2
vidoreColQwen is a model based on a novel model architecture and training strategy based on Vision Language Models (VLMs) to efficiently index documents from their visual features. It is a Qwen2.5-VL-3B extension that generates ColBERT- style multi-vector representations of text and images. It was introduced in the paper ColPali: Efficient Document Retrieval with Vision Language Models and first released in this repository This model takes dynamic image resolutions in input and does not resize them, changing their aspect ratio as in ColPali. Maximal resolution is set so that 768 image patches are created at most. Experiments show clear improvements with larger amounts of image patches, at the cost of memory requirements. Our training dataset of 127,460 query-page pairs is comprised of train sets of openly available academic datasets (63%) and a synthetic dataset made up of pages from web-crawled PDF documents and augmented with VLM-generated (Claude-3 Sonnet) pseudo-questions (37%). Our training set is fully English by design, enabling us to study zero-shot generalization to non-English languages. We explicitly verify no multi-page PDF document is used both *ViDoRe* and in the train set to prevent evaluation contamination. A validation set is created with 2% of the samples to tune hyperparameters.
翻訳待ち・原文を表示
入力 未確認→ 出力 未確認
料金未確認マルチモーダル・チャネル料金は個別に確認
詳細を見る ↗colqwen2-v0.1
vidore基础档案已收录，详细介绍后续补充。可先查看厂商、分类与来源。
入力 未確認→ 出力 未確認
料金未確認マルチモーダル・チャネル料金は個別に確認
詳細を見る ↗colqwen2-v1.0
vidoreColQwen2 is a model based on a novel model architecture and training strategy based on Vision Language Models (VLMs) to efficiently index documents from their visual features. It is a Qwen2-VL-2B extension that generates ColBERT- style multi-vector representations of text and images. It was introduced in the paper ColPali: Efficient Document Retrieval with Vision Language Models and first released in this repository This model takes dynamic image resolutions in input and does not resize them, changing their aspect ratio as in ColPali. Maximal resolution is set so that 768 image patches are created at most. Experiments show clear improvements with larger amounts of image patches, at the cost of memory requirements. Our training dataset of 127,460 query-page pairs is comprised of train sets of openly available academic datasets (63%) and a synthetic dataset made up of pages from web-crawled PDF documents and augmented with VLM-generated (Claude-3 Sonnet) pseudo-questions (37%). Our training set is fully English by design, enabling us to study zero-shot generalization to non-English languages. We explicitly verify no multi-page PDF document is used both *ViDoRe* and in the train set to prevent evaluation contamination. A validation set is created with 2% of the samples to tune hyperparameters.
翻訳待ち・原文を表示
入力 未確認→ 出力 未確認
料金未確認マルチモーダル・チャネル料金は個別に確認
詳細を見る ↗colqwen2-v1.0-hf
vidore> [!IMPORTANT] > This version of ColQwen2 should be loaded with the `transformers 🤗` release or Sentence Transformers, not with `colpali-engine`. > It was converted using the `convert_colqwen2_weights_to_hf.py` script > from the `vidore/colqwen2-v1.0-merged` checkpoint. ColQwen2 is a model based on a novel model architecture and training strategy based on Vision Language Models (VLMs) to efficiently index documents from their visual features. It is a Qwen2-VL-2B extension that generates ColBERT- style multi-vector representations of text and images. It was introduced in the paper ColPali: Efficient Document Retrieval with Vision Language Models and first released in this repository The HuggingFace `transformers` 🤗 implementation was contributed by Tony Wu (@tonywu71) and Yoni Gozlan (@yonigozlan).
翻訳待ち・原文を表示
入力 未確認→ 出力 未確認
料金未確認マルチモーダル・チャネル料金は個別に確認
詳細を見る ↗colSmol-256M
vidoreColSmolVLM is a model based on a novel model architecture and training strategy based on Vision Language Models (VLMs) to efficiently index documents from their visual features. It is a SmolVLM extension that generates ColBERT- style multi-vector representations of text and images. It was introduced in the paper ColPali: Efficient Document Retrieval with Vision Language Models and first released in this repository This version is trained with the commit b983e40 of the Colpali repository. (main branch from the repo) Our training dataset of 127,460 query-page pairs is comprised of train sets of openly available academic datasets (63%) and a synthetic dataset made up of pages from web-crawled PDF documents and augmented with VLM-generated (Claude-3 Sonnet) pseudo-questions (37%). Our training set is fully English by design, enabling us to study zero-shot generalization to non-English languages. We explicitly verify no multi-page PDF document is used both *ViDoRe* and in the train set to prevent evaluation contamination. A validation set is created with 2% of the samples to tune hyperparameters.
翻訳待ち・原文を表示
入力 未確認→ 出力 未確認
料金未確認マルチモーダル・チャネル料金は個別に確認
詳細を見る ↗colSmol-500M
vidoreColSmolVLM is a model based on a novel model architecture and training strategy based on Vision Language Models (VLMs) to efficiently index documents from their visual features. It is a SmolVLM extension that generates ColBERT- style multi-vector representations of text and images. It was introduced in the paper ColPali: Efficient Document Retrieval with Vision Language Models and first released in this repository This version is trained with the commit b983e40 of the Colpali repository. (main branch from the repo) Our training dataset of 127,460 query-page pairs is comprised of train sets of openly available academic datasets (63%) and a synthetic dataset made up of pages from web-crawled PDF documents and augmented with VLM-generated (Claude-3 Sonnet) pseudo-questions (37%). Our training set is fully English by design, enabling us to study zero-shot generalization to non-English languages. We explicitly verify no multi-page PDF document is used both *ViDoRe* and in the train set to prevent evaluation contamination. A validation set is created with 2% of the samples to tune hyperparameters.
翻訳待ち・原文を表示
入力 未確認→ 出力 未確認
料金未確認マルチモーダル・チャネル料金は個別に確認
詳細を見る ↗colsmolvlm-v0.1
vidore基础档案已收录，详细介绍后续补充。可先查看厂商、分类与来源。
基本情報を収録・詳細は順次追加
入力 未確認→ 出力 未確認
料金未確認マルチモーダル・チャネル料金は個別に確認
詳細を見る ↗該当するモデルがありません
提供元・分類・入出力の条件を変更してください。新しいモデルを随時追加しています。
COST EXPLORER
モデル選びに、費用の視点も。
月間トークン数を調整してAPI費用を比較。
1 M = 100万トークン・米ドル
同一チャネルの基本テキスト料金を比較
同一チャネルの基本テキスト料金を比較
収集済みの比較可能な100万トークン当たり米ドル料金です。キャッシュ割引、段階料金、追加推論出力、税金は含みません。最新料金は出典で確認してください。
MODEL HANDBOOK
モデルを理解して選ぶ
API料金はどう比較しますか？+
入力・出力・キャッシュ料金を分け、同じ用途と使用量で総費用を比較します。画像・音声・動画は枚数、時間、解像度で課金される場合があります。
オープンウェイトは無料で商用利用できますか？+
必ずしもそうではありません。バージョンごとのライセンス、商用制限、ポリシーを確認してください。自前運用には計算資源と保守費用も必要です。
ランキング1位が最適ですか？+
順位はテスト、バージョン、評価方法によります。実際の業務データで精度、遅延、安定性、費用を比較してください。