AI NEWS.ccAIが動く、未来が変わる
♡ 保存済み 0
AI NEWS・モデル情報能力を知り、根拠ある選択を。 ↗基本情報を先に収録・詳細を随時追加
THE AI MODEL DIRECTORY ここからモデルを探す

あなたに合う AIモデルを。

言語から画像、オープンウェイトからAPIまで。能力と実際の費用を比較。
次のアイデアに合うAIを見つけましょう。

人気の検索
84,513 件のモデル13008 社の提供元・公開者45 件の機能分類464件の比較可能な料金・30件の公開評価
Tテキスト生成▧画像生成▷動画生成⌘コード生成◖音声合成♫音楽生成⬡3Dモデリング▤文書分析
DISCOVER & COMPARE

AIモデルを探す 3

注目のモデルを見つける

bridgetower-base

BridgeTower

The BridgeTower model was proposed in "BridgeTower: Building Bridges Between Encoders in Vision-Language Representative Learning" by Xiao Xu, Chenfei Wu, Shachar Rosenman, Vasudev Lal, Wanxiang Che, Nan Duan. The model was pretrained on English language using masked language modeling (MLM) and image text matching (ITM)objectives. It was introduced in this paper and first released in this repository. The abstract from the paper is the following: Vision-Language (VL) models with the Two-Tower architecture have dominated visual-language representation learning in recent years. Current VL models either use lightweight uni-modal encoders and learn to extract, align and fuse both modalities simultaneously in a deep cross-modal encoder, or feed the last-layer uni-modal representations from the deep pre-trained uni-modal encoders into the top cross-modal encoder. Both approaches potentially restrict vision-language representation learning and limit model performance. In this paper, we propose BridgeTower, which introduces multiple bridge layers that build a connection between the top layers of uni-modal encoders and each layer of the cross-modal encoder. This enables effective bottom-up cross-modal alignment and fusion between visual and textual representations of different semantic levels of pre-trained uni-modal encoders in the cross-modal encoder. Pre-trained with only 4M images, BridgeTower achieves state-of-the-art performance on various downstream vision-language tasks. In particular, on the VQAv2 test-std set, BridgeTower achieves an accuracy of 78.73%, outperforming the previous state-of-the-art model METER by 1.09% with the same pre-training data and almost negligible additional parameters and computational costs. Notably, when further scaling the model, BridgeTower achieves an accuracy of 81.15%, surpassing models that are pre-trained on orders-of-magnitude larger datasets. You can use the raw model for masked language modeling, but it's mostly intended to be fine-tuned on a downstream task. See the model hub to look for fine-tuned versions on a task that interests you.

翻訳待ち・原文を表示

分類準備中
入力 未確認→ 出力 未確認
料金未確認マルチモーダル・チャネル料金は個別に確認
詳細を見る ↗
出典・文書 ↗

基础档案已收录，详细介绍后续补充。可先查看厂商、分类与来源。

基本情報を収録・詳細は順次追加

分類準備中
入力 未確認→ 出力 未確認
料金未確認マルチモーダル・チャネル料金は個別に確認
詳細を見る ↗
出典・文書 ↗

The BridgeTower model was proposed in "BridgeTower: Building Bridges Between Encoders in Vision-Language Representative Learning" by Xiao Xu, Chenfei Wu, Shachar Rosenman, Vasudev Lal, Wanxiang Che, Nan Duan. The model was pretrained on English language using masked language modeling (MLM) and image text matching (ITM)objectives. It was introduced in this paper and first released in this repository. The abstract from the paper is the following: Vision-Language (VL) models with the Two-Tower architecture have dominated visual-language representation learning in recent years. Current VL models either use lightweight uni-modal encoders and learn to extract, align and fuse both modalities simultaneously in a deep cross-modal encoder, or feed the last-layer uni-modal representations from the deep pre-trained uni-modal encoders into the top cross-modal encoder. Both approaches potentially restrict vision-language representation learning and limit model performance. In this paper, we propose BridgeTower, which introduces multiple bridge layers that build a connection between the top layers of uni-modal encoders and each layer of the cross-modal encoder. This enables effective bottom-up cross-modal alignment and fusion between visual and textual representations of different semantic levels of pre-trained uni-modal encoders in the cross-modal encoder. Pre-trained with only 4M images, BridgeTower achieves state-of-the-art performance on various downstream vision-language tasks. In particular, on the VQAv2 test-std set, BridgeTower achieves an accuracy of 78.73%, outperforming the previous state-of-the-art model METER by 1.09% with the same pre-training data and almost negligible additional parameters and computational costs. Notably, when further scaling the model, BridgeTower achieves an accuracy of 81.15%, surpassing models that are pre-trained on orders-of-magnitude larger datasets. Here is how to use this model to perform contrastive learning between image and text pairs:

翻訳待ち・原文を表示

分類準備中
入力 未確認→ 出力 未確認
料金未確認マルチモーダル・チャネル料金は個別に確認
詳細を見る ↗
出典・文書 ↗
COST EXPLORER

モデル選びに、費用の視点も。

コスト分析

月間トークン数を調整してAPI費用を比較。

1 M = 100万トークン・米ドル
同一チャネルの基本テキスト料金を比較

収集済みの比較可能な100万トークン当たり米ドル料金です。キャッシュ割引、段階料金、追加推論出力、税金は含みません。最新料金は出典で確認してください。

MODEL HANDBOOK

モデルを理解して選ぶ

選び方とよくある質問
API料金はどう比較しますか？+

入力・出力・キャッシュ料金を分け、同じ用途と使用量で総費用を比較します。画像・音声・動画は枚数、時間、解像度で課金される場合があります。

オープンウェイトは無料で商用利用できますか？+

必ずしもそうではありません。バージョンごとのライセンス、商用制限、ポリシーを確認してください。自前運用には計算資源と保守費用も必要です。

ランキング1位が最適ですか？+

順位はテスト、バージョン、評価方法によります。実際の業務データで精度、遅延、安定性、費用を比較してください。

AI NEWS・情報から選択へ

ニュースで知り、ツールで効率化、モデルで可能性を。

AIニュースを読む ↗AIツールを探す ↗