AI NEWS.ccAIが動く、未来が変わる
♡ 保存済み 0
AI NEWS・モデル情報能力を知り、根拠ある選択を。 ↗基本情報を先に収録・詳細を随時追加
THE AI MODEL DIRECTORY ここからモデルを探す

あなたに合う AIモデルを。

言語から画像、オープンウェイトからAPIまで。能力と実際の費用を比較。
次のアイデアに合うAIを見つけましょう。

人気の検索
84,991 件のモデル13202 社の提供元・公開者45 件の機能分類465件の比較可能な料金・30件の公開評価
Tテキスト生成▧画像生成▷動画生成⌘コード生成◖音声合成♫音楽生成⬡3Dモデリング▤文書分析
DISCOVER & COMPARE

AIモデルを探す 3

注目のモデルを見つける

Nyströmformer model for masked language modeling (MLM) pretrained on BookCorpus and English Wikipedia for sequence length 512. The Nyströmformer model was proposed in Nyströmformer: A Nyström-Based Algorithm for Approximating Self-Attention by Yunyang Xiong, Zhanpeng Zeng, Rudrasis Chakraborty, Mingxing Tan, Glenn Fung, Yin Li, and Vikas Singh. Transformers have emerged as a powerful tool for a broad range of natural language processing tasks. A key component that drives the impressive performance of Transformers is the self-attention mechanism that encodes the influence or dependence of other tokens on each specific token. While beneficial, the quadratic complexity of self-attention on the input sequence length has limited its application to longer sequences — a topic being actively studied in the community. To address this limitation, we propose Nyströmformer — a model that exhibits favorable scalability as a function of sequence length. Our idea is based on adapting the Nyström method to approximate standard self-attention with O(n) complexity. The scalability of Nyströmformer enables application to longer sequences with thousands of tokens. We perform evaluations on multiple downstream tasks on the GLUE benchmark and IMDB reviews with standard sequence length, and find that our Nyströmformer performs comparably, or in a few cases, even slightly better, than standard self-attention. On longer sequence tasks in the Long Range Arena (LRA) benchmark, Nyströmformer performs favorably relative to other efficient self-attention methods. Our code is available at this https URL.

翻訳待ち・原文を表示

穴埋め・マスク
入力 テキスト→ 出力 テキスト
料金未確認マルチモーダル・チャネル料金は個別に確認
詳細を見る ↗
出典・文書 ↗

yoso-4096

uw-madison

The YOSO model was proposed in You Only Sample (Almost) Once: Linear Cost Self-Attention Via Bernoulli Sampling by Zhanpeng Zeng, Yunyang Xiong, Sathya N. Ravi, Shailesh Acharya, Glenn Fung, Vikas Singh. Transformer-based models are widely used in natural language processing (NLP). Central to the transformer model is the self-attention mechanism, which captures the interactions of token pairs in the input sequences and depends quadratically on the sequence length. Training such models on longer sequences is expensive. In this paper, we show that a Bernoulli sampling attention mechanism based on Locality Sensitive Hashing (LSH), decreases the quadratic complexity of such models to linear. We bypass the quadratic cost by considering self-attention as a sum of individual tokens associated with Bernoulli random variables that can, in principle, be sampled at once by a single hash (although in practice, this number may be a small constant). This leads to an efficient sampling scheme to estimate self-attention which relies on specific modifications of LSH (to enable deployment on GPU architectures). We evaluate our algorithm on the GLUE benchmark with standard 512 sequence length where we see favorable performance relative to a standard pretrained Transformer. On the Long Range Arena (LRA) benchmark, for evaluating performance on long sequences, our method achieves results consistent with softmax self-attention but with sizable speed-ups and memory savings and often outperforms other efficient self-attention methods. Our code is available at this https URL

翻訳待ち・原文を表示

穴埋め・マスク
入力 テキスト→ 出力 テキスト
料金未確認マルチモーダル・チャネル料金は個別に確認
詳細を見る ↗
出典・文書 ↗
COST EXPLORER

モデル選びに、費用の視点も。

コスト分析

月間トークン数を調整してAPI費用を比較。

1 M = 100万トークン・米ドル
同一チャネルの基本テキスト料金を比較

収集済みの比較可能な100万トークン当たり米ドル料金です。キャッシュ割引、段階料金、追加推論出力、税金は含みません。最新料金は出典で確認してください。

MODEL HANDBOOK

モデルを理解して選ぶ

選び方とよくある質問
API料金はどう比較しますか？+

入力・出力・キャッシュ料金を分け、同じ用途と使用量で総費用を比較します。画像・音声・動画は枚数、時間、解像度で課金される場合があります。

オープンウェイトは無料で商用利用できますか？+

必ずしもそうではありません。バージョンごとのライセンス、商用制限、ポリシーを確認してください。自前運用には計算資源と保守費用も必要です。

ランキング1位が最適ですか？+

順位はテスト、バージョン、評価方法によります。実際の業務データで精度、遅延、安定性、費用を比較してください。

AI NEWS・情報から選択へ

ニュースで知り、ツールで効率化、モデルで可能性を。

AIニュースを読む ↗AIツールを探す ↗