BUD-E-Whisper
laion基础档案已收录，详细介绍后续补充。可先查看厂商、分类与来源。
入力 未確認→ 出力 未確認
料金未確認マルチモーダル・チャネル料金は個別に確認
詳細を見る ↗DISCOVER & COMPARE
AIモデルを探す 45
clap-htsat-fused
laion> Contrastive learning has shown remarkable success in the field of multimodal representation learning. In this paper, we propose a pipeline of contrastive language-audio pretraining to develop an audio representation by combining audio data with natural language descriptions. To accomplish this target, we first release LAION-Audio-630K, a large collection of 633,526 audio-text pairs from different data sources. Second, we construct a contrastive language-audio pretraining model by considering different audio encoders and text encoders. We incorporate the feature fusion mechanism and keyword-to-caption augmentation into the model design to further enable the model to process audio inputs of variable lengths and enhance the performance. Third, we perform comprehensive experiments to evaluate our model across three tasks: text-to-audio retrieval, zero-shot audio classification, and supervised audio classification. The results demonstrate that our model achieves superior performance in text-to-audio retrieval task. In audio classification tasks, the model achieves state-of-the-art performance in the zero-shot setting and is able to obtain performance comparable to models' results in the non-zero-shot setting. LAION-Audio-630K and the proposed model are both available to the public. You can use this model for zero shot audio classification or extracting audio and/or textual features.
翻訳待ち・原文を表示
入力 テキスト→ 出力 テキスト
料金未確認マルチモーダル・チャネル料金は個別に確認
詳細を見る ↗clap-htsat-unfused
laion0. TL;DR 1. Model Details 2. Usage 3. Uses 4. Citation > Contrastive learning has shown remarkable success in the field of multimodal representation learning. In this paper, we propose a pipeline of contrastive language-audio pretraining to develop an audio representation by combining audio data with natural language descriptions. To accomplish this target, we first release LAION-Audio-630K, a large collection of 633,526 audio-text pairs from different data sources. Second, we construct a contrastive language-audio pretraining model by considering different audio encoders and text encoders. We incorporate the feature fusion mechanism and keyword-to-caption augmentation into the model design to further enable the model to process audio inputs of variable lengths and enhance the performance. Third, we perform comprehensive experiments to evaluate our model across three tasks: text-to-audio retrieval, zero-shot audio classification, and supervised audio classification. The results demonstrate that our model achieves superior performance in text-to-audio retrieval task. In audio classification tasks, the model achieves state-of-the-art performance in the zero-shot setting and is able to obtain performance comparable to models' results in the non-zero-shot setting. LAION-Audio-630K and the proposed model are both available to the public. You can use this model for zero shot audio classification or extracting audio and/or textual features.
翻訳待ち・原文を表示
入力 テキスト→ 出力 テキスト
料金未確認マルチモーダル・チャネル料金は個別に確認
詳細を見る ↗基础档案已收录，详细介绍后续补充。可先查看厂商、分类与来源。
基本情報を収録・詳細は順次追加
入力 未確認→ 出力 未確認
料金未確認マルチモーダル・チャネル料金は個別に確認
詳細を見る ↗基础档案已收录，详细介绍后续补充。可先查看厂商、分类与来源。
基本情報を収録・詳細は順次追加
入力 未確認→ 出力 未確認
料金未確認マルチモーダル・チャネル料金は個別に確認
詳細を見る ↗A series of CLIP ConvNeXt-Base (w/ wide embed dim) models trained on subsets LAION-5B (https://laion.ai/blog/laion-5b/) using OpenCLIP (https://github.com/mlfoundations/open_clip). Goals: * Explore an alternative to ViT and ResNet (w/ AttentionPooling) CLIP models that scales well with model size and image resolution Firsts: * First known ConvNeXt CLIP models trained at scale in the range of CLIP ViT-B/16 and RN50x4 models * First released model weights exploring increase of augmentation + regularization for image tower via adding (greater scale range of RRC, random erasing, stochastic depth)
翻訳待ち・原文を表示
入力 未確認→ 出力 未確認
料金未確認マルチモーダル・チャネル料金は個別に確認
詳細を見る ↗基础档案已收录，详细介绍后续补充。可先查看厂商、分类与来源。
入力 未確認→ 出力 未確認
料金未確認マルチモーダル・チャネル料金は個別に確認
詳細を見る ↗1. Model Details 2. Uses 3. Training Details 4. Evaluation 5. Acknowledgements 6. Citation A series of CLIP ConvNeXt-Base (w/ wide embed dim) models trained on subsets LAION-5B (https://laion.ai/blog/laion-5b/) using OpenCLIP (https://github.com/mlfoundations/open_clip). Goals: * Explore an alternative to ViT and ResNet (w/ AttentionPooling) CLIP models that scales well with model size and image resolution
翻訳待ち・原文を表示
入力 画像→ 出力 テキスト
料金未確認マルチモーダル・チャネル料金は個別に確認
詳細を見る ↗1. Model Details 2. Uses 3. Training Details 4. Evaluation 5. Acknowledgements 6. Citation A series of CLIP ConvNeXt-Large (w/ extra text depth, vision MLP head) models trained on the LAION-2B (english) subset of LAION-5B using OpenCLIP. The models utilize: * the timm ConvNeXt-Large model (`convnext_large`) as the image tower * a MLP (`fc - gelu - drop - fc`) head in vision tower instead of the single projection of other CLIP models * a text tower with same width but 4 layers more depth than ViT-L / RN50x16 models (depth 16, embed dim 768).
翻訳待ち・原文を表示
入力 未確認→ 出力 未確認
料金未確認マルチモーダル・チャネル料金は個別に確認
詳細を見る ↗基础档案已收录，详细介绍后续补充。可先查看厂商、分类与来源。
基本情報を収録・詳細は順次追加
入力 未確認→ 出力 未確認
料金未確認マルチモーダル・チャネル料金は個別に確認
詳細を見る ↗基础档案已收录，详细介绍后续补充。可先查看厂商、分类与来源。
基本情報を収録・詳細は順次追加
入力 未確認→ 出力 未確認
料金未確認マルチモーダル・チャネル料金は個別に確認
詳細を見る ↗1. Model Details 2. Uses 3. Training Details 4. Evaluation 5. Acknowledgements 6. Citation A series of CLIP ConvNeXt-XXLarge (a custom `timm` ConvNeXt size) models trained on LAION-2B (english), a subset of LAION-5B, using OpenCLIP. The core training run was performed in pieces over a period of ~ 2 months. The global batch size for the core run was 81920. The last ~10% of training was re-done at a 95744 global batch size w/ higher LR and aug than original finish. The two were averaged together in a 'soup'. See more details in Training Details.
翻訳待ち・原文を表示
入力 未確認→ 出力 未確認
料金未確認マルチモーダル・チャネル料金は個別に確認
詳細を見る ↗1. Model Details 2. Uses 3. Training Details 4. Evaluation 5. Acknowledgements 6. Citation 7. How To Get Started With the Model A CLIP ViT-B/16 model trained with the DataComp-1B (https://github.com/mlfoundations/datacomp) using OpenCLIP (https://github.com/mlfoundations/open_clip). As per the original OpenAI CLIP model card, this model is intended as a research output for research communities. We hope that this model will enable researchers to better understand and explore zero-shot, arbitrary image classification. We also hope it can be used for interdisciplinary studies of the potential impact of such model.
翻訳待ち・原文を表示
入力 未確認→ 出力 未確認
料金未確認マルチモーダル・チャネル料金は個別に確認
詳細を見る ↗1. Model Details 2. Uses 3. Training Details 4. Evaluation 5. Acknowledgements 6. Citation A CLIP ViT-B/16 model trained with the LAION-2B English subset of LAION-5B (https://laion.ai/blog/laion-5b/) using OpenCLIP (https://github.com/mlfoundations/open_clip). Model training done by Mehdi Cherti on the JUWELS Booster supercomputer. See acknowledgements below.
翻訳待ち・原文を表示
入力 画像→ 出力 テキスト
料金未確認マルチモーダル・チャネル料金は個別に確認
詳細を見る ↗1. Model Details 2. Uses 3. Training Details 4. Evaluation 5. How To Get Started With the Model 6. Acknowledgements 7. Citation A CLIP ViT-B/32 model trained with the DataComp-1B (https://github.com/mlfoundations/datacomp) using OpenCLIP (https://github.com/mlfoundations/open_clip) at 256x256 resolution. As per the original OpenAI CLIP model card, this model is intended as a research output for research communities. We hope that this model will enable researchers to better understand and explore zero-shot, arbitrary image classification. We also hope it can be used for interdisciplinary studies of the potential impact of such model.
翻訳待ち・原文を表示
入力 未確認→ 出力 未確認
料金未確認マルチモーダル・チャネル料金は個別に確認
詳細を見る ↗1. Model Details 2. Uses 3. Training Details 4. Evaluation 5. Acknowledgements 6. Citation 7. How To Get Started With the Model A CLIP ViT-B/32 model trained with the DataComp-1B (https://github.com/mlfoundations/datacomp) using OpenCLIP (https://github.com/mlfoundations/open_clip). As per the original OpenAI CLIP model card, this model is intended as a research output for research communities. We hope that this model will enable researchers to better understand and explore zero-shot, arbitrary image classification. We also hope it can be used for interdisciplinary studies of the potential impact of such model.
翻訳待ち・原文を表示
入力 未確認→ 出力 未確認
料金未確認マルチモーダル・チャネル料金は個別に確認
詳細を見る ↗1. Model Details 2. Uses 3. Training Details 4. Evaluation 5. Acknowledgements 6. Citation 7. How To Get Started With the Model A CLIP ViT-B/32 model trained with the LAION-2B English subset of LAION-5B (https://laion.ai/blog/laion-5b/) using OpenCLIP (https://github.com/mlfoundations/open_clip). As per the original OpenAI CLIP model card, this model is intended as a research output for research communities. We hope that this model will enable researchers to better understand and explore zero-shot, arbitrary image classification. We also hope it can be used for interdisciplinary studies of the potential impact of such model.
翻訳待ち・原文を表示
入力 画像→ 出力 テキスト
料金未確認マルチモーダル・チャネル料金は個別に確認
詳細を見る ↗基础档案已收录，详细介绍后续补充。可先查看厂商、分类与来源。
基本情報を収録・詳細は順次追加
入力 未確認→ 出力 未確認
料金未確認マルチモーダル・チャネル料金は個別に確認
詳細を見る ↗1. Model Details 2. Uses 3. Training Details 4. Evaluation 5. Acknowledgements 6. Citation 7. How To Get Started With the Model A CLIP ViT-B/32 xlm roberta base model trained with the LAION-5B (https://laion.ai/blog/laion-5b/) using OpenCLIP (https://github.com/mlfoundations/open_clip). Model training done by Romain Beaumont on the stability.ai cluster.
翻訳待ち・原文を表示
入力 未確認→ 出力 未確認
料金未確認マルチモーダル・チャネル料金は個別に確認
詳細を見る ↗1. Model Details 2. Uses 3. Training Details 4. Evaluation 5. Acknowledgements 6. Citation 7. How To Get Started With the Model A CLIP ViT-bigG/14 model trained with the LAION-2B English subset of LAION-5B (https://laion.ai/blog/laion-5b/) using OpenCLIP (https://github.com/mlfoundations/open_clip). Model training done by Mitchell Wortsman on the stability.ai cluster.
翻訳待ち・原文を表示
入力 未確認→ 出力 未確認
料金未確認マルチモーダル・チャネル料金は個別に確認
詳細を見る ↗1. Model Details 2. Uses 3. Training Details 4. Evaluation 5. Acknowledgements 6. Citation 7. How To Get Started With the Model A CLIP ViT-g/14 model trained with the LAION-2B English subset of LAION-5B (https://laion.ai/blog/laion-5b/) using OpenCLIP (https://github.com/mlfoundations/open_clip). Model training done by Romain Beaumont on the stability.ai cluster.
翻訳待ち・原文を表示
入力 未確認→ 出力 未確認
料金未確認マルチモーダル・チャネル料金は個別に確認
詳細を見る ↗基础档案已收录，详细介绍后续补充。可先查看厂商、分类与来源。
入力 未確認→ 出力 未確認
料金未確認マルチモーダル・チャネル料金は個別に確認
詳細を見る ↗1. Model Details 2. Uses 3. Training Details 4. Evaluation 5. Acknowledgements 6. Citation 7. How To Get Started With the Model A CLIP ViT-H/14 frozen xlm roberta large model trained with the LAION-5B (https://laion.ai/blog/laion-5b/) using OpenCLIP (https://github.com/mlfoundations/open_clip). Model training done by Romain Beaumont on the stability.ai cluster.
翻訳待ち・原文を表示
入力 未確認→ 出力 未確認
料金未確認マルチモーダル・チャネル料金は個別に確認
詳細を見る ↗1. Model Details 2. Uses 3. Training Details 4. Evaluation 5. Acknowledgements 6. Citation 7. How To Get Started With the Model A CLIP ViT-H/14 model trained with the LAION-2B English subset of LAION-5B (https://laion.ai/blog/laion-5b/) using OpenCLIP (https://github.com/mlfoundations/open_clip). Model training done by Romain Beaumont on the stability.ai cluster.
翻訳待ち・原文を表示
入力 未確認→ 出力 未確認
料金未確認マルチモーダル・チャネル料金は個別に確認
詳細を見る ↗該当するモデルがありません
提供元・分類・入出力の条件を変更してください。新しいモデルを随時追加しています。
COST EXPLORER
モデル選びに、費用の視点も。
月間トークン数を調整してAPI費用を比較。
1 M = 100万トークン・米ドル
同一チャネルの基本テキスト料金を比較
同一チャネルの基本テキスト料金を比較
収集済みの比較可能な100万トークン当たり米ドル料金です。キャッシュ割引、段階料金、追加推論出力、税金は含みません。最新料金は出典で確認してください。
MODEL HANDBOOK
モデルを理解して選ぶ
API料金はどう比較しますか？+
入力・出力・キャッシュ料金を分け、同じ用途と使用量で総費用を比較します。画像・音声・動画は枚数、時間、解像度で課金される場合があります。
オープンウェイトは無料で商用利用できますか？+
必ずしもそうではありません。バージョンごとのライセンス、商用制限、ポリシーを確認してください。自前運用には計算資源と保守費用も必要です。
ランキング1位が最適ですか？+
順位はテスト、バージョン、評価方法によります。実際の業務データで精度、遅延、安定性、費用を比較してください。