This one of the three GPT-BERT baselines for the strict track of the 2025 BabyLM challenge. This specific model is trained with a majority number of examples being causal and a minority being masked. This is a pre-trained language model. It can be used to evaluate tasks zero-shot in both a causal and masked setting. It can also be fine-tuned by adding a new head and dropping the language modeling head. It can be used for language generation but given its small size and low number of words trained on, do not expect LLM-level performance. It can also be used for mask infilling. 1 Our distribution of part of the BNC Texts is permitted under the fair dealings provision of copyright law (see term (2g) in the BNC license).

译文排队中 · 当前显示来源原文

分类待补充

输入待核验→ 输出待核验

价格待核验多模态与渠道费用须分别核对

查看详情 ↗

加入对比来源 / 文档 ↗

babylm-baseline-100m-gpt-bert-masked-focus

BabyLM-community

This one of the three GPT-BERT baselines for the strict track of the 2025 BabyLM challenge. This specific model is trained with a majority number of examples being masked and a minority being masked. This is a pre-trained language model. It can be used to evaluate tasks zero-shot in both a causal and masked setting. It can also be fine-tuned by adding a new head and dropping the language modeling head. It can be used for language generation but given its small size and low number of words trained on, do not expect LLM-level performance. It can also be used for mask infilling. 1 Our distribution of part of the BNC Texts is permitted under the fair dealings provision of copyright law (see term (2g) in the BNC license).

译文排队中 · 当前显示来源原文

分类待补充

输入待核验→ 输出待核验

价格待核验多模态与渠道费用须分别核对

查看详情 ↗

加入对比来源 / 文档 ↗

babylm-baseline-100m-gpt-bert-mixed

BabyLM-community

This one of the three GPT-BERT baselines for the strict-small track of the 2025 BabyLM challenge. This specific model is trained with a equal number of examples being causal and masked. This is a pre-trained language model. It can be used to evaluate tasks zero-shot in both a causal and masked setting. It can also be fine-tuned by adding a new head and dropping the language modeling head. It can be used for language generation but given its small size and low number of words trained on, do not expect LLM-level performance. It can also be used for mask infilling. 1 Our distribution of part of the BNC Texts is permitted under the fair dealings provision of copyright law (see term (2g) in the BNC license).

译文排队中 · 当前显示来源原文

分类待补充

输入待核验→ 输出待核验

价格待核验多模态与渠道费用须分别核对

查看详情 ↗

加入对比来源 / 文档 ↗

babylm-baseline-100m-gpt2

BabyLM-community

基础档案已收录，详细介绍后续补充。可先查看厂商、分类与来源。

分类待补充

输入待核验→ 输出待核验

价格待核验多模态与渠道费用须分别核对

查看详情 ↗

加入对比来源 / 文档 ↗

babylm-baseline-10m-gpt-bert-causal-focus

BabyLM-community

This one of the three GPT-BERT baselines for the strict-small track of the 2025 BabyLM challenge. This specific model is trained with a majority number of examples being causal and a minority being masked. This is a pre-trained language model. It can be used to evaluate tasks zero-shot in both a causal and masked setting. It can also be fine-tuned by adding a new head and dropping the language modeling head. It can be used for language generation but given its small size and low number of words trained on, do not expect LLM-level performance. It can also be used for mask infilling. We used the BabyLM 10M (Strict-small) dataset to train the model. It is composed in the following way:

译文排队中 · 当前显示来源原文

分类待补充

输入待核验→ 输出待核验

价格待核验多模态与渠道费用须分别核对

查看详情 ↗

加入对比来源 / 文档 ↗

babylm-baseline-10m-gpt-bert-masked-focus

BabyLM-community

This one of the three GPT-BERT baselines for the strict-small track of the 2025 BabyLM challenge. This specific model is trained with a majority number of examples being masked and a minority being masked. This is a pre-trained language model. It can be used to evaluate tasks zero-shot in both a causal and masked setting. It can also be fine-tuned by adding a new head and dropping the language modeling head. It can be used for language generation but given its small size and low number of words trained on, do not expect LLM-level performance. It can also be used for mask infilling. We used the BabyLM 10M (Strict-small) dataset to train the model. It is composed in the following way:

译文排队中 · 当前显示来源原文

分类待补充

输入待核验→ 输出待核验

价格待核验多模态与渠道费用须分别核对

查看详情 ↗

加入对比来源 / 文档 ↗

babylm-baseline-10m-gpt-bert-mixed

BabyLM-community

This one of the three GPT-BERT baselines for the strict-small track of the 2025 BabyLM challenge. This specific model is trained with a equal number of examples being causal and masked. This is a pre-trained language model. It can be used to evaluate tasks zero-shot in both a causal and masked setting. It can also be fine-tuned by adding a new head and dropping the language modeling head. It can be used for language generation but given its small size and low number of words trained on, do not expect LLM-level performance. It can also be used for mask infilling. We used the BabyLM 10M (Strict-small) dataset to train the model. It is composed in the following way:

译文排队中 · 当前显示来源原文

分类待补充

输入待核验→ 输出待核验

价格待核验多模态与渠道费用须分别核对

查看详情 ↗

加入对比来源 / 文档 ↗

babylm-baseline-10m-gpt2

BabyLM-community

基础档案已收录，详细介绍后续补充。可先查看厂商、分类与来源。

分类待补充

输入待核验→ 输出待核验

价格待核验多模态与渠道费用须分别核对

查看详情 ↗

加入对比来源 / 文档 ↗

babylm-interaction-baseline-simpo

BabyLM-community

基础档案已收录，详细介绍后续补充。可先查看厂商、分类与来源。

分类待补充

输入待核验→ 输出待核验

价格待核验多模态与渠道费用须分别核对

查看详情 ↗

加入对比来源 / 文档 ↗

babylm-multimodal-baseline-flamingo

BabyLM-community

This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated. - **Developed by:** [More Information Needed] - **Funded by [optional]:** [More Information Needed] - **Shared by [optional]:** [More Information Needed] - **Model type:** [More Information Needed] - **Language(s) (NLP):** [More Information Needed] - **License:** [More Information Needed] - **Finetuned from model [optional]:** [More Information Needed] - **Repository:** [More Information Needed] - **Paper [optional]:** [More Information Needed] - **Demo [optional]:** [More Information Needed]

译文排队中 · 当前显示来源原文

文本生成

输入文本→ 输出文本

价格待核验多模态与渠道费用须分别核对

查看详情 ↗

加入对比来源 / 文档 ↗

babylm-multimodal-baseline-git

BabyLM-community

This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated. Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations. Carbon emissions can be estimated using the Machine Learning Impact calculator presented in Lacoste et al. (2019).

译文排队中 · 当前显示来源原文

视觉问答

输入文本 · 图像→ 输出文本

价格待核验多模态与渠道费用须分别核对

查看详情 ↗

加入对比来源 / 文档 ↗