This one of the three GPT-BERT baselines for the strict track of the 2025 BabyLM challenge. This specific model is trained with a majority number of examples being causal and a minority being masked. This is a pre-trained language model. It can be used to evaluate tasks zero-shot in both a causal and masked setting. It can also be fine-tuned by adding a new head and dropping the language modeling head. It can be used for language generation but given its small size and low number of words trained on, do not expect LLM-level performance. It can also be used for mask infilling. 1 Our distribution of part of the BNC Texts is permitted under the fair dealings provision of copyright law (see term (2g) in the BNC license).

번역 대기 중 · 원문 표시

분류 준비 중

입력 미확인→ 출력 미확인

요금 미확인멀티모달 및 채널 요금 별도 확인

자세히 보기 ↗

비교 추가출처 / 문서 ↗

babylm-baseline-100m-gpt-bert-masked-focus

BabyLM-community

This one of the three GPT-BERT baselines for the strict track of the 2025 BabyLM challenge. This specific model is trained with a majority number of examples being masked and a minority being masked. This is a pre-trained language model. It can be used to evaluate tasks zero-shot in both a causal and masked setting. It can also be fine-tuned by adding a new head and dropping the language modeling head. It can be used for language generation but given its small size and low number of words trained on, do not expect LLM-level performance. It can also be used for mask infilling. 1 Our distribution of part of the BNC Texts is permitted under the fair dealings provision of copyright law (see term (2g) in the BNC license).

번역 대기 중 · 원문 표시

분류 준비 중

입력 미확인→ 출력 미확인

요금 미확인멀티모달 및 채널 요금 별도 확인

자세히 보기 ↗

비교 추가출처 / 문서 ↗

babylm-baseline-100m-gpt-bert-mixed

BabyLM-community

This one of the three GPT-BERT baselines for the strict-small track of the 2025 BabyLM challenge. This specific model is trained with a equal number of examples being causal and masked. This is a pre-trained language model. It can be used to evaluate tasks zero-shot in both a causal and masked setting. It can also be fine-tuned by adding a new head and dropping the language modeling head. It can be used for language generation but given its small size and low number of words trained on, do not expect LLM-level performance. It can also be used for mask infilling. 1 Our distribution of part of the BNC Texts is permitted under the fair dealings provision of copyright law (see term (2g) in the BNC license).

번역 대기 중 · 원문 표시

분류 준비 중

입력 미확인→ 출력 미확인

요금 미확인멀티모달 및 채널 요금 별도 확인

자세히 보기 ↗

비교 추가출처 / 문서 ↗

babylm-baseline-100m-gpt2

BabyLM-community

基础档案已收录，详细介绍后续补充。可先查看厂商、分类与来源。

분류 준비 중

입력 미확인→ 출력 미확인

요금 미확인멀티모달 및 채널 요금 별도 확인

자세히 보기 ↗

비교 추가출처 / 문서 ↗

babylm-baseline-10m-gpt-bert-causal-focus

BabyLM-community

This one of the three GPT-BERT baselines for the strict-small track of the 2025 BabyLM challenge. This specific model is trained with a majority number of examples being causal and a minority being masked. This is a pre-trained language model. It can be used to evaluate tasks zero-shot in both a causal and masked setting. It can also be fine-tuned by adding a new head and dropping the language modeling head. It can be used for language generation but given its small size and low number of words trained on, do not expect LLM-level performance. It can also be used for mask infilling. We used the BabyLM 10M (Strict-small) dataset to train the model. It is composed in the following way:

번역 대기 중 · 원문 표시

분류 준비 중

입력 미확인→ 출력 미확인

요금 미확인멀티모달 및 채널 요금 별도 확인

자세히 보기 ↗

비교 추가출처 / 문서 ↗

babylm-baseline-10m-gpt-bert-masked-focus

BabyLM-community

This one of the three GPT-BERT baselines for the strict-small track of the 2025 BabyLM challenge. This specific model is trained with a majority number of examples being masked and a minority being masked. This is a pre-trained language model. It can be used to evaluate tasks zero-shot in both a causal and masked setting. It can also be fine-tuned by adding a new head and dropping the language modeling head. It can be used for language generation but given its small size and low number of words trained on, do not expect LLM-level performance. It can also be used for mask infilling. We used the BabyLM 10M (Strict-small) dataset to train the model. It is composed in the following way:

번역 대기 중 · 원문 표시

분류 준비 중

입력 미확인→ 출력 미확인

요금 미확인멀티모달 및 채널 요금 별도 확인

자세히 보기 ↗

비교 추가출처 / 문서 ↗

babylm-baseline-10m-gpt-bert-mixed

BabyLM-community

This one of the three GPT-BERT baselines for the strict-small track of the 2025 BabyLM challenge. This specific model is trained with a equal number of examples being causal and masked. This is a pre-trained language model. It can be used to evaluate tasks zero-shot in both a causal and masked setting. It can also be fine-tuned by adding a new head and dropping the language modeling head. It can be used for language generation but given its small size and low number of words trained on, do not expect LLM-level performance. It can also be used for mask infilling. We used the BabyLM 10M (Strict-small) dataset to train the model. It is composed in the following way:

번역 대기 중 · 원문 표시

분류 준비 중

입력 미확인→ 출력 미확인

요금 미확인멀티모달 및 채널 요금 별도 확인

자세히 보기 ↗

비교 추가출처 / 문서 ↗

babylm-baseline-10m-gpt2

BabyLM-community

基础档案已收录，详细介绍后续补充。可先查看厂商、分类与来源。

분류 준비 중

입력 미확인→ 출력 미확인

요금 미확인멀티모달 및 채널 요금 별도 확인

자세히 보기 ↗

비교 추가출처 / 문서 ↗

babylm-interaction-baseline-simpo

BabyLM-community

基础档案已收录，详细介绍后续补充。可先查看厂商、分类与来源。

분류 준비 중

입력 미확인→ 출력 미확인

요금 미확인멀티모달 및 채널 요금 별도 확인

자세히 보기 ↗

비교 추가출처 / 문서 ↗

babylm-multimodal-baseline-flamingo

BabyLM-community

This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated. - **Developed by:** [More Information Needed] - **Funded by [optional]:** [More Information Needed] - **Shared by [optional]:** [More Information Needed] - **Model type:** [More Information Needed] - **Language(s) (NLP):** [More Information Needed] - **License:** [More Information Needed] - **Finetuned from model [optional]:** [More Information Needed] - **Repository:** [More Information Needed] - **Paper [optional]:** [More Information Needed] - **Demo [optional]:** [More Information Needed]

번역 대기 중 · 원문 표시

텍스트 생성

입력 텍스트→ 출력 텍스트

요금 미확인멀티모달 및 채널 요금 별도 확인

자세히 보기 ↗

비교 추가출처 / 문서 ↗

babylm-multimodal-baseline-git

BabyLM-community

This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated. Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations. Carbon emissions can be estimated using the Machine Learning Impact calculator presented in Lacoste et al. (2019).

번역 대기 중 · 원문 표시

시각 질의응답

입력 텍스트 · 이미지→ 출력 텍스트

요금 미확인멀티모달 및 채널 요금 별도 확인

자세히 보기 ↗

비교 추가출처 / 문서 ↗