Pretrained model on English language using a causal language modeling (CLM) objective. It was introduced in this paper and first released at this page. Disclaimer: The team releasing GPT-2 also wrote a model card for their model. Content from this model card has been written by the Hugging Face team to complete the information they provided and give specific examples of bias. GPT-2 is a transformers model pretrained on a very large corpus of English data in a self-supervised fashion. This means it was pretrained on the raw texts only, with no humans labelling them in any way (which is why it can use lots of publicly available data) with an automatic process to generate inputs and labels from those texts. More precisely, it was trained to guess the next word in sentences.
翻訳待ち・原文を表示
入力 テキスト→ 出力 テキスト
- Model Details - How To Get Started With the Model - Uses - Risks, Limitations and Biases - Training - Evaluation - Environmental Impact - Technical Specifications - Citation Information - Model Card Authors **Model Description:** GPT-2 Large is the **774M parameter** version of GPT-2, a transformer-based language model created and released by OpenAI. The model is a pretrained model on English language using a causal language modeling (CLM) objective. - **Developed by:** OpenAI, see associated research paper and GitHub repo for model developers. - **Model Type:** Transformer-based language model - **Language(s):** English - **License:** Modified MIT License - **Related Models:** GPT-2, GPT-Medium and GPT-XL - **Resources for more information:** - Research Paper - OpenAI Blog Post - GitHub Repo - OpenAI Model Card for GPT-2 - Test the full generation capabilities here: https://transformer.huggingface.co/doc/gpt2-large
翻訳待ち・原文を表示
入力 テキスト→ 出力 テキスト
**Model Description:** GPT-2 Medium is the **355M parameter** version of GPT-2, a transformer-based language model created and released by OpenAI. The model is a pretrained model on English language using a causal language modeling (CLM) objective. - **Developed by:** OpenAI, see associated research paper and GitHub repo for model developers. - **Model Type:** Transformer-based language model - **Language(s):** English - **License:** Modified MIT License - **Related Models:** GPT2, GPT2-Large and GPT2-XL - **Resources for more information:** - Research Paper - OpenAI Blog Post - GitHub Repo - OpenAI Model Card for GPT-2 - Test the full generation capabilities here: https://transformer.huggingface.co/doc/gpt2-large Use the code below to get started with the model. You can use this model directly with a pipeline for text generation. Since the generation relies on some randomness, we set a seed for reproducibility:
翻訳待ち・原文を表示
入力 テキスト→ 出力 テキスト
- Model Details - How To Get Started With the Model - Uses - Risks, Limitations and Biases - Training - Evaluation - Environmental Impact - Technical Specifications - Citation Information - Model Card Authors **Model Description:** GPT-2 XL is the **1.5B parameter** version of GPT-2, a transformer-based language model created and released by OpenAI. The model is a pretrained model on English language using a causal language modeling (CLM) objective. - **Developed by:** OpenAI, see associated research paper and GitHub repo for model developers. - **Model Type:** Transformer-based language model - **Language(s):** English - **License:** Modified MIT License - **Related Models:** GPT-2, GPT-Medium and GPT-Large - **Resources for more information:** - Research Paper - OpenAI Blog Post - GitHub Repo - OpenAI Model Card for GPT-2 - OpenAI GPT-2 1.5B Release Blog Post - Test the full generation capabilities here: https://transformer.huggingface.co/doc/gpt2-large
翻訳待ち・原文を表示
入力 テキスト→ 出力 テキスト
- Model Details - How To Get Started With the Model - Uses - Risks, Limitations and Biases - Training - Evaluation - Environmental Impact - Technical Specifications - Citation Information - Model Card Authors **Model Description:** `openai-gpt` (a.k.a. "GPT-1") is the first transformer-based language model created and released by OpenAI. The model is a causal (unidirectional) transformer pre-trained using language modeling on a large corpus with long range dependencies. - **Developed by:** Alec Radford, Karthik Narasimhan, Tim Salimans, Ilya Sutskever. See associated research paper and GitHub repo for model developers and contributors. - **Model Type:** Transformer-based language model - **Language(s):** English - **License:** MIT License - **Related Models:** GPT2, GPT2-Medium, GPT2-Large and GPT2-XL - **Resources for more information:** - Research Paper - OpenAI Blog Post - GitHub Repo - Test the full generation capabilities here: https://transformer.huggingface.co/doc/gpt
翻訳待ち・原文を表示
入力 テキスト→ 出力 テキスト
- Model Details - Uses - Risks, Limitations and Biases - Training - Evaluation - Environmental Impact - Technical Specifications - Citation Information - Model Card Authors - How To Get Started With the Model **Model Description:** RoBERTa base OpenAI Detector is the GPT-2 output detector model, obtained by fine-tuning a RoBERTa base model with the outputs of the 1.5B-parameter GPT-2 model. The model can be used to predict if text was generated by a GPT-2 model. This model was released by OpenAI at the same time as OpenAI released the weights of the largest GPT-2 model, the 1.5B parameter version. - **Developed by:** OpenAI, see GitHub Repo and associated paper for full author list - **Model Type:** Fine-tuned transformer-based language model - **Language(s):** English - **License:** MIT - **Related Models:** RoBERTa base, GPT-XL (1.5B parameter version), GPT-Large (the 774M parameter version), GPT-Medium (the 355M parameter version) and GPT-2 (the 124M parameter version) - **Resources for more information:** - Research Paper (see, in particular, the section beginning on page 12 about Automated ML-based detection). - GitHub Repo - OpenAI Blog Post - Explore the detector model here
翻訳待ち・原文を表示
入力 テキスト→ 出力 テキスト
- Model Details - Uses - Risks, Limitations and Biases - Training - Evaluation - Environmental Impact - Technical Specifications - Citation Information - Model Card Authors - How To Get Started With the Model **Model Description:** RoBERTa large OpenAI Detector is the GPT-2 output detector model, obtained by fine-tuning a RoBERTa large model with the outputs of the 1.5B-parameter GPT-2 model. The model can be used to predict if text was generated by a GPT-2 model. This model was released by OpenAI at the same time as OpenAI released the weights of the largest GPT-2 model, the 1.5B parameter version. - **Developed by:** OpenAI, see GitHub Repo and associated paper for full author list - **Model Type:** Fine-tuned transformer-based language model - **Language(s):** English - **License:** MIT - **Related Models:** RoBERTa large, GPT-XL (1.5B parameter version), GPT-Large (the 774M parameter version), GPT-Medium (the 355M parameter version) and GPT-2 (the 124M parameter version) - **Resources for more information:** - Research Paper (see, in particular, the section beginning on page 12 about Automated ML-based detection). - GitHub Repo - OpenAI Blog Post - Explore the detector model here
翻訳待ち・原文を表示
入力 テキスト→ 出力 テキスト
