Falcon-H1 is a new series of large language models (LLMs) featuring a novel hybrid architecture that combines Transformer-based attention with State Space Models (SSMs) for superior long-context memory and computational efficiency. Released in multiple configurations (0.5B to 34B parameters), Falcon-H1 models demonstrate state-of-the-art performance and exceptional parameter and training efficiency. The flagship Falcon-H1-34B matches or outperforms models up to 70B scale, while smaller models also show strong performance relative to their size. These models excel across reasoning, mathematics, multilingual tasks, instruction following, and scientific knowledge, supporting up to 256K context tokens and 18 languages. All models are released under a permissive open-source license. For more details about the training protocol of this model, please refer to the Falcon-H1 technical blogpost and Technical Report. Currently to use this model you can either rely on Hugging Face `transformers`, `vLLM` or our custom fork of `llama.cpp` library.
번역 대기 중 · 원문 표시
입력 텍스트→ 출력 텍스트
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
기본 정보 등록 · 상세 정보 보완 예정
입력 텍스트→ 출력 텍스트
For more details about the training protocol of this model, please refer to the Falcon-H1 technical blogpost and Technical Report. Currently to use this model you can either rely on Hugging Face `transformers`, `vLLM` or our custom fork of `llama.cpp` library. Make sure to install the latest version of `transformers` or `vllm`, eventually install these packages from source:
번역 대기 중 · 원문 표시
입력 텍스트→ 출력 텍스트
0. TL;DR 1. Model Details 2. Training Details 3. Usage 4. Evaluation 5. Citation - **Developed by:** https://www.tii.ae - **Model type:** Causal decoder-only - **Architecture:** Hybrid Transformers + Mamba architecture - **Language(s) (NLP):** English, Multilingual - **License:** Falcon-LLM License For more details about the training protocol of this model, please refer to the Falcon-H1 technical blogpost and Technical Report.
번역 대기 중 · 원문 표시
입력 텍스트→ 출력 텍스트
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
분류 준비 중
입력 미확인→ 출력 미확인
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
입력 텍스트→ 출력 텍스트
For more details about the training protocol of this model, please refer to the Falcon-H1 technical blogpost and Technical Report. Currently to use this model you can either rely on Hugging Face `transformers`, `vLLM` or `llama.cpp` library. Make sure to install the latest version of `transformers` or `vllm`, eventually install these packages from source:
번역 대기 중 · 원문 표시
입력 텍스트→ 출력 텍스트
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
분류 준비 중
입력 미확인→ 출력 미확인
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
기본 정보 등록 · 상세 정보 보완 예정
입력 텍스트→ 출력 텍스트
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
입력 텍스트→ 출력 텍스트
For more details about the training protocol of this model, please refer to the Falcon-H1-Tiny technical blogpost. Currently to use this model you can either rely on Hugging Face `transformers`, `vLLM`, `sglang`, `llama.cpp`, `ollama` or `mlx` library. You can find all GGUF files compatible with `llama.cpp` under our official collection - an example setup could be:
번역 대기 중 · 원문 표시
분류 준비 중
입력 미확인→ 출력 미확인
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
기본 정보 등록 · 상세 정보 보완 예정
입력 텍스트→ 출력 텍스트
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
기본 정보 등록 · 상세 정보 보완 예정
분류 준비 중
입력 미확인→ 출력 미확인
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
기본 정보 등록 · 상세 정보 보완 예정
입력 텍스트→ 출력 텍스트
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
입력 텍스트→ 출력 텍스트
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
입력 텍스트→ 출력 텍스트
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
기본 정보 등록 · 상세 정보 보완 예정
분류 준비 중
입력 미확인→ 출력 미확인
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
기본 정보 등록 · 상세 정보 보완 예정
입력 텍스트→ 출력 텍스트
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
입력 텍스트→ 출력 텍스트
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
기본 정보 등록 · 상세 정보 보완 예정
분류 준비 중
입력 미확인→ 출력 미확인
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
분류 준비 중
입력 미확인→ 출력 미확인
This repository presents **Falcon-H1R-7B**, a reasoning-specialized model introduced in the paper Falcon-H1R: Pushing the Reasoning Frontiers with a Hybrid Model for Efficient Test-Time Scaling. Built on top of Falcon-H1-7B-Base, it was trained via cold-start supervised fine-tuning with long reasoning traces and further enhanced by scaling RL with GRPO. The model demonstrates outstanding performance across various benchmark evaluations, including mathematics, programming, instruction following, and general logic. For more details about the training protocol of this model, please refer to the Falcon-H1R technical blogpost and Technical Report.
번역 대기 중 · 원문 표시
입력 텍스트→ 출력 텍스트
Find below some example scripts on how to use the model in `transformers` (Make sure to have the latest transformers, or the one built from source): Falcon-Mamba has been trained with ~ 5,500 GT mainly coming from Refined-Web, a large volume web-only dataset filtered and deduplicated. Similar to the others Falcon suite models, Falcon-Mamba has been trained leveraging a multi-stage training strategy to increase the context-length from 2,048 to 8,192. Moreover, inspired by the concept of Curriculum Learning, we carefully selected data mixtures throughout the training stages, considering both data diversity and complexity. Note that at inference the context-length is not relevant as the Mamba architecture has no limit on long range dependency. At the last training stage, small portion of high-quality curated data was used to further enhance performance. Overall, the data sources included RefinedWeb-English, high quality technical data, code data and math data extracted from public sources. In particular, we used samples coming from Fineweb-edu during our last training stage.
번역 대기 중 · 원문 표시
입력 텍스트→ 출력 텍스트
基础档案已收录,详细介绍后续补充。可先查看厂商、分类与来源。
기본 정보 등록 · 상세 정보 보완 예정
입력 텍스트→ 출력 텍스트