CodeRankEmbed-flash-attn

모델 소개

A **bf16 quantization of `nomic-ai/CodeRankEmbed`** with a custom `modeling_hf_nomic_bert.py`, shipped in this repo, that **picks one of three attention implementations for the hardware it runs on.** It is not a finetune — the weights are the original CodeRankEmbed weights cast to bf16 (no further training). Two of the three replace the original's padded `O(seq²)` attention with an `O(N)` unpadded path; the third keeps the original's algorithm as the correctness reference and universal fallback. `nomic-ai/CodeRankEmbed` loads through `trust_remote_code`, and its attention path is **eager only** — activation memory grows as `batch × heads × seq²`, which runs out of memory at large batches even though the model is only 137M params. This repo adds two attention paths that compute the same attention in `O(N)` memory by packing unpadded sequences, so the large batches that the eager path cannot fit run comfortably — with **parity embeddings** (no quality change): Both run the same FA2-family kernel and are gated by the same GPU-capability check. The modeling file ships all three paths itself, so no runtime patching or post-load hooks are needed.

주요 특징

特点摘要待依据来源补齐，不凭模型名称推断能力。

한계 및 유의 사항

구체적 한계를 판단할 출처가 부족합니다. 실제 성능, 지연, 데이터 정책, 라이선스와 버전 수명을 확인하세요.

출처별 요금 및 비용 분석

요금은 채널, 지역, 설정에 따라 다릅니다. 각 채널 요금은 개별 표시되며 제공사의 통일 공식 요금이 아닙니다.

공개 평가 및 실행 설정

暂无已采集的可核验公开评分。模型未上榜不代表能力较低。

자주 묻는 질문

출처 및 추적 기록

许可证：mit。模型介绍与第三方评测均以原来源的具体版本和方法为准。