THE AI MODEL DIRECTORY Start exploring models here

Find your ideal AI model.

From language to images, open weights to APIs. Understand capabilities and compare real costs.
Find the right engine for your next idea.

Explore AI models 1

Provider Input Output License

Discover models worth your attention

CodeRankEmbed-flash-attn

handwoven8588

A **bf16 quantization of `nomic-ai/CodeRankEmbed`** with a custom `modeling_hf_nomic_bert.py`, shipped in this repo, that **picks one of three attention implementations for the hardware it runs on.** It is not a finetune — the weights are the original CodeRankEmbed weights cast to bf16 (no further training). Two of the three replace the original's padded `O(seq²)` attention with an `O(N)` unpadded path; the third keeps the original's algorithm as the correctness reference and universal fallback. `nomic-ai/CodeRankEmbed` loads through `trust_remote_code`, and its attention path is **eager only** — activation memory grows as `batch × heads × seq²`, which runs out of memory at large batches even though the model is only 137M params. This repo adds two attention paths that compute the same attention in `O(N)` memory by packing unpadded sequences, so the large batches that the eager path cannot fit run comfortably — with **parity embeddings** (no quality change): - `torch_varlen` — `torch.nn.attention.varlen.varlen_attn`, shipped in torch itself (no extra package), available from torch **2.10.0** onward. - `flash_attn` — the `flash_attn` package's varlen kernel. Kept as a fallback for older torch builds that don't yet have `torch.nn.attention.varlen` but do have `flash_attn` installed. This package is **optional**.

Category pending

Input Not verified→ Output Not verified

Price not verifiedCheck multimodal and channel pricing separately

View details ↗

CompareSource / docs ↗

COST EXPLORER

Great models. Clear costs.

Cost analysis

Adjust monthly token usage to compare estimated API costs.

Monthly input tokens 10 MMonthly output tokens 2 M1 M = 1 million tokens · USD
Compares base text-token rates within the same channel

Uses collected, comparable USD-per-million-token rates. Snapshots exclude cache discounts, tiers, extra reasoning output and taxes. Check current source prices.

MODEL HANDBOOK

Understand before you choose

Selection guide & FAQ

How should API prices be compared?+

Separate input, output and cache rates, then estimate the same workload. Image, audio and video rates may use items, duration or resolution rather than tokens.

Do open weights mean free commercial use?+

Not necessarily. Check each version’s license, commercial restrictions and policies. Self-hosting also incurs compute and maintenance costs.

Is the top-ranked model the best for me?+

Rankings depend on tasks, versions and methods. Compare accuracy, latency, reliability and costs on your own workload.

Find your ideal AI model.

Explore AI models 1

CodeRankEmbed-flash-attn

No matching models

Great models. Clear costs.

Understand before you choose

Follow trends. Find tools. Explore models.