Model Size vs. Quality

Retrieval quality (NDCG@10) against parameter count — smaller & higher is better
ColBERT (late interaction) Dense Our models Pareto frontier
On the Pareto frontier models not dominated on size & quality
ModelParamsScore
The dashed step traces the overall Pareto frontier: no model below-and-right of it is both smaller and better. Hover any point for its scores.