NohTow commited on
Commit
cb9947e
·
verified ·
1 Parent(s): 41b4bba

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -50,7 +50,7 @@ For more information, please read our [blogpost](https://huggingface.co/blog/lig
50
 
51
  **DenseOn** is a dense (single-vector) retrieval model built on ModernBERT (149M parameters), trained by [LightOn](https://lighton.ai). It encodes queries and documents independently using cosine similarity with `query:`/`document:` prefixes and CLS pooling.
52
 
53
- DenseOn achieves **56.75** average NDCG@10 on BEIR (14 datasets) and **57.71** on decontaminated BEIR (12 datasets), topping all base-size dense models and outperforming models up to 4x larger.
54
  Notably it:
55
  - **Tops all base-size dense models on BEIR**, ahead of GTE-ModernBERT (55.19) and on par with much larger Snowflake Arctic Embed L v2 (55.22, 568M) and Qwen3-Embedding-0.6B (55.52).
56
  - **Holds up under decontamination**: when training-overlap samples are stripped from the BEIR corpora, DenseOn improves to **57.71 nDCG@10** on the 12-dataset decontaminated split.
@@ -61,7 +61,7 @@ See our [blog post](https://huggingface.co/blog/lightonai/denseon-lateon) for fu
61
 
62
  ## Results
63
 
64
- ### BEIR (14 datasets, NDCG@10)
65
 
66
  | Model | Average | Size | Emb dim | ArguAna | CQADupstackRetrieval | ClimateFEVER | DBPedia | FEVER | FiQA2018 | HotpotQA | MSMARCO | NFCorpus | NQ | QuoraRetrieval | SCIDOCS | SciFact | TRECCOVID | Touche2020 |
67
  |---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
 
50
 
51
  **DenseOn** is a dense (single-vector) retrieval model built on ModernBERT (149M parameters), trained by [LightOn](https://lighton.ai). It encodes queries and documents independently using cosine similarity with `query:`/`document:` prefixes and CLS pooling.
52
 
53
+ DenseOn achieves **56.75** average NDCG@10 on BEIR (15 datasets) and **57.71** on decontaminated BEIR (12 datasets), topping all base-size dense models and outperforming models up to 4x larger.
54
  Notably it:
55
  - **Tops all base-size dense models on BEIR**, ahead of GTE-ModernBERT (55.19) and on par with much larger Snowflake Arctic Embed L v2 (55.22, 568M) and Qwen3-Embedding-0.6B (55.52).
56
  - **Holds up under decontamination**: when training-overlap samples are stripped from the BEIR corpora, DenseOn improves to **57.71 nDCG@10** on the 12-dataset decontaminated split.
 
61
 
62
  ## Results
63
 
64
+ ### BEIR (15 datasets, NDCG@10)
65
 
66
  | Model | Average | Size | Emb dim | ArguAna | CQADupstackRetrieval | ClimateFEVER | DBPedia | FEVER | FiQA2018 | HotpotQA | MSMARCO | NFCorpus | NQ | QuoraRetrieval | SCIDOCS | SciFact | TRECCOVID | Touche2020 |
67
  |---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|