Tamazight NLP

community

https://mozilladatacollective.com/organization/cmjr8s3vt0go5mk07flwea5wy

tamazight-nlp

Activity Feed Request to join this org

AI & ML interests

NLP, ASR, Text-To-Speech

Recent Activity

ayymen updated a collection 2 days ago

Bitext Datasets

ayymen updated a collection 2 days ago

Bitext Datasets

ayymen updated a collection 2 days ago

Bitext Datasets

View all activity

ayymen

updated a collection 2 days ago

Bitext Datasets

Collection

51 items • Updated 2 days ago • 1

ayymen

updated a collection 5 days ago

Speech Datasets

Collection

19 items • Updated 5 days ago • 1

ayymen

updated a collection 6 days ago

Dictionaries

Collection

13 items • Updated 6 days ago

PhysiQuanty

posted an update 24 days ago

Post

4766

🧠 Arithmetic-SLM : A 30M model that manages to compute simple arithmetic better than a 3B model 🚀
WhirlwindAI/Arithmetic-SLM
WhirlwindAI/arithmetic-slm

🏆 Leaderboard ArithMark-2 🏆
🥇 Qwen/Qwen2.5-Math-1.5B = 82.08%
🥈 WhirlwindAI/Arithmetic-SLM = 78.60% (31.7M Params)
🥉 Qwen/Qwen2.5-3B = 78.44%

Example WhirlwindAI/Arithmetic-SLM =
0.5 * 0.5 = 0.25 ✅
105 + 45 / 8 = 110 ✅
(132 / 12) + (46 - 15) = 42 ✅
(10 + 28) * 3 = 114 ✅
1 * (16 + 28) = 44 ✅
(21 + 27) * (14 - 7) = 336 ❌

leaderboard = """
|              Model               |    Params    |   Score   |
|----------------------------------|--------------|-----------|
|      Qwen/Qwen2.5-Math-1.5B      |     1.54B    |   82.08%  |
|    WhirlwindAI/Arithmetic-SLM    |    31.70M    |   78.60%  | <=
|         Qwen/Qwen2.5-3B          |     3.09B    |   78.44%  |
|        Qwen/Qwen2.5-1.5B         |     1.54B    |   77.72%  |
|    Qwen/Qwen2.5-Coder-1.5B       |     1.54B    |   74.88%  |
|   HuggingFaceTB/SmolLM2-1.7B     |     1.71B    |   66.12%  |
|        Qwen/Qwen2.5-0.5B         |      494M    |   63.04%  |
| facebook/MobileLLM-R1-140M-base  |      140M    |   53.88%  |
|     SupraLabs/Supra-50M-Base     |       52M    |   27.12%  |
"""