🔄 In a Training Loop

Dean Byrne PRO

Quazim0t0

·

https://huggingface.co/DaisyChainAI

AI & ML interests

DaisyChainAI🌼 / SmallLM's / San Francisco / Open Source

Recent Activity

reacted to Hoglet-33's post with ❤️ about 13 hours ago

We are announcing the first generation of the Pebble model family! These are the models we are releasing: - Pebble 10M - Pebble 25M - Pebble 50M Each model will use a Mamba-Transformer 3:1 hybrid architecture and will be pretrained on 25 billion tokens before IFT and SFT. Depending on development time and resources, we may also release: - Pebble 5M - Pebble 75M - Pebble 1M (possibly) We hope you're excited and enjoy the models! Follow for more: @Hoglet-33 https://huggingface.co/basically-ai

reacted to Hoglet-33's post with 🔥 about 13 hours ago

We are announcing the first generation of the Pebble model family! These are the models we are releasing: - Pebble 10M - Pebble 25M - Pebble 50M Each model will use a Mamba-Transformer 3:1 hybrid architecture and will be pretrained on 25 billion tokens before IFT and SFT. Depending on development time and resources, we may also release: - Pebble 5M - Pebble 75M - Pebble 1M (possibly) We hope you're excited and enjoy the models! Follow for more: @Hoglet-33 https://huggingface.co/basically-ai

updated a model 3 days ago

Quazim0t0/Byrne-100M-Ultra-MC

View all activity

Organizations

Quazim0t0 's collections 7