olmoe-7b-split

OLMoE 7B-A1B split GGUF artifacts used by the playground wllama preset.

These files are the GGUF artifacts used by the local Transformers.js playground wllama CPU presets. Large files are kept under quantization subdirectories so browser clients can request the first shard URL and expand the remaining shards.

Source And License

The GGUF conversion, quantization, and splitting steps do not change the upstream model license.

Downloads last month
31
GGUF
Model size
7B params
Architecture
olmoe
Hardware compatibility
Log In to add your hardware

2-bit

4-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for sinatras/olmoe-7b-split