Instructions to use state-spaces/mamba-130m with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use state-spaces/mamba-130m with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("state-spaces/mamba-130m", device_map="auto") - Notebooks
- Google Colab
- Kaggle
model_type
#4
by sdyy - opened
state-spaces/mamba-130m
model_type='?????'
from langchain_community.llms import CTransformers
Change the model_type to 'llama'
llm = CTransformers(
model='./mamba-2.8b-f32.gguf',
model_type='mamba', # أو أي نوع مناسب آخر
config={'max_new_tokens': 256, 'repetition_penalty': 1.1}
)
print(llm.invoke('AI is going to'))