# pip install -U transformers accelerate
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("PriyanshiD/Llama-3.2-3B-bnb-4bit-python-DPO", device_map="auto")Quick Links
Uploaded model
- Developed by: PriyanshiD
- License: apache-2.0
- Finetuned from model : unsloth/Llama-3.2-3B-bnb-4bit
This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.
Model tree for PriyanshiD/Llama-3.2-3B-bnb-4bit-python-DPO
Base model
meta-llama/Llama-3.2-3B Quantized
unsloth/Llama-3.2-3B-bnb-4bit
# Use a pipeline as a high-level helper # Warning: Pipeline type "question-answering" is no longer supported in transformers v5. # You must load the model directly (see below) or downgrade to v4.x with: # pip install "transformers<5.0.0" from transformers import pipeline pipe = pipeline("question-answering", model="PriyanshiD/Llama-3.2-3B-bnb-4bit-python-DPO")