Transformers
Safetensors
English

ParamMute-8B-SFT

This is the supervised fine-tuning (SFT) checkpoint released with ParamMute: Suppressing Knowledge-Critical FFNs for Faithful Retrieval-Augmented Generation. It is based on Llama 3 8B Instruct and uses the ParamMute activation-suppression setting for layers 19–26. ParamMute studies how to make a retrieval-augmented model follow accurate retrieved evidence when it conflicts with the model’s memorized answer.

Paper and resources

To evaluate contextual faithfulness, use the normalization and recall metrics defined in Section 5.

Citation

@inproceedings{huang2025parammute,
  title = {{ParamMute: Suppressing Knowledge-Critical FFNs for Faithful Retrieval-Augmented Generation}},
  author = {Pengcheng Huang and Zhenghao Liu and Yukun Yan and Haiyan Zhao and Xiaoyuan Yi and Hao Chen and Zhiyuan Liu and Maosong Sun and Tong Xiao and Ge Yu and Chenyan Xiong},
  year = {2025},
  doi = {10.52202/085713-3356},
  url = {https://proceedings.neurips.cc/paper_files/paper/2025/hash/90d1e515d74686ad148b469a3cecbbaa-Abstract-Conference.html},
  booktitle = {Advances in Neural Information Processing Systems 38},
  publisher = {Curran Associates, Inc.}
}
Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for chengpingan/ParamMute-8B-SFT

Finetuned
(613)
this model

Collection including chengpingan/ParamMute-8B-SFT

Paper for chengpingan/ParamMute-8B-SFT