InternVL2_5-1B_Geometry

The Geometry expert of the OptMerge MLLM merging benchmark (ICLR 2026). It is one of five capability experts (VQA, Geometry, Chart, OCR, Grounding) fine-tuned from the same base model, so that they can be merged into one model without training data.

Training

  • Base model: OpenGVLab/InternVL2_5-1B
  • Method: Full fine-tuning (learning rate 4e-5, warmup ratio 0.03, cosine schedule, 1 epoch).
  • Data: GeoQA+ (zh), G-LLaVA (190K samples, Table 1 of the paper).

Results

From Table 2 of the paper. The last row merges this expert with the other four experts using OptMerge.

Model VizWiz GQA MathVista MATH-Vision ChartQA TextVQA OCRVQA RefCOCO RefCOCO+ RefCOCOg Avg.
InternVL2.5-1B-Instruct (base model) 29.15 54.62 46.80 18.42 69.48 72.51 41.08 71.69 65.41 67.40 53.66
InternVL2_5-1B_Geometry 13.45 32.80 55.20 25.00 51.76 56.91 35.35 24.73 19.61 23.84 33.86
OptMerge (5 experts merged) 30.97 57.13 54.48 21.05 68.72 76.01 46.35 75.97 69.72 73.94 57.44

Usage

# pip install timm einops   (required by the InternVL remote code)
import torch
from transformers import AutoModel, AutoTokenizer

model_id = "yongxianwei/InternVL2_5-1B_Geometry"
model = AutoModel.from_pretrained(model_id, torch_dtype=torch.bfloat16, trust_remote_code=True).eval().cuda()
tokenizer = AutoTokenizer.from_pretrained(model_id, trust_remote_code=True)
# Image preprocessing and model.chat(...) follow the official InternVL2.5-1B model card.

To merge the five experts yourself, see Reproducing OptMerge.

Citation

If you use these checkpoints or the MLLMerging code, please cite both OptMerge and its extended version:

@inproceedings{wei2025optmerge,
  title={OptMerge: Unifying Multimodal LLM Capabilities and Modalities via Model Merging},
  author={Wei, Yongxian and Cheng, Runxi and Jin, Weike and Yang, Enneng and Shen, Li and Hou, Lu and Du, Sinan and Yuan, Chun and Cao, Xiaochun and Tao, Dacheng},
  booktitle={The Fourteenth International Conference on Learning Representations},
  year={2026},
  url={https://openreview.net/forum?id=Me0n0iESJY}
}

@article{wei2026swudi,
  title={Closed-Form Spectral Regularization for Multi-Task Model Merging},
  author={Wei, Yongxian and Cheng, Runxi and Zhang, Xingxuan and Shen, Li and Yuan, Chun and Cui, Peng and Tao, Dacheng},
  journal={arXiv preprint arXiv:2606.07289},
  year={2026}
}
Downloads last month
306
Safetensors
Model size
0.9B params
Tensor type
F16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for yongxianwei/InternVL2_5-1B_Geometry

Finetuned
(24)
this model

Collection including yongxianwei/InternVL2_5-1B_Geometry

Papers for yongxianwei/InternVL2_5-1B_Geometry