int-4 quantized version is missing [link broken]
#10
by pranay-ar - opened
Hi, thank you for the great work. I am not sure if the int4-quantized repo is public yet or if the page doesn't even exist, since the link in this section is broken. Please update accordingly.
Int4 quantized version
Download the int4 quantized version for lower GPU memory (7GB) usage: MiniCPM-o-2_6-int4.
Cuiunbo changed discussion status to closed