How Can We Synthesize High-Quality Pretraining Data? A Systematic Study of Prompt Design, Generator Model, and Source Data
Paper • 2604.13977 • Published
SSU
university
AI & ML interests
None defined yet.
Recent Activity
Papers
Mitigating Catastrophic Forgetting in Target Language Adaptation of LLMs via Source-Shielded Updates
atsuki-yamaguchiÂ
authored 3
papers 22 days ago
atsuki-yamaguchiÂ
submitted a
paper to Daily Papers 29 days ago
atsuki-yamaguchiÂ
published 7
models 4 months ago
ssu-project/OLMo-2-1124-7B-Instruct-ig-fft-20MT
7B • Updated • 1
ssu-project/OLMo-2-1124-7B-Instruct-ig-gmt-20MT
7B • Updated • 3
ssu-project/OLMo-2-1124-7B-Instruct-ig-adalora-20MT
Updated
ssu-project/OLMo-2-1124-7B-Instruct-ig-hft-20MT
7B • Updated • 1
ssu-project/OLMo-2-1124-7B-Instruct-ig-ssu-20MT
7B • Updated • 1
ssu-project/OLMo-2-1124-7B-Instruct-ig-magnitude-20MT
7B • Updated • 4
ssu-project/OLMo-2-1124-7B-Instruct-ig-random-20MT
7B • Updated • 3
atsuki-yamaguchiÂ
updated 2
models 4 months ago
atsuki-yamaguchiÂ
updated a
Space 4 months ago
atsuki-yamaguchiÂ
updated 5
models 4 months ago
ssu-project/OLMo-2-1124-7B-Instruct-ig-hft-20MT
7B • Updated • 1
ssu-project/OLMo-2-1124-7B-Instruct-ig-magnitude-20MT
7B • Updated • 4
ssu-project/OLMo-2-1124-7B-Instruct-ig-gmt-20MT
7B • Updated • 3
ssu-project/OLMo-2-1124-7B-Instruct-ig-adalora-20MT
Updated
ssu-project/OLMo-2-1124-7B-Instruct-ig-fft-20MT
7B • Updated • 1
atsuki-yamaguchiÂ
published a
model 5 months ago