Data Attribution

EleutherAI 's Collections

Evals

Deep Ignorance

Pythia Scaling Suite

PolyPythias

Data Attribution

Quirky Models and Datasets

Pile-T5

Quirky Math (archive)

Pile-T5 T5x Checkpoints

Sparse Autoencoders

updated 9 days ago

Leave-1%-out retrained models, per-query loss changes, and datasets for computing LDS.

Upvote

EleutherAI/LDS-retrain-bank-adamw-N4k-bs256

Viewer • Updated Aug 25 • 2k • 760
EleutherAI/LDS-retrain-bank-adamw-N8k-bs256

Viewer • Updated Aug 25 • 4.64k • 375
EleutherAI/LDS-retrain-bank-muon-N8k-bs256

Viewer • Updated Aug 25 • 2k • 338
EleutherAI/LDS-retrain-bank-adamw-N16k-bs256

Viewer • Updated Aug 25 • 3.2k • 680
EleutherAI/LDS-retrain-bank-adamw-N16k-bs256-scale0.25

Viewer • Updated Aug 25 • 2.9k • 666
EleutherAI/LDS-retrain-bank-muon-N4k-bs256

Viewer • Updated Aug 25 • 2k • 359
EleutherAI/LDS-retrain-bank-adamw-N16k-bs256-ep4

Viewer • Updated about 1 month ago • 4k • 507
EleutherAI/LDS-retrain-bank-adamw-N32k-bs256

Viewer • Updated about 1 month ago • 4k • 492
EleutherAI/LDS-retrain-bank-muon-N16k-bs16

Viewer • Updated about 1 month ago • 4k • 781
EleutherAI/LDS-retrain-bank-muon-N32k-bs256

Viewer • Updated about 1 month ago • 4k • 676
EleutherAI/LDS-retrain-bank-adamw-N16k-bs256-gpt2-medium

Viewer • Updated about 1 month ago • 4k • 487
EleutherAI/bergson-smollm2-lds-chunks

Viewer • Updated Jul 17 • 60.1k • 59
EleutherAI/bergson-smollm2-scaling

Viewer • Updated Aug 20 • 512k • 54
EleutherAI/LDS-retrain-bank-adamw-N16k-bs128

Viewer • Updated Aug 24 • 2k • 30
EleutherAI/LDS-retrain-bank-adamw-N16k-bs16

Viewer • Updated Aug 24 • 2k • 74
EleutherAI/LDS-retrain-bank-adamw-N16k-bs32

Viewer • Updated Aug 23 • 2k • 27
EleutherAI/LDS-retrain-bank-adamw-N16k-bs512

Viewer • Updated Aug 24 • 2k • 228
EleutherAI/LDS-retrain-bank-adamw-N16k-bs64

Viewer • Updated Aug 22 • 2k • 305
EleutherAI/LDS-retrain-bank-adamw-N16k-bs256-clip1.0

Viewer • Updated Aug 24 • 2.9k • 128
EleutherAI/LDS-retrain-bank-adamw-N16k-bs256-scale0.5

Viewer • Updated Aug 24 • 2.9k • 11
EleutherAI/LDS-retrain-bank-adamw-N16k-bs256-wd0.0

Viewer • Updated Aug 24 • 2.9k • 54
EleutherAI/LDS-retrain-bank-adamw-N16k-bs256-wd0.1

Viewer • Updated Aug 24 • 2.9k • 73
EleutherAI/LDS-retrain-bank-muon-N16k-bs128

Viewer • Updated Aug 22 • 2k • 691
EleutherAI/LDS-retrain-bank-muon-N16k-bs32

Viewer • Updated Aug 23 • 4k • 52
EleutherAI/LDS-retrain-bank-muon-N16k-bs64

Viewer • Updated Aug 24 • 2k • 17
EleutherAI/LDS-retrain-bank-muon-N16k-bs256

Viewer • Updated Aug 24 • 5.64k • 595
EleutherAI/LDS-retrain-bank-adamw-N64k-bs256

Viewer • Updated 27 days ago • 4.18k • 281
EleutherAI/bergson-wikitext-2-gpt2

Updated 10 days ago • 23
EleutherAI/LDS-retrain-bank-adamw-wikitext2-N4656-bs8-seed1004

Viewer • Updated 26 days ago • 89.9k • 910
EleutherAI/LDS-retrain-bank-adamw-wikitext2-N4656-bs8-seed1005

Viewer • Updated 26 days ago • 96.2k • 469
EleutherAI/LDS-retrain-bank-adamw-wikitext2-N4656-bs8-seed1006

Viewer • Updated 26 days ago • 96.2k • 893
EleutherAI/LDS-retrain-bank-adamw-wikitext2-N4656-bs8-seed1008

Viewer • Updated 26 days ago • 96.2k • 872
EleutherAI/LDS-retrain-bank-adamw-wikitext2-N4656-bs8-seed1007

Viewer • Updated 26 days ago • 96.2k • 957
EleutherAI/LDS-retrain-bank-london16k-bs256-muon

Viewer • Updated 23 days ago • 2k • 243
EleutherAI/PARTIAL_LDS-retrain-bank-muon-N64k-bs256

Updated 23 days ago • 641
EleutherAI/PARTIAL_LDS-retrain-bank-gpt2medium-16k-bs32

Viewer • Updated 23 days ago • 1.3k • 479
EleutherAI/pile-heldout-queries-2048

Updated 12 days ago • 70
EleutherAI/fineweb-heldout-queries-2048

Updated 12 days ago • 54
EleutherAI/bergson-wikitext-2-4656-chunks

Viewer • Updated Aug 2 • 5.14k • 83

Note Pre-tokenized WikiText-2 chunks for the Bae et al. 2024 SOURCE replication
EleutherAI/bergson-wikitext-gpt2-leaderboard

Updated 10 days ago • 11
EleutherAI/bergson-wikitext-gpt2-leaderboard-bank

Viewer • Updated 10 days ago • 11.3k • 180
EleutherAI/bergson-wikitext-512-chunks

Viewer • Updated Jul 8 • 4.86k • 342

Upvote