Models
Datasets
Spaces
Buckets new
Docs
Enterprise
Pricing
- Website
- Community
- Solutions
Log In
Sign Up

Collections

Discover the best community collections!

Collections including paper arxiv:2209.11895

250 Years of America, 250 Open AI Milestones

For the 250th birthday of the USA: the 250 most important American open models, datasets, papers and Spaces, ranked from #1 down. Happy 4th of July!

Attention Is All You Need

Paper • 1706.03762 • Published Jun 12, 2017 • 144
PyTorch: An Imperative Style, High-Performance Deep Learning Library

Paper • 1912.01703 • Published Dec 3, 2019 • 2
google-bert/bert-base-uncased

Fill-Mask • 0.1B • Updated Feb 19, 2024 • 38.5M • • 3.39k
openai-community/gpt2

Text Generation • 0.1B • Updated Feb 19, 2024 • 15.4M • 4.21k

Smarter LLMs Research

RARR: Researching and Revising What Language Models Say, Using Language Models

Paper • 2210.08726 • Published Oct 17, 2022 • 1
Hypothesis Search: Inductive Reasoning with Language Models

Paper • 2309.05660 • Published Sep 11, 2023 • 2
In-context Learning and Induction Heads

Paper • 2209.11895 • Published Sep 24, 2022 • 2
ReAct: Synergizing Reasoning and Acting in Language Models

Paper • 2210.03629 • Published Oct 6, 2022 • 38

Papers - ICL - Induction Head

What needs to go right for an induction head? A mechanistic study of in-context learning circuits and their formation

Paper • 2404.07129 • Published Apr 10, 2024 • 3
In-context Learning and Induction Heads

Paper • 2209.11895 • Published Sep 24, 2022 • 2
pyvene: A Library for Understanding and Improving PyTorch Models via Interventions

Paper • 2403.07809 • Published Mar 12, 2024 • 1

Papers - ICL - In-Context Learning

Pretraining Data Mixtures Enable Narrow Model Selection Capabilities in Transformer Models

Paper • 2311.00871 • Published Nov 1, 2023 • 3
Can large language models explore in-context?

Paper • 2403.15371 • Published Mar 22, 2024 • 31
Data Distributional Properties Drive Emergent In-Context Learning in Transformers

Paper • 2205.05055 • Published Apr 22, 2022 • 2
Long-context LLMs Struggle with Long In-context Learning

Paper • 2404.02060 • Published Apr 2, 2024 • 36

Papers - Emergent Properties - ICL - Induction Heads

Additional reading: https://transformer-circuits.pub/2021/framework/index.html

In-context Learning and Induction Heads

Paper • 2209.11895 • Published Sep 24, 2022 • 2
What needs to go right for an induction head? A mechanistic study of in-context learning circuits and their formation

Paper • 2404.07129 • Published Apr 10, 2024 • 3
pyvene: A Library for Understanding and Improving PyTorch Models via Interventions

Paper • 2403.07809 • Published Mar 12, 2024 • 1

Papers - ICL - Induction Circuit

Two layer induction heads

What needs to go right for an induction head? A mechanistic study of in-context learning circuits and their formation

Paper • 2404.07129 • Published Apr 10, 2024 • 3
In-context Learning and Induction Heads

Paper • 2209.11895 • Published Sep 24, 2022 • 2
pyvene: A Library for Understanding and Improving PyTorch Models via Interventions

Paper • 2403.07809 • Published Mar 12, 2024 • 1

Papers - Anthropic

Training LLMs over Neurally Compressed Text

Paper • 2404.03626 • Published Apr 4, 2024 • 22
In-context Learning and Induction Heads

Paper • 2209.11895 • Published Sep 24, 2022 • 2

250 Years of America, 250 Open AI Milestones

For the 250th birthday of the USA: the 250 most important American open models, datasets, papers and Spaces, ranked from #1 down. Happy 4th of July!

Attention Is All You Need

Paper • 1706.03762 • Published Jun 12, 2017 • 144
PyTorch: An Imperative Style, High-Performance Deep Learning Library

Paper • 1912.01703 • Published Dec 3, 2019 • 2
google-bert/bert-base-uncased

Fill-Mask • 0.1B • Updated Feb 19, 2024 • 38.5M • • 3.39k
openai-community/gpt2

Text Generation • 0.1B • Updated Feb 19, 2024 • 15.4M • 4.21k

Papers - Emergent Properties - ICL - Induction Heads

Additional reading: https://transformer-circuits.pub/2021/framework/index.html

In-context Learning and Induction Heads

Paper • 2209.11895 • Published Sep 24, 2022 • 2
What needs to go right for an induction head? A mechanistic study of in-context learning circuits and their formation

Paper • 2404.07129 • Published Apr 10, 2024 • 3
pyvene: A Library for Understanding and Improving PyTorch Models via Interventions

Paper • 2403.07809 • Published Mar 12, 2024 • 1

Smarter LLMs Research

RARR: Researching and Revising What Language Models Say, Using Language Models

Paper • 2210.08726 • Published Oct 17, 2022 • 1
Hypothesis Search: Inductive Reasoning with Language Models

Paper • 2309.05660 • Published Sep 11, 2023 • 2
In-context Learning and Induction Heads

Paper • 2209.11895 • Published Sep 24, 2022 • 2
ReAct: Synergizing Reasoning and Acting in Language Models

Paper • 2210.03629 • Published Oct 6, 2022 • 38

Papers - ICL - Induction Circuit

Two layer induction heads

What needs to go right for an induction head? A mechanistic study of in-context learning circuits and their formation

Paper • 2404.07129 • Published Apr 10, 2024 • 3
In-context Learning and Induction Heads

Paper • 2209.11895 • Published Sep 24, 2022 • 2
pyvene: A Library for Understanding and Improving PyTorch Models via Interventions

Paper • 2403.07809 • Published Mar 12, 2024 • 1

Papers - ICL - Induction Head

What needs to go right for an induction head? A mechanistic study of in-context learning circuits and their formation

Paper • 2404.07129 • Published Apr 10, 2024 • 3
In-context Learning and Induction Heads

Paper • 2209.11895 • Published Sep 24, 2022 • 2
pyvene: A Library for Understanding and Improving PyTorch Models via Interventions

Paper • 2403.07809 • Published Mar 12, 2024 • 1

Papers - Anthropic

Training LLMs over Neurally Compressed Text

Paper • 2404.03626 • Published Apr 4, 2024 • 22
In-context Learning and Induction Heads

Paper • 2209.11895 • Published Sep 24, 2022 • 2

Papers - ICL - In-Context Learning

Pretraining Data Mixtures Enable Narrow Model Selection Capabilities in Transformer Models

Paper • 2311.00871 • Published Nov 1, 2023 • 3
Can large language models explore in-context?

Paper • 2403.15371 • Published Mar 22, 2024 • 31
Data Distributional Properties Drive Emergent In-Context Learning in Transformers

Paper • 2205.05055 • Published Apr 22, 2022 • 2
Long-context LLMs Struggle with Long In-context Learning

Paper • 2404.02060 • Published Apr 2, 2024 • 36

Company

TOS Privacy About Careers

Website

Models Datasets Spaces Pricing Docs