Instructions to use HuggingFaceFW/fineweb-edu-classifier with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use HuggingFaceFW/fineweb-edu-classifier with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-classification", model="HuggingFaceFW/fineweb-edu-classifier")# Load model directly from transformers import AutoTokenizer, AutoModelForSequenceClassification tokenizer = AutoTokenizer.from_pretrained("HuggingFaceFW/fineweb-edu-classifier") model = AutoModelForSequenceClassification.from_pretrained("HuggingFaceFW/fineweb-edu-classifier") - Inference
- Notebooks
- Google Colab
- Kaggle
Add LICENSE file
#10 opened 6 months ago
by
jewittje
Handle Long Documents
#9 opened over 1 year ago
by
xinyu1205
classification or regression? how to choose.
2
#7 opened over 1 year ago
by
DaleMeng
Documents in fineweb dataset may exceed max context length of this classifier
1
#6 opened almost 2 years ago
by
ZefanW
Choice on pretrained model and fine-tuning.
2
#3 opened almost 2 years ago
by
Avditvs