Instructions to use mnaylor/psychbert-cased with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use mnaylor/psychbert-cased with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("fill-mask", model="mnaylor/psychbert-cased")# Load model directly from transformers import AutoTokenizer, AutoModelForMaskedLM tokenizer = AutoTokenizer.from_pretrained("mnaylor/psychbert-cased") model = AutoModelForMaskedLM.from_pretrained("mnaylor/psychbert-cased", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Mitch Naylor commited on
Commit ·
735ebaf
1
Parent(s): 9fdc17d
Update README.md
Browse files
README.md
CHANGED
|
@@ -1,7 +1,7 @@
|
|
| 1 |
# PsychBERT
|
| 2 |
This domain adapted language model is pretrained from the `bert-base-cased` checkpoint on masked language modeling, using a dataset of ~40,000 PubMed papers in the domain of psychology, psychiatry, mental health, and behavioral health; as well as a dastaset of roughly 200,000 social media conversations about mental health. This work is submitted as an entry for BIBM 2021.
|
| 3 |
|
| 4 |
-
**Note**: the widget
|
| 5 |
|
| 6 |
```
|
| 7 |
from transformers import FlaxAutoModelForMaskedLM, AutoModelForMaskedLM
|
|
|
|
| 1 |
# PsychBERT
|
| 2 |
This domain adapted language model is pretrained from the `bert-base-cased` checkpoint on masked language modeling, using a dataset of ~40,000 PubMed papers in the domain of psychology, psychiatry, mental health, and behavioral health; as well as a dastaset of roughly 200,000 social media conversations about mental health. This work is submitted as an entry for BIBM 2021.
|
| 3 |
|
| 4 |
+
**Note**: the token-prediction widget on this page does not work with Flax models. In order to use the model, please pull it into a Python session as follows:
|
| 5 |
|
| 6 |
```
|
| 7 |
from transformers import FlaxAutoModelForMaskedLM, AutoModelForMaskedLM
|