Just a suggestion: How about we pretrain a common Scandinavian model instead, as our languages are so similar? I’ve made a project suggestion here: Scandinavian RoBERTa.
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| Scandinavian RoBERTa | 30 | 2190 | July 15, 2021 | |
| Pretrain RoBERTa-large from scratch in Finnish | 1 | 380 | June 29, 2021 | |
| RobIt : PreTrain RoBERTa-base from scratch in Italian | 4 | 523 | June 29, 2021 | |
| BERTIN: PreTrain RoBERTa-large from scratch in Spanish | 23 | 2153 | July 19, 2021 | |
| PreTrain RoBERTa from scratch in Portuguese | 16 | 2612 | October 4, 2021 |