I tried to add an extra dimension to the Huggingface pre-trained BERT tokenizer. The extra column represents the extra label. For example, if the original embedding of the word “dog” was [1,1,1,1,1,1,1], then I might add a special column with index 2 to represent ‘noun’. Thus, the new embedding beco…

How to concatenate the word embedding for special tokens and words

xuan4470 June 13, 2021, 8:00am 2

Topic		Replies	Views
How to train the embedding of special token? Intermediate	1	4296	October 17, 2021
Process to adding new tokens to a corpus and subsequently training the corresponding word embeddings Beginners	0	3811	April 21, 2021
Can we add extra word embedding to the BERT? Beginners	6	5347	August 15, 2022
How to concatenate additional features to the last layer of Bert 🤗Transformers	6	2656	January 14, 2024
Add per-word embedding from outer source to Bert embedding layer Beginners	0	343	January 14, 2024