I’m trying to train an ASR model using Transformers, Datasets and lightning. I want to use lightning as it will make it easier to train on my custom dataset. I have posted the code I’m using below as well as some loss curves and WER curves. I’ve trained on the librispeech dataset, only including u…

I used LearningRateFinder and it came back with an optimal learning rate of 6.3095734448019305e-06. It definitely feels like there is an error somewhere.

Anybody know what kind parameters you need to successfully train Wav2Vec like: Dataset size Utterance length (I’m using 5 seconds. Maybe you need much longer. I’m bound by my 12GB 1080Ti) Learning rate Optimizer (I’m using AdamW) Scheduler (I’m using CosineAnnealing) Number of epochs (200) Tokeniz…

Can't get Wav2Vec to converge

🤗Transformers

pfjf2 May 24, 2023, 8:14am 3

Wav2Vec2 WER remains 1.00 and return blank transcriptions looks related

Topic		Replies	Views
Wav2vec2 not converging when finetuning 🤗Transformers	7	2683	June 15, 2021
Why is Wav2Vec pretraining loss not decreasing? Models	10	2753	April 29, 2022
Finetuning Wav2Vec2 loss constant Beginners	1	351	August 14, 2023
Fine-tuning Wav2Vec2 for English ASR with 🤗 on local machine Transformers 🤗Transformers	1	476	August 10, 2021
Wav2Vec2: fix growing training and validation loss after few epochs Models	5	2320	January 27, 2022

Can't get Wav2Vec to converge

Related topics