1. Distilled from Whisper Large V3 on Malaysian and Science context. 2. Better translation for Malay, Manglish, Mandarin, Tamil and Science context. 3. Word level timestamp, introduced ` ` token, **a new task!** 1. Finetune on mesolitica/Malaysian-STT-Whisper - Revision 267552e0f093068519a816112c2741939d057f48 - WanDB at https://wandb.ai/huseinzol05/malaysian-whisper-large-v3-turbo-v3 2. Stage 2, Annealing on 5% from mesolitica/Malaysian-STT-Whisper and 100% from mesolitica/Malaysian-STT-Whisper-Stage2 - Revision 5f6ca0596f01527ec2d013662cfc168d5f754461 - WanDB at https://wandb.ai/huseinzol05/malaysian-whisper-large-v3-turbo-v3-stage2 1. assembly.mp3
Trained on 1536 context length, able to translate malay, pasar malay (social media texts or local context), english, manglish, javanese, banjarese and indonesian to target language. It also able to maintain the text structure as it is and only translate necessary texts, eg, programming code. Added more coding translation dataset, noisy b.cari.com.my translation, noisy ChatGPT4 translation and heavy postfilter.
Finetuned https://huggingface.co/facebook/wav2vec2-xls-r-300m on https://github.com/huseinzol05/malaya-speech/tree/master/data/mixed-stt **This model trained on a single RTX 3090 Ti 24GB VRAM, provided by https://mesolitica.com/**. Evaluation set from https://github.com/huseinzol05/malaya-speech/tree/master/pretrained-model/prepare-stt with sizes,