Espnet Versions Save

End-to-End Speech Processing Toolkit

v.202402

2 months ago

News

We're thrilled to announce that our latest update brings two groundbreaking features to our project: espnetez and ESPnet-SPK!

New Features

[New Features][ESPnet2][ESPnet1][Installation][SE] Add diffusion-base SE model to ESPnet-SE #5572 by @LiChenda
[New Features][ESPnet2][ESPnet1][CI][ASR] Add Bayes Risk CTC (reworked) #5519 by @jctian98
[New Features][ESPnet2][TTS] TTS evaluation script and monitoring functionality using MOS prediction model #5485 by @Takaaki-Saeki
[New Features][ESPnet2][SE] Add USES model for speech enhancement in diverse conditions #5482 by @Emrys365
[New Features][ESPnet2][CI][SID] ESPnet-SPk: major update #5408 by @Jungjee
[New Features][ESPnet2][TTS][ASR] Add espnetez #5372 by @Masao-Someki

Enhancement

[Enhancement][ESPnet2][OWSM] Improving OWSM inference interface #5618 by @pyf98
[Enhancement][ESPnet2][OWSM] Add OWSM v3.1 #5611 by @pyf98
[Enhancement][ESPnet2][CI] ESPnet-SPK: Additional models, supplement readme #5559 by @Jungjee
[Enhancement][ESPnet2][CI][SE] Add PyTorch & GPU support for DNSMOS calculation #5548 by @Emrys365
[Enhancement][ESPnet2][TTS][SID] Speaker embedding extractor (with ESPnet pre-trained speaker model) #5579 by @ftshijt

Recipe

[Recipe][ESPnet2][Music] Fix relative setting of train-dev-test #5623 by @ftshijt
[Recipe][ESPnet2][SID] ESPnet-SPK: add Voxblink recipe #5583 by @Jungjee
[Recipe][ESPnet2][SID] ESPnet-SPK: Model upload and result generation #5558 by @Jungjee
[Recipe][ESPnet2][Music] ACE singer recipe fixing #5551 by @ftshijt
[Recipe][ESPnet2][TTS] TTS2 Template #5541 by @ftshijt
[Recipe][ESPnet2][ASR] fix kaldi dependency in asr2 #5540 by @ftshijt
[Recipe][ESPnet2][CI][S2ST] CI test for s2st #5526 by @ftshijt
[Recipe][ESPnet2][ASR] Added data.sh to SPRING-INX IITM Recipe #5522 by @arjun-gangwar
[Recipe][ESPnet2][ASR] Add Libriheavy small and medium ASR2 recipes #5512 by @akreal
[Recipe][ESPnet2][ASR] SPRING-INX IITM RECIPE #5505 by @arjun-gangwar
[Recipe][ESPnet2][ASR][RNNT] Add transducer conformer configuration to commonvoice recipe #5503 by @zuazo
[Recipe][ESPnet2][ESPnet1] add centralized data preparation for OWSM #5478 by @jctian98
[Recipe][ESPnet1] Added clean speech results #5649 by @linan2
[Recipe][ESPnet2][Installation][AV] AVSR recipe for Easycom Dataset #5630 by @ms-dot-k
[Recipe][ESPnet2] Update CHiME-7 ASR1 recipe #5555 by @popcornell
[Recipe][ESPnet2] Add E-Branchformer model checkpoint in OWSM v2 #5517 by @pyf98
[Recipe][ESPnet2][SLU] Slue PR configs #5087 by @siddhu001

Bugfix

[Bugfix][ESPnet2] Fix path dependency in ESPnet tutorial #5645 by @siddhu001
[Bugfix][ESPnet2] Fix ESPnet tutorial #5644 by @siddhu001
[Bugfix] Fix CI #5642 by @siddhu001
[Bugfix][ESPnet2] Fixed bug by copying missing Kaldi scripts #5636 by @VicentCano
[Bugfix][ESPnet1][ASR] CTC prefix score, fix if blank == eos #5620 by @albertz
[Bugfix][ESPnet2] Fix minor OWSM data prep bug #5607 by @juice500ml
[Bugfix][ESPnet2][ESPnet1][CI] E721 #5589 by @sw005320
[Bugfix][ESPnet2][ESPnet1] Make minlenratio effective #5581 by @jctian98
[Bugfix][ESPnet2] Fix except #5567 by @takenori-y
[Bugfix][ESPnet1][Installation][CI] Improve error robustness of unit tests #5535 by @Emrys365
[Bugfix][ESPnet2][AV] Fix bug in lrs3 data preprocessing #5520 by @ms-dot-k
[Bugfix][ESPnet1] replace old mustc links with new instructions #5516 by @brianyan918
[Bugfix][ESPnet2][ST] Fix s2st HF model uploading #5504 by @tjysdsg
[Bugfix][ESPnet2][ESPnet1] bug fixes for must_c v2 recipe #5640 by @jasonmusespresso

Documentation

[Documentation][ESPnet2] Add instructions for finetuning owsm #5539 by @pyf98
[Documentation] Updated the reference of the accepted JOSS paper #5515 by @neillu23

Others

[Others] Update Discord Invitation Link #5578 by @Fhrozen
[Others][ESPnet2][CI] Improve error robustness of unit tests #5523 by @Emrys365

Acknowledgements

Special thanks to @Emrys365, @Fhrozen, @Jungjee, @LiChenda, @Masao-Someki, @Takaaki-Saeki, @VicentCano, @akreal, @albertz, @arjun-gangwar, @brianyan918, @ftshijt, @jasonmusespresso, @jctian98, @juice500ml, @linan2, @ms-dot-k, @neillu23, @popcornell, @pyf98, @siddhu001, @sw005320, @takenori-y, @tjysdsg, @zuazo.

v.202310

6 months ago

What's Changed

Support arbitrary language finetune for Whisper models. by @pengchengguo in https://github.com/espnet/espnet/pull/5344
Update Dipco Data URL by @Fhrozen in https://github.com/espnet/espnet/pull/5391
Update readme in TEMPLATE/svs1 by @linyueqian in https://github.com/espnet/espnet/pull/5394
add gramvaani asr recipe by @bloodraven66 in https://github.com/espnet/espnet/pull/5366
ESPnet-SPK: sampler by @Jungjee in https://github.com/espnet/espnet/pull/5365
Adding general data augmentation methods for speech preprocessing by @Emrys365 in https://github.com/espnet/espnet/pull/5370
Update of several SE recipes and some minor fixes by @Emrys365 in https://github.com/espnet/espnet/pull/5401
Reproducing MIMOIRIS by @YoshikiMas in https://github.com/espnet/espnet/pull/5409
Kathbath asr by @bloodraven66 in https://github.com/espnet/espnet/pull/5369
Add pytorch2.0.1 to CI by @kamo-naoyuki in https://github.com/espnet/espnet/pull/5413
[skip ci] Update README.md by @kamo-naoyuki in https://github.com/espnet/espnet/pull/5417
In spec_augment.py, check whether an array is writeable before modifying it inplace by @mdecerbo in https://github.com/espnet/espnet/pull/5416
Docker updates for local builds by @Fhrozen in https://github.com/espnet/espnet/pull/5406
fix typo in TEMPLATE/svs1/README.md by @linyueqian in https://github.com/espnet/espnet/pull/5426
Update install_mwerSegmenter.sh by @sw005320 in https://github.com/espnet/espnet/pull/5437
Support Whisper-style training as a new task S2T by @pyf98 in https://github.com/espnet/espnet/pull/5120
fix twice numpy installation issue by @kan-bayashi in https://github.com/espnet/espnet/pull/5447
Add Whisper SOT recipe for Librimix by @LiChenda in https://github.com/espnet/espnet/pull/5371
Update for the JOSS paper editor review by @neillu23 in https://github.com/espnet/espnet/pull/5418
Add the VOiCES recipe for ASR by @Emrys365 in https://github.com/espnet/espnet/pull/5448
Improve diacritic compatibility in data_prep.pl preprocessing scripts by @zuazo in https://github.com/espnet/espnet/pull/5445
[WIP] create recipe for acesinger by @linyueqian in https://github.com/espnet/espnet/pull/5431
Add BibleTTS recipe by @wyh2000 in https://github.com/espnet/espnet/pull/5436
ASR2 CHiME4 & Gigaspeech Recipes by @yichen14 in https://github.com/espnet/espnet/pull/5434
[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/espnet/espnet/pull/5427
Simple fix to reduce test_slu_inference time by @siddhu001 in https://github.com/espnet/espnet/pull/5460
Do not use root logger in Beamsearch by @vsd-vector in https://github.com/espnet/espnet/pull/5454
Fix whisper test by @siddhu001 in https://github.com/espnet/espnet/pull/5464
Add doc for OWSM by @pyf98 in https://github.com/espnet/espnet/pull/5463
Speech-to-speech translation Task by @ftshijt in https://github.com/espnet/espnet/pull/4859
AVSR recipes on LRS3 using pre-trained AV-HuBERT model by @ms-dot-k in https://github.com/espnet/espnet/pull/5456
Support LoRA based large model finetuning. by @pengchengguo in https://github.com/espnet/espnet/pull/5400
Multilingual Librispeech (MLS) refactor ASR1 recipe by @juice500ml in https://github.com/espnet/espnet/pull/5323
Add phonemized LibriTTS ASR recipe by @akreal in https://github.com/espnet/espnet/pull/5466
Update the Enh framework to support training with variable numbers of speakers by @Emrys365 in https://github.com/espnet/espnet/pull/5414
speed up TFGridNet code by @zqwang7 in https://github.com/espnet/espnet/pull/5395
[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/espnet/espnet/pull/5468
ASR2 recipe on Tedlium3 dataset by @kohei0209 in https://github.com/espnet/espnet/pull/5331
Create README.md in OWSM v1 by @pyf98 in https://github.com/espnet/espnet/pull/5489
Update setup.py by @sw005320 in https://github.com/espnet/espnet/pull/5490
Fix default value in ML-SUPERB by @ftshijt in https://github.com/espnet/espnet/pull/5492
Fix bugs of Whisper SOT. by @pengchengguo in https://github.com/espnet/espnet/pull/5494
Multilingual Librispeech ASR2 + ASR1 baselines by @juice500ml in https://github.com/espnet/espnet/pull/5441
Add a new SE recipe combining five public corpora by @Emrys365 in https://github.com/espnet/espnet/pull/5484
Update .mergify.yml by @kamo-naoyuki in https://github.com/espnet/espnet/pull/5502
update version to 202310 by @kan-bayashi in https://github.com/espnet/espnet/pull/5501

New Contributors

@linyueqian made their first contribution in https://github.com/espnet/espnet/pull/5394
@mdecerbo made their first contribution in https://github.com/espnet/espnet/pull/5416
@zuazo made their first contribution in https://github.com/espnet/espnet/pull/5445
@wyh2000 made their first contribution in https://github.com/espnet/espnet/pull/5436
@yichen14 made their first contribution in https://github.com/espnet/espnet/pull/5434
@vsd-vector made their first contribution in https://github.com/espnet/espnet/pull/5454
@ms-dot-k made their first contribution in https://github.com/espnet/espnet/pull/5456
@juice500ml made their first contribution in https://github.com/espnet/espnet/pull/5323
@kohei0209 made their first contribution in https://github.com/espnet/espnet/pull/5331

Full Changelog: https://github.com/espnet/espnet/compare/v.202308...v.202310

v.202308

8 months ago

What's Changed

Update tutorial by @ftshijt in https://github.com/espnet/espnet/pull/4648
Update tutorials by @ftshijt in https://github.com/espnet/espnet/pull/4898
add e-branchformer result for tedlium3 and add checker for text output length by @Some-random in https://github.com/espnet/espnet/pull/5130
Limit the Numpy version (<1.24) to fix CI error temporarily. by @simpleoier in https://github.com/espnet/espnet/pull/5162
[SVS] Add new recipes by @A-Quarter-Mile in https://github.com/espnet/espnet/pull/5158
Update README.md of CHiME-7 DASR: fixing typos by @popcornell in https://github.com/espnet/espnet/pull/5166
Fix typo in CONTRIBUTING.md by @eltociear in https://github.com/espnet/espnet/pull/5167
CHiME-7 DASR: Update install_dependencies.sh, fix lhotse version by @popcornell in https://github.com/espnet/espnet/pull/5168
Update TD-SpeakerBeam by @Emrys365 in https://github.com/espnet/espnet/pull/5155
Add pre-trained causal speech separation model and streaming demo by @LiChenda in https://github.com/espnet/espnet/pull/5172
KSC recipe by @khassanoff in https://github.com/espnet/espnet/pull/5171
[SVS] Add new recipe by @A-Quarter-Mile in https://github.com/espnet/espnet/pull/5173
Update AphasiaBank Recipe by @tjysdsg in https://github.com/espnet/espnet/pull/5104
fix the gradient backward issue when joint training with s3prl frontend by @simpleoier in https://github.com/espnet/espnet/pull/5159
Add installer for ParallelWaveGAN by @ftshijt in https://github.com/espnet/espnet/pull/4052
[GAN SVS] Add VISinger2, UHifiGAN, Avocodo by @jerryuhoo in https://github.com/espnet/espnet/pull/5123
[SVS] Update docs README.md by @South-Twilight in https://github.com/espnet/espnet/pull/5178
Update SVS README.md by @jerryuhoo in https://github.com/espnet/espnet/pull/5180
Adding eendss models by @soumimaiti in https://github.com/espnet/espnet/pull/5157
2022fall new task tutorial by @ftshijt in https://github.com/espnet/espnet/pull/5186
[SVS] Updates for recipes by @A-Quarter-Mile in https://github.com/espnet/espnet/pull/5187
[GAN SVS] fix phoneme predictor by @jerryuhoo in https://github.com/espnet/espnet/pull/5188
Update generate_librimix_sd.sh by @leepeiying in https://github.com/espnet/espnet/pull/5182
Bug fix for #5195 by @YosukeHiguchi in https://github.com/espnet/espnet/pull/5196
[SVS] Update on recipes by @A-Quarter-Mile in https://github.com/espnet/espnet/pull/5197
Update preprocessor.py by @sw005320 in https://github.com/espnet/espnet/pull/5200
Minor fixes for ML-SUPERB by @ftshijt in https://github.com/espnet/espnet/pull/5202
Quick fix for whisper specaug by @siddhu001 in https://github.com/espnet/espnet/pull/5206
espnet-spk data preparation part by @Jungjee in https://github.com/espnet/espnet/pull/5184
Fix M4singer multi-spk recipe by @ftshijt in https://github.com/espnet/espnet/pull/5201
Update Dataset link for mlsuperb by @ftshijt in https://github.com/espnet/espnet/pull/5216
Fix bug when score_type is set to normal in ml_superb by @ftshijt in https://github.com/espnet/espnet/pull/5217
Add new functions and fix some bugs in SE by @Emrys365 in https://github.com/espnet/espnet/pull/5193
Update import order by @ftshijt in https://github.com/espnet/espnet/pull/5229
Closed CHiME-7 DASR adding evaluation inference + adding support to use diarization baseline "pre-computed" JSONs (new PR) by @popcornell in https://github.com/espnet/espnet/pull/5228
Standalone Transducer v1.1 by @b-flo in https://github.com/espnet/espnet/pull/5140
Small fixes for Transducer by @b-flo in https://github.com/espnet/espnet/pull/5247
add asr2 task and librispeech recipe as an example. by @simpleoier in https://github.com/espnet/espnet/pull/5181
fix norm compatibility in scale discriminator by @kan-bayashi in https://github.com/espnet/espnet/pull/5240
CFSD, SECS metrics for TTS by @imdanboy in https://github.com/espnet/espnet/pull/5235
Add new SE recipes: chime1/enh1, chime2/enh1, reverb/enh1, and wsj0_2mix/tse1 by @Emrys365 in https://github.com/espnet/espnet/pull/5246
Fix bugs in mfa_format.py by @G-Thor in https://github.com/espnet/espnet/pull/5223
New features for SVS by @ftshijt in https://github.com/espnet/espnet/pull/5245
re-fix norm compatibility in scale discriminator by @kan-bayashi in https://github.com/espnet/espnet/pull/5249
add conv1d subsampling 3 and egs2/librispeech/asr2 wavlm_large_21 kmeans (1000/2000) results by @simpleoier in https://github.com/espnet/espnet/pull/5252
Revise the ESPnet-SE++ Joss paper to incorporate the feedback from the reviewer. by @neillu23 in https://github.com/espnet/espnet/pull/5212
Fix a bug in score script for ML-SUPERB by @ftshijt in https://github.com/espnet/espnet/pull/5254
Refactor prep_segments in SVS by @jerryuhoo in https://github.com/espnet/espnet/pull/5210
A minor fix for num_splits_ssl for training by @ftshijt in https://github.com/espnet/espnet/pull/5262
[SVS] add singing tacotron by @A-Quarter-Mile in https://github.com/espnet/espnet/pull/5233
Add script to use speaker averaged xvectors in TTS training by @G-Thor in https://github.com/espnet/espnet/pull/5244
Fix filling of waveform_buffer with samples for streaming inference by @espnetUser in https://github.com/espnet/espnet/pull/5267
Some name update for ml-superb by @ftshijt in https://github.com/espnet/espnet/pull/5276
Add support for K2 pruned transducer loss by @b-flo in https://github.com/espnet/espnet/pull/5268
Fix Transducer doc by @b-flo in https://github.com/espnet/espnet/pull/5306
Update installation.md by @kamo-naoyuki in https://github.com/espnet/espnet/pull/5291
Update install_nkf.sh by @sw005320 in https://github.com/espnet/espnet/pull/5300
Fix Cython version to pass the installation of libraries with Cython by @kan-bayashi in https://github.com/espnet/espnet/pull/5310
Update README.md by @sw005320 in https://github.com/espnet/espnet/pull/5315
Update setup.py by @sw005320 in https://github.com/espnet/espnet/pull/5316
Migrate recipe for nit_song070 from Muskit by @wwwbxy123 in https://github.com/espnet/espnet/pull/5251
[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/espnet/espnet/pull/5294
A few updates for asr2 and hubert by @simpleoier in https://github.com/espnet/espnet/pull/5285
Add decode_options and hyp_cleaner in evaluate_whisper_inference by @pyf98 in https://github.com/espnet/espnet/pull/5272
update pyworld version by @kan-bayashi in https://github.com/espnet/espnet/pull/5319
fix a data preparation issue for librimix recipe. by @LiChenda in https://github.com/espnet/espnet/pull/5322
Update README.md in egs2/librimix/tse1 and egs2/wsj0_2mix/tse1 by @Emrys365 in https://github.com/espnet/espnet/pull/5289
fix the s3prl frontend gradient backprop bug, ensuring feature_grad_mult=1.0 by @simpleoier in https://github.com/espnet/espnet/pull/5297
ESPNet-SPK part 2 - training by @Jungjee in https://github.com/espnet/espnet/pull/5258
remove some tests in espnet1 integration test by @sw005320 in https://github.com/espnet/espnet/pull/5328
Fix random segments by @iamanigeeit in https://github.com/espnet/espnet/pull/5274
Skip CI for draft PR by @ftshijt in https://github.com/espnet/espnet/pull/5333
Update cancel.yml by @kan-bayashi in https://github.com/espnet/espnet/pull/5334
Update several SE recipes and bash scripts by @Emrys365 in https://github.com/espnet/espnet/pull/5327
Add PULL_REQUEST_TEMPLATE.md by @kan-bayashi in https://github.com/espnet/espnet/pull/5340
ESPnet-Spk part 3 - inference every epoch using EER by @Jungjee in https://github.com/espnet/espnet/pull/5314
Minimize espnet2 integration test by @kan-bayashi in https://github.com/espnet/espnet/pull/5324
PR Labels for CI control by @Fhrozen in https://github.com/espnet/espnet/pull/5320
Split ci into several jobs by @kan-bayashi in https://github.com/espnet/espnet/pull/5343
Update CONTRIBUTING.md by @sw005320 in https://github.com/espnet/espnet/pull/5335
Update Scoring for Speech Summarization from NLG-Eval to Huggingface Evaluate by @roshansh-cmu in https://github.com/espnet/espnet/pull/5341
Fix documentation skip CI by @Fhrozen in https://github.com/espnet/espnet/pull/5351
Update the usage by @sw005320 in https://github.com/espnet/espnet/pull/5349
Docker Update by @Fhrozen in https://github.com/espnet/espnet/pull/5321
Update installation.md by @sw005320 in https://github.com/espnet/espnet/pull/5348
Fix doc condition by @kan-bayashi in https://github.com/espnet/espnet/pull/5355
Update issue templates by @sw005320 in https://github.com/espnet/espnet/pull/5357
Update Contribution.md by @Fhrozen in https://github.com/espnet/espnet/pull/5352
Fix .mergify condition by @kan-bayashi in https://github.com/espnet/espnet/pull/5354
Reduce ffmpeg installation time in ci by @kan-bayashi in https://github.com/espnet/espnet/pull/5356
Update CI table by @kan-bayashi in https://github.com/espnet/espnet/pull/5359
Clean workflow files by @kan-bayashi in https://github.com/espnet/espnet/pull/5360
Couple of tweaks for asr2.sh for the HF hub upload by @akreal in https://github.com/espnet/espnet/pull/5362
Update TEMPLATE_HF_Readme.md (fix bash typo) by @akreal in https://github.com/espnet/espnet/pull/5361
Add discrete-token ASR for LibriSpeech 100h by @akreal in https://github.com/espnet/espnet/pull/5350
Whisper fine-tuning recipes for CHiME-4 and WSJ by @YoshikiMas in https://github.com/espnet/espnet/pull/5342
Fix bug in ngram training in slu.sh by @siddhu001 in https://github.com/espnet/espnet/pull/5364
Add musdb18 recipe for music source separation by @Emrys365 in https://github.com/espnet/espnet/pull/5338
Bugfix: JETS CTCLoss by @imdanboy in https://github.com/espnet/espnet/pull/5288
Check the value of n_shift == upsample_factor in GAN_TTS by @imdanboy in https://github.com/espnet/espnet/pull/5299
MFA format fix by @iamanigeeit in https://github.com/espnet/espnet/pull/5275
add --num-workers 0 option to enable coverage to truck data loader by @kan-bayashi in https://github.com/espnet/espnet/pull/5368
ESPnet-SPK: fix data augment by @Jungjee in https://github.com/espnet/espnet/pull/5347
A few minor fixes for SSL by @ftshijt in https://github.com/espnet/espnet/pull/5265
remove unused file + small typo/style by @b-flo in https://github.com/espnet/espnet/pull/5346
ESPnet-SPK: EER validation efficiency improvement by @Jungjee in https://github.com/espnet/espnet/pull/5358
New Architectures for ST by @brianyan918 in https://github.com/espnet/espnet/pull/4815
[SVS] Add CI test by @A-Quarter-Mile in https://github.com/espnet/espnet/pull/5269
Add causal LM to Hugging Face Transformers Decoder by @akreal in https://github.com/espnet/espnet/pull/5313
Make make_pad_mask onnx convertible by @Masao-Someki in https://github.com/espnet/espnet/pull/5326
fix numerical error of parallel wavegan compatibility test in CI by @kan-bayashi in https://github.com/espnet/espnet/pull/5380
Add LibriTTS-R recipe by @ShigekiKarita in https://github.com/espnet/espnet/pull/5379
minor fix: correct wrong comments by @imdanboy in https://github.com/espnet/espnet/pull/5378
Add quotation marks to install_datasets.sh by @qmeeus in https://github.com/espnet/espnet/pull/5387

New Contributors

@khassanoff made their first contribution in https://github.com/espnet/espnet/pull/5171
@leepeiying made their first contribution in https://github.com/espnet/espnet/pull/5182
@Jungjee made their first contribution in https://github.com/espnet/espnet/pull/5184
@wwwbxy123 made their first contribution in https://github.com/espnet/espnet/pull/5251

Full Changelog: https://github.com/espnet/espnet/compare/v.202304...v.202308

v.202304

11 months ago

What's Changed

Update collect stats stage so that less memory cost in Utt_mvn by @simpleoier in https://github.com/espnet/espnet/pull/4888
Apply the latest black by @kamo-naoyuki in https://github.com/espnet/espnet/pull/4907
Add pytorch=1.13.1 to CI configuration by @kamo-naoyuki in https://github.com/espnet/espnet/pull/4906
How2 fix README, incorrect url by @roshansh-cmu in https://github.com/espnet/espnet/pull/4902
standardized inference and number of iterations for mSuperb single lang track by @DanBerrebbi in https://github.com/espnet/espnet/pull/4905
Fix typo in lrs/README.md by @eltociear in https://github.com/espnet/espnet/pull/4911
MSUPERB setting update by @ftshijt in https://github.com/espnet/espnet/pull/4913
Update test_import.yaml to install numba by @kamo-naoyuki in https://github.com/espnet/espnet/pull/4918
update pyopenjtalk version to 0.3.0 by @kan-bayashi in https://github.com/espnet/espnet/pull/4912
CHiME-7 Task1 recipe by @popcornell in https://github.com/espnet/espnet/pull/4894
Update CHiME-7 Task 1 README.md by @popcornell in https://github.com/espnet/espnet/pull/4920
Use native CPU version of STFT on newer pytorch versions, fix librosa window size < ftt by @bmilde in https://github.com/espnet/espnet/pull/4922
Add few shot subset for mSuperb multilingual setting by @guapaQAQ in https://github.com/espnet/espnet/pull/4923
Fix existing bugs in the TSE task by @Emrys365 in https://github.com/espnet/espnet/pull/4915
IAM OCR recipe updates by @kenzheng99 in https://github.com/espnet/espnet/pull/4927
Fixing some issues with chime7-task1 baseline by @popcornell in https://github.com/espnet/espnet/pull/4925
set default none decoder for ASR by @ftshijt in https://github.com/espnet/espnet/pull/4917
Update inference and training setting for mSuperb multilingual model by @guapaQAQ in https://github.com/espnet/espnet/pull/4932
Add E-Branchformer Transducer results by @pyf98 in https://github.com/espnet/espnet/pull/4933
add tf-gridnet by @zqwang7 in https://github.com/espnet/espnet/pull/4864
Fixes + Channel Selection for CHiME-7 Task by @popcornell in https://github.com/espnet/espnet/pull/4934
fix extracted feature dummy generation by @roshansh-cmu in https://github.com/espnet/espnet/pull/4926
Fix device mismatch error in GPU decoding with PyTorch 1.13 by @pyf98 in https://github.com/espnet/espnet/pull/4941
CHiME-7 DASR MD5 checksum fix for mixer6/train_call by @popcornell in https://github.com/espnet/espnet/pull/4942
Update show_asr_result.sh by @kamo-naoyuki in https://github.com/espnet/espnet/pull/4943
CHiME-7 DASR correct development results by @popcornell in https://github.com/espnet/espnet/pull/4946
Fix 'floordiv is deprecated' warnings by @fujimotos in https://github.com/espnet/espnet/pull/4945
Added WSLII installation instruction by @sw005320 in https://github.com/espnet/espnet/pull/4949
Update Muskits by @A-Quarter-Mile in https://github.com/espnet/espnet/pull/4931
Set a longer time execution threshold for related failed time-outs CI by @ftshijt in https://github.com/espnet/espnet/pull/4962
Modify data prep for mSUPERB multilingual by @guapaQAQ in https://github.com/espnet/espnet/pull/4965
Add E-Branchformer results in some recipes by @pyf98 in https://github.com/espnet/espnet/pull/4958
Add 'six' as a required Python module by @fujimotos in https://github.com/espnet/espnet/pull/4964
add msuperb linguistic analysis by @hhhaaahhhaa in https://github.com/espnet/espnet/pull/4938
Fix a 'ref_channel'-related issue in espnet2/bin/enh_inference.py by @Emrys365 in https://github.com/espnet/espnet/pull/4972
Add E-Branchformer results in slurp_entity by @pyf98 in https://github.com/espnet/espnet/pull/4971
Add Conformer and E-Branchformer results in fisher_spanish_callhome ASR by @pyf98 in https://github.com/espnet/espnet/pull/4976
[SVS] Add Joint-training by @A-Quarter-Mile in https://github.com/espnet/espnet/pull/4977
Update the chunk iterator for the TSE task by @Emrys365 in https://github.com/espnet/espnet/pull/4929
update msuperb LID scoring script by @hhhaaahhhaa in https://github.com/espnet/espnet/pull/4979
add multilingual+lid lid score generation by @hhhaaahhhaa in https://github.com/espnet/espnet/pull/4982
Add python=3.10 to CI by @kamo-naoyuki in https://github.com/espnet/espnet/pull/4627
LID score v2 by @hhhaaahhhaa in https://github.com/espnet/espnet/pull/4983
Fix ci by @kamo-naoyuki in https://github.com/espnet/espnet/pull/4985
Change to use Ubuntu-latest instead of Ubuntu-18.04 in CI by @kamo-naoyuki in https://github.com/espnet/espnet/pull/4986
Remove six by @kamo-naoyuki in https://github.com/espnet/espnet/pull/4988
Modify format_wav_scp.py to support PCM of uint8, int32, float32, float64, etc. by @kamo-naoyuki in https://github.com/espnet/espnet/pull/4997
Fix Whisper tokenizer CI error by @slSeanWU in https://github.com/espnet/espnet/pull/5004
fix s3prl upstream attribute bug by @jwrh in https://github.com/espnet/espnet/pull/5003
[Recipe] Add iwslt22 low resource speech translation task for egs2 by @freddy5566 in https://github.com/espnet/espnet/pull/4994
Fix typeguard version by @silvanocerza in https://github.com/espnet/espnet/pull/5009
Add .pre-commit-config.yaml by @kamo-naoyuki in https://github.com/espnet/espnet/pull/5011
Copy Kaldi utils/steps/sid and add a new github action to check the consistency by @kamo-naoyuki in https://github.com/espnet/espnet/pull/4998
Modfiy .pre-commit-config.yaml by @kamo-naoyuki in https://github.com/espnet/espnet/pull/5012
Modify .pre-commit-config.yaml by @kamo-naoyuki in https://github.com/espnet/espnet/pull/5014
Modify .pre-commit-config.yaml by @kamo-naoyuki in https://github.com/espnet/espnet/pull/5015
[Tuning] iwslt22 low-resource ST decode configuration tuning by @freddy5566 in https://github.com/espnet/espnet/pull/5019
Modify asr.sh by @kamo-naoyuki in https://github.com/espnet/espnet/pull/5020
[SVS] Improve visinger by @jerryuhoo in https://github.com/espnet/espnet/pull/5022
Use scripts/utils/print_args.sh instead of pyscripts/utils/print_args.py by @kamo-naoyuki in https://github.com/espnet/espnet/pull/5025
Add docstring in extra_path.sh by @kamo-naoyuki in https://github.com/espnet/espnet/pull/5028
Update installation.md by @kamo-naoyuki in https://github.com/espnet/espnet/pull/5029
Update README.md by @kamo-naoyuki in https://github.com/espnet/espnet/pull/5030
Update README.md by @kamo-naoyuki in https://github.com/espnet/espnet/pull/5031
Change bc to python by @kamo-naoyuki in https://github.com/espnet/espnet/pull/5032
Update tools/Makefile and path.sh by @kamo-naoyuki in https://github.com/espnet/espnet/pull/5027
Fix for format_wav_scp.py by @kamo-naoyuki in https://github.com/espnet/espnet/pull/5038
Add execute permission to install_ice_g2p.sh by @kamo-naoyuki in https://github.com/espnet/espnet/pull/5040
Bug fix of #5025 by @kamo-naoyuki in https://github.com/espnet/espnet/pull/5039
[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/espnet/espnet/pull/5041
Update README.md by @kamo-naoyuki in https://github.com/espnet/espnet/pull/5042
Update README.md by @kamo-naoyuki in https://github.com/espnet/espnet/pull/5043
Update README.md by @kamo-naoyuki in https://github.com/espnet/espnet/pull/5045
Fix in gen_task1_data.sh from CHiME7 by @boeddeker in https://github.com/espnet/espnet/pull/4953
Update README.md by @eml914 in https://github.com/espnet/espnet/pull/5044
Add installers/install_ffmpeg.sh by @kamo-naoyuki in https://github.com/espnet/espnet/pull/5046
Fix broken links reported by #5048 by @ShigekiKarita in https://github.com/espnet/espnet/pull/5050
fix: resolve upgrade issues with praatio 6.0; lock praatio version by @timmahrt in https://github.com/espnet/espnet/pull/4978
Add miniconda in gitignore by @pyf98 in https://github.com/espnet/espnet/pull/5052
CHiME-7 DASR fixes from participants feedback by @popcornell in https://github.com/espnet/espnet/pull/4999
Fix the condition for maxlen warning in beam search by @pyf98 in https://github.com/espnet/espnet/pull/5055
Fixed SQLalchemy version for MFA by @Fhrozen in https://github.com/espnet/espnet/pull/5059
Support Multi-Blank Transducer in Espnet2 by @jctian98 in https://github.com/espnet/espnet/pull/4876
Fix chime7 DASR task1 run.sh by @kamo-naoyuki in https://github.com/espnet/espnet/pull/5060
CHiME-7 DASR recipe, fix display bug for scenario-wide DER and JER by @popcornell in https://github.com/espnet/espnet/pull/5061
Add test_format_wav_scp_sh.bats by @kamo-naoyuki in https://github.com/espnet/espnet/pull/5062
Update documentation by @kamo-naoyuki in https://github.com/espnet/espnet/pull/5063
Support SOT training on LibriMix data. by @pengchengguo in https://github.com/espnet/espnet/pull/4861
Update check_install.py by @kamo-naoyuki in https://github.com/espnet/espnet/pull/5066
Tedlium3 recipe by @Some-random in https://github.com/espnet/espnet/pull/5068
Bug Fix: pretrained s3prl-frontend based models loaded with parameters key mismatch error by @simpleoier in https://github.com/espnet/espnet/pull/5074
Mechanism for multi channels input using multi columns wav.scp by @kamo-naoyuki in https://github.com/espnet/espnet/pull/5075
Clean ML-SUPERB by @ftshijt in https://github.com/espnet/espnet/pull/5067
CHiME-7 DASR: first diarization system based on Pyannote. by @popcornell in https://github.com/espnet/espnet/pull/5054
Chime7-task1 diarization (updated results) by @popcornell in https://github.com/espnet/espnet/pull/5088
Add InterCTC to E-Branchformer encoder, and the ability to save InterCTC inference output to files by @tjysdsg in https://github.com/espnet/espnet/pull/5084
[SVS] Bug fix: sample rate by @A-Quarter-Mile in https://github.com/espnet/espnet/pull/5094
[SVS] Extend SingingGenerate by @A-Quarter-Mile in https://github.com/espnet/espnet/pull/5100
[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/espnet/espnet/pull/5080
Add kaldi steps/libs by @kamo-naoyuki in https://github.com/espnet/espnet/pull/5106
Fix sentencepice version to v0.1.97 by @kamo-naoyuki in https://github.com/espnet/espnet/pull/5107
Drop PyTorch<=1.9 by @kamo-naoyuki in https://github.com/espnet/espnet/pull/5111
Update installers/install_kenlm.sh by @kamo-naoyuki in https://github.com/espnet/espnet/pull/5110
Merge */{scripts,pyscripts} into asr1/{scripts,pyscripts} by @kamo-naoyuki in https://github.com/espnet/espnet/pull/5109
Update ReazonSpeech training recipe for v1.1.0 by @fujimotos in https://github.com/espnet/espnet/pull/5114
Fix typo in espnet2_format_wav_scp.md by @boeddeker in https://github.com/espnet/espnet/pull/5116
Dtype for Speechbrain by @Fhrozen in https://github.com/espnet/espnet/pull/5112
Add test of soundfile for Makefile by @kamo-naoyuki in https://github.com/espnet/espnet/pull/5119
Add lm_inference for conditional text generation by @pyf98 in https://github.com/espnet/espnet/pull/5122
CHiME-7 diarization (updated README.md) by @popcornell in https://github.com/espnet/espnet/pull/5102
[WIP] Update Docker by @Fhrozen in https://github.com/espnet/espnet/pull/5128
Fix several bugs and improve function design in SE by @Emrys365 in https://github.com/espnet/espnet/pull/5103
[SVS] Update XiaoiceSing by @A-Quarter-Mile in https://github.com/espnet/espnet/pull/5124
Add missing filter_scps scripts and note about kaldi for diarization example of mini_librispeech by @toto6038 in https://github.com/espnet/espnet/pull/5139
Bump up the debian version to 11 by @kamo-naoyuki in https://github.com/espnet/espnet/pull/5144
Bug fixing and improvement in SE functions by @Emrys365 in https://github.com/espnet/espnet/pull/5143
Add data augmentation to ReazonSpeech recipe by @fujimotos in https://github.com/espnet/espnet/pull/5127
Update error calculator for transducer by @aky15 in https://github.com/espnet/espnet/pull/5097
Add streaming speech enhancemnt inference. by @LiChenda in https://github.com/espnet/espnet/pull/5049
Update README.md about debian by @sw005320 in https://github.com/espnet/espnet/pull/5146
Fix issues in split scps by @pyf98 in https://github.com/espnet/espnet/pull/5138
fix 5148 by @kamo-naoyuki in https://github.com/espnet/espnet/pull/5149
fix format_wav_scp.py by @kamo-naoyuki in https://github.com/espnet/espnet/pull/5150
Add more stats to the training log by @Emrys365 in https://github.com/espnet/espnet/pull/5147
update version to 202304 by @kan-bayashi in https://github.com/espnet/espnet/pull/5151

New Contributors

@bmilde made their first contribution in https://github.com/espnet/espnet/pull/4922
@guapaQAQ made their first contribution in https://github.com/espnet/espnet/pull/4923
@zqwang7 made their first contribution in https://github.com/espnet/espnet/pull/4864
@hhhaaahhhaa made their first contribution in https://github.com/espnet/espnet/pull/4938
@jwrh made their first contribution in https://github.com/espnet/espnet/pull/5003
@freddy5566 made their first contribution in https://github.com/espnet/espnet/pull/4994
@silvanocerza made their first contribution in https://github.com/espnet/espnet/pull/5009
@pre-commit-ci made their first contribution in https://github.com/espnet/espnet/pull/5041
@boeddeker made their first contribution in https://github.com/espnet/espnet/pull/4953
@timmahrt made their first contribution in https://github.com/espnet/espnet/pull/4978
@Some-random made their first contribution in https://github.com/espnet/espnet/pull/5068
@toto6038 made their first contribution in https://github.com/espnet/espnet/pull/5139

Full Changelog: https://github.com/espnet/espnet/compare/v.202301...v.202304

v.202301

1 year ago

What's Changed

Initialize VISinger branch by @ftshijt in https://github.com/espnet/espnet/pull/4683
Update VISInger branch by @ftshijt in https://github.com/espnet/espnet/pull/4705
Update UASR branch with latest ESPnet functions by @ftshijt in https://github.com/espnet/espnet/pull/4752
Update uasr by @ftshijt in https://github.com/espnet/espnet/pull/4770
Shell scripts for UASR processing by @ftshijt in https://github.com/espnet/espnet/pull/4769
Uasr python scripts by @DongjiGao in https://github.com/espnet/espnet/pull/4791
Update visinger by @ftshijt in https://github.com/espnet/espnet/pull/4818
Update test_custom_transducer.py by @sw005320 in https://github.com/espnet/espnet/pull/4826
Update asr.sh by @sw005320 in https://github.com/espnet/espnet/pull/4827
Fixed pad mode for librosa.stft by @Masao-Someki in https://github.com/espnet/espnet/pull/4832
Add E-Branchformer models in some recipes by @pyf98 in https://github.com/espnet/espnet/pull/4833
Fix data prep in GigaSpeech by @pyf98 in https://github.com/espnet/espnet/pull/4836
time sync decoding for asr by @brianyan918 in https://github.com/espnet/espnet/pull/4792
Remove duplicated VOXFORGE in db.sh (line81 and line157) by @pyf98 in https://github.com/espnet/espnet/pull/4840
Fix argument parsing for non_linguistic_symbols in asr.sh by @pyf98 in https://github.com/espnet/espnet/pull/4841
Add a warning statement when the hypo length equals to the max out length. by @pengchengguo in https://github.com/espnet/espnet/pull/4843
Add target speaker extraction (TSE) functions by @Emrys365 in https://github.com/espnet/espnet/pull/4823
Multilingual superb by @ftshijt in https://github.com/espnet/espnet/pull/4824
VISinger by @jerryuhoo in https://github.com/espnet/espnet/pull/4689
Update VISInger to latest by @ftshijt in https://github.com/espnet/espnet/pull/4849
VISinger for singing voice synthesis by @ftshijt in https://github.com/espnet/espnet/pull/4848
Reduce word counts for ESPnet-SE++ Joss paper by @neillu23 in https://github.com/espnet/espnet/pull/4844
Add E-Branchformer configs and models in ASR recipes by @pyf98 in https://github.com/espnet/espnet/pull/4837
Address Muskits updates on README by @ftshijt in https://github.com/espnet/espnet/pull/4850
Minor fix for MSUPERB recipe by @ftshijt in https://github.com/espnet/espnet/pull/4851
Update for the latest changes in the draft (minor changes) by @neillu23 in https://github.com/espnet/espnet/pull/4852
Add E-Branchformer results on Librispeech by @kkim-asapp in https://github.com/espnet/espnet/pull/4856
Update hubert implementation. by @simpleoier in https://github.com/espnet/espnet/pull/4747
VISinger unit test by @jerryuhoo in https://github.com/espnet/espnet/pull/4855
Minor fix to commonvoice espnet1 by @ftshijt in https://github.com/espnet/espnet/pull/4862
[WIP] Add S4 decoder in ESPnet2 by @m-koichi in https://github.com/espnet/espnet/pull/4845
Update hubert feature and acknowledge information in related Readmes. by @simpleoier in https://github.com/espnet/espnet/pull/4863
Generating MFA aligments by @Fhrozen in https://github.com/espnet/espnet/pull/4803
[WIP] EURO uasr scripts by @DongjiGao in https://github.com/espnet/espnet/pull/4846
Update README.md related to ASR architecture by @m-koichi in https://github.com/espnet/espnet/pull/4865
Minor fix to librimix diar recipe by @ftshijt in https://github.com/espnet/espnet/pull/4867
Add Full Whisper Model for Finetuning by @slSeanWU in https://github.com/espnet/espnet/pull/4793
Add torchaudio version check for HuBERT pretraining by @simpleoier in https://github.com/espnet/espnet/pull/4872
add k2 decoder related scripts for EURO by @DongjiGao in https://github.com/espnet/espnet/pull/4868
EURO: small fix (temporarily remove support for nbest_rescoring) by @DongjiGao in https://github.com/espnet/espnet/pull/4875
Add description for Whisper ASR in homepage readme by @slSeanWU in https://github.com/espnet/espnet/pull/4877
Update README.md by @eltociear in https://github.com/espnet/espnet/pull/4879
add explanations to text tokenizing related scripts and remove unused script by @DongjiGao in https://github.com/espnet/espnet/pull/4880
update information about source and our modification for k2 related scripts by @DongjiGao in https://github.com/espnet/espnet/pull/4881
AphasiaBank ASR recipe by @tjysdsg in https://github.com/espnet/espnet/pull/4860
Multilingual SUPERB update by @ftshijt in https://github.com/espnet/espnet/pull/4878
ESPnet Unsupervised ASR (EURO project) by @ftshijt in https://github.com/espnet/espnet/pull/4774
Support ProDiff in TTS by @Fhrozen in https://github.com/espnet/espnet/pull/4808
Add E-Branchformer for GigaSpeech by @pyf98 in https://github.com/espnet/espnet/pull/4882
FLEURS - Auxillary CTC conditioning tasks by @wanchichen in https://github.com/espnet/espnet/pull/4756
Add python 3.8 requirement for Whisper & update tests by @slSeanWU in https://github.com/espnet/espnet/pull/4891
Update some ASR results in the main readme file by @pyf98 in https://github.com/espnet/espnet/pull/4883
Add Conv2dSubsampling1 module and test it in AphasiaBank ASR recipe by @tjysdsg in https://github.com/espnet/espnet/pull/4892
Support x-vector extractor based on RawNet by @Takaaki-Saeki in https://github.com/espnet/espnet/pull/4884
single language track setups by @DanBerrebbi in https://github.com/espnet/espnet/pull/4895
fixing bug deu1 by @DanBerrebbi in https://github.com/espnet/espnet/pull/4900
Fix dataprep issues based on updated data release via Google form by @roshansh-cmu in https://github.com/espnet/espnet/pull/4899
Add a new EGS2 recipe 'reazonspeech' by @fujimotos in https://github.com/espnet/espnet/pull/4885
Update version to 202301 by @kan-bayashi in https://github.com/espnet/espnet/pull/4901

New Contributors

@DongjiGao made their first contribution in https://github.com/espnet/espnet/pull/4791
@jerryuhoo made their first contribution in https://github.com/espnet/espnet/pull/4689
@m-koichi made their first contribution in https://github.com/espnet/espnet/pull/4845
@fujimotos made their first contribution in https://github.com/espnet/espnet/pull/4885

Full Changelog: https://github.com/espnet/espnet/compare/v.202211...v.202301

v.202211

1 year ago

What's Changed

Update muskits update by @ftshijt in https://github.com/espnet/espnet/pull/4616
Muskit installation by @A-Quarter-Mile in https://github.com/espnet/espnet/pull/4617
Sync Muskits branch with Master by @ftshijt in https://github.com/espnet/espnet/pull/4640
Updates on Muskit Migration by @A-Quarter-Mile in https://github.com/espnet/espnet/pull/4631
Update Muskits branch by @ftshijt in https://github.com/espnet/espnet/pull/4662
Add stage 5 & stage 6 by @A-Quarter-Mile in https://github.com/espnet/espnet/pull/4649
Muskit: rename & reorganize features by @A-Quarter-Mile in https://github.com/espnet/espnet/pull/4668
Update Muskits branch by @ftshijt in https://github.com/espnet/espnet/pull/4671
Muskits CI fixing by @ftshijt in https://github.com/espnet/espnet/pull/4672
Muskits CI fix by @ftshijt in https://github.com/espnet/espnet/pull/4673
Muskits - apply isort by @ftshijt in https://github.com/espnet/espnet/pull/4677
Muskits CI fix by @ftshijt in https://github.com/espnet/espnet/pull/4678
Muskit: Add tokenizer by @A-Quarter-Mile in https://github.com/espnet/espnet/pull/4676
Muskits - various fix for CI test by @ftshijt in https://github.com/espnet/espnet/pull/4679
Muskit: add recipe ofuton by @A-Quarter-Mile in https://github.com/espnet/espnet/pull/4681
Muskits (CI fix) by @ftshijt in https://github.com/espnet/espnet/pull/4682
Fix CI issue in muskits by @ftshijt in https://github.com/espnet/espnet/pull/4687
Add dns_icassp22 Speech Enhancement Recipe by @slSeanWU in https://github.com/espnet/espnet/pull/4657
Singing Voice Synthesis Task for ESPnet by @ftshijt in https://github.com/espnet/espnet/pull/4670
Documentation of Tutorial and Muskits by @ftshijt in https://github.com/espnet/espnet/pull/4692
Add tests on MacOS and Windows (only installation) by @kamo-naoyuki in https://github.com/espnet/espnet/pull/4669
Add missing entries in readme by @ftshijt in https://github.com/espnet/espnet/pull/4699
Support ST without texts in source language by @sophia1488 in https://github.com/espnet/espnet/pull/4688
Update ConvInput for Transducer by @b-flo in https://github.com/espnet/espnet/pull/4720
Small changes for standalone Transducer by @b-flo in https://github.com/espnet/espnet/pull/4722
Fix input block tutorial documentation for Transducer by @b-flo in https://github.com/espnet/espnet/pull/4724
Fix HF Pytest Errors by @siddhu001 in https://github.com/espnet/espnet/pull/4737
Update to puebla-nahuatl recipe (some minor fixes) by @ftshijt in https://github.com/espnet/espnet/pull/4713
Add espnet2 TTS recipe on M-AILABS by @Takaaki-Saeki in https://github.com/espnet/espnet/pull/4701
Update outdated enh config files by @Emrys365 in https://github.com/espnet/espnet/pull/4719
add src_sos & src_eos for mt task to address the index out of range w… by @simpleoier in https://github.com/espnet/espnet/pull/4736
Add g2pk_explicit_space tokenizer by @jonghwanhyeon in https://github.com/espnet/espnet/pull/4718
Fix JETS inference with GST (#4743) by @kan-bayashi in https://github.com/espnet/espnet/pull/4744
Update on Muskit by @A-Quarter-Mile in https://github.com/espnet/espnet/pull/4700
add fleurs conformer+sc-ctc results by @wanchichen in https://github.com/espnet/espnet/pull/4746
Add recipe for OCR task on IAM handwriting dataset by @kenzheng99 in https://github.com/espnet/espnet/pull/4707
Add Talromur2 recipe by @G-Thor in https://github.com/espnet/espnet/pull/4680
Add multi-channel enh_asr for CHiME-4 by @YoshikiMas in https://github.com/espnet/espnet/pull/4706
chunk_mask error by @aky15 in https://github.com/espnet/espnet/pull/4751
fix wav2vec2 encoder mask bug by @simpleoier in https://github.com/espnet/espnet/pull/4772
Add Hugging Face Transformers Decoder, Tokenizer and their example on SLURP by @akreal in https://github.com/espnet/espnet/pull/4099
[Recipe PR] MELD: Multimodal EmotionLines Dataset by @realzza in https://github.com/espnet/espnet/pull/4771
MultiIRIS follow up by @YoshikiMas in https://github.com/espnet/espnet/pull/4765
Add CATSLU results for XLS-R with mBART-50 by @akreal in https://github.com/espnet/espnet/pull/4782
Add MEDIA and PortMEDIA results for XLS-R with mBART-50 by @akreal in https://github.com/espnet/espnet/pull/4794
Add SLUE-VoxPopuli results for WavLM with mBART-50 by @akreal in https://github.com/espnet/espnet/pull/4777
Follow up for SLURP and CATSLU by @akreal in https://github.com/espnet/espnet/pull/4796
Update README in chime4/enh_asr1 by @YoshikiMas in https://github.com/espnet/espnet/pull/4795
fix parsing token_list by @imdanboy in https://github.com/espnet/espnet/pull/4778
Use torchaudio functions for beamforming related operations in torch 1.12.1+ by @Emrys365 in https://github.com/espnet/espnet/pull/4638
PIT E2E multi-speaker ASR and librimix recipe by @simpleoier in https://github.com/espnet/espnet/pull/4753
Fix an audio format issue in some enh recipes by @YoshikiMas in https://github.com/espnet/espnet/pull/4799
Fixing How2-2000h Data preparation and Seq Length Assert for Longformer Encoder by @roshansh-cmu in https://github.com/espnet/espnet/pull/4805
Adding MFA scripts for LJSpeech by @iamanigeeit in https://github.com/espnet/espnet/pull/4801
fix typo in espnet2_tutorial.md by @eltociear in https://github.com/espnet/espnet/pull/4811
[WIP] E-Branchformer Encoder in ESPnet2 by @kkim-asapp in https://github.com/espnet/espnet/pull/4812
Muskit update by @A-Quarter-Mile in https://github.com/espnet/espnet/pull/4783

New Contributors

@A-Quarter-Mile made their first contribution in https://github.com/espnet/espnet/pull/4617
@sophia1488 made their first contribution in https://github.com/espnet/espnet/pull/4688
@kenzheng99 made their first contribution in https://github.com/espnet/espnet/pull/4707
@realzza made their first contribution in https://github.com/espnet/espnet/pull/4771
@iamanigeeit made their first contribution in https://github.com/espnet/espnet/pull/4801
@eltociear made their first contribution in https://github.com/espnet/espnet/pull/4811
@kkim-asapp made their first contribution in https://github.com/espnet/espnet/pull/4812

Full Changelog: https://github.com/espnet/espnet/compare/v.202209...v.202211

v.202209

1 year ago

What's Changed

Add dynamic mixing in the speech separation task. by @LiChenda in https://github.com/espnet/espnet/pull/4387
Added test script and usage for calculate_rtf.py script to ESPnet2 tutorial page by @espnetUser in https://github.com/espnet/espnet/pull/4560
Offline/Online (standalone) ESPnet2 Transducer by @b-flo in https://github.com/espnet/espnet/pull/4479
Unfix matplotlib version by @kamo-naoyuki in https://github.com/espnet/espnet/pull/4576
use torch.finfo for dtype other than float by @wenzhe-nrv in https://github.com/espnet/espnet/pull/4584
Update recipe for slurp-entity by @ftshijt in https://github.com/espnet/espnet/pull/4585
Egs2 aesrc by @brianyan918 in https://github.com/espnet/espnet/pull/4592
update checks for bias in initialization by @LiChenda in https://github.com/espnet/espnet/pull/4574
[WIP] Update to fit the recent update in s3prl. by @simpleoier in https://github.com/espnet/espnet/pull/4593
Unfix numpy version by @kamo-naoyuki in https://github.com/espnet/espnet/pull/4598
Update to fit the recent update in s3prl. by @simpleoier in https://github.com/espnet/espnet/pull/4600
Add improved results on FLEURS dataset by @wanchichen in https://github.com/espnet/espnet/pull/4596
Update mp4_to_wav.sh by @jaehyun-ko in https://github.com/espnet/espnet/pull/4605
Pass output_dir as str to wandb.init() by @jonghwanhyeon in https://github.com/espnet/espnet/pull/4607
Support enh_s2t joint training on multi-speaker data by @Emrys365 in https://github.com/espnet/espnet/pull/4566
Add ASR results for commonvoice zh_TW by @slSeanWU in https://github.com/espnet/espnet/pull/4612
Fix both utt2sid and utt2lid when removing long/short data by @jonghwanhyeon in https://github.com/espnet/espnet/pull/4609
recipe config update by @ftshijt in https://github.com/espnet/espnet/pull/4621
Add pytorch=1.12.1 to CI configurations by @kamo-naoyuki in https://github.com/espnet/espnet/pull/4604
New SLU task by @siddhu001 in https://github.com/espnet/espnet/pull/4569
Joss paper: Software Design and User Interface of ESPnet-SE++: Speech Enhancement for Robust Speech Processing by @neillu23 in https://github.com/espnet/espnet/pull/4620
Update conformer result of AMI corpus by @teinhonglo in https://github.com/espnet/espnet/pull/4629
Offline/Online Branchformer Transducer by @b-flo in https://github.com/espnet/espnet/pull/4582
Change to install numba using pip instead of conda by @kamo-naoyuki in https://github.com/espnet/espnet/pull/4637
Add MixIT support. It is unsupervised only. Semi-supervised config is not available for now. by @simpleoier in https://github.com/espnet/espnet/pull/4619
Add 2-pass SLU code for FSC Challenge by @siddhu001 in https://github.com/espnet/espnet/pull/4636
CI fix and some other minor recipe fixes by @ftshijt in https://github.com/espnet/espnet/pull/4656
Update the title of plots to be y-label vs x-label by @pyf98 in https://github.com/espnet/espnet/pull/4647
Update VIVOS download link by @hieuthi in https://github.com/espnet/espnet/pull/4644
Add ASR recipe of MAGICDATA mandarin read speech by @tjysdsg in https://github.com/espnet/espnet/pull/4635
Amend to CI fix by @ftshijt in https://github.com/espnet/espnet/pull/4663
qasr update by @massabaali7 in https://github.com/espnet/espnet/pull/4642
Open_li110 for large-scale multilingual speech by @ftshijt in https://github.com/espnet/espnet/pull/4408
Fix the path of calculate_rft.py by @sw005320 in https://github.com/espnet/espnet/pull/4660
Fix importlib-metadata version by @kan-bayashi in https://github.com/espnet/espnet/pull/4686
Cmu arctic tts pretrain finetune by @soumimaiti in https://github.com/espnet/espnet/pull/4456
updated version to 202209 by @kan-bayashi in https://github.com/espnet/espnet/pull/4685

New Contributors

@wenzhe-nrv made their first contribution in https://github.com/espnet/espnet/pull/4584
@jaehyun-ko made their first contribution in https://github.com/espnet/espnet/pull/4605
@jonghwanhyeon made their first contribution in https://github.com/espnet/espnet/pull/4607
@slSeanWU made their first contribution in https://github.com/espnet/espnet/pull/4612
@massabaali7 made their first contribution in https://github.com/espnet/espnet/pull/4642
@soumimaiti made their first contribution in https://github.com/espnet/espnet/pull/4456

Full Changelog: https://github.com/espnet/espnet/compare/v.202207...v.202209

v.202207

1 year ago

New Features

[New Features][ESPnet1][ASR] Add DDP support for v1 ASR training. #4430 by @lazykyama
[New Features][ESPnet2] Support tensorboard graph #4418 by @kamo-naoyuki
[New Features][ESPnet2][ASR] Branchformer Encoder in ESPnet2 #4400 by @pyf98
[New Features][ESPnet2][Diarization][SE] enh_diar joint model #4339 by @YushiUeda
[New Features][ESPnet2][ESPnet1] Calculate RTF and latency in espnet2 #4382 by @espnetUser
[New Features][ESPnet2][ESPnet1][SE] Add EnhPreprocessor for Speech Enhancement #4321 by @Emrys365
[New Features][ESPnet2][SE] Add DPTNet and WarmupStepLR scheduler #4449 by @Emrys365
[New Features][ESPnet2][SE] Add support for calculating losses on noise and dereverberated signals #4476 by @Emrys365

Recipe

[Recipe][ESPnet2] Aishell-2 GPU info #4501 by @jctian98
[Recipe][ESPnet2] Fix librispeech default path to signify auto download #4517 by @karthik19967829
[Recipe][ESPnet2] Recipe fix for PueblaNahuatl Recipe #4522 by @ftshijt
[Recipe][ESPnet2][ASR][README] Add Aishell-2 ASR Recipe for Espnet2 #4451 by @jctian98
[Recipe][ESPnet2][ASR][README] Add AmericasNLP 2022 baselines #4428 by @akreal
[Recipe][ESPnet2][ESPnet1][ASR][Installation] FLEURS ASR Recipe for ESPnet2 #4455 by @wanchichen
[Recipe][ESPnet2][ESPnet1][ASR][README] tedx_spanish_corpus egs2 recipe #4523 by @jessicah25
[Recipe][ESPnet2][ESPnet1][ASR][SE] Adding L3DAS22 Task1 model to ESPNet-SE #3994 by @popcornell
[Recipe][ESPnet2][ESPnet1][ST] Must_C v1 and v2 in egs2 #4306 by @brianyan918
[Recipe][ESPnet2][README] Dcase task1 Baseline #4317 by @siddhu001
[Recipe][ESPnet2][README] Report Aishell-2 Transducer results #4489 by @jctian98
[Recipe][ESPnet2][README] Update language codes in AmericasNLP 2022 baseline #4441 by @akreal
[Recipe][ESPnet2][README] Vox populi baseline #4478 by @siddhu001
[Recipe][ESPnet2][SE] L3DAS22 enhancement recipe #4269 by @neillu23
[Recipe][ESPnet2][SE] Update notes in the recipes for DNS challenges #4433 by @YoshikiMas
[Recipe][ESPnet2][SE][SLU][ST] LT-Spatialized and SLURP-Spatialized combined enhancement recipe #4268 by @neillu23
[Recipe][ESPnet2][ST] Add moses check for ST recipes #4417 by @ftshijt
[Recipe][ESPnet2][TTS] Add talromur recipe #4379 by @G-Thor
[Recipe][ESPnet2][TTS] Fix for issue #4401 #4402 by @G-Thor
[Recipe][ESPnet2][TTS] add pre-trained model jets in the recipe of ljspeech, kss #4406 by @imdanboy

Bugfix

[Bugfix][ESPnet1] fix the corrupted pretrained model #4490 by @wentaoxandry
[Bugfix][ESPnet1][ESPnet2] Fix an4 URL #4427 by @pyf98
[Bugfix][ESPnet1][ESPnet2][RNNT] Fix mAES with big vocab size #4312 by @b-flo
[Bugfix][ESPnet2] Adding init.py to espnet2/diar/layers and espnet2/diar/separator #4470 by @cycentum
[Bugfix][ESPnet2] Fix tensorboard-graph creation for multi gpu mode #4431 by @kamo-naoyuki
[Bugfix][ESPnet2] Update char_tokenizer.py #4499 by @xiabingquan
[Bugfix][ESPnet2][ESPnet1][ASR][LM][MT][TTS] Fix Transducer LM fusion and add Logging for Transducer inference #4327 by @chintu619
[Bugfix][ESPnet2][SE] Fix a bug in enh unit test #4435 by @Emrys365

Enhancement

[Enhancement][ESPnet2] Optionize graph creation #4551 by @kan-bayashi
[Enhancement][ESPnet2][Installation][TTS] Add icelandic g2p #4384 by @G-Thor
[Enhancement][ESPnet2][SE] Add support of test-only criterions after each epoch #4381 by @Emrys365
[Enhancement][ESPnet2][SSL] raise more useful error in espnet2/asr/frontend/s3prl.py if s3prl is not installed #4480 by @popcornell
[Enhancement][ESPnet2][TTS] Add JETS AlignmentModule in calculate_all_attentions.py #4446 by @seastar105

Refactoring

[Refactoring][ESPnet1] Refactoring 'is_prefix' function #4530 by @jhlee9010
[Refactoring][ESPnet2][ASR] Zero_infinity option for ctc loss #4415 by @kamo-naoyuki

Others

[CI][ESPnet1][ESPnet2][Installation] Remove the version restriction for numpy #4419 by @kamo-naoyuki
[CI][ESPnet2] Canged to install espnet from wheel in the test_import CI test #4471 by @kamo-naoyuki
[CI][Installation] Temporary fixed numpy version #4464 by @kamo-naoyuki
[Documentation] Add notes on batch size and num of GPUs in ESPnet2 documentation #4436 by @pyf98
[Documentation][ESPnet1] Update decoder.py #4322 by @sw005320
[Documentation][ESPnet2] Add a note to follow the installation instructions #4477 by @akreal

Acknowledgements

Special thanks to @Emrys365, @G-Thor, @YoshikiMas, @YushiUeda, @akreal, @b-flo, @brianyan918, @chintu619, @cycentum, @espnetUser, @ftshijt, @imdanboy, @jctian98, @jessicah25, @jhlee9010, @kamo-naoyuki, @kan-bayashi, @karthik19967829, @lazykyama, @neillu23, @popcornell, @pyf98, @seastar105, @siddhu001, @sw005320, @wanchichen, @wentaoxandry, @xiabingquan.

v.202205

1 year ago

New Features

[New Features][ESPnet1][ESPnet2][ASR] Add quantization in ESPnet2 for asr inference #4349 by @pyf98
[New Features][ESPnet2][SE] Add svoice recipe for wsj0-2mix speech separation #4257 by @nateanl
[New Features][ESPnet2][SE] Merge Deep Clustering and Deep Attractor Network to enh separator #4110 by @earthmanylf
[New Features][ESPnet2][SE] Some improvements to current enh functions #4251 by @Emrys365
[New Features][ESPnet2][SE][Installation] Import fast_bss_eval and update some time-domain losses for enh task #4256 by @LiChenda
[New Features][ESPnet2][TTS] add e2e tts model: JETS #4364 by @imdanboy

Bugfix

[Bugfix][ESPnet1] Fix minimum input length for Conv2dSubsampling2 in check_short_utt #4378 by @akreal
[Bugfix][ESPnet1][ESPnet2] Minor fixes for the intermediate loss usage and Mask-CTC decoding #4374 by @YosukeHiguchi
[Bugfix][ESPnet2] Fix #4396 #4398 by @kamo-naoyuki
[Bugfix][ESPnet2] Fix a bug in utterance_mvn #4304 by @Emrys365
[Bugfix][ESPnet2] Minor fix for Mask-CTC forward function #4347 by @YosukeHiguchi
[Bugfix][ESPnet2] Wandb Minor Fix for Model Resume #4329 by @roshansh-cmu
[Bugfix][ESPnet2] fix the enh_s2t_task argument in espnet2/bin/st_inference.py #4323 by @simpleoier
[Bugfix][ESPnet2][MT][ST] fix bug in mt/st templates for having separate token lists #4149 by @brianyan918
[Bugfix][ESPnet2][Recipe] Fix aishell3 data preparation script #4277 by @LanceaKing
[Bugfix][ESPnet2][SE] Fix a bug in stats aggregation when PITSolver is used #4343 by @Emrys365
[Bugfix][ESPnet2][SE] fix for enhancement model loading compatibility #4259 by @LiChenda
[Bugfix][ESPnet2][ST] bug fixes in ST recipes #4341 by @chintu619
[Bugfix][ESPnet2][TTS] Fix optional data names for TTS #4355 by @kan-bayashi
[Bugfix][ESPnet2][TTS] fix a bug in Mandarin pypinyin_g2p_phone #4206 by @WeiGodHorse
[Bugfix][ESPnet2][TTS] fix loss = NaN in VITS with mixed precision #4356 by @kan-bayashi
[Bugfix][ESPnet2][streaming] Add unit test to streaming ASR inference #4352 by @espnetUser
[Bugfix][Installation] fix s3prl install by using legacy version. Temporal solution. #4399 by @simpleoier
[Bugfix][README] Fix typo #4338 by @ftshijt

Enhancement

[Enhancement][ESPnet1][ESPnet2][ASR][SE][SLU][ST] enh_s2t joint model #4226 by @simpleoier
[Enhancement][ESPnet2] Add progress bar to phonemization #4320 by @G-Thor
[Enhancement][ESPnet2][MT] Update show_translation_result.sh to show all decoding results under the given exp directory #4330 by @pyf98

Recipe

[Recipe][ESPnet1][ASR] Accented English Speech Recognition Challenge 2020 recipe (AESRC2020) #3898 by @brianyan918
[Recipe][ESPnet1][ESPnet2][ASR][README][Recipe] Add MediaSpeech ASR recipe #4183 by @AshibaWu
[Recipe][ESPnet2][ASR][README] recipee for Microsoft speech corpus for Indian Languages #4191 by @navya-yarrabelly
[Recipe][ESPnet2][ASR][README] Accented French Openslr57 ASR recipe (ESPnet2) (part of Homework3 MNLP) #4280 by @DanBerrebbi
[Recipe][ESPnet2][ASR][README] Add Mask-CTC results #4180 by @YosukeHiguchi
[Recipe][ESPnet2][ASR][README] Add ml_openslr63 ASR recipe #4173 by @bharaniuk
[Recipe][ESPnet2][ASR][README] Adding new recipe for Burmese (OpenSLR80) #4182 by @JainSameer06
[Recipe][ESPnet2][ASR][README] add chime6 recipe #4332 by @simpleoier
[Recipe][ESPnet2][ASR][SE][README] add egs2/chime4/enh_asr1 recipe and results #4316 by @simpleoier
[Recipe][ESPnet2][README][RNNT] updated librispeech-asr with rnn-t results #4281 by @chintu619
[Recipe][ESPnet2][README][SE] 2021 Clarity Challenge recipe #4210 by @popcornell
[Recipe][ESPnet2][README][SE] Add AISHELL-4 ENH recipe #4249 by @Emrys365
[Recipe][ESPnet2][README][SE] Add ConferencingSpeech 2021 recipe to egs2 #4192 by @Emrys365
[Recipe][ESPnet2][README][SE] Add ICASSP2021 DNS Challenge 2 recipe #4253 by @YoshikiMas
[Recipe][ESPnet2][README][SE] Add INTERSPEECH 2021 DNS Challenge 3 recipe #4238 by @YoshikiMas
[Recipe][ESPnet2][README][SE] Add results of ICASSP2021 DNS Challenge 2 recipe #4309 by @YoshikiMas
[Recipe][ESPnet2][README][SE] Rename egs2/clarity21/enh_2021 to egs2/clarity21/enh1 #4328 by @Emrys365
[Recipe][ESPnet2][README][SE] add convtasnet recipe for dns_ins20 #4314 by @muqiaoy
[Recipe][ESPnet2][README][SLU] Harpervalley recipe #4315 by @YushiUeda
[Recipe][ESPnet2][README][SLU] SLUE Voxpopuli base recipe #4262 by @siddhu001
[Recipe][ESPnet2][README][ST] CoVOST2 recipes #4300 by @ftshijt
[Recipe][ESPnet2][SLU][README] Update SLU results for ICASSP #4283 by @siddhu001

Others

[CI][Docker] Github Action Trigger Docker Build #4295 by @Fhrozen
[CI][Docker] Github Action for Docker build #4219 by @Fhrozen
[CI][ESPnet1][ESPnet2][Installation][README] Add isort checking to the CI tests #4372 by @kamo-naoyuki
[CI][ESPnet1][ESPnet2][Installation][README][mergify] Add pytorch=1.10.2 and 1.11.0 to ci configurations #4348 by @kamo-naoyuki
[CI][ESPnet2][ASR][SE] add integration test and fix the decoding in enh_asr and enh_st #4310 by @simpleoier
[CI][ESPnet2][New Features][SLU][ST][streaming] Add streaming ST/SLU #4243 by @D-Keqi
[CI][ESPnet2][ST] Add Test Functions for ST Train and Inference #4324 by @ftshijt
[CI][Installation] update install_pesq.sh #4265 by @LiChenda
[Documentation][ESPnet2][README][TTS] Minor update for JETS #4369 by @kan-bayashi
[Documentation][README] Change the order of README #4289 by @ftshijt
[Documentation][README] Update README.md #4284 by @sw005320

Acknowledgements

Special thanks to @AshibaWu, @D-Keqi, @DanBerrebbi, @Emrys365, @Fhrozen, @G-Thor, @JainSameer06, @LanceaKing, @LiChenda, @WeiGodHorse, @YoshikiMas, @YosukeHiguchi, @YushiUeda, @akreal, @bharaniuk, @brianyan918, @chintu619, @earthmanylf, @espnetUser, @ftshijt, @imdanboy, @kamo-naoyuki, @kan-bayashi, @muqiaoy, @nateanl, @navya-yarrabelly, @popcornell, @pyf98, @roshansh-cmu, @siddhu001, @simpleoier, @sw005320.

v.202204

2 years ago

News

From this version, we decided to use date-based versioning, e.g., v.202204.

New Features

[New Features][ESPnet1] added learnable fourier features #4029 by @popcornell
[New Features][ESPnet1][ESPnet2][ASR] Restricted Self Attention for E2E Speech Summarization #4071 by @roshansh-cmu
[New Features][ESPnet1][Installation][README] add lrs avsr recipe #4104 by @wentaoxandry
[New Features][ESPnet1][README] add lip reading sentences dataset code #4074 by @wentaoxandry
[New Features][ESPnet2][ASR] [ESPnet2] Intermediate/Self-conditioned CTC #4084 by @YosukeHiguchi
[New Features][ESPnet2][ASR] [WIP] [ESPnet2] Mask-CTC #4158 by @YosukeHiguchi
[New Features][ESPnet2][ASR][README] Add stochastic depth to conformer and share results on LibriSpeech 960h #4142 by @pyf98
[New Features][ESPnet2][MT] MT task for espnet2 with IWSLT14 recipe #4111 by @siddalmia
[New Features][ESPnet2][README][SE] Add DC-CRN complex masking and spectral mapping approach for speech enhancement #4127 by @Emrys365
[New Features][ESPnet2][README][SE] Add DCCRN separator #4097 by @Johnson-Lsx
[New Features][ESPnet2][README][SE] Add a new separator for speech enhancement/separation tasks #4062 by @LiChenda
[New Features][ESPnet2][README][SE] Add iFaSNet for enhancement/separation tasks. #4130 by @LiChenda
[New Features][ESPnet2][SE] Refactor DNN_Beamformer in espnet2 and add new beamformers #4082 by @Emrys365

Enhancement

[Enhancement][ESPnet2] Add an optional suffix to the averaged model file name #4067 by @pyf98
[Enhancement][ESPnet2] Update perturb_data_dir_speed.sh #4091 by @AmirHussein96
[Enhancement][ESPnet2][ASR] Add tests for Intermediate/Self-conditioned CTC #4117 by @YosukeHiguchi
[Enhancement][ESPnet2][TTS] Add option to use norm. feats over denorm. #4250 by @G-Thor

Recipe

[Recipe][ESPnet1][RNNT] [ESPNET1] Add the results of conformer-transducer for Librispeech #4080 by @eesungkim
[Recipe][ESPnet2][ASR] Add ASR recipe for VCTK dataset based on TTS's dataprep. #4088 by @kashikashi
[Recipe][ESPnet2][ASR] Add new conformer config with hop length 160 for LibriSpeech 960h #4162 by @pyf98
[Recipe][ESPnet2][ASR] Add new zh_openslr38 ASR recipe #4181 by @cuichenx
[Recipe][ESPnet2][ASR] Add transformer results for LibriSpeech 100h #4089 by @pyf98
[Recipe][ESPnet2][ASR] Added Marathi OpenSLR 64 recipe #4179 by @SujaySKumar
[Recipe][ESPnet2][ASR] Added recipe for Microsoft Speech Corpus (Indian languages) #4194 by @chintu619
[Recipe][ESPnet2][ASR] Automatic lyric recognition Recipe #4129 by @ftshijt
[Recipe][ESPnet2][ASR] ESPNET - LRS3 Recepie #4101 by @gdebayan
[Recipe][ESPnet2][ASR] bengali asr model with no finetuning #4047 by @dzeinali
[Recipe][ESPnet2][MT] IWSLT'14 Results using ESPnet2-MT #4132 by @pyf98
[Recipe][ESPnet2][README] Mandarin ISO id should be CMN instead of ZHO #4125 by @xinjli
[Recipe][ESPnet2][README] Update README.md #4037 by @dzeinali
[Recipe][ESPnet2][README] Update README.md #4121 by @dzeinali
[Recipe][ESPnet2][README] Update README.md for How2 2000h ASR,SUM #4155 by @roshansh-cmu
[Recipe][ESPnet2][RNNT] Create decode_rnnt_conformer.yaml #4058 by @sw005320
[Recipe][ESPnet2][RNNT] Create train_rnnt_conformer.yaml #4057 by @sw005320
[Recipe][ESPnet2][SLU] Add IEMOCAP results and configs #4100 by @YushiUeda
[Recipe][ESPnet2][SLU] Add new config and support for computing WER in SLUE-VoxCeleb #4152 by @siddhu001
[Recipe][ESPnet2][SLU] Add sentiment data preparation for IEMOCAP #4065 by @YushiUeda
[Recipe][ESPnet2][SLU] ESPnet2 swbd_sentiment recipe #4134 by @YushiUeda
[Recipe][ESPnet2][ST] egs2/iwslt22_dialect #4013 by @brianyan918

Bugfix

[Bugfix][CI][ESPnet2] Fix CI test failures related to torch_complex 0.4.0 #4112 by @Emrys365
[Bugfix][CI][Installation] fix doc ci by pinning jinja version #4239 by @xinjli
[Bugfix][ESPnet2] Fix n-gram decoding #4168 by @sw005320
[Bugfix][ESPnet2] bug fixes and efficient train/dev split in data prep of Microsoft Indian Languages recipe #4196 by @chintu619
[Bugfix][ESPnet2] fix errors in configs of librispeech ssl frontends #4098 by @simpleoier
[Bugfix][ESPnet2][ASR][ST] [bug patch] egs2/iwslt22_dialect #4049 by @brianyan918
[Bugfix][ESPnet2][MT][ST] Fix joint tokenization in st.sh #4143 by @pyf98
[Bugfix][ESPnet2][MT][ST] scoring fixes MT and ST #4146 by @siddalmia
[Bugfix][ESPnet2][TTS] Fix speaker normalization #4229 by @LanceaKing
[Bugfix][Installation] set gtn version #4122 by @brianyan918
[Bugfix][ESPnet1][ESPnet2] minor fixes in ST in espnet2 #4056 by @siddalmia

Others

[CI] Simplify vocoder compatibility test #4061 by @kan-bayashi
[CI][Documentation] Fix notebook in the official doc. #4171 by @ShigekiKarita
[Docker] Docker Updates #4064 by @Fhrozen
[Documentation] Add a checklist for PRs on recipe #4053 by @ftshijt
[Documentation] README Update for E2E Speech Summarization #4071 #4150 by @roshansh-cmu
[Documentation] Update the example PyTorch version in Installation doc #4116 by @pyf98
[Documentation] [documentation] fix minor typo in installation.md #4164 by @JDongian
[Documentation][ESPnet1] fix typo #4044 by @ooyamatakehisa
[Documentation][ESPnet1][ESPnet2][ASR] Add Huggingface-cli usage #4027 by @karthik19967829

Acknowledgements

Special thanks to @AmirHussein96, @Emrys365, @Fhrozen, @G-Thor, @JDongian, @Johnson-Lsx, @LanceaKing, @LiChenda, @ShigekiKarita, @SujaySKumar, @YosukeHiguchi, @YushiUeda, @brianyan918, @chintu619, @cuichenx, @dzeinali, @eesungkim, @ftshijt, @gdebayan, @kan-bayashi, @karthik19967829, @kashikashi, @ooyamatakehisa, @popcornell, @pyf98, @roshansh-cmu, @siddalmia, @siddhu001, @simpleoier, @sw005320, @wentaoxandry, @xinjli.