Faster Whisper Versions Save

• Bug fixes and performance improvements:
  • Update logic to get segment from features before encoding (https://github.com/SYSTRAN/faster-whisper/pull/705)
  • Fix window end heuristic for hallucination_silence_threshold (https://github.com/SYSTRAN/faster-whisper/pull/706)

Fix the broken tag v0.10.0

• Support "large-v3" model with
  • The ability to load feature_size/num_mels and other from preprocessor_config.json
  • A new language token for Cantonese (yue)
• Update CTranslate2 requirement to include the latest version 3.22.0
• Update tokenizers requirement to include the latest version 0.15
• Change the hub to fetch models from Systran organization

• Support distil-whisper model (https://github.com/SYSTRAN/faster-whisper/pull/557) Robust knowledge distillation of the Whisper model via large-scale pseudo-labelling.
  For more detail: https://github.com/huggingface/distil-whisper

• Upgrade ctranslate2 version to 4.0 to support CUDA 12 (https://github.com/SYSTRAN/faster-whisper/pull/694)

• Upgrade PyAV version to 11.* to support Python3.12.x (https://github.com/SYSTRAN/faster-whisper/pull/679)

• Small bug fixes

  • Illogical "Avoid computing higher temperatures on no_speech" (https://github.com/SYSTRAN/faster-whisper/pull/652)
  • broken prompt_reset_on_temperature (https://github.com/SYSTRAN/faster-whisper/pull/604)
  • Word timing tweaks (https://github.com/SYSTRAN/faster-whisper/pull/616)

• New improvements from original OpenAI Whisper project

  • Skip silence around hallucinations (https://github.com/SYSTRAN/faster-whisper/pull/646)
  • Prevent infinite loop for out-of-bound timestamps in clip_timestamps (https://github.com/SYSTRAN/faster-whisper/pull/697)

• Support "large-v3" model with
  • The ability to load feature_size/num_mels and other from preprocessor_config.json
  • A new language token for Cantonese (yue)
• Update CTranslate2 requirement to include the latest version 3.22.0
• Update tokenizers requirement to include the latest version 0.15
• Change the hub to fetch models from Systran organization

• Add function faster_whisper.available_models() to list the available model sizes
• Add model property supported_languages to list the languages accepted by the model
• Improve error message for invalid task and language parameters
• Update tokenizers requirement to include the latest version 0.14

Expose new transcription options

Some generation parameters that were available in the CTranslate2 API but not exposed in faster-whisper:

• repetition_penalty to penalize the score of previously generated tokens (set > 1 to penalize)
• no_repeat_ngram_size to prevent repetitions of ngrams with this size

Some values that were previously hardcoded in the transcription method:

• prompt_reset_on_temperature to configure after which temperature fallback step the prompt with the previous text should be reset (default value is 0.5)

Other changes

• Fix a possible memory leak when decoding audio with PyAV by forcing the garbage collector to run
• Add property duration_after_vad in the returned TranscriptionInfo object
• Add "large" alias for the "large-v2" model
• Log a warning when the model is English-only but the language parameter is set to something else

• Fix a bug related to no_speech_threshold: when the threshold was met for a segment, the next 30-second window reused the same encoder output and was also considered as non speech
• Improve selection of the final result when all temperature fallbacks failed by returning the result with the best log probability

Improve word-level timestamps heuristics

Some recent improvements from openai-whisper are ported to faster-whisper:

• Squash long words at window and sentence boundaries (https://github.com/openai/whisper/commit/255887f219e6b632bc1a6aac1caf28eecfca1bac)
• Improve timestamp heuristics (https://github.com/openai/whisper/commit/f572f2161ba831bae131364c3bffdead7af6d210)

Support download of user converted models from the Hugging Face Hub

The WhisperModel constructor now accepts any repository ID as argument, for example:

model = WhisperModel("username/whisper-large-v2-ct2")

The utility function download_model has been updated similarly.

Other changes

• Accept an iterable of token IDs for the argument initial_prompt (useful to include timestamp tokens in the prompt)
• Avoid computing higher temperatures when no_speech_threshold is met (same as https://github.com/openai/whisper/commit/e334ff141d5444fbf6904edaaf408e5b0b416fe8)
• Fix truncated output when using a prefix without disabling timestamps
• Update the minimum required CTranslate2 version to 3.17.0 to include the latest fixes

Extend TranscriptionInfo with additional properties

• all_language_probs: the probability of each language (only set when language=None)
• vad_options: the VAD options that were used for this transcription

Improve robustness on temporary connection issues to the Hugging Face Hub

When the model is loaded from its name like WhisperModel("large-v2"), a request is made to the Hugging Face Hub to check if some files should be downloaded.

It can happen that this request raises an exception: the Hugging Face Hub is down, the internet is temporarily disconnected, etc. These types of exception are now catched and the library will try to directly load the model from the local cache if it exists.

Other changes

• Enable the onnxruntime dependency for Python 3.11 as the latest version now provides binary wheels for Python 3.11
• Fix occasional IndexError on empty segments when using word_timestamps=True
• Export __version__ at the module level
• Include missing requirement files in the released source distribution