What's Changed sync : ggml by @ggerganov in #3896 include parakeet in build-xcframework.sh by @daaku in #3899 Fix pkgconfig configuration (Nix build failure) by @nmouha in #3894 examples : update model names in parakeet-cli README.md [no ci] by @danbev in #3906 examples: Fix argument flag for min speech duration in VAD by @QuantiusBenignus in #3907 sync : ggml by @ggerganov in #3912 examples : Imp…
What's Changed ci : add GGML_NATIVE=OFF and GGML_BMI2=OFF to windows-blas by @danbev in #3891 release : v1.9.1 by @danbev in #3892 Full Changelog: v1.9.0...v1.9.1
What's Changed ci : only trigger release jobs for tags by @danbev in #3883 parakeet : add support for NVIDIA Parakeet by @danbev in #3735 ruby : add support for Parakeet by @KitaitiMakoto in #3885 release : v1.9.0 by @danbev in #3886 Full Changelog: v1.8.7...v1.9.0
What's Changed Do not assume /usr/lib library installation. by @waptaff in #3693 server : merge split UTF-8 token text in verbose JSON by @lyonsno in #3850 whisper : catch C++ exceptions in whisper_init_with_params_no_state by @danscMax in #3831 ci : refactor + optimize by @ggerganov in #3847 ci : only publish/push docker images daily by @danbev in #3854 ci : use ccache instead of sccache for wind…
What's Changed common : re-implement ffmpeg-transcode.cpp + clarify ffmpeg usage by @ggerganov in #3846 ci : fix path to whisper.h in examples.yml [no ci] by @danbev in #3842 Full Changelog: v1.8.5...v1.8.6
Overview Maintenance release + performance improvements all around: https://github.com/ggml-org/whisper.cpp/blob/master/scripts/bench-all-gg.txt What's Changed ruby : fix dangling pointers, memory leak, and SEGV on parallel transcription by @KitaitiMakoto in #3715 sync : ggml by @ggerganov in #3730 vad : add streaming detect + explicit state reset by @danielbodart in #3677 bench : sync submit-resu…
Overview Maintenance release, latest ggml, some performance gains across the board. What's Changed Fix: UTF-8 character cut off to two "�" in segment wrapping (max_len) by @lordofriver in #3592 examples: add -g/--gpu-device option and GPU_DEVICE env support by @brauliobo in #3557 sync : ggml by @ggerganov in #3636 Fix macOS dSYM path case mismatch in XCFramework build by @friederbluemle in #3630 r…
Overview Maintenance release, latest ggml, minor improvements in the tools/server/bindings. What's Changed server : set no_context == true by @ggerganov in #3482 WASM example broken for Hebrew by @Orel-A in #3487 ruby : tiny bug fix by @KitaitiMakoto in #3490 12x Performance Boost with Integrated Graphics by @OrelSokolov in #3492 ruby : VAD separately from ASR by @KitaitiMakoto in #3518 vad : Sile…
Overview Fix a bug in the ggml norm CPU scalar operator What's Changed sync : ggml by @ggerganov in #3478 Full Changelog: v1.8.1...v1.8.2
Overview Fix Vulkan builds Fix memory leaks when using VAD Support --carry-initial-prompt What's Changed bindings-java : disable flash attention by default by @danbev in #3445 ruby : Loose RegExp of a test to follow change of flash attension default by @KitaitiMakoto in #3448 vad : fix memory leaks in VAD implementation by @danbev in #3453 ruby : Bump Ruby bindings' version to 1.3.4 by @KitaitiMak…
Overview Flash attention is now enabled by default Performance improvements M1 Pro CPU Config Model Th FA Enc. Dec. Bch5 PP Commit M1 Pro METAL tiny 1 0 32.44 1.71 0.43 0.04 8a67c55 M1 Pro METAL base 1 0 63.54 2.62 0.71 0.06 8a67c55 M1 Pro METAL small 1 0 200.30 5.34 1.72 0.17 8a67c55 M1 Pro METAL medium 1 0 580.06 11.71 4.18 0.45 8a67c55 CPU Config Model Th FA Enc. Dec. Bch5 PP Commit M1 Pro META…