Simdutf Versions Save

Unicode routines (UTF8, UTF16, UTF32) and Base64: billions of characters per second using SSE2, AVX2, NEON, AVX-512, RISC-V Vector Extension. Part of Node.js and Bun.

v5.0.0

2 months ago

What's Changed

New Features

Accelerated Base64 by @lemire in https://github.com/simdutf/simdutf/pull/375 reviewed by @WojciechMula

Optimization/Performance

add RVV (RISC-V Vector Extension) backend, resolves #362 by @camel-cdr in https://github.com/simdutf/simdutf/pull/373 reviewed by @WojciechMula
disables runtime dispatching when there is a single implementation. by @lemire in https://github.com/simdutf/simdutf/pull/367

Fixes

Fixing overflow in UTF32 to UTF8 under Neon. by @lemire in https://github.com/simdutf/simdutf/pull/368
Fix BOM Check for UTF-8 by @sepcnt in https://github.com/simdutf/simdutf/pull/370
Add loongarch64 by @shipujin in https://github.com/simdutf/simdutf/pull/372

New Contributors

@sepcnt made their first contribution in https://github.com/simdutf/simdutf/pull/370
@shipujin made their first contribution in https://github.com/simdutf/simdutf/pull/372

Full Changelog: https://github.com/simdutf/simdutf/compare/v4.0.9...v5.0.0

v4.0.9

4 months ago

What's Changed

Fix some typos by @striezel in https://github.com/simdutf/simdutf/pull/359
adding an extra utf8 to utf32 test case by @lemire in https://github.com/simdutf/simdutf/pull/364
We can improve slightly UTF-8 validation under some x64 targets. by @lemire in https://github.com/simdutf/simdutf/pull/365

Full Changelog: https://github.com/simdutf/simdutf/compare/v4.0.8...v4.0.9

v4.0.8

6 months ago

What's Changed

Fix Visual Studio regression (last patch release) by @lemire in https://github.com/simdutf/simdutf/pull/357 (cc @anonrig)

Full Changelog: https://github.com/simdutf/simdutf/compare/v4.0.7...v4.0.8

v4.0.7

6 months ago

What's Changed

Silencing some warnings (C++98 compatibility). by @lemire in https://github.com/simdutf/simdutf/pull/356 reported by @zcbenz

Full Changelog: https://github.com/simdutf/simdutf/compare/v4.0.6...v4.0.7

v4.0.6

6 months ago

What's Changed

Fixing warnings issued by clang (Node issue 50930) by @lemire in https://github.com/simdutf/simdutf/pull/355 reported by @anonrig and @zcbenz

Full Changelog: https://github.com/simdutf/simdutf/compare/v4.0.5...v4.0.6

v4.0.5

6 months ago

What's Changed

fixing issue 350 by @lemire in https://github.com/simdutf/simdutf/pull/352 #define conflict (ERROR_H) reported by @p0358
Avoiding "unused functions" when compiling for ARM64 by @lemire in https://github.com/simdutf/simdutf/pull/353
Using macro workaround for Visual Studio ARM by @lemire in https://github.com/simdutf/simdutf/pull/351

Full Changelog: https://github.com/simdutf/simdutf/compare/v4.0.4...v4.0.5

v4.0.4

6 months ago

What's Changed

additional vreinterpret casts combined with aarch64 gcc tests in CI by @lemire in https://github.com/simdutf/simdutf/commit/43b46b3cf15d9f368924afe1209cd6f6543dbf7a Reported by @anonrig
cleaning of latin1_to_utf8_avx512_branch by @lemire in https://github.com/simdutf/simdutf/pull/347
convenience functions to trim partial characters at the end of a string. by @lemire in https://github.com/simdutf/simdutf/pull/349 which fixes https://github.com/simdutf/simdutf/issues/348 (Streaming API for transcoding?) by @kovidgoyal

Note that, at this point in time, the simdutf library is meant to be used with valid inputs with eventual error reporting. Transcoding with replacement, to accommodate invalid inputs, is an open issue https://github.com/simdutf/simdutf/issues/147

Full Changelog: https://github.com/simdutf/simdutf/compare/v4.0.3...v4.0.4

v4.0.3

7 months ago

What's Changed

Add vreinterpret by @lemire in https://github.com/simdutf/simdutf/pull/344 to fix a build issue for some compilers (reported by @anonrig)

Full Changelog: https://github.com/simdutf/simdutf/compare/v4.0.2...v4.0.3

v4.0.2

7 months ago

What's Changed

bug: Fix out of bounds access for haswell simd op by @silvergasp in https://github.com/simdutf/simdutf/pull/340
fix alignment issue for bele tests by @lemire in https://github.com/simdutf/simdutf/pull/342 reported by @clausecker

Full Changelog: https://github.com/simdutf/simdutf/compare/v4.0.1...v4.0.2

v4.0.1

7 months ago

What's Changed

pkg-config support by @lemire in https://github.com/simdutf/simdutf/pull/336 requested by @clausecker
Fixing issue 337: rewrite of sse_convert_utf32_to_latin1 (simplify) by @lemire in https://github.com/simdutf/simdutf/pull/338 to fix issue https://github.com/simdutf/simdutf/issues/337 reported by @anonrig

Full Changelog: https://github.com/simdutf/simdutf/compare/v4.0.0...v4.0.1