Dragonflydb Dragonfly Versions Save

A modern replacement for Redis and Memcached

v1.17.1

1 month ago

Dragonfly v1.17.1

This is a patch release.

What's Changed

fix: potential data race in the transactional code (#2911)

v1.17.0

1 month ago

Dragonfly v1.17.0

Some prominent changes include:

Improved performance for MGET operations (#2453)
Fix argument parsing in json.objkeys (#2872)
Fix ipv6 support for replication (#2889)
Support serialisation of bloom filters - saving to and loading from snapshots (#2846)
Support of HLL PFADD (#2761)
Support bullmq workloads that do not have {} hashtags in their queue names (#2890)

What's Changed

fix: #2745 don't start migration process again after apply the same the same config is applied by @BorysTheDev in https://github.com/dragonflydb/dragonfly/pull/2822
feat(transaction): Idempotent callbacks (immediate runs) by @dranikpg in https://github.com/dragonflydb/dragonfly/pull/2453
refactor(cluster): replace sync_id with node_id for slot migration #2835 by @BorysTheDev in https://github.com/dragonflydb/dragonfly/pull/2838
feat(tiering): Simple OpManager by @dranikpg in https://github.com/dragonflydb/dragonfly/pull/2781
chore: implement path mutation for JsonFlat by @romange in https://github.com/dragonflydb/dragonfly/pull/2805
feat(cluster): add migration removing by config #2835 by @BorysTheDev in https://github.com/dragonflydb/dragonfly/pull/2844
chore: expose direct API on Bloom objects by @romange in https://github.com/dragonflydb/dragonfly/pull/2845
chore: generalize CompactObject::AllocateMR by @kostasrim in https://github.com/dragonflydb/dragonfly/pull/2847
feat(tiering): Simplest small bins by @dranikpg in https://github.com/dragonflydb/dragonfly/pull/2810
refactor: clean cluster slot migration code by @BorysTheDev in https://github.com/dragonflydb/dragonfly/pull/2848
fix(tests): Fix numsub test by @dranikpg in https://github.com/dragonflydb/dragonfly/pull/2852
fix: healthcheck for docker containers by @romange in https://github.com/dragonflydb/dragonfly/pull/2853
fix: possible crash in tls code by @romange in https://github.com/dragonflydb/dragonfly/pull/2854
fix(server): Do not block admin-port commands by @chakaz in https://github.com/dragonflydb/dragonfly/pull/2842
fix(pytest): make pytests fail if server crash on shutdown by @adiholden in https://github.com/dragonflydb/dragonfly/pull/2827
feat(server): add prints on takeover timeout by @adiholden in https://github.com/dragonflydb/dragonfly/pull/2856
fix(pytest): dont check process return code on kill by @adiholden in https://github.com/dragonflydb/dragonfly/pull/2862
fix: authorize the http connection to call commands by @romange in https://github.com/dragonflydb/dragonfly/pull/2863
feat(cluster): Send number of keys for incoming and outgoing migrations. by @chakaz in https://github.com/dragonflydb/dragonfly/pull/2858
feat(tiering): TieredStorageV2 by @dranikpg in https://github.com/dragonflydb/dragonfly/pull/2849
bug(server): set connection flags block/pause flag on all blocking commands by @adiholden in https://github.com/dragonflydb/dragonfly/pull/2816
chore: serialize SBF by @romange in https://github.com/dragonflydb/dragonfly/pull/2846
fix: test_replicaof_reject_on_load crash on stop by @kostasrim in https://github.com/dragonflydb/dragonfly/pull/2818
feat(dbslice): Add self-laundering iterator in DbSlice by @chakaz in https://github.com/dragonflydb/dragonfly/pull/2815
chore: License update by @romange in https://github.com/dragonflydb/dragonfly/pull/2767
fix(acl): incompatibilities with acl load by @kostasrim in https://github.com/dragonflydb/dragonfly/pull/2867
fix(json): make path optional in json.objkeys by @kostasrim in https://github.com/dragonflydb/dragonfly/pull/2872
fix: return wrong type errors for SET...GET command by @romange in https://github.com/dragonflydb/dragonfly/pull/2874
fix(redis replication): remove partial sync flow ,not supported yet by @adiholden in https://github.com/dragonflydb/dragonfly/pull/2865
chore: limit traffic logger only to the main interface by @romange in https://github.com/dragonflydb/dragonfly/pull/2877
chore: relax repltakeover constraints to only exclude write commands by @kostasrim in https://github.com/dragonflydb/dragonfly/pull/2873
chore(replayer): Roll back to go1.18 by @dranikpg in https://github.com/dragonflydb/dragonfly/pull/2881
fix: brpoplpush single shard to wake up blocked transactions by @kostasrim in https://github.com/dragonflydb/dragonfly/pull/2875
chore: LockTable tracks fingerprints of keys by @romange in https://github.com/dragonflydb/dragonfly/pull/2839
chore: reject TLS handshake when our listener is plain TCP by @romange in https://github.com/dragonflydb/dragonfly/pull/2882
Add support for Sparse HLL PFADD by @azuredream in https://github.com/dragonflydb/dragonfly/pull/2761
feat server: bring visibility to script errors by @adiholden in https://github.com/dragonflydb/dragonfly/pull/2879
chore: clean up REPLTAKEOVER flow by @romange in https://github.com/dragonflydb/dragonfly/pull/2887
chore(tiering): Move files and move kb literal to common by @dranikpg in https://github.com/dragonflydb/dragonfly/pull/2868
chore(interpreter): Support object replies by @dranikpg in https://github.com/dragonflydb/dragonfly/pull/2885
fix(ci/helm): Stick to v0.73.0 version of prom operator by @Pothulapati in https://github.com/dragonflydb/dragonfly/pull/2893
fix(acl): authentication with UDS socket by @kostasrim in https://github.com/dragonflydb/dragonfly/pull/2895
feat(cluster): add repeated ACK if an error is happened by @BorysTheDev in https://github.com/dragonflydb/dragonfly/pull/2892
chore(blocking): Remove faulty DCHECK by @dranikpg in https://github.com/dragonflydb/dragonfly/pull/2898
chore: add a clear link on how to build dragonfly from source by @romange in https://github.com/dragonflydb/dragonfly/pull/2884
feat(server): Allow configuration of hashtag extraction by @chakaz in https://github.com/dragonflydb/dragonfly/pull/2890
fix: fix build under macos by @BorysTheDev in https://github.com/dragonflydb/dragonfly/pull/2901
fix(cluster_replication): replicate redis cluster node bug fix by @adiholden in https://github.com/dragonflydb/dragonfly/pull/2876
fix(acl): skip http and add check on connection traversals by @kostasrim in https://github.com/dragonflydb/dragonfly/pull/2883
fix(zset): Better memory consumption calculation by @chakaz in https://github.com/dragonflydb/dragonfly/pull/2900
fix: fix ld for num converting by @BorysTheDev in https://github.com/dragonflydb/dragonfly/pull/2902
chore: add help string for memory_fiberstack_vms_bytes by @romange in https://github.com/dragonflydb/dragonfly/pull/2903
fix(sanitizers): false positive fail on multi_test::Eval by @kostasrim in https://github.com/dragonflydb/dragonfly/pull/2896
chore: pull helio and add ipv6 replication test by @dranikpg in https://github.com/dragonflydb/dragonfly/pull/2889
chore: add ipv6 support for native linux release by @romange in https://github.com/dragonflydb/dragonfly/pull/2908

Huge thanks to all the contributors! ❤️

Full Changelog: https://github.com/dragonflydb/dragonfly/compare/v1.16.0...v1.17.0

v1.16.1

1 month ago

Dragonfly v1.16.1

This is a patch release.

What's Changed

fix: authorize the http connection to call DF commands (#2863)
possible crash in tls code (#2854 )
healthcheck for docker containers (#2853)

Full Changelog: https://github.com/dragonflydb/dragonfly/compare/v1.16.0...v1.16.1

v1.16.0

1 month ago

Dragonfly v1.16.0

Our spring release. We are getting closer to 2.0 with some very exciting features ahead. Stay tuned!

Some prominent changes include:

Improved memory accounting of client connections (#2710 #2755 and #2692 )
FT.AGGREGATE call (#2413)
Properly handle and replicate Memcache flags (#2787 #2807)
Intoduce BF.AGGREGATE BD.(M)ADD and BF.(M)EXISTS methods (#2801). Note, that it does not work with snapshots and replication yet.
Dragonfly builds natively on MacOS. We would love some help with extending the release pipeline to create a proper macos binary.
Following the requests from the Edge developers community, we added a basic HTTP API support! Try running Dragonfly with: --expose_http_api flag and then call curl -X POST -d '["ping"]' localhost:6379/api. We will follow up with more extensive docs later this month.
Lots of stability fixes, especially around Sidekiq and BullMQ workloads.

What's Changed

chore: make usan asan optional and enable them on CI by @kostasrim in https://github.com/dragonflydb/dragonfly/pull/2631
fix: missing manual trigger for daily sanitizers by @kostasrim in https://github.com/dragonflydb/dragonfly/pull/2682
bug(tiering): fix overflow in page offset calculation and wrong hash offset calculation by @theyueli in https://github.com/dragonflydb/dragonfly/pull/2683
Chore: Fixed Docker Health Check by @manojks1999 in https://github.com/dragonflydb/dragonfly/pull/2659
chore: Increase disk space in the coverage runs by @romange in https://github.com/dragonflydb/dragonfly/pull/2684
fix(flushall): Decommit memory after releasing tables. by @chakaz in https://github.com/dragonflydb/dragonfly/pull/2691
feat(server): Account for serializer's temporary buffer size by @chakaz in https://github.com/dragonflydb/dragonfly/pull/2689
refactor: remove FULL-SYNC-CUT cmd #2687 by @BorysTheDev in https://github.com/dragonflydb/dragonfly/pull/2688
chore: add malloc-based stats and decommit by @romange in https://github.com/dragonflydb/dragonfly/pull/2692
feat(cluster): automatic slot migration finalization #2697 by @BorysTheDev in https://github.com/dragonflydb/dragonfly/pull/2698
Basic FT.AGGREGATE by @dranikpg in https://github.com/dragonflydb/dragonfly/pull/2413
chore: little transaction cleanup by @dranikpg in https://github.com/dragonflydb/dragonfly/pull/2608
fix(channel store): add acquire/release pair in fast update path by @dranikpg in https://github.com/dragonflydb/dragonfly/pull/2704
chore: add ubuntu22 devcontainer by @romange in https://github.com/dragonflydb/dragonfly/pull/2700
feat(cluster): Add --cluster_id flag by @chakaz in https://github.com/dragonflydb/dragonfly/pull/2695
feat(server): Use mimalloc in SSL calls by @chakaz in https://github.com/dragonflydb/dragonfly/pull/2710
chore: Pull helio with new BlockingCounter by @dranikpg in https://github.com/dragonflydb/dragonfly/pull/2711
chore(transaction): Simplify PollExecution by @dranikpg in https://github.com/dragonflydb/dragonfly/pull/2712
chore(transaction): Don't call GetLocalMask from blocking controller by @dranikpg in https://github.com/dragonflydb/dragonfly/pull/2715
chore: improve compatibility of EXPIRE functions with Redis by @romange in https://github.com/dragonflydb/dragonfly/pull/2696
chore: disable flaky fuzzy migration test by @kostasrim in https://github.com/dragonflydb/dragonfly/pull/2716
chore: update sanitizers workflow by @kostasrim in https://github.com/dragonflydb/dragonfly/pull/2686
chore: Use c-ares for resolving hosts in ProtocolClient by @chakaz in https://github.com/dragonflydb/dragonfly/pull/2719
Remove check-fail in ExpireIfNeeded and introduce DFLY LOAD by @romange in https://github.com/dragonflydb/dragonfly/pull/2699
chore: Record cmd stat from invoke by @dranikpg in https://github.com/dragonflydb/dragonfly/pull/2720
fix(transaction): nullptr access on non transactional commands by @kostasrim in https://github.com/dragonflydb/dragonfly/pull/2724
fix(BgSave): async from sync by @kostasrim in https://github.com/dragonflydb/dragonfly/pull/2702
chore: remove core/fibers by @romange in https://github.com/dragonflydb/dragonfly/pull/2723
fix(transaction): Replace with armed sync point by @dranikpg in https://github.com/dragonflydb/dragonfly/pull/2708
feat(json): Deserialize ReJSON format by @chakaz in https://github.com/dragonflydb/dragonfly/pull/2725
feat: add flag masteruser by @kostasrim in https://github.com/dragonflydb/dragonfly/pull/2693
refactor: block list refactoring #2580 by @BorysTheDev in https://github.com/dragonflydb/dragonfly/pull/2732
chore: fix DeduceExecMode by @dranikpg in https://github.com/dragonflydb/dragonfly/pull/2733
fix(cluster): Reply with correct \n / \r\n from CLUSTER sub cmd by @chakaz in https://github.com/dragonflydb/dragonfly/pull/2731
chore: Introduce fiber stack allocator by @romange in https://github.com/dragonflydb/dragonfly/pull/2730
fix(cluster): Save replica ID per replica by @chakaz in https://github.com/dragonflydb/dragonfly/pull/2735
fix(ssl): Proper cleanup by @chakaz in https://github.com/dragonflydb/dragonfly/pull/2742
chore: add skeleton files for flat_dfs code by @romange in https://github.com/dragonflydb/dragonfly/pull/2738
chore: better error reporting when connecting to tls with plain socket by @romange in https://github.com/dragonflydb/dragonfly/pull/2740
chore: Support json paths without root selector by @dranikpg in https://github.com/dragonflydb/dragonfly/pull/2747
chore: journal cleanup by @romange in https://github.com/dragonflydb/dragonfly/pull/2749
refactor: remove start-slot-migration cmd #2727 by @BorysTheDev in https://github.com/dragonflydb/dragonfly/pull/2728
feat(server): Add TLS usage to /metrics and INFO MEMORY by @chakaz in https://github.com/dragonflydb/dragonfly/pull/2755
chore: preparations for adding flat json support by @romange in https://github.com/dragonflydb/dragonfly/pull/2752
chore(transaction): Introduce RunCallback by @dranikpg in https://github.com/dragonflydb/dragonfly/pull/2760
feat(replication): Do not auto replicate different master by @chakaz in https://github.com/dragonflydb/dragonfly/pull/2753
Improve Helm chart to be rendered locally and on machines where is not the application target by @fafg in https://github.com/dragonflydb/dragonfly/pull/2706
chore: preparation for basic http api by @romange in https://github.com/dragonflydb/dragonfly/pull/2764
feat(server): Add metric for RDB save duration. by @chakaz in https://github.com/dragonflydb/dragonfly/pull/2768
chore: fix flat_dfs read tests. by @romange in https://github.com/dragonflydb/dragonfly/pull/2772
fix(ci): do not overwrite last_log_file among tests by @kostasrim in https://github.com/dragonflydb/dragonfly/pull/2759
feat(server): support cluster replication by @adiholden in https://github.com/dragonflydb/dragonfly/pull/2748
fix: fiber preempts on read path and OnCbFinish() clears fetched_items_ by @kostasrim in https://github.com/dragonflydb/dragonfly/pull/2763
chore(ci): open last_log_file in append mode by @kostasrim in https://github.com/dragonflydb/dragonfly/pull/2776
doc(README): fix outdated expiry ranges description by @enjoy-binbin in https://github.com/dragonflydb/dragonfly/pull/2779
Benchmark runner by @adiholden in https://github.com/dragonflydb/dragonfly/pull/2780
chore(replication-tests): add cache_mode on test replication all by @kostasrim in https://github.com/dragonflydb/dragonfly/pull/2685
feat(tiering): DiskStorage by @dranikpg in https://github.com/dragonflydb/dragonfly/pull/2770
chore: add a boilerplate for bloom filter family by @romange in https://github.com/dragonflydb/dragonfly/pull/2782
chore: introduce conversion routines between JsonType and FlatJson by @romange in https://github.com/dragonflydb/dragonfly/pull/2785
chore: Fix memcached flags not updated by @dranikpg in https://github.com/dragonflydb/dragonfly/pull/2787
chore: remove duplicate code from dash and simplify by @kostasrim in https://github.com/dragonflydb/dragonfly/pull/2765
chore: disable test_cluster_slot_migration by @kostasrim in https://github.com/dragonflydb/dragonfly/pull/2788
fix: new[] delete[] missmatch in disk_storage by @kostasrim in https://github.com/dragonflydb/dragonfly/pull/2792
fix: sanitizers clang build and clean up some warnings by @kostasrim in https://github.com/dragonflydb/dragonfly/pull/2793
chore: add bloom filter class by @romange in https://github.com/dragonflydb/dragonfly/pull/2791
chore: add SBF data structure by @romange in https://github.com/dragonflydb/dragonfly/pull/2795
chore(tiering): Disable compilation for MacOs by @dranikpg in https://github.com/dragonflydb/dragonfly/pull/2799
chore: fix daily build by @romange in https://github.com/dragonflydb/dragonfly/pull/2798
chore: expose SBF via compact_object by @romange in https://github.com/dragonflydb/dragonfly/pull/2797
fix(ci): malloc trim on sanitizers workflow by @kostasrim in https://github.com/dragonflydb/dragonfly/pull/2794
fix(cluster): Don't miss updates in FLUSHSLOTS by @chakaz in https://github.com/dragonflydb/dragonfly/pull/2783
feat: add bf.(m)add and bf.(m)exists commands by @romange in https://github.com/dragonflydb/dragonfly/pull/2801
fix: SBF memory leaks by @kostasrim in https://github.com/dragonflydb/dragonfly/pull/2803
chore: refactor StringFamily::Set to use CmdArgParser by @romange in https://github.com/dragonflydb/dragonfly/pull/2800
fix: propagate memcached flags to replica by @romange in https://github.com/dragonflydb/dragonfly/pull/2807
DFLYMIGRATE ACK refactoring by @BorysTheDev in https://github.com/dragonflydb/dragonfly/pull/2790
feat: add master lsn and journal_executed dcheck in replica via ping by @kostasrim in https://github.com/dragonflydb/dragonfly/pull/2778
fix: correct json response for errors by @romange in https://github.com/dragonflydb/dragonfly/pull/2813
chore: bloom test - cover corner cases by @romange in https://github.com/dragonflydb/dragonfly/pull/2806
bug(server): do not write lsn opcode to journal by @adiholden in https://github.com/dragonflydb/dragonfly/pull/2814
chore: Fix build by disabling the tests. by @romange in https://github.com/dragonflydb/dragonfly/pull/2821
fix(replication): replication with multi shard sync enabled lagging by @adiholden in https://github.com/dragonflydb/dragonfly/pull/2823
fix: io_uring/fibers bug in DnsResolve by @romange in https://github.com/dragonflydb/dragonfly/pull/2825

New Contributors

@manojks1999 made their first contribution in https://github.com/dragonflydb/dragonfly/pull/2659
@fafg made their first contribution in https://github.com/dragonflydb/dragonfly/pull/2706
@enjoy-binbin made their first contribution in https://github.com/dragonflydb/dragonfly/pull/2779

Huge thanks to all the contributors! ❤️

🇮🇱 🇺🇦

Full Changelog: https://github.com/dragonflydb/dragonfly/compare/v1.15.0...v1.16.0

v1.15.1

2 months ago

Dragonfly v1.15.1

This is a patch release.

What's Changed

fix: Workaround for a possible crash during BLPOP calls.

Full Changelog: https://github.com/dragonflydb/dragonfly/compare/v1.15.0...v1.15.1

v1.15.0

2 months ago

Dragonfly v1.15.0

After more than a month, we are releasing a new version with even more efficient transactional algorithms, improved lua compatibility, better memory management and lots of stability fixes. For Mac enthusiasts - the project now builds natively on MacOs 💻

Some prominent changes include:

Lua redis.log(..) is recognized (#2476)
Lua can optionally return doubles as longs when replying to RESP2 clients using --lua_resp2_legacy_float flag (#2672)
Added backlog option (#2456)