Kvrocks Versions Save

Apache Kvrocks is a distributed key value NoSQL database that uses RocksDB as storage engine and is compatible with Redis protocol.

v2.8.0

2 months ago

Important Notice

Dependency Updates: RocksDB is bumped from 8.8.1 to 8.11.3 in this version.

Highlights:

Set the default value of redis-cursor-compatible to yes, so from this version, Kvrocks' SCAN will be compatible with Redis by default. We also proudly announce that RESP3 is fully supported now, you can enable the RESP3 feature via set resp3-enabled yes.

In addition, the cluster now can use the rocksdb write-batch to migrate slot data between instances via the APPLYBATCH command, which is faster and consumes less CPU compared to the replay command way.

It is worth mentioning that the community is working on the RedisSearch module, and we look forward to seeing RedisSearch in a future release.

New Features

Bug Fixes

Improvements

Misc

New Contributors

Full Changelog: https://github.com/apache/kvrocks/compare/v2.7.0...v2.8.0-rc1

v2.7.0

4 months ago

Important Notice

Dependency Updates: RocksDB is bumped from 8.3.3 to 8.8.1 in this version.

Highlights:

We're thrilled to announce that the JSON data structure is supported now, huge thanks to @PragmaTwice and all contributors for making this happen. Also, basic capabilities of Functions have been supported to make up for the lack of modularity of the EVAL-series commands.

From this release, the speedb is allowed to be used as an alternative to rocksdb, you have a try as simple as to append the build option -DENABLE_SPEEDB=ON. Additionally, dynamic change number of worker threads is also supported and users can change it via CONFIG SET workers {NUMBER}. Furthermore, numerous new commands and bug fixes have been implemented.

NOTICE: JSON and BloomFilter is not ready for the cluster mode yet.

New Features

Bug Fixes

Improvements

Misc

New Contributors

Full Changelog: https://github.com/apache/kvrocks/compare/v2.6.0...v2.7.0-rc1

v2.6.0

7 months ago

Important Notice

Dependency Updates: RocksDB is bumped from 8.3.2 to 8.3.3 in this version.

Configuration Changes: The default value of max-io-mb is changed to 0 (unlimited), and rocksdb.level_compaction_dynamic_level_bytes changed to yes from no.

Highlights: In this release, we have added support for the BloomFilter data structure and most of its commands (prefixed with BF.). Special thanks to @zncleon and @mapleFU. Additionally, the RESTORE command has been supported by @git-hulk to facilitate various data migration scenarios, such as using RedisShake upon Kvrocks. Moreover, TLS can now secure not only server connections but also replication connections. Furthermore, numerous new commands and bug fixes have been implemented. We extend our gratitude to all contributors!

New Features

Improvements

Bug Fixes

Misc

New Contributors

Full Changelog: https://github.com/apache/kvrocks/compare/v2.5.1...v2.6.0

v2.5.1

9 months ago

Highlights: This release only contains bug fixes since 2.5.0 and some critical issues need to be noticed. For #1615, the data race when reading the cluster slot's info may cause the server to crash in cluster mode, and #1568 / #1593 will also crash the server if users pass the wrong arguments.

Bug Fixes

  • Fix a data race when updating the slots_info string by @git-hulk in #1615
  • Fix make warning on GCC by @Yangsx-1 in #1605
  • Fix ZRANGESTORE not overwrite the dst key by @enjoy-binbin in #1609
  • Fix ZREMRANGEBYSCORE arity, should be 4 instead of -4 by @enjoy-binbin in #1604
  • Fix Docker image may crash if running on the AMD platform by @ovaistariq in #1602
  • Fix INFO used_memory_rss_human field name by @enjoy-binbin in #1595
  • Return an error when Stream::Range fails and remove some debug server logs by @enjoy-binbin in #1556
  • Fix config set compression type didn't take effect by @xiaobiaozhao in #1576
  • Fix ZRANGESTORE arity -4 that crashes the server by @enjoy-binbin in #1593
  • Fix version typo in a variable name by @enjoy-binbin in #1591
  • ZUNION arity should be -3 instead of -4 by @enjoy-binbin in #1589
  • Fix DECRBY LLONG_MIN caused an overflow by @enjoy-binbin in #1581
  • Fix GEOHASH / GEOPOS should return nil array instead of error for non-existing key by @enjoy-binbin in #1573
  • Fix EXEC / DISCARD without MULTI wrongly reset watch by @enjoy-binbin in #1562
  • Fix SCRIPT EXISTS arity by @enjoy-binbin in #1567
  • Fix EVAL crashing server when numkeys is -1 by @enjoy-binbin in #1568

v2.5.0

9 months ago

Important Notice

Dependency Updates: RocksDB is bumped from 8.1.1 to 8.3.2 in this version.

Highlights: We have supported Redis-compatible SCAN cursors so that you can use any Redis client library to perform the SCAN far painless than before. Enable it via redis-cursor-compatible in the configuration file. Many thanks to @jihuayu. Meanwhile, lots of ZSET commands are newly supported, like ZMPOP, ZRANGESTORE, BZMPOP, ZUNION. Many thanks to @infdahai for driving them and other contributors for implementing them. The detailed changes and contributors are listed below.

New Features

Improvements

Bug Fixes

Misc

New Contributors

Full Changelog: https://github.com/apache/kvrocks/compare/v2.4.0...v2.5.0-rc2

v2.4.0

1 year ago

Note: In this release, we have upgraded RocksDB to version 8.1.1. In addition, we have introduced a new storage encoding format that can accommodate 64-bit element count and expiration time in milliseconds. To enable this feature, you must include -DENABLE_NEW_ENCODING=ON during the build process (which is not enabled by default). Once the new encoding is enabled, data stored using the old encoding will remain accessible for reading and writing as usual. However, any new data will be written using the new encoding format.

New Features

Improvements

Bug Fixes

Misc

New Contributors

Full Changelog: https://github.com/apache/incubator-kvrocks/compare/v2.3.0...v2.4.0

v2.3.0

1 year ago

For this release, we now upgrade the RocksDB to 7.9.2 which will significantly improve the compaction performance. Another to be noticed, Kvrocks cluster mode will persist the cluster nodes' topology in the local file by default, you can disable it in flight by config set persist-cluster-nodes-enable no.

New Features

Improvements

Bug Fixes

Refine Code Style

New Contributors

v2.2.0

1 year ago

Notice

For this release, we are still using rocksdb 6.29, but we will update to rocksdb 7 in the next release (as in the unstable branch).

New Features

  • Allow using LuaJIT to improve the performance of the Lua script (#697)
  • Add the new command GETDEL (#771)
  • Add the new command SMISMEMBER (#778)
  • Add the new data structure Redis STREAM (#745)
  • Add TLS support for kvrocks connections (#797)
  • Add the new command HELLO (#881)
  • Add the new command EVAL_RO (#782)
  • Add the new command DISK (#882)
  • Add the new command GETEX (#961)
  • Support CLI options for the kvrocks server (#1037)
  • Add the new command options for ZADD (#1022)
  • Add ZLIB dependency for compression in rocksdb (#1078)

Improvements

  • Switch the default value of log-dir to stdout (#754)
  • Add fpm packaging to x.py (#752)
  • Propagate sanitizer flags to all cmake deps (#759)
  • Move runtest to x.py with customized server/cli path (#765)
  • Add StatusOr for error handling in modern C++ style (#768)
  • Add ParseInt in StatusOr style (#787)
  • Show function name in backtrace (#796)
  • Optimize get bitmap string and remove redundant num2bit array (#793)
  • Allows Kvrocks to listen to only the unix socket (#809)
  • Update dependency to latest version (lz4, libevent, gtest) (#828)
  • Export the rocksdb write options (#885)
  • Support quoted string and inline comment in config (#849)
  • Add the FilterBlobByKey for SubKeyFilter (#902)
  • Avoid using Get when iterating sub-keys during migration (#906)
  • Support EXAT/PEXAT option in the set command (#901)
  • Return from HRANGE if the key wasn't found (#923)
  • Update jemalloc to 5.3.0 (#940)
  • Use ParseInt to replace sto*, ato* (#924)
  • Add UniqueFD and ScopeExit (#973)
  • Align georadius behavior of redis (#993)
  • Align the expire option behavior of redis (#1017)
  • Support config set backup-dir new-dir (#1026)
  • Use a consistent way to get the current time (#1038)
  • Add support for showing used_memory_startup (#1044)
  • Improve stack trace format and clean main.cc (#1053)
  • Add command parser (#1032)
  • Add WriteBatchInspector to inspect WriteBatch (#1069)
  • Improve libunwind linking in CMake (#1079)

Bug Fixes

  • Fix didn't return the out of range error in cluster import command(#767)
  • Fix should forbid to create of the default namespace (#772)
  • Fix CMake configuration error in snappy (#803)
  • Fix inline protocol don't allow LF only EOL (#808)
  • Fix successor commands won't be processed before receiving the next read event (#839)
  • Fix georadius should return an empty set if the key does not exist (#845)
  • Fix config set rocksdb.blob_garbage_collection_age_cutoff (#914)
  • Fix ping with arg should return a bulk string (#933)
  • Fix server cannot exit properly when enabling cluster mode (#969)
  • Fix shouldn't lowercase the configuration value in kvrocks2redis(#971)
  • Fix don't duplicate killed clients which have already flagged kCloseAfterReply (#1020)
  • Fix properly parse cmake version (#1043)
  • Fix rename-command only the first one works(#1047)
  • Fix CAS and CAD return statuses (#1055)
  • Fix random crash in the migration test case (#1068)

Test Refactoring

TCL tests are now moved to Go, refer to #811.

Misc

  • Replace cpplint with clang-format (#979)
  • Refactor source file structure (#989)
  • Update C++ standard to 17 (#1006)
  • Use clang-tidy instead of cppcheck (#1025)

v2.1.0

1 year ago

New features

  • Support source packaging by x.py (#729)
  • Support to use lz4 compression in RocksDB (#584)
  • Allow to send logs to stdout/stderr (#613)
  • LPOP/RPOP support pop multi elements (#594)
  • Add LMove command (#577)
  • Support to listen on the IPV6 address (#554)
  • Add support for listening to unix socket (#531)
  • Support BITOP command (#471)
  • Support unlink command (#517)

Improvements

  • replace shell scripts with x.py (#725)
  • Use lock_guard to replace the manual mutex lock/unlock (#723)
  • Build docker image with travis ci (#724)
  • Return values instead of passing pointers (#722)
  • Don't call GetCurrentTime in expired and type when possible (#709)
  • Remove the slice ToString() when encoding or decoding the key (#707)
  • Use the const reference for avoiding copy (#704)
  • Check sanitizer status for TCL tests in CI (#698)
  • CMake: support ninja as a build backend (#626)
  • Build static lib for glog (#618)
  • Improve using of ASan and TSan in CMake build (#599)
  • PSYNC based on Unique Replication Sequence ID (#538)
  • Remove handwritten makefiles to keep only one build system (#576)
  • Use FetchContent instead of ExternalProject and git submodules in CMake (#564)
  • Upgrade the rocksdb version to 6.29.5(latest version for 6.x) (#555)
  • Support to send auth command before migrating slots (#514)
  • Allow to dynamic resize the level_compaction_dynamic_level_bytes and level base size (#497)

Bugfixes

  • Make the set command consistent with redis (#730)
  • Fix some time dependencies in replication.tcl (#688)
  • Fix get rocksdb ops tcl test case (#668)
  • Fix typos in config file (#669)
  • Fix replication tests should wait for server restarted (#660)
  • Fix the role command can't be used when loading data (#661)
  • Fix Wrongly parsed the RESP empty/null array (#652)
  • Fix compile warnings in kvrocks (#653)
  • Fix unmatched iterator in Cluster::SetClusterNodes (#646)
  • Fix load namespaces from the config file would ignore case (#642)
  • Fix RocksDB can't auto resume after disk quota exceeded error (#628)
  • Fix don't swallow the error when creating column families failed (#620)
  • Compile lua by C++ compilers to avoid memory leaks (#614)
  • Fix the slave may crash when restoring the db (#606)
  • Fix leaks reported by ASan (#605)
  • Fix can't find jemalloc when building with makefile on MacOSX (#557)
  • Stop sending files if failed in full synchronization (#539)
  • Avoid requirepass and masterauth conflicts with the namespace tokens (#507)
  • Fix slave can't resync with master after password change (#520)
  • Fix rocksdb cmake depends should use list instead of string (#518)
  • Fix spop command should return bulk string instead of array when without count(#515)
  • Fix wrong replication state (#506)
  • Avoid flush all redis db in kvrocks2redis (#498)
  • Fix failing in setting thread name with string more than 16 byte (#496)
  • Avoid accessing slot_migrate_ before it is created (#472)
  • Fix the connection fd was used after free (#479)

Others

  • Add use case CIRCL.lu (#546)
  • Change license to Apache 2.0 (#533)
  • Add DISCLAIMER (#558)
  • Apply Apache License header for Tcl files (#548)
  • Add .asf.yaml file (#545)
  • Apply Apache License header for source code (#543)

v2.0.6

2 years ago

Thanks ChrisZMF who implements slot-based data migration for Kvrocks cluster mode, this authentically makes kvrocks cluster scalable. Even though it already is used in production environments, you still should be cautious of it.

Here is a comprehensive list of changes in this release compared to 2.0.5

New features

  • Support slot-based data migration (#430) Biggest feature of this version, authentically makes kvrocks scalable, user can use CLUSTERX MIGRATE command to migrate slot and use CLUSTERX SETSLOT to change cluster slot distribution after finishing migration.
  • Make level0_file_num_compaction_trigger of RocksDB configurable (#455)
  • Support CLUSTERX SETSLOT command (#463)

Improvements

  • Support executing INFO command during restoring database (#375)
  • Auto Rewrite the config after the namespace was updated (#423)
  • Support to convert sortedint type to zset type in kvrocks2redis (#431)
  • Optimize the seek of RocksDB iterators (#438)
  • Make the bitmap range the same with that of Redis (#465)
  • Support GET command on bitmap type (#447)
  • Support to use row cache of RocksDB (#407)

Bug fixes

  • Fix the parameter blob_garbage_collection_age_cutoff would be always zero (#425)
  • Fix config rewrite overwrite the first rename-command with the last one (#429)
  • Fix zrevrangebyscore for multi members with the same max score (#434)
  • Fix data race in SetCurrentConnection (#440)
  • Fix failing full replication when enabling slave-empty-db-before-fullsync (#446)
  • Fix memory leak when full replication (#461) Maybe leak dozen kilobytes per full replication
  • Fix the bitmap range is smaller than that of Redis (#465)