Dear Users,

3.13-rc3 (release candidate) is officially out!

What's new

Updated packaging for current releases of popular distributions:

• Debian 10.4
• Ubuntu 20.04
• CentOS 8

Known issues by severity

grave

• upgrading from 3.12 to 3.13 can potentially lose EC chunks

major

• seekdir/telldir does not work properly, especially seekdir with negative offsets
• chunk replicated onto a drive that fails during a write operation can end up in limbo state (undergoal) until chunkserver is restarted

minor

• uRaft package is not integrated yet (not ready for use)
• Ganesha has not been tested yet
• chunk rebalancing behavior is flaky (is some scenarios it takes more time than it should)

Future plans

LizardFS team plans for two more rc versions before an actual 3.13 release:

• rc4 - fix all known grave and major issues
• rc5 - integration of uRaft and Ganesha

Dear Users,

3.13.0-rc2 (release candidate) is officially out!

2 major bugs fixed:

• Issue #662
• Issue #780

Minor fixes and features:

• Changing configuration paths from /etc/mfs/ to /etc/lizardfs/ (#456)
• Fixing autofs mounts (#731)
• Fix for not honored ACL (#816)
• Fixed build for 32-build mfsmount3
• Replacing fixed version of Google Test and spdlog with newest available version (#774)
• Making DebHelper able to use multiple parallel jobs
• Fix incorrect number of files/directories with specified goal (#723)
• Fixing compilation of the Wireshark plugin
• Fixed lizardfs-uraft deb package (#719)
• Added missing header to make LizardFS compilable again (#655)
• Clearing up compilation compilation warnings
• Fixing debug info
• Adding code documentation

Cheers, LizardFS Team

Dear Users,

3.13.0-rc1 (release candidate) is officially out!

Featuring:

• uRaft HA
• fixes to EC handling
• nfs-ganesha plugin changed to use only C code
• reduced number of secondary groups retrievals
• add fuse3 client
• many fixes

Detailed info:

• uRaft HA *

uRaft is HA solution designed for use with LizardFS. It allows for seamless switching of master server in case of hardware failure. More information about uRaft is available in LizardfFS Handbook (https://docs.lizardfs.com/index.html)

• fixes to EC handling *

For chunk types with number of parity greater than 4 there could occur situation when it wasn't possible to recover missing data. This was low probability event but nonetheless it could happen. To solve this problem we have to recompute parity parts for those types of chunks. Unfortunately until all parity parts are recomputed affected chunks are in endangered state.

• nfs-ganesha plugin changed to use only C code *

In preparation for moving LizardFS nfs-ganesha plugin to official nfs-ganesha repository, we had to remove all occurrences of C++ code and replace it with plain C.

• reduced number of secondary groups retrievals *

In LizardFS we introduced handling of secondary groups. Unfortunately the function to retrieve secondary groups in FUSE library turned out to be using a lot of CPU resources. Thanks to removing unnecessary calls to this function, mount performance increased significantly.

• add fuse3 client *

LizardFS now include mount3 client which uses FUSE3 library. Thanks to new features in FUSE3, now mount performs much better in many scenarios. Here are the most important changes visible to LizardFS users:

• big_writes option is now enabled by default (also it isn't recognized as a parameter anymore).
• Added writeback_cache option. With kernel 3.14 and newer this enables write-back caching which can significantly improve performance.
• increased read/write performance (specially for small operations)

Because most of the Linux distributions don't include FUSE3 library, we have build FUSE3 packages and made them available on LizardFS page (https://lizardfs.com/)

Cheers, Adam Ochmański LizardFS Team

Dear Users,

3.12.0 is officially out!

Featuring:

C API nfs-ganesha plugin RichACL - a new POSIX + NFSv4 compatible ACL standard OSX ACL support through osxfuse ACL in-memory deduplication client readahead enabled by default file lock fixes AVX2 support for erasure code goals MinGW compilation fixes more flexible chunkserver options many fixes Detailed info:

C API * LizardFS 3.12 comes with liblizardfs-client library and C language API header. It's now possible to build programs/plugins with direct support for LizardFS operations, no FUSE needed. For reference, see: src/mount/client/lizardfs_c_api.h src/data/liblizardfs-client-example.c

For those building LizardFS from source, pass a -DENABLE_CLIENT_LIB=YES flag to cmake in order to make sure you're building client library as well.

nfs-ganesha plugin * Our official plugin for Ganesha NFS server is included as well. This plugin enables a LizardFS FSAL (File System Abstraction Layer) to Ganesha, which is then used to access LizardFS clusters directly. Our new plugin is pNFS and NFSv4.1 friendly.

For those building LizardFS from source, pass a -DENABLE_NFS_GANESHA=YES flag to cmake in order to make sure you're building client library as well.

RichACL * In order to extend POSIX access control list implementation we introduced RichACL support. Backward compatibility with POSIX ACLs is guaranteed. Additionally, it's possible to use NFSv4-style ACL tools (nfs4_getfacl/nfs4_setfacl) and RichACL tools (getrichacl/setrichacl) to manage more complicated access control rules.

OSX ACL * Setting/getting ACLs is also possible on OSX via both command line chmod/ls -e interface and desktop.

File lock fixes * Global file locking mechanism is now fully fixed and passes all NFS lock tests from connectathon suite.

AVX2 * Erasure code goal computing routines now take full advantage of AVX2 processor extensions.

MinGW * LizardFS is now bug-free again for MinGW cross-compiling.

Chunkserver options * Replication limits are now fully configurable in chunkserver config. Also, chunk test (a.k.a. scrubbing) has 1 millisecond precision now instead of previous 1 second, which allows users to turn on more aggressive scrubbing with simple chunkserver reload.

Best regards, LizardFS Team

Dear Users,

3.12.0-rc (release candidate) is officially out!

Featuring:

• C API
• nfs-ganesha plugin
• RichACL - a new POSIX + NFSv4 compatible ACL standard
• OSX ACL support through osxfuse
• ACL in-memory deduplication
• client readahead enabled by default
• file lock fixes
• AVX2 support for erasure code goals
• MinGW compilation fixes
• more flexible chunkserver options
• many fixes

Detailed info:

• C API *

LizardFS 3.12 comes with liblizardfs-client library and C language API header. It's now possible to build programs/plugins with direct support for LizardFS operations, no FUSE needed. For reference, see: src/mount/client/lizardfs_c_api.h src/data/liblizardfs-client-example.c

For those building LizardFS from source, pass a -DENABLE_CLIENT_LIB=YES flag to cmake in order to make sure you're building client library as well.

• nfs-ganesha plugin *

Our official plugin for Ganesha NFS server is included as well. This plugin enables a LizardFS FSAL (File System Abstraction Layer) to Ganesha, which is then used to access LizardFS clusters directly. Our new plugin is pNFS and NFSv4.1 friendly.

For those building LizardFS from source, pass a -DENABLE_NFS_GANESHA=YES flag to cmake in order to make sure you're building client library as well.

• RichACL * In order to extend POSIX access control list implementation we introduced RichACL support. Backward compatibility with POSIX ACLs is guaranteed. Additionally, it's possible to use NFSv4-style ACL tools (nfs4_getfacl/nfs4_setfacl) and RichACL tools (getrichacl/setrichacl) to manage more complicated access control rules.

• OSX ACL * Setting/getting ACLs is also possible on OSX via both command line chmod/ls -e interface and desktop.

• File lock fixes * Global file locking mechanism is now fully fixed and passes all NFS lock tests from connectathon suite.

• AVX2 * Erasure code goal computing routines now take full advantage of AVX2 processor extensions.

• MinGW * LizardFS is now bug-free again for MinGW cross-compiling.

• Chunkserver options * Replication limits are now fully configurable in chunkserver config. Also, chunk test (a.k.a. scrubbing) has 1 millisecond precision now instead of previous 1 second, which allows users to turn on more aggressive scrubbing with simple chunkserver reload.

Cheers, LizardFS Team

Dear Users, LizardFS 3.11.3 is ready.

Yet another bugfix release, here's what we fixed:  

• master: fix issues with reporting defective files
• mount: fix request size in read cache for empty results   Best, LizardFS Team

Dear Users,

LizardFS 3.11.2 is already here!

This is a very minor release and its only purpose is to fix wrong version code in 3.11.1.

Enjoy!

Best, LizardFS Team

Dear Users,

LizardFS 3.11.1 is out!

This is a minor bugfix release, so it contains bugfixes only:

• master: fix high cpu usage in fs_periodic_file_test
• master: fix dangling nodes in defective files list
• mount: fix direntry cache bug for repeated paths

Enjoy!

Best, LizardFS Team

Dear Users,

here comes LizardFS 3.11.0! Featuring:

master: improve ACL implementation master: add option to avoid same-ip chunkserver replication master: add minimal goal configuration option master: reimplement directory entry cache for faster lookups master: add whole-path lookups master: chunkserver add chunkserver load awareness mount: add readahead to improve sequential read perfromance mount: add secondary groups support tools: add correct-only flag to filerepair tools: add -s and -i options to snapshot command tools: add recursive remove operations (for removing large directories and snapshots) tools: add tool for stopping execution of tasks (snapshot, recursive remove, etc.) all: change to semantic versioning system all: many fixes

Detailed information:

Readahead Clients can now benefit from integrated readahead mechanism. In order to enable readahead, please mount with the following options: -o cacheexpirationtime={MSEC} -o readaheadmaxwindowsize={KB} Example: mfsmount -o cacheexpirationtime=1000 -o readaheadmaxwindowsize=8192

Recursive remove A tool for removing large directories/snapshots is finally implemented. Example: lizardfs rremove big_directory/ lizardfs rremove -h

Tools for managing tasks Two administration tools are available for managing long tasks: lizardfs-admin list-tasks lizardfs-admin stop-task Run above commands for detailed usage information.

Secondary groups support LizardFS is now able to fully recognize secondary groups of users and take them into account while evaluating permissions.

Best, LizardFS Team

Hi all,

LizardFS 3.10.6 is here!

This release provides fixes only:

• (master) judy library fixes
• (master) ARM compilation fixes

Best, LizardFS Team