MooseFS v3.0.103 Release Notes

Release Date: 2018-11-23 // over 5 years ago
  • Dear MooseFS Users,

    ๐Ÿ›  MooseFS 3.0.103 is now stable! This release includes both bugfixes and new features.

    Block Device

    The biggest and most awaited feature introduced in this version is support for Block Storage which allows you to skip FUSE layer completely and give a block device instead of a file system layer to the OS on the Client using mbfsbdev instead of mfsmount.

    ๐Ÿ‘€ See more in man mfsbdev.

    This is kind of "feature release" of Block Device - we may improve it or its management in the future. You are very welcome to test it and report any issues by raising a GitHub issue. Your reports will help to make this feature and MooseFS better! ๐Ÿ‘ :)

    MooseFS Meta Dirinfo

    The second new big feature is mfsmetadirinfo. It is so-called "offline" implementation of well-known mfsdirinfo -p and similarly allows you to count real space usage of a particular directory precisely, with taking snapshots into consideration. The tool is faster than mfsdirinfo -p and you can use it on your Master Server. The tool operates on a dumped metadata file (e.g. metadata.mfs.back or metadata.mfs).

    ๐Ÿ‘€ See more in man mfsmetadirinfo.

    Extremely fast Pseudo-random Generator

    ๐Ÿš€ This release also includes extremely fast (>1GB/s) pseudo-random generator visible as a virtual file .random in root directory (not listed by ls). You can use it for testing purposes, similarly as you use e.g. /dev/urandom.

    ๐Ÿ†• New Chunk testing routine in MB/s

    MooseFS constantly checks Chunks' checksums in background in order to prevent silent data corruption. This version gives you ability to define speed in MB/s of this checking. It is especially important for big clusters with huge number of small files where definition in chunks per second could reflect in a very long time of whole cluster checking (like years).

    ๐Ÿ›  Complete list of features and fixes in MooseFS 3.0.103

    ๐Ÿš€ Please find the list of fixes this release includes below:

    • ๐Ÿง (bdev) new module for Linux - dedicated block device
    • (metatools) added new metatool mfsmetadirinfo - offline version of mfsdirinfo -p
    • (mount) added extremely fast (>1GB/s) pseudo-random generator visible as a virtual file .random in root directory (not listed by ls)
    • โœ… (cs) changed chunk testing routine (new definition is in MB/s per disk)
    • (tools) changed data structure used by mfsdirinfo -p (faster, less memory usage)
    • (cs) added optional high speed internal rebalancing
    • ๐Ÿ”จ (tools) network code refactoring (less code, reconnection to master on error)
    • (master+client) added space reservation for superuser
    • (daemons) added optional processname_set function
    • ๐Ÿ›  (daemons) fixed waitpid condition
    • (cs) added data precaching (posix_fadcvise(WILLNEED)) before reading chunk data
    • ๐Ÿšš (master) remove chunk copy from structures (instead of leaving as INVALID) when replication returned error
    • ๐Ÿ“‡ (master) close listen sockets after fork (metadata save in background)
    • ๐Ÿ“‡ (master) added subprocess for saving downloaded metadata in background (pro only)
    • ๐Ÿ›  (master) fixed mfsrmsnapshot issue (SNAPSHOT flag not set in directories - intr. in 3.0.101)
    • (mount) added option to load master password from given file
    • ๐Ÿšง (cs) proper disconnection from master during reload (maintenance mode during reload)

    Best regards,
    Piotr / MooseFS Team