Changelog History
Page 2
-
v3.0.104 Changes
April 01, 2019๐ MooseFS 3.0.104 is now stable! This release includes both bugfixes and new features.
๐ We would like to thank all the contributors who helped us making this release, especially (alphabetically): @borkd, @dragon2611, @nickb937, @njaard, @onlyjob. Thank you for all your help!
(If I forgot to mention somebody, I am very sorry and please let me know!)
๐ Please find the list of fixes this release includes below:
- ๐ (master) fixed taking into account labels in classes 1-9
- ๐ (master) fixed recovering
userperm
andotherperm
in ACL (in practice it doesn't matter โ mainly cosmetics) - ๐ (cli+cgi) fixed
python3
compatibility issue (casting toint
for%X
format) - ๐ (master) increased mmap allocation block size (Linux kernel issue โ too many
mmaps
leads to memory not being properly released by the kernel) - ๐ (client) fixed handling internal packets with size zero (client disconnection during chunkserver registration)
- ๐ (client) fixed symlink cache handling (potential race condition)
- (master) added global option for preventing using same ip or same rack for more than one chunk copy
- (client) added ignoring
_netdev
option โ sometimes needed in case of mounting from fstab - (master) added defining
rackid
as string paths inmfstopology.cfg
(introduced optional higher distances between servers) - ๐ (master) fixed desync on adding damaged chunk
- ๐ (master) added changelog save mode (background, async and sync)
- ๐ (all) fixed issues reported by
cppcheck
(fixes #179) - ๐ (cli+cgi) fixed issues reported by
pylint
(fixes #180) - (cs) added 'damaged' flag to chunk (prevents syslog flooding โ issue #192)
- ๐ (metatools) fixed conflict with builtin function
humanize_number
(NetBSD) - ๐ท (master) better handling chunks with pending high-priority jobs
- ๐ฒ (master) long loop detection (log info whenever time between polls is longer than 5 seconds)
- ๐ (master) fixed condition that checks if thare are all chunkservers and all chunks available (and using it for detecting
ENOSPC
condition โ issue #201) - (mount) added
.params
pseudofile with mfsmount working parameters (such as cache sizes, timeouts etc.) - ๐ (cs) fixed removing chunks from data structures when marking disk as 'damaged' (issue #207)
- ๐ (cs) fixed handling 'damaged' disks with chunks on reload (issue #207)
- (cs) unlink duplicates week after detection (instead of removing them instantly โ related to issue #207)
- (tools) added displaying number of blocks in
mfsfileinfo
- (master) added error messages for 'fork' errors
- ๐ (cgi) fixed handling encodings (issue #206 and #208)
- (cgi) added timestamp (issue #197)
- ๐ (cgi) fixed
chart.cgi
url (issue #200) - ๐ (cs) fixed crc values for non existing blocks
- ๐ (mount) fixed changing processname
- (supervisor) added reloading config parameters on SIGHUP (aka 'reload' โ 'pro' version only)
- ๐ (cs) fixed exiting protocol
- (cs) added internal rebalance chart
Best regards,
Piotr / MooseFS Team -
v3.0.103 Changes
November 23, 2018Dear MooseFS Users,
๐ MooseFS 3.0.103 is now stable! This release includes both bugfixes and new features.
Block Device
The biggest and most awaited feature introduced in this version is support for Block Storage which allows you to skip FUSE layer completely and give a block device instead of a file system layer to the OS on the Client using
mbfsbdev
instead ofmfsmount
.๐ See more in
man mfsbdev
.This is kind of "feature release" of Block Device - we may improve it or its management in the future. You are very welcome to test it and report any issues by raising a GitHub issue. Your reports will help to make this feature and MooseFS better! ๐ :)
MooseFS Meta Dirinfo
The second new big feature is
mfsmetadirinfo
. It is so-called "offline" implementation of well-knownmfsdirinfo -p
and similarly allows you to count real space usage of a particular directory precisely, with taking snapshots into consideration. The tool is faster thanmfsdirinfo -p
and you can use it on your Master Server. The tool operates on a dumped metadata file (e.g.metadata.mfs.back
ormetadata.mfs
).๐ See more in
man mfsmetadirinfo
.Extremely fast Pseudo-random Generator
๐ This release also includes extremely fast (>1GB/s) pseudo-random generator visible as a virtual file
.random
in root directory (not listed byls
). You can use it for testing purposes, similarly as you use e.g./dev/urandom
.๐ New Chunk testing routine in MB/s
MooseFS constantly checks Chunks' checksums in background in order to prevent silent data corruption. This version gives you ability to define speed in MB/s of this checking. It is especially important for big clusters with huge number of small files where definition in chunks per second could reflect in a very long time of whole cluster checking (like years).
๐ Complete list of features and fixes in MooseFS 3.0.103
๐ Please find the list of fixes this release includes below:
- ๐ง (bdev) new module for Linux - dedicated block device
- (metatools) added new metatool
mfsmetadirinfo
- offline version ofmfsdirinfo -p
- (mount) added extremely fast (>1GB/s) pseudo-random generator visible as a virtual file
.random
in root directory (not listed byls
) - โ (cs) changed chunk testing routine (new definition is in MB/s per disk)
- (tools) changed data structure used by
mfsdirinfo -p
(faster, less memory usage) - (cs) added optional high speed internal rebalancing
- ๐จ (tools) network code refactoring (less code, reconnection to master on error)
- (master+client) added space reservation for superuser
- (daemons) added optional
processname_set
function - ๐ (daemons) fixed waitpid condition
- (cs) added data precaching
(posix_fadcvise(WILLNEED))
before reading chunk data - ๐ (master) remove chunk copy from structures (instead of leaving as INVALID) when replication returned error
- ๐ (master) close listen sockets after fork (metadata save in background)
- ๐ (master) added subprocess for saving downloaded metadata in background (pro only)
- ๐ (master) fixed
mfsrmsnapshot
issue (SNAPSHOT flag not set in directories - intr. in 3.0.101) - (mount) added option to load master password from given file
- ๐ง (cs) proper disconnection from master during reload (maintenance mode during reload)
Best regards,
Piotr / MooseFS Team -
v3.0.101 Changes
July 23, 2018Dear MooseFS Users,
๐ MooseFS 3.0.101 is stable now! Please find the list of fixes this release includes below:
- (master) make under goal replications respect topology (patch made by tclh123)
- (master) fix inforec undergoal (patch made by tclh123)
- ๐ (cgiserv) fixed handling connection close during data sending (leaving active pipes which caused leaving
mfs.cgi
subprocesses) - ๐ (mount) decreased memory usage (fixed handling buffers allocated per thread)
- (all) setting correct errno when read returns 0 (in
sockets.c
) - ๐ (mount) fixed double free of
plock_data
structure - ๐ (master) fixed inconsistency in calculating realsize when storage class definition has changed
- ๐ (master+mount) fixed handling read-only filesystems (
ro
flag in exports and lookup-openlflags
) - 0๏ธโฃ (all) fixed differences in defaults between source, config and manpages
- (all) added
nobreak
macro to explicitly inform compiler that intentionally there is nobreak
before followingcase
- ๐ง (mount) added
mfssuid
andmfsdev
options to mount (allows mounting with suid/dev options using system mount on Linux) - โ
(cs) added using
posix_fadvise(...DONTNEED)
for tested chunks - ๐ (master) fixed HA bug (uninitialized variable might cause everlasting ELECT - PRO only)
- ๐ (cs) fixed
metaid
handling - (master) added clearing SNAPHSOT eattr on file/directory modifications
- (master) added optional same rack preference for destination server during undergoal replications
- โฑ (mount+tools) increased masterproxy timeout from 1s to 20s
Best regards,
Piotr / MooseFS Team