SheepDog v1.0 Release Notes

Release Date: 2016-06-30 // almost 8 years ago
  • 🆕 NEW FEATURE:

    • VDI over 4TiB: Now we can create a VDI larger than 4 tebibytes in size. This is realized by enlarging the size of data objects in a VDI. When you let it 8MiB (=2**23 bytes), the size of VDI is 8TiB (=8MiB*1024*1024). Note that this can degrade I/O performance. So you should use this only if nesessary.
    • multi-cluster in one ZooKeeper: Now we can manage one or more Sheepdog clusters in one ZooKeeper ensemble. You should give the cluster driver a "cluster ID" to which cluster the sheep process is to join when it is launched.
    • fixed vnodes: Gives vnodes to each sheep process in a cluster not automatically but manually. This is useful for reducing temporal disk space during recovery. Note that vnodes should be given to each sheep process in proportion to the capacity of disk(s). So you should use this carefully.
    • recycleing VID: Lets a cluster garbage-collect VDI IDs when all the members in a VDI family are deleted then reuse them when a new VDI is being created. This is useful for a cluster that VDIs are created, snapshotted and deleted many times.
    • avoiding diskfull caused by recovery: Lets each sheep process in a cluster not start recovery if total capacity of objects placed on it in the next epoch is larger than that of disk(s).

    SHEEP COMMAND INTERFACE:

    • new option "-V" to set the number of fixed vnodes manually (default: disabled i.e. vnodes calculated automatically)
    • a "cluster ID" can be given to the ZooKeeper cluster driver in the form of "host:port[,..]/clusterID" (default: "/sheepdog")

    DOG COMMAND INTERFACE:

    • new command "dog benchmark":
    • new option "-z" to "dog cluster format" to set default data object size and VDI size in a cluster (default: 22 i.e. 4MiB = 2**22 bytes per data object and 4TiB = 4MiB*1024*1024 per VDI)
    • new option "-V" to "dog cluster format" to enable fixed vnodes (default: disabled i.e. vnodes calculated automatically)
    • new option "-R" to "dog cluster format" to enable recycling VID (default: disabled)
    • new option "-F" to "dog cluster format" to enable avoiding diskfull caused by recovery (default: disabled i.e. try to recover always)
    • new option "-z" to "dog vdi create" to set data object size and VDI size being created individually with cluster's default
    • new option "-R" to "dog vdi snapshot" not to create a new snapshot if a working VDI does not have its own objects (default: disabled)

    ✅ TESTING:

    • operation test: Useful for testing SD_OP_*.

    OTHER IMPORTANT NOTE:

    • object cache feature and related interfaces are removed