IML Overview and Roadmap – Joe Grund, Whamcloud
Integrated Manager for Lustre (IML) is an open source suite of tools and a unified interface for managing / monitoring Lustre. In this session, you will learn what IML is, how it can make your life as a Lustre administrator easier, how it will be improving in the future, and how you can contribute.
While historically IML had been a monolithic piece of proprietary software, its open sourcing has increased its usage beyond the hundreds of paid customer production deployments. This expansion has been further increased due to efforts to modularize IML into components so that it is now possible for users to leverage a subset of the functionality for their own purposes.
IML enables a user to install, monitor and manage a Lustre filesystem, and get near real-time alerts and feedback of statistics and possible issues. Monitoring features include heatmaps of OST bandwidth / IOPS, and view of top jobs. Management features include High Availability of a Lustre filesystems via Corosync and Pacemaker and resource management via a state machine.
The latest 4.0.x release can be accessed at github.com/whamcloud/integrated-manager-for-lustre/releases. It supports the latest Lustre 2.10.x LTS and ZFS 0.7.x releases and has added scalability improvements such as device detection via Udev events.
The upcoming 5.0 release adds support for Lustre 2.12, monitoring of devices and pool health via ZED and libzfs, HA using Lustre and ZFS resource agents, delivery of IML in RPM form, manager install via Docker stack, UI Enhancements, and performance improvements using Rust.
Finally, the presentation will outline proposed enhancements after IML 5, Including full ZFS management and enhanced deployments.