In the X10000's disaggregated architecture, each drive is carved into small logical units called disklets, which are grouped into RAID-protected slices. These disklet RAID slices are dynamically assigned to Data Service Partitions (DSPs), which are sharded, portable partitions that vertically slice the overall workload across the stateless controller nodes. Because objects are distributed across DSPs using a hash-based scheme, I/O load is continuously balanced across every controller in the cluster, and DSPs can be rapidly and evenly redistributed among remaining controllers if nodes are lost or added—since all persistent state resides in the JBOFs rather than the nodes. This is the opposite of consolidating disklets into a single partition or confining workload to specific controllers; the design goal of DSPs is precisely to spread workload across all available controllers via disklet-based slicing.
Community Discussion