Patent attributes
A streaming data storage system provides for segment groups that facilitate the distribution of event traffic among storage entities. When too much event traffic with the same routing key (or with a small number of routing keys) is being ingested by the system into one segment of a data stream, the system subdivides the segment into a segment group of sub-segments, which can be distributed among storage resources of the streaming data storage system. Writer components of the system append events received from upstream applications to the sub-segments along with a writer identifier and a sequence number for each event. Reader components of the system use writer identifiers and the sequence numbers to serve events from the segment group to upstream code in the proper order, on a per-writer basis.