A method is used in managing inline data compression in storage systems. A number of allocation units in which data of a file system is stored in a segment in a compressed format is determined. The segment comprises of a first storage space for storing a set of allocation units and a second storage space that is not allocated to the set of allocation units. Based on a policy, the second storage space of the segment is associated to at least one allocation unit of the set of allocation units.