Patent attributes
One example method includes receiving stream data batches at a client node. The client node determines if the stream data batches are compressible. For the compressible stream data batches, a request is sent to a server node for an on-demand stream compression service, the request including an indicator of a stream data type for the compressible data batches. The on-demand stream compression service is deployed and launched at the client node. The on-demand stream compression service includes a compressor pool of compressors that are able to compress the stream data type of the compressible stream data batches. A compressor of the compressor pool is selected and used to compress the compressible stream data batches. The compressed stream data batches are sent to the server node.