US Patent 11514615 Streaming systems and methods of providing interactive streaming service

A streaming system includes a streaming server and a client device. The streaming server is configured to train an interactive frame prediction model based on streaming data, a user input and metadata associated with the user input, encode the streaming data by selectively using a predicted frame generated based on the trained interactive frame prediction model and transmit the trained interactive frame prediction model and the encoded streaming data. The client device is configured to receive the trained interactive frame prediction model and the encoded streaming data, and decode the encoded streaming data based on the trained interactive frame prediction model to provide recovered streaming data to a user.