US Patent 9954920 Distributed secure decoding and processing of big data streams

Embodiments are directed to a secure MapReduce model for distributed processing and decoding of big data streams. An encoding engine may be employed to divide a data stream into equally sized segments. The segments may be encoded using a document key provided in a set of bundles. The bundles may contain encoded segment metadata, including the document key used to encode the stream. The document key and segment metadata may be encrypted using public key cryptography, and optionally included in the bundles. The encrypted bundles may be embedded into the encoded segments which may be provided to other network computers that include a decoding engine and an application engine. The encrypted bundles may be decrypted to obtain the document key for each encoded segment. The encoded segments may then be decrypted using the document key. And, each decoded segment may be provided to an application engine for further processing.