Activity monitoring and replay techniques monitor and replay user consumption of content. To perform one of the techniques, event data from users that reflects the consumption of content is collected. The collected event data is used to infer one or more features in the content that are consumed by the user. The consumption of the one or more features by the user is replayed.