Various embodiments described herein relate to a server-based virtual training environment monitor, which may configure and customize an exercise and fitness program accessible through augmented and virtual reality applications running on an electronic device of a user, based on a current state and events associated with the user. The current state and events are determined through reactive agents (for example, intelligent agents) and monitoring devices (for example, sensors), which are directly or indirectly associated with the electronic device.