Present embodiments are directed to a distributed control system of an interactive video system. The distributed control system includes a switched fabric network, which includes an input node implemented to collect scanning data for a participant. The switched fabric network also includes a set of processing nodes implemented to generate a virtual representation for the participant based at least in part on the scanning data for the participant. Further, the switched fabric network includes an output node, which includes an output device implemented to present the virtual representation of the participant in a virtual environment.