Disclosed herein are related to a device and a method of generating triggers to provide effects to an artificial reality based on features in an environment. In one aspect, a set of candidate triggers for applying effects to the artificial reality provided by the device is determined according to features in an environment. In one aspect, a subset of the set of candidate triggers is determined according to a predetermined policy. In one aspect, corresponding effects to apply to the artificial reality are generated by the device according to the subset of the set of candidate triggers.