Upon authorizing a user via challenge biometric data, user data is determined to be updated based on detecting a trigger. Upon detecting the trigger prior to authenticating the user, the user data is updated with the challenge biometric data based on authenticating the user. Upon detecting the trigger after authenticating the user, the user data is updated with updated challenge biometric data based on a confidence score for the second biometric data exceeding a threshold. Structure components are controlled based on the updated user data.