US Patent 10311409 Detection and interpretation of visual indicators

Devices, systems and methods are disclosed that detect and interpret the meaning of visual and/or audio indicators of devices, and provide information, solutions to potential malfunctions, and/or automatic ordering of consumable products to users. For example, sequences of visual indicators (such as LEDs) and/or audio indicators (such as speakers that output beeps) generated by home electronics and other devices may be monitored using an image capture component (such as a camera) or audio capture component (such as a microphone), and the sequences may be interpreted to provide users with information of what is wrong with a device, how to fix a device, purchase a new device, offer repair services, etc. The systems and methods may also provide users with notifications relating to such indicators when the user is away from home.