A user interface (UI) enhancement system modifies a computer user interface based on user interactions recorded over time. The UI enhancement system records user interactions and develops a corresponding heat map. The heat map represents frequencies of user actions such as links clicked, scrolling actions, buttons selected, jumps within a page, etc. Based on the heat map, the UI enhancement system modifies a user interface configuration file which in turn influences the appearance and/or behavior of elements within the user interface to improve the user experience. Some embodiments give greater prominence to a UI element associated with greater “heat” and less prominence to an element with less “heat”.