US Patent 9639263 Native overlay for rapid editing of web content

A web rendering module in the operating system is used to render and display a web page. The web rendering module also generates layout data that describes the position and size of each visual element on the rendered web page. A web editing application uses the layout data to generate a native overlay. The native overlay is an arrangement of cells, and each cell has the same position and size as a respective visual element. The application displays the native overlay on top of the rendered web page so that each visual element on the web page is aligned with a cell in the native overlay. The cells in the native overlay are transparent so that the rendered web page remains visible to the user, but the native overlay captures any interactions that the user performs. The interactions are then processed to make a corresponding change to the web page.