US Patent 7412391 User interface design apparatus and method

A user interface design apparatus which reduces the load associated with input operation by an author is provided. When a speech recognition grammar including a semantic structure generating rule is acquired, at least one semantic structure is extracted from the semantic structure generating rule included in the grammar. This semantic structure is presented to the author. The author can select the semantic structural element presented using an input device. Upon selection by the author is completed, the selected information is extracted and is reflected in user interface contents.