Technical solutions are described method for analyzing a natural language conversation-generating machine. An example computer implemented method includes determining, from a plurality of adjacency pairs in a conversation, a number of base pairs. The computer implemented method also includes determining, from the plurality of adjacency pairs, a number of expansion pairs. The computer implemented method also includes computing a efficiency score for the conversation by computing a ratio of the number of base pairs and the number of expansion pairs.