Described are energy storage devices employing a gas storage structure, which can accommodate or store gas evolved from the energy storage device. The energy storage device comprises an electrochemical cell with electrodes comprising metal-containing compositions, like metal oxides, metal nitrides, or metal hydrides, and a solid state electrolyte.