An image decoding device is provided which reconstructs an intra prediction mode of a current prediction unit using a prediction mode group indicator and a prediction mode index, determines a size of a sub block when intra prediction is performed on each sub block of the current prediction unit, and creates reference pixels and a prediction block per sub block.