An image decoding method includes: splitting a first block included in an image on the basis of at least one of a split type and a split direction of the first block to determine at least one second block from the first block; determining one of a prediction mode of the at least one second block and whether to split the at least one second block on the basis of at least one of a size and a shape of the determined at least one second block; obtaining a prediction block of a block included in the at least one second block on the basis of one of the determined prediction mode and whether to split the at least one second block; and restoring the block included in the at least one second block on the basis of the prediction block of the block included in the at least one second block. Here, the split type represents one of binary-split, tri-split, and quad-split.