Provided is a method based on deep neural network to extract appearance and geometry features for pulmonary textures classification, which belongs to the technical fields of medical image processing and computer vision. Taking 217 pulmonary computed tomography images as original data, several groups of datasets are generated through a preprocessing procedure. Each group includes a CT image patch, a corresponding image patch containing geometry information and a ground-truth label. A dual-branch residual network is constructed, including two branches separately takes CT image patches and corresponding image patches containing geometry information as input. Appearance and geometry information of pulmonary textures are learnt by the dual-branch residual network, and then they are fused to achieve high accuracy for pulmonary texture classification. Besides, the proposed network architecture is clear, easy to be constructed and implemented.