The invention provides an ultrahigh-rise building rubbish recovery system. The system comprises a noiseless rubbish pipeline, wherein a first buffer structure is arranged in the rubbish pipeline; a filtering dumping hole is formed in a side surface of the rubbish pipeline; large-particle-size rubbishes and small-particle-size rubbishes are separated out on a storey through the filtering dumping hole; a second buffer structure and a dumping platform are arranged at the bottom of the rubbish pipeline; and building rubbishes falling out of the rubbish pipeline are buffered and guided to the dumping platform through the second buffer structure. According to the system, the difficult problem of how to transport the building rubbishes by classification in ultrahigh-rise buildings is solved, so that existing defects of raised dust, noises, low transport efficiency and the like in building rubbish transportation can be overcome as far as possible.