The present disclosure provides a portable terahertz security inspection apparatus, including: a carrying body; a terahertz emitting device arranged on the carrying body, wherein the terahertz emitting device includes a terahertz signal source and an emitting unit connected to the terahertz signal source and configured to emit a terahertz wave; a terahertz detector arranged on the carrying body and configured to receive the terahertz wave reflected from an inspected object; a data acquisition and processing system arranged on the carrying body and connected to the terahertz detector, wherein the data acquisition and processing system is configured to receive a scan data for the inspected object from the terahertz detector and generate a terahertz image; and a display device connected to the data acquisition and processing system and configured to receive and display the terahertz image from the data acquisition and processing system. The portable terahertz security inspection apparatus does not need to be equipped with a mechanical scanning system, so that a volume and a weight of the terahertz security inspection apparatus may be greatly reduced, and a security inspector may move the terahertz security inspection apparatus manually to perform scanning of the imaging area.