The invention discloses a device for eliminating yellow smoke from a chimney in the starting initial stage of a gas turbine, the device includes a flue gas cooling module, a NOx absorption processing module and a control unit, wherein the flue gas cooling module includes a cooling water atomization unit, a water storage tank and a cooling water collecting tank, the cooling water collecting tank is arranged in an exhaust outlet flue, positioned below the cooling water atomization unit and used for collection of cooling water, the NOx absorption processing module includes a microbial solution spraying unit, an absorption chamber, a microbial solution collecting pool and a microbial culture pool, the microbial culture pool is used for storage and further processing of a microbial solution from the microbial solution collecting pool, and supplying the microbial solution to the microbial solution spraying unit by a microbial solution pump, and the device has the advantages of strong pertinence, high NOx removal efficiency, simple structure, low investment, low operation cost and the like.