A combustor cap assembly includes an impingement plate coupled to an annular shroud and a cap plate which is coupled to the impingement plate and forms an impingement air plenum therebetween. The cap assembly further includes a flow conditioning plate which is coupled to a forward end portion of the shroud. The flow conditioning plate includes an inner band portion, an outer band portion and an annular portion which extends radially therebetween. The annular portion includes upstream side, a downstream side and a plurality of flow conditioning passages which provide for fluid communication through the upstream and downstream sides. The inner band portion of the flow conditioning plate at least partially defines an exhaust channel. The exhaust channel is in fluid communication with the impingement air plenum and an exhaust outlet. The exhaust outlet is positioned to route cooling air from the impingement air plenum into an annular flow passage defined within a combustor.