A system includes a combustor cap assembly for a multi-tube fuel nozzle. The combustor cap assembly includes a support structure defining an interior volume configured to receive an air flow. The combustor cap assembly also includes multiple mixing tubes disposed within the interior volume, wherein each mixing tube is configured to mix air and fuel to form an air-fuel mixture. The combustor cap assembly further includes a combustor cap removably coupled to the support structure. The combustor cap includes multiple nozzles integrated within the combustor cap. Each nozzle of the multiple nozzles is coupled to a respective mixing tube of the multiple mixing tubes. The combustor cap is configured to internally cool itself via one or more cooling features integrated within the combustor cap.