The techniques include communicating a plurality of TCP data segments from different TCP connections as a single TCP data segment via a TCP gateway connection. For example, network host devices of autonomous systems may ordinarily transfer TCP data segments across dedicated TCP connections. An Autonomous System Boundary Router (ASBR) on one end of the TCP gateway connection may intercept TCP data segments from different TCP connections and may append the TCP data segments as a single appended TCP data segment and communicated via the TCP gateway connection. An ASBR on the other end of the TCP gateway connection may separate TCP data segments from the appended TCP data segment and determine, based on connection flow information, the TCP connections associated with each of the separated TCP data segments. The ASBR may then forward the separated TCP data segments to their original destinations.