Methods, apparatus, systems, and software for implementing context adaptive video streaming using multiple streaming connections. Original video content is split into multiple bitstreams at a video streaming server and streamed to a video streaming client. Higher-importance video content, such as I-frames and the base layer for scalable video coder (SVC) content are streamed over a high-priority streaming connection, while lower-importance video content is streamed over a low-priority streaming connection. The high-priority streaming connection may employ a reliable connection protocol such as TCP protocol, while the lower-priority connection may employ UDP or a modified TCP protocol under which some portions of the bitstream may be dropped. Cross-layer context adaptive streaming may be implemented under which context data such as network context and video application context information may be considered to adjust parameters associated with implement one or more streaming connections.