A hydrocarbon fluid pipeline may include pipeline segments connected together in end-to-end relation between first and second spaced apart geographic locations and configured to carry hydrocarbon fluid therethrough. The hydrocarbon fluid pipeline may also include a radio frequency (RF) heating station that may include an RF source and an RF heater between adjacent pipeline segments of the plurality thereof. The RF heater may include an inner tubular dielectric coupler between the adjacent pipeline segments, and an electrically conductive outer housing surrounding the inner tubular dielectric coupler and connected to the RF source to heat the hydrocarbon fluid.