Examples disclosed herein relate to: computing, by a computing device at a party among a plurality of parties, a sum of local data owned by the party. The local data is horizontally partitioned into a plurality of data segments, with each data segment representing a non-overlapping subset of data entries owned by a particular party; computing a local gradient based on the horizontally partitioned local data; initializing each data segment; anonymizing aggregated local gradients received from the mediator, wherein the aggregated local gradients comprise gradients computed based on a plurality of data entries owned by the plurality of parties; receiving, from a mediator, a global gradient based on the aggregated local gradients; learning a global analytic model based on the global gradient; and performing privacy-preserving multi-party analytics on the horizontally partitioned local data based on the learned global analytic model.