Systems and methods for scalable comparisons between two pixel maps are provided. In an embodiment, an agricultural intelligence computer system generates pixel maps from non-image data by transforming a plurality of values and location values into pixel values and pixel locations. The non-image data may include data relating to a particular agricultural field, such as nutrient content in the soil, pH values, soil moisture, elevation, temperature, and/or measured crop yields. The agricultural intelligence computer system converts each pixel map into a vector of values. The agricultural intelligence computer system also generates a matrix of metric coefficients where each value in the matrix of metric coefficients is computed using a spatial distance between to pixel locations in one of the pixel maps. Using the vectors of values and the matrix of metric coefficients, the agricultural intelligence computer system generates a difference metric identifying a difference between the two pixel maps. In an embodiment, the difference metric is normalized so that the difference metric is scalable to pixel maps of different sizes. The difference metric may then be used to select particular images that best match a measured yield, identify relationships between field values and measured crop yields, identify and/or select management zones, investigate management practices, and/or strengthen agronomic models of predicted yield.