A system and method for pixel and object level neutral detection. An image is scanned into a plurality of pixels. A local pixel of interest is identified along with a neighborhood of pixels around the local pixel. The chroma value of the current pixel as well as the average local chroma of the neighborhood are calculated. An adjusted chroma is determined based on the average local chroma. A luminance value can also be measured for the current pixel and for each of the neighbor pixels and a luminance variation determined. The adjusted chroma can be further modified based on the determined luminance variation. The adjusted chroma is compared against a threshold to determine a neutral pixel detection tag for the current pixel. The pixel tags can be utilized to control an adjustment of pixels in a device independent L*a*b* or a device independent CMYK domain.