Various embodiments of an apparatus, methods, systems and computer program products described herein are directed to an agricultural observation and treatment system and method of operation. The agricultural treatment system may receive captured sensor data of an agricultural environment by one or more image capture devices, generate a first image from the captured sensor data, detect a first real-world agricultural object from the first image, determine a first pose of the first real-world agricultural object, identify the detected first real-world agricultural object as a new agricultural object or a preidentified agricultural object, and determine a treatment policy associated with the first real-world agricultural object.