Robotic arms or manipulators can be utilized to grasp inventory items within an inventory system. Information can be obtained about constraints relative to relevant elements of a process of transferring the item from place to place. Examples of such elements may include a grasping location from which an item is to be grasped, a receiving location in which a grasped item is to be placed, or a space between the grasping location and the receiving location. The information about the constraints can be used to select from multiple possible grasping options, such as by eliminating options that conflict with the constraints or preferring options that outperform others given the constraints.