Search

Within the densely structured environment of an orchard, pinpointing the exact harvesting location is fundamental to the autonomous operation of fruit-picking robotic systems. Despite this, current techniques are prone to miscalculations in positioning under intricate conditions such as abbreviated stalks, partial concealment, or instances where the target is entirely misread, any of which can compromise the robot's operational efficiency in the field. To address complex vineyard harvesting scenarios, this paper presents an advanced method for picking-point determination that relies on semantic-level inference. The approach introduces three novel components: the semantic reasoning module (SRM), the ROI threshold adjustment strategy (RTAS), and the picking point location optimization module (PPOM). The SRM is deployed to resolve cases where obstructions mask grape stalks, suffer from partial recognition errors, or undergo total recognition failure. The RTAS is designed to overcome difficulties associated with stalks that are positioned low and are notably short during the picking sequence. In the final stage, the PPOM adjusts the calculated picking point coordinates to their optimum, granting the manipulator greater maneuverability as it executes the harvest action. Empirical validation demonstrates that SegFormer produces an mIoU (mean Intersection over Union) of 84.54%, accompanied by B_IoU and P_IoU scores of 73.90% and 75.63%, respectively. In addition, the refined fruit-picking point localization method achieved a success rate of 94.96%, representing an improvement of 8.12% over the baseline technique. The average computation time stands at 0.5428 ± 0.0063 s per instance, which is adequate for real-time harvesting demands.