Leaf blight, caused by bacterial and fungal infections, threatens plant health by inducing leaf discoloration and reducing crop yield. To address this, we propose a MobileNetV3-based classifier for the Jasmine plant, leveraging streamlined Convolutional Neural Networks (CNNs) to precisely identify disease stages. The design combines depthwise convolutional layers with max-pooling layers to extract superior features, focusing on vital low-level features that signal the condition. Via preprocessing methods that include data augmentation with a Conditional GAN and Particle Swarm Optimization for feature selection, the classifier achieves reliable performance. Assessment on carefully assembled datasets shows a remarkable 97% training accuracy, demonstrating its potency. Real-world trials across varying settings, including severe camera tilts and fluctuating illumination, verify the model’s durability, delivering test accuracies within the 94% to 96% range. The dataset’s bespoke structure for CNN-based classification ensures the reliability of the outcomes. Notably, the model’s compact classification, characterized by swift processing speed and minimal size, makes it a practical choice for immediate deployment. This all-encompassing strategy highlights the presented classifier’s value in managing leaf blight spot disease difficulties in cash crops.