As humans, Eating fruits provides us with a lot of health benefits. However, Inefficient handling and distribution of fresh fruits due to the lacking of skilled labors and storage facilities led us to a lot of common problems and diseases. In the meantime, Scientific research still faces hurdles in the post-harvest handling problems while packing and usually directed at narrowly defined problems. Recently, contemporary computer vision has advanced to the point that it can now be used in a variety of fields as it has been adopted to the agricultural field while playing an important role with its large potential capabilities to address the challenges related to the fruits. The proposed project aims to build a fast, reliable and more accurate fruit detection & defection classification system that can harness the capabilities provided by computer vision techniques which will contribute to the large wide area of the agricultural digitalization sector.