SenMangoFruitDDS is a dataset of mango fruit diseases containing images of 224*224 in JPG format. The dataset contains images of four diseases namely Alternaria, Anthracnose, Black Mould Rot and Stem and Rot. An additionnal category in the dataset is healthy fruits. Fruit images are captured from an orchard located in Senegal, using mobile phone camera. Two versions are proposed: SenMangoFruitDDS_original is the one with original images and SenMangoFruitDDS_bgremoved contains images with background remove.