Diabetic Retinopathy (DR) is a medical condition, also known as diabetic eye disease, which is vision-threatening damage to the retina of the eye caused by diabetes. As the technology advances, researchers are becoming more interested in intelligent medical diagnosis systems to assist screening of DR in earlier stages. In this study, variety of state-of-the-art procedures are used to extract the anatomic segments and lesions from the color fundus images. In addition, an automated system is proposed for the detection of anatomic segments and lesions by grading approach to help clinical diagnosis of the DR analysis. Four publicly available databases of color fundus images and various appropriate measurement techniques are used to compare quantitatively the performance of the proposed system. The experiments conducted on DIARETDB0, DIARETDB1, STARE, and HRF data sets have proved that accuracy, sensitivity, and specificity of the proposed system are comparable or superior to state-of-the-art methods.