With the wide application of information and communication technology, the smart library, which is mainly characterized by the provision of digital content and smart services, has attained a new stage. The digital literacy of users has become a key factor influencing the reading effect of digital content and the implementation effect of smart services in the smart library. This study recruits college students who use smart libraries as the research object. It uses the literature research method, Delphi method, and analytic hierarchy process; draws on existing authoritative digital literacy frameworks and evaluation methods; and combines two rounds of expert interviews to establish a digital literacy evaluation system for college students using the smart library. It also carries out empirical analysis by a questionnaire survey. The results show that the proposed digital literacy evaluation system can evaluate accurately the digital literacy of college students in smart libraries. Furthermore, it can provide useful reference for the improvement of digital literacy of these students and for the construction of a smart library.