Can artists be recognized from the way they render certain materials, such as fabric, skin, or hair? In this paper, we study this problem with a focus on recognizing works by Rembrandt, Van Dyck, and other Dutch and Flemish artists from the same era. This paper proposes a novel material-based approach based on Swin Transformer and Cascade Mask R-CNN to address artist recognition task. We report the performance on a dataset of 644 images. Additionally, the models robustness to image variations is studied.