Archaeological textiles are often highly fragmented, and solving a puzzle is needed to recover the original composition and respective motifs. The lack of ground truth and unknown number of the original artworks that the fragments come from complicate this process. We clustered the RGB images of the Viking Age Oseberg Tapestry based on their texture features. Classical texture descriptors as well as modern deep learning were used to construct a texture feature vector that was subsequently fed to the clustering algorithm. We anticipated that the clustering outcome would give indications to the number of original artworks. While the two clusters of different textures emerged, this finding needs to be taken with care due to a broad range of limitations and lessons learned.