Texture features can be considered as methods for encoding an image: taking pixel intensities or filter responses and forming them into a description which can be used to solve problems including recognition and matching. In this paper we are considering the inverse problem: given a textural representation of an image, how well can we recover the original. We show how the LBP method encodes comparative relationships between pixels and relative to these relations we can recover an image with our new method. We extend the recovery method to work with the Sudoku texture representation (an extension of LBP). We show that this method produces a reconstruction more correlated with the original image than the prior art.