Raw images are more useful than JPEG images for machine vision algorithms and professional photographers because raw images preserve a linear relation between pixel values and the light measured from the scene. A camera is radiometrically calibrated if there is a computational model which can predict how the raw image is mapped to the corresponding rendered image (e.g., JPEGs) and vice versa. Our method makes use of the observation that the rank order of pixel values is mostly preserved post-color correction. We show that this observation is the key for getting a compact and robust radiometric calibration model. Since our method requires fewer variables, it can be solved for using less calibration data. An additional advantage is that we can derive the camera pipeline from a single pair of raw–JPEG images. Experiments demonstrate that our method delivers state-of-the-art results (especially for the most interesting conversion from JPEG to raw).