In recent years three-dimensional images at atomic resolution have been obtained by holography as well as by x-ray crystallography. In this report we explore the connections between these two methods from a unified point of view. To recover the unknown structure we use mathematical methods developed for the solution of inverse problems. We review relevant experiments and discuss some ideas that may lead to more powerful imaging methods in the future.