The growth of the eye, unlike other parts of the body, is not ballistic. It is guided by visual feedback with the eventual aim being optimal focus of the retinal image or emmetropization . It has been shown in animal models that interference with the quality of the retinal image leads to a disruption to the normal growth pattern, resulting in the development of refractive errors and defocused retinal images . While it is clear that retinal images rich in pattern information are needed to control eye growth, it is unclear what particular aspect of image structure is relevant. Retinal images comprise a range of spatial frequencies at different absolute and relative contrasts and in different degrees of spatial alignment. Here we show, by using synthetic images, that it is not the local edge structure produced by relative spatial frequency alignments within an image but rather the spatial frequency composition per se that is used to regulate the growth of the eye. Furthermore, it is the absolute energy at high spatial frequencies regardless of the spectral slope that is most effective. Neither result would be expected from currently accepted ideas of how human observers judge the degree of image "blur" in a scene where both phase alignments and the relative energy distribution across spatial frequency (i.e., spectral slope) are important.