The efficient coding hypothesis has revolutionized theoretical neuroscience. I would argue that it is best understood using rate-distortion theory. I use rate-distortion theory to inspire a simple model of sensory adaptation. In randomly drawn, fluctuating environments, this model suggests that neurogenesis in sensory regions is unnecessary and predicts that biological sensors are poised to just barely confuse “minimal confounds” in the environment.