Spatial memory impairment is well documented in old age; however, less is known about spatial memory during middle age. We examined the performance of healthy young, middle-aged, and older adults on a spatial memory task with varying levels of spatial similarity (distance). On low similarity trials, young adults significantly outperformed middle-aged adults, who significantly outperformed older adults (Ps < 0.05). On high similarity trials, young adults significantly outperformed middle-aged and older adults (Ps < 0.05); however, middle-aged and older adults did not differ. Subtle age-related changes in spatial memory may emerge during middle age, particularly when spatial similarity is high.