The cognitive processes involved in route retracing are not well known. This study aims to highlight them in an elderly population in which contradictory results have been obtained, certain studies showing specific difficulties for route retracing, others not. Thirty-nine elderly subjects performed a route-learning task (forward-backward) in a garden, then completed spatial knowledge tasks and standardised cognitive tests. Results show four factors that were predictive of route retracing performance: route repetition, the pointing task, and two standardised cognitive tests, one assessing spatial working memory, and another global cognitive efficiency. According to these results, route retracing involves route and survey knowledge (i.e., egocentric and allocentric strategy), and the integration of forward-backward perspectives is underpinned by the spatial working memory. Moreover, the subjects did not make more errors in route retracing than in the route repetition task, suggesting that a real environment could compensate for a failing allocentric strategy.