Place-based education has traditionally had a limited focus on mathematics, and critical mathematics education often lacks explicit attention to place and space. We explore integrating theories of place, spatial justice, and critical mathematics education. To begin, we consider various frameworks of place--including Indigenous, urban, and critical perspectives--to situate a discussion on how place acts as a shaping force on social relations like race, gender, and sexuality, and, conversely, how social relations shape place. We include mathematics as a category of social relations in that guiding framework. We next summarize and build on various notions of place and spatial justice, toward their integration with critical mathematics education. In so doing, we present teaching mathematics for spatial justice, or using mathematics 1) to identify power relations in and through place and 2) to transform the world by re-imagining and remaking place. We sidestep a false urban-rural divide and instead, illustrate the potential of teaching mathematics for spatial justice using rich examples organized around four thematic categories: geographies of opportunity, mapping, human mobility, and land relations and obligations.