A growing body of work is investigating the use of mental maps during decision-making. Here we discuss how decision-making organizes experiences according to an internal model of the current task, thereby structuring memory. Likewise, we consider how the structure of mental maps contributes to decision-making.