Past research on restorativeness has emphasized mainly the potential of natural environments. In our hypothesis, built environments are also likely to be recognized as restorative places. In this study, focusing on restorative experiences more than on environments alone, attention is drawn on the relative importance of the four restorative components proposed by “attention restoration theory”—being-away, extent, fascination, compatibility—in leisure experiences of people at different stages of the lifespan, and on the characterization of these experiences in terms of relaxation and excitement. We also take account of the time available for restoration and the context in which the need for restoration may emerge, according to three models of the relationships between work and leisure: spill-over, compensation and segmentation. Results show that natural and built environments can have different restorative potentials in relation to the stage of the lifespan and to the time available for restoration; moreover, in people's perception, the four restorative components differ from each other in their relative importance. The social and affective dimensions came out as important features of restorative experiences. Finally, relaxation and excitement in leisure patterns were shown to be differentially related to work characteristics. Briefly, restorativeness emerged as the result of a global “place experience”.