This paper discusses whether a consideration of the capacity of rocks to affect humans in terms of their charisma or object-agency can aid in understanding identified variation in patterns of lithic procurement, distribution, and use. Lithic assemblages at sites dating to both the Late Mesolithic and Early Neolithic in two separate areas of the central mountain plateau in southern Norway demonstrate use of locally available rock. Their use contrasts with that of flint which could only be sourced at the coast. While the use of flint in regions with a restricted range of available and suitable rock types is understandable, the presence of flint in regions rich in flint alternatives is more puzzling. In order to understand the choices and actions of prehistoric communities we must consider other factors, such as a sensorial exploration of the ability of raw materials to affect humans, together with the diverging ontological perspectives that shape human–material relations and the social situations of practice. This paper argues that, in addition to their straightforward utility, lithic raw materials had socially situated object-agency and inherent characteristics of charisma and that these exerted powerful influences on human choice, perception, and preference.