In this paper we define the notion of a probabilistic valued measure and the corresponding L-P spaces. With suitable interpretations, we also prove Holder's inequality. These results give us sufficient motivations to define probabilistic dual spaces and probabilistic inner product spaces, for which the probabilistic L-2 space serves as a model. (C) 2013 Elsevier Inc. All rights reserved.