The theory of ordered topological vector spaces has been treated in a great number of articles and books. On the other hand, topological vector groups were introduced and studied by D. A. Raikov [On B-complete topological vector groups, Studia Math. 31 (1968), 296-305] and P. S. Kenderov [On topological vector groups, Mat. Sb. 10 (1970), 531-546]. These are vector spaces with a topology in which addition is continuous, but multiplication by scalars is continuous only if the scalar field is taken with the discrete topology. In this paper we introduce ordered topological vector groups and investigate their structure, in particular exploring them in the case when they need not be locally convex.