In this paper we are concerned with the backward problems governed by differential equations. It is a first time that we can construct a backward time dynamics on the past cone, such that an augmented dynamical system of the Lie type X = B(X, t)X with t epsilon R-, X is an element of Mn+1 lying on the past cone and B is an element of so(n, 1), was derived for the backward differential equations system X over dot = f(x, t), t is an element of R-, x is an element of R-n. These two differential equations systems are mathematically equivalent. Then we apply the backward group preserving scheme (BGPS), which is an explicit single-step algorithm formulated by an exponential mapping to preserve the group preperties of SOo(n, 1), on the backward heat conduction problem (BHCP). It can retrieve all the initial data with high order accuracy. Several numerical examples of the BHCP were work out, and we show that the BGPS is applicable to the BHCP, even those of strongly ill-posed ones. Under the noisy final data the BGPS is also robust to against the disturbance. The one-step BGPS effectively reconstructs the initial data from a given final data, with a suitable grid length resulting into a high accuracy never seen before. The results are very significant in the computations of BHCP.