M-estimator for symmetric location families in ranked set sampling has been studied in the literature. Estimating asymptotic variance of this estimator has not been addressed yet. To fill this gap, we develop two consistent estimators in this article. The proposed estimators are then utilized to construct confidence intervals for the location parameter. Monte Carlo simulations are employed to assess performance of the intervals. Finally, an empirical study is presented for illustration.