Inspired by previous work of Bruinier-Ono and Mertens-Rolen, we study class polynomials for non-holomorphic modular functions arising from modular forms of negative weight. In particular, we give general conditions for the irreducibility of class polynomials and obtain a general theorem to check when functions constructed in a special way are class invariants.