In this paper, a constructive general matrix factorization scheme is developed for extracting a nontrivial factor from a given nD (n > 2) polynomial matrix whose maximal order minors satisfy certain conditions. It is shown that three classes of nD polynomial matrices admit this kind of general matrix factorization. It turns out that minor prime factorization and determinantal factorization are two interesting special cases of the proposal general factorization. As a consequence, the paper provides a partial solution to an open problem of minor prime factorization as well as to a recent conjecture on minor prime factorizability for nD polynomial matrices. Three illustrative examples are worked out in detail.