The approximate degree of a Boolean function f (x(1), x(2),..., x(n)) is the minimum degree of a real polynomial that approximates f pointwise within 1/3. Upper bounds on approximate degree have a variety of applications in learning theory, differential privacy, and algorithm design in general. Nearly all known upper bounds on approximate degree arise in an existential manner from bounds on quantum query complexity. We develop a first-principles, classical approach to the polynomial approximation of Boolean functions. We use it to give the first constructive upper bounds on the approximate degree of several fundamental problems: (i) O(n(3/4) -1/4(2(k)-1) for the k-element distinctness problem; (ii) O(n(1)-1/k+1) for the k-subset sum problem; (iii) O(n(1)-1/k+1) for any k-DNF or k-CNF formula; (iv) O(n(3/4)) for the surjectivity problem. In all cases, we obtain explicit, closed-form approximating polynomials that are unrelated to the quantum arguments from previous work. Our first three results match the bounds from quantum query complexity. Our fourth result improves polynomially on the Theta(n) quantum query complexity of the problem and refutes the conjecture by several experts that surjectivity has approximate degree Omega(n). In particular, we exhibit the first natural problem with a polynomial gap between approximate degree and quantum query complexity.
