Optimal Non-parametric Learning in Repeated Contextual Auctions with Strategic Buyer

We study learning algorithms that optimize revenue in repeated contextual posted-price auctions where a seller interacts with a single strategic buyer that seeks to maximize his cumulative discounted surplus. The buyer's valuation of a good is a fixed private function of a d-dimensional context (feature) vector that describes the good being sold. In contrast to existing studies on repeated contextual auctions with strategic buyer, in our work, the seller is not assumed to know the parametric model that underlies this valuation function. We introduce a novel non-parametric learning algorithm that is horizon-independent and has tight strategic regret upper bound of circle minus(Td/(d + 1)). We also non-trivially generalize several value-localization techniques of noncontextual repeated auctions to make them effective in the considered contextual non-parametric learning of the buyer valuation function.