Intrinsic Ultracontractivity and Ground State Estimates of Non-local Dirichlet forms on Unbounded Open Sets

In this paper we consider a large class of symmetric Markov processes X=(Xt)t≥0\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$${X=(X_t)_{t\ge0}}$$\end{document} on Rd\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$${\mathbb{R}^d}$$\end{document} generated by non-local Dirichlet forms, which include jump processes with small jumps of α\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$${\alpha}$$\end{document}-stable-like type and with large jumps of super-exponential decay. Let D⊂Rd\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$${D\subset \mathbb{R}^d}$$\end{document} be an open (not necessarily bounded and connected) set, and XD=(XtD)t≥0\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$${X^D=(X_t^D)_{t \ge 0}}$$\end{document} be the killed process of X on exiting D. We obtain explicit criterion for the compactness and the intrinsic ultracontractivity of the Dirichlet Markov semigroup (PtD)t≥0\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$${(P^{D}_t)_{t\ge0}}$$\end{document} of XD. When D is a horn-shaped region, we further obtain two-sided estimates of ground state in terms of jumping kernel of X and the reference function of the horn-shaped region D.