Purpose The incidence of pancreatic neuroendocrine tumors (pNETs) was increasing. The main purpose of this study was to statistically analyze the incidence and prevalence of pNETs and the main risk factors for the prognosis. Methods Based on the Surveillance, Epidemiology, and End Results (SEER) database, with three registries integrated, this study comprehensively displayed the annual age adjust incidence of pNETs from 1975 to 2018, the estimated 20-year limited-duration prevalence, and conducted the univariate and multivariate survival analysis. Results The incidence of pNETs has increased to about 1.5 per 100,000 population, and the prevalence has reached about 0.008% with the aged, Grade 1 and nonfunctional tumors accounting for the majority. The average median overall survival (OS), 5-year survival rate, and median disease-free survival (DFS) of pNETs patients from 1975 to 2018 were 85 months, 57.55%, and 220 months, respectively. From 2000 to 2018, the median OS was 94 months, and the 5-year survival rate was 59.94%. In multivariate survival analysis, the greatest risk factor was Grade 3 & 4 with HR = 3.62 (3.10-4.28), followed by distant stage with HR = 2.77 (2.28-3.36), and aged over 80 years old with HR = 2.26 (1.33-3.83). Surgery was a protective prognostic factor with HR = 0.34 (0.29-0.40). Conclusion The incidence and prevalence of pNETs were still increasing, but the trend was gradual and aging in recent years. The survival time of pNETs was longer but has not changed much in recent years. The degrees of malignancy, stage, and operation were the most important prognosis factors.