Evaluation of monte carlo to support commissioning of the treatment planning system of new pencil beam scanning proton therapy facilities

Objective. To demonstrate the potential of Monte Carlo (MC) to support the resource-intensive measurements that comprise the commissioning of the treatment planning system (TPS) of new proton therapy facilities. Approach. Beam models of a pencil beam scanning system (Varian ProBeam) were developed in GATE (v8.2), Eclipse proton convolution superposition algorithm (v16.1, Varian Medical Systems) and RayStation MC (v12.0.100.0, RaySearch Laboratories), using the beam commissioning data. All models were first benchmarked against the same commissioning data and validated on seven spread-out Bragg peak (SOBP) plans. Then, we explored the use of MC to optimise dose calculation parameters, fully understand the performance and limitations of TPS in homogeneous fields and support the development of patient-specific quality assurance (PSQA) processes. We compared the dose calculations of the TPSs against measurements (DDTPSvs.Meas.) or GATE (DDTPSvs.GATE) for an extensive set of plans of varying complexity. This included homogeneous plans with varying field-size, range, width, and range-shifters (RSs) (n = 46) and PSQA plans for different anatomical sites (n = 11). Main results. The three beam models showed good agreement against the commissioning data, and dose differences of 3.5% and 5% were found for SOBP plans without and with RSs, respectively. DDTPSvs.Meas. and DDTPSvs.GATE were correlated in most scenarios. In homogeneous fields the Pearson's correlation coefficient was 0.92 and 0.68 for Eclipse and RayStation, respectively. The standard deviation of the differences between GATE and measurements (+/- 0.5% for homogeneous and +/- 0.8% for PSQA plans) was applied as tolerance when comparing TPSs with GATE. 72% and 60% of the plans were within the GATE predicted dose difference for both TPSs, for homogeneous and PSQA cases, respectively. Significance. Developing and validating a MC beam model early on into the commissioning of new proton therapy facilities can support the validation of the TPS and facilitate comprehensive investigation of its capabilities and limitations.