Line Operational Evaluation (LOE) air carrier scenario based evaluation

This paper presents a methodology for developing Line Operational Evaluations (LOEs) which assess crew and individual pilot proficiency in the FAA's Advanced Qualification Program (AQP). Under AQP, Crew Resource Management (CRM) skills are trained and assessed along with technical maneuvers in the issuing of an Airmen type certification. The environment for assessing this technical and CRM proficiency is the LOE which must be designed and implemented under strict adherence to the requirements of AQP. The paper will discuss the five major steps in the design process, discuss the issues associated with scenario based measurement of pilot proficiency, and the application of statistical analysis to improve evaluator standardization and the reliability and validity of data.