Multi-level operational C2 architecture modeling via hierarchically structured semi-Markov decision processes

This paper presents a multi-level operational command and control (C-2) architecture that is applicable to the Navy's maritime operations centers (MOCs) for assessing, planning and executing multiple missions and tasks across a range of military operations. The control architecture consists of three levels: strategic level control (SLC), operational level control (OLC) and tactical level control (TLC). In addition to coordination within each level, two specific coordination layers are identified at the strategic-operational level control (SLC-OLC) and at the operational-tactical level control (OLC-TLC) interfaces. We employ a semi-Markov decision process (SMDP) approach at the SLC-OLC interface layer to optimize DIME (diplomatic, information, military and economic) actions based on national resource priorities. A distributed SMDP approach is applied to action-goal attainment (AGA) graphs at the OLC-TLC interface layer to address the mission monitoring/planning issues and to optimize the courses of action based on the outcomes of asset-task allocation at the TLC. The optimization of a hierarchy of SMDPs is accomplished by exchanging performance and mission priority information through the interface layers. Specifically, the times between decision epochs at the SLC-OLC layer are determined by the mission completion times at the OLC-TLC layer, while the mission priorities (weights) to be used in mission planning at the OLC-TLC layer are determined by DIME actions at the SLC-OLC layer. In short, we model the hierarchical decision making process by exchanging the outcomes of SMDPs between the SLC-OLC and the OLC-TLC layers to find the best courses of actions for a range of military operations.