This paper first presents a set of interconnection rules to be used in constructing control flow graphs for parallel programs. It then demonstrates that use of these rules enforces the principle of hierarchical design in a very natural way. The impact of this design discipline on reliability issues is discussed. The limitation of this set of rules is indicated as well as how they may be overcome.