Predicting the structural response of advanced multiphase alloys and understanding the underlying microscopic mechanisms that are responsible for it are two critically important roles that modeling plays in alloy development. The demonstration of superior properties of an alloy, such as high strength, creep resistance, high ductility, and fracture toughness, is not sufficient to secure its use in widespread applications. Still, a good model is needed to take measurable alloy properties, such as microstructure and chemical composition, and forecast how the alloy will perform in specified mechanical deformation conditions, including temperature, time, and rate. Here, we highlight recent achievements using multiscale modeling in elucidating the coupled effects of alloying, microstructure, and mechanism dynamics on the mechanical properties of polycrystalline alloys. Much of the understanding gained by these efforts relies on the integration of computational tools that vary over many length scales and time scales, from first-principles density functional theory, atomistic simulation methods, dislocation and defect theory, micromechanics, phase-field modeling, single crystal plasticity, and polycrystalline plasticity.