During the last decade, the usage of difficult-to-machine materials such as austenitic stainless steels has increased continuously in various industrial applications. Tools such as blind hole taps, punches, or deep drawing molds are often exposed to severe wear while machining/forming these materials, mainly due to excessive adhesion and material transfer. On combination with abrasive wear due to work-hardened wear debris, tool lifetime in these applications is often limited. In this study, ball-on-disc experiments were carried out with arc-evaporated AlCrN coatings with different Al/(Al + Cr) ratios against Al2O3 and austenitic stainless steel balls in ambient atmosphere. Test temperatures of 25, 500, and 700A degrees C were chosen for the hard Al2O3 balls simulating severe abrasive loads, whereas 25, 150, and 250A degrees C were used for the softer stainless steel material to evaluate the adhesive wear behavior. Characterization of the wear tracks was done by scanning electron microscopy in combination with energy-dispersive X-ray analysis and optical profilometry. The best abrasive wear resistance during testing against Al2O3 was observed for the coating with the highest Al content. In the case of the austenitic stainless steel balls, sticking of the ball material to the coating surface was the dominating wear mechanism. The influence of test temperature, chemical composition, and surface roughness was studied in detail.