While affecting all age groups, respiratory syncytial virus (RSV) infections can be particularly severe in infants, who develop functionally distinct immune responses, as well as in immunocompromised individuals. The extent to which environmental, viral and host factors contribute to the pathogenesis of RSV varies considerably between infected individuals. A correlation between the level of virus replication and pathogenesis has been established, and several viral proteins, in particular NS1 and NS2, modulate the immune response. Host immunity clearly contributes to RSV pathogenesis, and a number of specific cell populations may be involved. Ultimately, whether the response induced by RSV is protective or pathogenic depends on a combination of host factors, young age being one of the most important ones.