The past two decades have seen the emergence of remarkable interconnections among previously remotely related disciplines, such as condensed matter, nuclear physics, gravity and quantum information, fuelled both by experimental advances and by the new powerful theoretical methods offered by holographic duality. In this Review, we sample some recent developments in holographic duality in connection with quantum many-body dynamics. These include insights into strongly correlated phases without quasiparticles and their transport properties, quantum many-body chaos and the scrambling of quantum information. We also discuss recent progress in understanding the structure of holographic duality itself using quantum information, including a 'local' version of the duality, as well as the quantum error-correction interpretation of quantum many-body states with a gravity dual, and how such notions help to demonstrate the unitarity of black hole evaporation. Holographic duality is an equivalence relation between a gravitational system and a quantum many-body system. The Review discusses various insights obtained from the duality into properties of strongly coupled matter, quantum many-body chaos and deep connections between quantum information and geometry.