Image Analysis of Nuclei Histopathology Using Deep Learning: A Review of Segmentation, Detection, and Classification

Deep learning has recently advanced in its applicability to computer vision challenges, and medical imaging has become the most used technique in histopathology image analysis. Nuclei instance segmentation, detection, and classification are one such task. Reliable analysis of these image slides is critical in cancer identification, treatment, and care. Researchers have recently been interested in this issue. This study reviews the categorization and investigation of strategies utilized in recent works to improve the effectiveness of automated nuclei segmentation, detection, and classification in histopathology images. It critically examines state-of-the-art deep learning techniques, analyzes the trends, identifies the challenges, and highlights and helps with the future directions for research. The taxonomy includes deep learning techniques, enhancement, and optimization methods. The survey findings will help to overcome the challenges of nuclei segmentation, detection, and classification while improving the performance of models and, thus, aid future research plans. © 2023, The Author(s), under exclusive licence to Springer Nature Singapore Pte Ltd.