Lightweight Multi-Scale Context Aggregation Deraining Network With Artifact-Attenuating Pooling and Activation Functions

Single image deraining is a fundamental pre-processing step in many computer vision applications for improving the visual effect and system performance of the downstream high-level tasks in adverse weather conditions. This study proposes a novel multi-scale context aggregation network, to effectively solve the single image deraining problem. Specifically, we exploit a lightweight residual structure subnet as the baseline architecture to extract fine and detailed texture context at the original scale and further incorporate a multi-scale progressive aggregation module (MPAM) to learn the complementary high-level context for enhancing the modeling capability of the overall deraining network. The MPAM, designed as a plug-and-play module to be utilized in the arbitrary network, is composed of multi-scale convolution blocks to learn a wide variety of contexts in multiple receptive fields, and then carries out progressive context aggregation between adjacent scales with residual connections, which is expected to concurrently disentangle the multi-scale structures of scene contents and multiple rain layers in the rainy images, and models more representative contexts for reconstructing the clean image. To reduce the learnable parameters in the MPAM, we further explore a context hallucinate block for replacing the multi-scale convolution block, and propose a lightweight MPAM. Moreover, for being specially adaptive to deal with the input rainy images with a lot of unwanted components (rain layers), we delve into the artifact-attenuating pooling and activation functions via taking into consideration of the surrounding spatial context instead of pixel-wise operation and propose the spatial context-aware pooling (SCAP) and activation (SCAA) for incorporating with our deraining network to boost performance. Extensive experiments on the benchmark datasets demonstrate that our proposed method performs favorably against state-of-the-art deraining approaches.