Cloud Type Classification Using Multi-modal Information Based on Multi-task Learning

Cloud classification is an important and challenging task in cloud observation technology. For better classification, we present a method based on multi-task learning using multi-modal information. We utilize different loss functions to conduct multi-task learning. We implement a series of experiments on multi-modal ground-based cloud datasets for different tasks. Experimental results show that multi-task learning is effective for cloud image classification using multi-modal information, and it can improve the results of cloud image classification.