FishAPP: a Mobile App to Detect Fish Falsification through Image Processing and Machine Learning Techniques

Food forgery is one of the most articulated socioeconomic concerns, which contributed to increase people awareness on what they eat. Identification of species represents a key aspect to expose commercial frauds implemented by substitution of valuable species with others of lower value. Fish species identification is mainly performed by morphological identification of gross anatomical features of the whole fish. However, the increasing presence on markets of new little-known species makes morphological identification of species difficult. In this paper we present FishAPP, a cloud-based infrastructure for fish species recognition. FishAPP is composed of a mobile application developed for the Android and the iOS mobile operating system enabling the user to shot pictures of a whole fish and submit them for remote analysis and a remote cloud-based processing system that implements a complex image processing pipeline and a neural network machine learning system able to analyze the obtained images and to perform classification into predefined fish classes. Preliminary results obtained from the available dataset provided encouraged results.