Deep learning algorithms are facing the limitation in virtual reality application due to the cost of memory, computation, and real-time computation problem. Models with rigorous performance might suffer from enormous parameters and large-scale structure, and it would be hard to replant them onto embedded devices. In this paper, with the inspiration of GhostNet, we proposed an efficient structure ShuffleGhost to make use of the redundancy in feature maps to alleviate the cost of computations, as well as tackling some drawbacks of GhostNet. Since GhostNet suffers from high computation of convolution in Ghost module and shortcut, the restriction of downsampling would make it more difficult to apply Ghost module and Ghost bottleneck to other backbone. This paper proposes three new kinds of ShuffleGhost structure to tackle the drawbacks of GhostNet. The ShuffleGhost module and ShuffleGhost bottlenecks are utilized by the shuffle layer and group convolution from ShuffleNet, and they are designed to redistribute the feature maps concatenated from Ghost Feature Map and Primary Feature Map. Besides, they eliminate the gap of them and extract the features. Then, SENet layer is adopted to reduce the computation cost of group convolution, as well as evaluating the importance of the feature maps which concatenated from Ghost Feature Maps and Primary Feature Maps and giving proper weights for the feature maps. This paper conducted some experiments and proved that the ShuffleGhostV3 has smaller trainable parameters and FLOPs with the ensurance of accuracy. And with proper design, it could be more efficient in both GPU and CPU side.
机构:
Zhejiang Int Studies Univ, Sch Int Business, Hangzhou 310023, Peoples R ChinaZhejiang Int Studies Univ, Sch Int Business, Hangzhou 310023, Peoples R China
Gao, Chao
Wu, Fan
论文数: 0引用数: 0
h-index: 0
机构:
Beijing Forestry Univ, Sch Econ & Management, Beijing 100083, Peoples R ChinaZhejiang Int Studies Univ, Sch Int Business, Hangzhou 310023, Peoples R China
机构:
Shanghai Univ Engn Sci, Sch Management, Shanghai, Peoples R ChinaShanghai Jiao Tong Univ, Dept Cent Lab, Childrens Hosp, Shanghai, Peoples R China
Huang, Bangtong
Chen, Zihong
论文数: 0引用数: 0
h-index: 0
机构:
Shantou Univ, Coll Engn, Shantou, Peoples R ChinaShanghai Jiao Tong Univ, Dept Cent Lab, Childrens Hosp, Shanghai, Peoples R China
Chen, Zihong
Liu, Zheng
论文数: 0引用数: 0
h-index: 0
机构:
Shanghai Univ Engn Sci, Sch Management, Shanghai, Peoples R ChinaShanghai Jiao Tong Univ, Dept Cent Lab, Childrens Hosp, Shanghai, Peoples R China
Liu, Zheng
Yang, Zekun
论文数: 0引用数: 0
h-index: 0
机构:
Chinese Univ Hong Kong, Dept Comp Sci & Engn, Shatin, Hong Kong, Peoples R ChinaShanghai Jiao Tong Univ, Dept Cent Lab, Childrens Hosp, Shanghai, Peoples R China
机构:
Gannan Normal Univ, Sci & Technol Coll, Dept Fine Arts, Ganzhou 341000, Jiangxi, Peoples R ChinaGannan Normal Univ, Sci & Technol Coll, Dept Fine Arts, Ganzhou 341000, Jiangxi, Peoples R China