Further Exploration of Deep Aggregation for Shadow Detection

Islam Md Jahidul; Omar  Faruq

doi:10.47813/2782-2818-2022-2-3-0312-0330

Авторы

Islam Md Jahidul Northeastern University, Liaoning, Shenyang, P. R. China
Omar Faruq Information and Communication Engineering, Chongqing University of Posts and Telecommunications, China https://orcid.org/0000-0002-4901-2753

DOI:

https://doi.org/10.47813/2782-2818-2022-2-3-0312-0330

Ключевые слова:

partial decoder module, adjacent feature, shadow detection

Аннотация

Обнаружение теней является фундаментальной проблемой в области компьютерного зрения. Это требует, чтобы сеть понимала глобальную семантику и локальные детали изображения. Все существующие методы зависят от агрегации функций многоступенчатой предварительно обученной сверточной нейронной сети, но по сравнению с возможностями высокого уровня возможности низкого уровня обеспечивают меньшую производительность обнаружения. Использование низкоуровневых функций не только увеличивает сложность сети, но и снижает эффективность использования времени. В этой статье мы предлагаем новый детектор теней, который использует только функции высокого уровня и исследует дополнительную информацию между соседними слоями функций. Эксперименты показывают, что метод, описанный в этой статье, может точно обнаруживать тени и работать лучше, чем самые передовые методы. Подробные эксперименты, проведенные в трех общедоступных наборах данных обнаружения теней SUB, UCF и ISTD, демонстрируют, что предложенный метод эффективен и стабилен.

Биографии авторов

Islam Md Jahidul, Northeastern University, Liaoning, Shenyang, P. R. China

Islam Md Jahidul, School of Software Engineering, Northeastern University, No. 195, Chuangxin Road, Hunnan, Liaoning, 110819, Shenyang, P. R. China; School of Communication and Information Engineering, Chongqing University of Posts and Telecommunications, 2 Chongwen Rd, Chongqing, 400065, Nan An Qu, P. R. China

Omar Faruq, Information and Communication Engineering, Chongqing University of Posts and Telecommunications, China

Omar Faruq, School of Communication and Information Engineering, Chongqing University of Posts and Telecommunications, 2 Chongwen Rd, Chongqing, 400065, Nan An Qu, P. R. China; School of Software Engineering, Northeastern University, No. 195, Chuangxin Road, Hunnan, Liaoning, 110819, Shenyang, P. R. China.

Библиографические ссылки

Guanbin Li, Yu Y. Visual saliency based on multiscale deep features. IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 2015; 5455-5463. doi: 10.1109/CVPR.2015.7299184

Finlayson Graham D, Drew Mark S, Lu Cheng. Entropy minimization for shadow removal. International Journal of Computer Vision. 2009; 85 (1): 35-57.

Lalonde J.F., Efros A.A., Narasimhan S.G. Detecting Ground Shadows in Outdoor Consumer Photographs. In: Daniilidis, K., Maragos, P., Paragios, N. (eds) Computer Vision – ECCV 2010. ECCV 2010. Lecture Notes in Computer Science. Springer, Berlin, Heidelberg. 2010; 6312. https://doi.org/10.1007/978-3-642-15552-9_24

Ruiqi Guo, Qieyun Dai, Derek Hoiem. Paired regions for shadow detection and removal. IEEE transactions on pattern analysis and machine intelligence/ 2012; 35(12): 2956-2967.

Vicente T.F.Y., Hoai M., Samaras D. Leave-One-Out Kernel Optimization for Shadow Detection and Removal. In IEEE Transactions on Pattern Analysis and Machine Intelligence. 2018; 40 (3): 682-695. doi: 10.1109/TPAMI.2017.2691703

Ding B., Long C., Zhang L., Xiao C. ARGAN: Attentive Recurrent Generative Adversarial Network for Shadow Detection and Removal. IEEE/CVF International Conference on Computer Vision (ICCV). 2019; 10212-10221. doi: 10.1109/ICCV.2019.01031

Hearst Marti A., Dumais Susan T, Osuna Edgar, Platt John, Scholkopf Bernhard. Support vector machines. IEEE Intelligent Systems and their applications. 1998; 13 (4): 18-28.

Liu C., Jia K., Liu P. Fast Intra Coding Algorithm for Depth Map with End-to-End Edge Detection Network. IEEE International Conference on Visual Communications and Image Processing (VCIP). 2020; 379-382. doi: 10.1109/VCIP49819.2020.9301859

Wang Yupei, Zhao Xin, Li Yin, Hu Xuecai, Huang Kaiqi. Densely cascaded shadow detection network via deeply supervised parallel fusion. In Proceedings of the 27th International Joint Conference on Artificial Intelligence (IJCAI'18). AAAI Press. 2018; 1007-1013.

Chen S., Fu Y. Progressively Guided Alternate Refinement Network for RGB-D Salient Object Detection. In: Vedaldi, A., Bischof, H., Brox, T., Frahm, JM. (eds) Computer Vision – ECCV 2020. ECCV 2020. Lecture Notes in Computer Science. 2020; 12353. Springer, Cham. https://doi.org/10.1007/978-3-030-58598-3_31

Simonyan Karen, Zisserman Andrew. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv. 2014; 1409.1556.

Jiandong Tian, Xiaojun Qi, Liangqiong Qu, Yandong Tang. New spectrum ratio properties and features for shadow detection. Pattern Recognition. 2016; 51: 85-96.

Liangqiong Qu, Jiandong Tian, Shengfeng He, Yandong Tang, Rynson W. H. Lau. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 2017; 4067-4075.

Caijuan Shi, Weiming Zhang, Changyu Duan, Houru Chen. A pooling-based feature pyramid network for salient object detection. Image and Vision Computing. 2021; 107: 104099.

Salman Hameed Khan, Mohammed Bennamoun, Ferdous Sohel, Roberto Togneri. Automatic Feature Learning for Robust Shadow Detection. In Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition (CVPR '14). IEEE Computer Society, USA. 2014; 1939-1946. https://doi.org/10.1109/CVPR.2014.249

Li Shen, Teck Wee Chua, Karianto Leman. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 2015; 2067-2074.

Weiwei Sun, Ruisheng Wang. Fully convolutional networks for semantic segmentation of very high resolution remotely sensed images combined with dsm. IEEE Geoscience and Remote Sensing Letters. 2018; 15(3): 474-478.

Hieu Le, Tomas F. Yago Vicente, Vu Nguyen, Minh Hoai, Dimitris Samaras. Proceedings of the European Conference on Computer Vision (ECCV). 2018; 662-678.

Chen L.C., Papandreou G., Kokkinos I., Murphy K., Yuille A.L. DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs. In IEEE Transactions on Pattern Analysis and Machine Intelligence. 2018; 40 (4): 834-848. doi: 10.1109/TPAMI.2017.2699184

Zhang L., Dai J., Lu H., He Y., Wang G. A Bi-Directional Message Passing Model for Salient Object Detection. IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2018; 1741-1750. doi: 10.1109/CVPR.2018.00187

Zhang P., Wang D., Lu H., Wang H., Ruan X. Amulet: Aggregating Multi-level Convolutional Features for Salient Object Detection. IEEE International Conference on Computer Vision (ICCV). 2017; 202-211. doi: 10.1109/ICCV.2017.31

Wu Zhe, Su Li. Qingming Huang. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 2019; 3907-3916.

Wang J., Li X., Yang J. Stacked Conditional Generative Adversarial Networks for Jointly Learning Shadow Detection and Shadow Removal. IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2018; 1788-1797. doi: 10.1109/CVPR.2018.00192

Mingliang Xu, Jiejie Zhu, Pei Lv, Bing Zhou, Marshall F Tappen, Rongrong Ji. Learning-based shadow recognition and removal from monochromatic natural images. IEEE Transactions on Image Processing. 2017; 26(12): 5811-5824.

Zheng Q., Qiao X., Cao Y., Lau R. W. H. Distraction-Aware Shadow Detection. IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 2019; 5162-5171. doi: 10.1109/CVPR.2019.00531

Lei Zhu, Zijun Deng, Xiaowei Hu, Chi-Wing Fu, Xuemiao Xu, Jing Qin, Pheng-Ann Heng. Proceedings of the European Conference on Computer Vision (ECCV). 2018; 121-136. https://link.springer.com/conference/eccv