On Deep Research Problems in Deep Learning

Abstract

The subject of deep learning has emerged in the last decade as one of the most promising approaches to machine learning. Today, certainly, much of the recent progress in artificial intelligence is due to it, but research challenges are still unresolved and remain open to the research community. This paper attempts to offer a comprehensive review of deep learning progress in active research frontiers. On the one side, by presenting a brief overview of deep learning success, we inspire researchers to work in deep learning. On the other hand, we examine a range of technical issues, and open research issues that we believe are relevant topics for exploratory research. As deep learning applies to various fields, we restrict this paper’s scope to visual recognition tasks to analyze these problems with a specific lens. However, these problems will be broadly applicable to other fields. It will make it easier for new researchers to recognize outstanding research problems in the deep learning domain.