Optimizer for Convolutional neural network

The name of the pictureThe name of the pictureThe name of the pictureClash Royale CLAN TAG#URR8PPP











up vote
5
down vote

favorite












What is the best optimizer for Convolutional neural network (CNN)?



Can I use RMSProp for CNN or only for RNN?










share|improve this question

























    up vote
    5
    down vote

    favorite












    What is the best optimizer for Convolutional neural network (CNN)?



    Can I use RMSProp for CNN or only for RNN?










    share|improve this question























      up vote
      5
      down vote

      favorite









      up vote
      5
      down vote

      favorite











      What is the best optimizer for Convolutional neural network (CNN)?



      Can I use RMSProp for CNN or only for RNN?










      share|improve this question













      What is the best optimizer for Convolutional neural network (CNN)?



      Can I use RMSProp for CNN or only for RNN?







      deep-learning keras tensorflow convnet computer-vision






      share|improve this question













      share|improve this question











      share|improve this question




      share|improve this question










      asked Sep 16 at 11:29









      Noran

      1527




      1527




















          1 Answer
          1






          active

          oldest

          votes

















          up vote
          5
          down vote



          accepted










          Yes, you can use the same optimizers you are familiar with for CNNs.



          I don't think that there is a best optimizer for CNNs. The most popular in my opinion is Adam. However some people like to use a plain SGD optimizer with custom parameters.



          An excellent article explaining the differences between most popular gradient descent based optimizers can be found here.






          share|improve this answer




















            Your Answer




            StackExchange.ifUsing("editor", function ()
            return StackExchange.using("mathjaxEditing", function ()
            StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix)
            StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
            );
            );
            , "mathjax-editing");

            StackExchange.ready(function()
            var channelOptions =
            tags: "".split(" "),
            id: "557"
            ;
            initTagRenderer("".split(" "), "".split(" "), channelOptions);

            StackExchange.using("externalEditor", function()
            // Have to fire editor after snippets, if snippets enabled
            if (StackExchange.settings.snippets.snippetsEnabled)
            StackExchange.using("snippets", function()
            createEditor();
            );

            else
            createEditor();

            );

            function createEditor()
            StackExchange.prepareEditor(
            heartbeatType: 'answer',
            convertImagesToLinks: false,
            noModals: false,
            showLowRepImageUploadWarning: true,
            reputationToPostImages: null,
            bindNavPrevention: true,
            postfix: "",
            noCode: true, onDemand: true,
            discardSelector: ".discard-answer"
            ,immediatelyShowMarkdownHelp:true
            );



            );













             

            draft saved


            draft discarded


















            StackExchange.ready(
            function ()
            StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f38327%2foptimizer-for-convolutional-neural-network%23new-answer', 'question_page');

            );

            Post as a guest






























            1 Answer
            1






            active

            oldest

            votes








            1 Answer
            1






            active

            oldest

            votes









            active

            oldest

            votes






            active

            oldest

            votes








            up vote
            5
            down vote



            accepted










            Yes, you can use the same optimizers you are familiar with for CNNs.



            I don't think that there is a best optimizer for CNNs. The most popular in my opinion is Adam. However some people like to use a plain SGD optimizer with custom parameters.



            An excellent article explaining the differences between most popular gradient descent based optimizers can be found here.






            share|improve this answer
























              up vote
              5
              down vote



              accepted










              Yes, you can use the same optimizers you are familiar with for CNNs.



              I don't think that there is a best optimizer for CNNs. The most popular in my opinion is Adam. However some people like to use a plain SGD optimizer with custom parameters.



              An excellent article explaining the differences between most popular gradient descent based optimizers can be found here.






              share|improve this answer






















                up vote
                5
                down vote



                accepted







                up vote
                5
                down vote



                accepted






                Yes, you can use the same optimizers you are familiar with for CNNs.



                I don't think that there is a best optimizer for CNNs. The most popular in my opinion is Adam. However some people like to use a plain SGD optimizer with custom parameters.



                An excellent article explaining the differences between most popular gradient descent based optimizers can be found here.






                share|improve this answer












                Yes, you can use the same optimizers you are familiar with for CNNs.



                I don't think that there is a best optimizer for CNNs. The most popular in my opinion is Adam. However some people like to use a plain SGD optimizer with custom parameters.



                An excellent article explaining the differences between most popular gradient descent based optimizers can be found here.







                share|improve this answer












                share|improve this answer



                share|improve this answer










                answered Sep 16 at 12:04









                JkBk

                1464




                1464



























                     

                    draft saved


                    draft discarded















































                     


                    draft saved


                    draft discarded














                    StackExchange.ready(
                    function ()
                    StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f38327%2foptimizer-for-convolutional-neural-network%23new-answer', 'question_page');

                    );

                    Post as a guest













































































                    Popular posts from this blog

                    Peggy Mitchell

                    Palaiologos

                    The Forum (Inglewood, California)