Unix find command on a 6T disk taking 14hrs : csh

The name of the pictureThe name of the pictureThe name of the pictureClash Royale CLAN TAG#URR8PPP











up vote
0
down vote

favorite












I have a csh script with the below lines to capture user name, file and size in a given disk. This was working fine until it hit capacity limit on a 6T disk which has over 5.5million files for just 1 user. How do I go about modifying this line to speed up runtime. Currently takes 14-15hrs on this line.



set len = ()
foreach i ( `find $cwd -not -path '*/.*' -printf "%un" | sort -u` )
set len = ($len:q `find $cwd -user $i | wc -l`)
end

find $cwd -printf "%u %sn" | awk 'user[$1]+=$2;count[$1]++; END for( i in user) printf "%s%-13s%5s%-0.2f%s%5s%7sn","", i, "", user[i]/1024**3,"GB", "", count[i]'| sort -nk2 -r








share







New contributor




Rancho is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.























    up vote
    0
    down vote

    favorite












    I have a csh script with the below lines to capture user name, file and size in a given disk. This was working fine until it hit capacity limit on a 6T disk which has over 5.5million files for just 1 user. How do I go about modifying this line to speed up runtime. Currently takes 14-15hrs on this line.



    set len = ()
    foreach i ( `find $cwd -not -path '*/.*' -printf "%un" | sort -u` )
    set len = ($len:q `find $cwd -user $i | wc -l`)
    end

    find $cwd -printf "%u %sn" | awk 'user[$1]+=$2;count[$1]++; END for( i in user) printf "%s%-13s%5s%-0.2f%s%5s%7sn","", i, "", user[i]/1024**3,"GB", "", count[i]'| sort -nk2 -r








    share







    New contributor




    Rancho is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
    Check out our Code of Conduct.





















      up vote
      0
      down vote

      favorite









      up vote
      0
      down vote

      favorite











      I have a csh script with the below lines to capture user name, file and size in a given disk. This was working fine until it hit capacity limit on a 6T disk which has over 5.5million files for just 1 user. How do I go about modifying this line to speed up runtime. Currently takes 14-15hrs on this line.



      set len = ()
      foreach i ( `find $cwd -not -path '*/.*' -printf "%un" | sort -u` )
      set len = ($len:q `find $cwd -user $i | wc -l`)
      end

      find $cwd -printf "%u %sn" | awk 'user[$1]+=$2;count[$1]++; END for( i in user) printf "%s%-13s%5s%-0.2f%s%5s%7sn","", i, "", user[i]/1024**3,"GB", "", count[i]'| sort -nk2 -r








      share







      New contributor




      Rancho is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.











      I have a csh script with the below lines to capture user name, file and size in a given disk. This was working fine until it hit capacity limit on a 6T disk which has over 5.5million files for just 1 user. How do I go about modifying this line to speed up runtime. Currently takes 14-15hrs on this line.



      set len = ()
      foreach i ( `find $cwd -not -path '*/.*' -printf "%un" | sort -u` )
      set len = ($len:q `find $cwd -user $i | wc -l`)
      end

      find $cwd -printf "%u %sn" | awk 'user[$1]+=$2;count[$1]++; END for( i in user) printf "%s%-13s%5s%-0.2f%s%5s%7sn","", i, "", user[i]/1024**3,"GB", "", count[i]'| sort -nk2 -r






      linux shell awk find csh





      share







      New contributor




      Rancho is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.










      share







      New contributor




      Rancho is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.








      share



      share






      New contributor




      Rancho is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.









      asked 3 mins ago









      Rancho

      1




      1




      New contributor




      Rancho is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.





      New contributor





      Rancho is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.






      Rancho is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.

























          active

          oldest

          votes











          Your Answer







          StackExchange.ready(function()
          var channelOptions =
          tags: "".split(" "),
          id: "106"
          ;
          initTagRenderer("".split(" "), "".split(" "), channelOptions);

          StackExchange.using("externalEditor", function()
          // Have to fire editor after snippets, if snippets enabled
          if (StackExchange.settings.snippets.snippetsEnabled)
          StackExchange.using("snippets", function()
          createEditor();
          );

          else
          createEditor();

          );

          function createEditor()
          StackExchange.prepareEditor(
          heartbeatType: 'answer',
          convertImagesToLinks: false,
          noModals: false,
          showLowRepImageUploadWarning: true,
          reputationToPostImages: null,
          bindNavPrevention: true,
          postfix: "",
          onDemand: true,
          discardSelector: ".discard-answer"
          ,immediatelyShowMarkdownHelp:true
          );



          );






          Rancho is a new contributor. Be nice, and check out our Code of Conduct.









           

          draft saved


          draft discarded


















          StackExchange.ready(
          function ()
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2funix.stackexchange.com%2fquestions%2f477826%2funix-find-command-on-a-6t-disk-taking-14hrs-csh%23new-answer', 'question_page');

          );

          Post as a guest



































          active

          oldest

          votes













          active

          oldest

          votes









          active

          oldest

          votes






          active

          oldest

          votes








          Rancho is a new contributor. Be nice, and check out our Code of Conduct.









           

          draft saved


          draft discarded


















          Rancho is a new contributor. Be nice, and check out our Code of Conduct.












          Rancho is a new contributor. Be nice, and check out our Code of Conduct.











          Rancho is a new contributor. Be nice, and check out our Code of Conduct.













           


          draft saved


          draft discarded














          StackExchange.ready(
          function ()
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2funix.stackexchange.com%2fquestions%2f477826%2funix-find-command-on-a-6t-disk-taking-14hrs-csh%23new-answer', 'question_page');

          );

          Post as a guest













































































          Popular posts from this blog

          How to check contact read email or not when send email to Individual?

          Displaying single band from multi-band raster using QGIS

          How many registers does an x86_64 CPU actually have?