Remove all parent directories from a list of paths

The name of the pictureThe name of the pictureThe name of the pictureClash Royale CLAN TAG#URR8PPP











up vote
1
down vote

favorite












I have a bash command that lists the directories in HDFS beginning with '/random'.



It goes as follows:



hdfs dfs -ls -R /random | grep '^d' | awk 'print $NF'


It generates the following output:



/random/custom
/random/custom/hive
/random/custom/hive/jars
/random/app
/random/app/nifi
/random/app/nifi/egispub
/random/app/nifi/empgis
/random/app/nifi/ods
/random/app/nifi/ptcsm
/random/app/nifi/tmds
/random/app/nifi/ucmdb
/random/app/oozie
/random/app/oozie/efdm
/random/app/oozie/efdm/ensco
/random/app/oozie/efdm/ensco/standardized_efdm_ensco_parser_5min
/random/app/oozie/efdm/ensco/standardized_efdm_ensco_parser_5min/lib
/random/app/oozie/efdm/mermec
/random/app/oozie/efdm/mermec/cleansed_efdm_mermec_5min
/random/app/oozie/efdm/mermec/standardized_efdm_mermec_5min
/random/app/oozie/gis
/random/app/oozie/gis/opk
/random/app/oozie/gis/opk/standardized_gis_opk_parser_10min
/random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/lib
/random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/schemas


I would like to modify my command so that only the full directory path is listed, as follows:



/random/custom/hive/jars
/random/app/nifi/egispub
/random/app/nifi/empgis
/random/app/nifi/ods
/random/app/nifi/ptcsm
/random/app/nifi/tmds
/random/app/nifi/ucmdb
/random/app/oozie/efdm/ensco/standardized_efdm_ensco_parser_5min/lib
/random/app/oozie/efdm/mermec/cleansed_efdm_mermec_5min
/random/app/oozie/efdm/mermec/standardized_efdm_mermec_5min
/random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/lib
/random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/schemas


How would you do it?






text-processing







share|improve this question









New contributor




user316697 is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.



















  • "I would like to modify my command so that only the full directory path is listed." What do you mean by this? Do you mean that only /random/custom/hive/jars should be output (assuming jars is a directory)? Do you mean that only the path to the /random/custom directory should be listed? The full directory path to which location?
    – code_dredd
    4 hours ago











  • Also, did you try anything? If so, what was it?
    – code_dredd
    4 hours ago










  • Hi, I updated my post to answer your question. I have not tried anything yet. I am looking into awk, sed and grep as options.
    – user316697
    4 hours ago














up vote
1
down vote

favorite












I have a bash command that lists the directories in HDFS beginning with '/random'.



It goes as follows:



hdfs dfs -ls -R /random | grep '^d' | awk 'print $NF'


It generates the following output:



/random/custom
/random/custom/hive
/random/custom/hive/jars
/random/app
/random/app/nifi
/random/app/nifi/egispub
/random/app/nifi/empgis
/random/app/nifi/ods
/random/app/nifi/ptcsm
/random/app/nifi/tmds
/random/app/nifi/ucmdb
/random/app/oozie
/random/app/oozie/efdm
/random/app/oozie/efdm/ensco
/random/app/oozie/efdm/ensco/standardized_efdm_ensco_parser_5min
/random/app/oozie/efdm/ensco/standardized_efdm_ensco_parser_5min/lib
/random/app/oozie/efdm/mermec
/random/app/oozie/efdm/mermec/cleansed_efdm_mermec_5min
/random/app/oozie/efdm/mermec/standardized_efdm_mermec_5min
/random/app/oozie/gis
/random/app/oozie/gis/opk
/random/app/oozie/gis/opk/standardized_gis_opk_parser_10min
/random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/lib
/random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/schemas


I would like to modify my command so that only the full directory path is listed, as follows:



/random/custom/hive/jars
/random/app/nifi/egispub
/random/app/nifi/empgis
/random/app/nifi/ods
/random/app/nifi/ptcsm
/random/app/nifi/tmds
/random/app/nifi/ucmdb
/random/app/oozie/efdm/ensco/standardized_efdm_ensco_parser_5min/lib
/random/app/oozie/efdm/mermec/cleansed_efdm_mermec_5min
/random/app/oozie/efdm/mermec/standardized_efdm_mermec_5min
/random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/lib
/random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/schemas


How would you do it?






text-processing







share|improve this question









New contributor




user316697 is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.



















  • "I would like to modify my command so that only the full directory path is listed." What do you mean by this? Do you mean that only /random/custom/hive/jars should be output (assuming jars is a directory)? Do you mean that only the path to the /random/custom directory should be listed? The full directory path to which location?
    – code_dredd
    4 hours ago











  • Also, did you try anything? If so, what was it?
    – code_dredd
    4 hours ago










  • Hi, I updated my post to answer your question. I have not tried anything yet. I am looking into awk, sed and grep as options.
    – user316697
    4 hours ago












up vote
1
down vote

favorite









up vote
1
down vote

favorite











I have a bash command that lists the directories in HDFS beginning with '/random'.



It goes as follows:



hdfs dfs -ls -R /random | grep '^d' | awk 'print $NF'


It generates the following output:



/random/custom
/random/custom/hive
/random/custom/hive/jars
/random/app
/random/app/nifi
/random/app/nifi/egispub
/random/app/nifi/empgis
/random/app/nifi/ods
/random/app/nifi/ptcsm
/random/app/nifi/tmds
/random/app/nifi/ucmdb
/random/app/oozie
/random/app/oozie/efdm
/random/app/oozie/efdm/ensco
/random/app/oozie/efdm/ensco/standardized_efdm_ensco_parser_5min
/random/app/oozie/efdm/ensco/standardized_efdm_ensco_parser_5min/lib
/random/app/oozie/efdm/mermec
/random/app/oozie/efdm/mermec/cleansed_efdm_mermec_5min
/random/app/oozie/efdm/mermec/standardized_efdm_mermec_5min
/random/app/oozie/gis
/random/app/oozie/gis/opk
/random/app/oozie/gis/opk/standardized_gis_opk_parser_10min
/random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/lib
/random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/schemas


I would like to modify my command so that only the full directory path is listed, as follows:



/random/custom/hive/jars
/random/app/nifi/egispub
/random/app/nifi/empgis
/random/app/nifi/ods
/random/app/nifi/ptcsm
/random/app/nifi/tmds
/random/app/nifi/ucmdb
/random/app/oozie/efdm/ensco/standardized_efdm_ensco_parser_5min/lib
/random/app/oozie/efdm/mermec/cleansed_efdm_mermec_5min
/random/app/oozie/efdm/mermec/standardized_efdm_mermec_5min
/random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/lib
/random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/schemas


How would you do it?






text-processing







share|improve this question









New contributor




user316697 is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.











I have a bash command that lists the directories in HDFS beginning with '/random'.



It goes as follows:



hdfs dfs -ls -R /random | grep '^d' | awk 'print $NF'


It generates the following output:



/random/custom
/random/custom/hive
/random/custom/hive/jars
/random/app
/random/app/nifi
/random/app/nifi/egispub
/random/app/nifi/empgis
/random/app/nifi/ods
/random/app/nifi/ptcsm
/random/app/nifi/tmds
/random/app/nifi/ucmdb
/random/app/oozie
/random/app/oozie/efdm
/random/app/oozie/efdm/ensco
/random/app/oozie/efdm/ensco/standardized_efdm_ensco_parser_5min
/random/app/oozie/efdm/ensco/standardized_efdm_ensco_parser_5min/lib
/random/app/oozie/efdm/mermec
/random/app/oozie/efdm/mermec/cleansed_efdm_mermec_5min
/random/app/oozie/efdm/mermec/standardized_efdm_mermec_5min
/random/app/oozie/gis
/random/app/oozie/gis/opk
/random/app/oozie/gis/opk/standardized_gis_opk_parser_10min
/random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/lib
/random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/schemas


I would like to modify my command so that only the full directory path is listed, as follows:



/random/custom/hive/jars
/random/app/nifi/egispub
/random/app/nifi/empgis
/random/app/nifi/ods
/random/app/nifi/ptcsm
/random/app/nifi/tmds
/random/app/nifi/ucmdb
/random/app/oozie/efdm/ensco/standardized_efdm_ensco_parser_5min/lib
/random/app/oozie/efdm/mermec/cleansed_efdm_mermec_5min
/random/app/oozie/efdm/mermec/standardized_efdm_mermec_5min
/random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/lib
/random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/schemas


How would you do it?






text-processing




text-processing






share|improve this question









New contributor




user316697 is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.











share|improve this question









New contributor




user316697 is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.









share|improve this question




share|improve this question








edited 2 mins ago









don_crissti

48k15126155




48k15126155






New contributor




user316697 is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.









asked 4 hours ago









user316697

62




62




New contributor




user316697 is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.





New contributor





user316697 is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.






user316697 is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.











  • "I would like to modify my command so that only the full directory path is listed." What do you mean by this? Do you mean that only /random/custom/hive/jars should be output (assuming jars is a directory)? Do you mean that only the path to the /random/custom directory should be listed? The full directory path to which location?
    – code_dredd
    4 hours ago











  • Also, did you try anything? If so, what was it?
    – code_dredd
    4 hours ago










  • Hi, I updated my post to answer your question. I have not tried anything yet. I am looking into awk, sed and grep as options.
    – user316697
    4 hours ago
















  • "I would like to modify my command so that only the full directory path is listed." What do you mean by this? Do you mean that only /random/custom/hive/jars should be output (assuming jars is a directory)? Do you mean that only the path to the /random/custom directory should be listed? The full directory path to which location?
    – code_dredd
    4 hours ago











  • Also, did you try anything? If so, what was it?
    – code_dredd
    4 hours ago










  • Hi, I updated my post to answer your question. I have not tried anything yet. I am looking into awk, sed and grep as options.
    – user316697
    4 hours ago















"I would like to modify my command so that only the full directory path is listed." What do you mean by this? Do you mean that only /random/custom/hive/jars should be output (assuming jars is a directory)? Do you mean that only the path to the /random/custom directory should be listed? The full directory path to which location?
– code_dredd
4 hours ago





"I would like to modify my command so that only the full directory path is listed." What do you mean by this? Do you mean that only /random/custom/hive/jars should be output (assuming jars is a directory)? Do you mean that only the path to the /random/custom directory should be listed? The full directory path to which location?
– code_dredd
4 hours ago













Also, did you try anything? If so, what was it?
– code_dredd
4 hours ago




Also, did you try anything? If so, what was it?
– code_dredd
4 hours ago












Hi, I updated my post to answer your question. I have not tried anything yet. I am looking into awk, sed and grep as options.
– user316697
4 hours ago




Hi, I updated my post to answer your question. I have not tried anything yet. I am looking into awk, sed and grep as options.
– user316697
4 hours ago










3 Answers
3






active

oldest

votes

















up vote
1
down vote













You're looking to printing non-directory files only? Try piping your result through



awk -F/ 'NF <= OLDNF print LAST; OLDNF = NF; LAST = $0 END print LAST'
/random/custom/hive/jars
/random/app/nifi/egispub
/random/app/nifi/empgis
/random/app/nifi/ods
/random/app/nifi/ptcsm
/random/app/nifi/tmds
/random/app/nifi/ucmdb
/random/app/oozie/efdm/ensco/standardized_efdm_ensco_parser_5min/lib
/random/app/oozie/efdm/mermec/cleansed_efdm_mermec_5min
/random/app/oozie/efdm/mermec/standardized_efdm_mermec_5min
/random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/lib
/random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/schemas


It looks for "growing depth" of the path read, and prints if that shrank (going back in dir depth) or stays equal (file on same hierarchy level).






share|improve this answer




















  • lines need to be feed to awk with sorted and this will fail if you had a lines like /c/dn/e/f/cn/a/b. since you are checking the number of fields
    – sddgob
    2 hours ago


















up vote
0
down vote













Another awk approach which is based on matching current line against the previous line. and you must sort the input first.



... |sort | awk '$0 ~ pre pre=$0; next preprint pre pre=$0 END print '


Input:



/random/custom
/c/d
/e/f/c
/a/b
/random/custom/hive/jars
/random/app
/random/app/nifi
/random/app/nifi/egispub
/random/app/nifi/empgis
/random/app/nifi/ods
/random/app/nifi/ptcsm
/random/app/nifi/tmds
/random/app/nifi/ucmdb
/random/app/oozie
/random/app/oozie/efdm
/random/app/oozie/efdm/ensco
/random/app/oozie/efdm/ensco/standardized_efdm_ensco_parser_5min
/random/app/oozie/efdm/ensco/standardized_efdm_ensco_parser_5min/lib
/random/app/oozie/efdm/mermec
/random/app/oozie/efdm/mermec/cleansed_efdm_mermec_5min
/random/app/oozie/efdm/mermec/standardized_efdm_mermec_5min
/random/app/oozie/gis
/random/app/oozie/gis/opk
/random/app/oozie/gis/opk/standardized_gis_opk_parser_10min
/random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/lib
/random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/schemas


Output:



$ awk '$0 ~ pre pre=$0; next preprint pre pre=$0 END print ' <(sort infile)
/a/b
/c/d
/e/f/c
/random/app/nifi/egispub
/random/app/nifi/empgis
/random/app/nifi/ods
/random/app/nifi/ptcsm
/random/app/nifi/tmds
/random/app/nifi/ucmdb
/random/app/oozie/efdm/ensco/standardized_efdm_ensco_parser_5min/lib
/random/app/oozie/efdm/mermec/cleansed_efdm_mermec_5min
/random/app/oozie/efdm/mermec/standardized_efdm_mermec_5min
/random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/lib
/random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/schemas
/random/custom/hive/jars





share|improve this answer



























    up vote
    0
    down vote













    With modern seds (and assuming sorted input):



    sed -E '$!N;/(.+)n1/!P;D' infile


    If your sed is anticuado try:



    sed '$!N;/(.1,)n1/!P;D' infile




    share




















      Your Answer







      StackExchange.ready(function()
      var channelOptions =
      tags: "".split(" "),
      id: "106"
      ;
      initTagRenderer("".split(" "), "".split(" "), channelOptions);

      StackExchange.using("externalEditor", function()
      // Have to fire editor after snippets, if snippets enabled
      if (StackExchange.settings.snippets.snippetsEnabled)
      StackExchange.using("snippets", function()
      createEditor();
      );

      else
      createEditor();

      );

      function createEditor()
      StackExchange.prepareEditor(
      heartbeatType: 'answer',
      convertImagesToLinks: false,
      noModals: false,
      showLowRepImageUploadWarning: true,
      reputationToPostImages: null,
      bindNavPrevention: true,
      postfix: "",
      onDemand: true,
      discardSelector: ".discard-answer"
      ,immediatelyShowMarkdownHelp:true
      );



      );






      user316697 is a new contributor. Be nice, and check out our Code of Conduct.









       

      draft saved


      draft discarded


















      StackExchange.ready(
      function ()
      StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2funix.stackexchange.com%2fquestions%2f476577%2fremove-all-parent-directories-from-a-list-of-paths%23new-answer', 'question_page');

      );

      Post as a guest

















      3 Answers
      3






      active

      oldest

      votes








      3 Answers
      3






      active

      oldest

      votes









      active

      oldest

      votes






      active

      oldest

      votes








      up vote
      1
      down vote













      You're looking to printing non-directory files only? Try piping your result through



      awk -F/ 'NF <= OLDNF print LAST; OLDNF = NF; LAST = $0 END print LAST'
      /random/custom/hive/jars
      /random/app/nifi/egispub
      /random/app/nifi/empgis
      /random/app/nifi/ods
      /random/app/nifi/ptcsm
      /random/app/nifi/tmds
      /random/app/nifi/ucmdb
      /random/app/oozie/efdm/ensco/standardized_efdm_ensco_parser_5min/lib
      /random/app/oozie/efdm/mermec/cleansed_efdm_mermec_5min
      /random/app/oozie/efdm/mermec/standardized_efdm_mermec_5min
      /random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/lib
      /random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/schemas


      It looks for "growing depth" of the path read, and prints if that shrank (going back in dir depth) or stays equal (file on same hierarchy level).






      share|improve this answer




















      • lines need to be feed to awk with sorted and this will fail if you had a lines like /c/dn/e/f/cn/a/b. since you are checking the number of fields
        – sddgob
        2 hours ago















      up vote
      1
      down vote













      You're looking to printing non-directory files only? Try piping your result through



      awk -F/ 'NF <= OLDNF print LAST; OLDNF = NF; LAST = $0 END print LAST'
      /random/custom/hive/jars
      /random/app/nifi/egispub
      /random/app/nifi/empgis
      /random/app/nifi/ods
      /random/app/nifi/ptcsm
      /random/app/nifi/tmds
      /random/app/nifi/ucmdb
      /random/app/oozie/efdm/ensco/standardized_efdm_ensco_parser_5min/lib
      /random/app/oozie/efdm/mermec/cleansed_efdm_mermec_5min
      /random/app/oozie/efdm/mermec/standardized_efdm_mermec_5min
      /random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/lib
      /random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/schemas


      It looks for "growing depth" of the path read, and prints if that shrank (going back in dir depth) or stays equal (file on same hierarchy level).






      share|improve this answer




















      • lines need to be feed to awk with sorted and this will fail if you had a lines like /c/dn/e/f/cn/a/b. since you are checking the number of fields
        – sddgob
        2 hours ago













      up vote
      1
      down vote










      up vote
      1
      down vote









      You're looking to printing non-directory files only? Try piping your result through



      awk -F/ 'NF <= OLDNF print LAST; OLDNF = NF; LAST = $0 END print LAST'
      /random/custom/hive/jars
      /random/app/nifi/egispub
      /random/app/nifi/empgis
      /random/app/nifi/ods
      /random/app/nifi/ptcsm
      /random/app/nifi/tmds
      /random/app/nifi/ucmdb
      /random/app/oozie/efdm/ensco/standardized_efdm_ensco_parser_5min/lib
      /random/app/oozie/efdm/mermec/cleansed_efdm_mermec_5min
      /random/app/oozie/efdm/mermec/standardized_efdm_mermec_5min
      /random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/lib
      /random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/schemas


      It looks for "growing depth" of the path read, and prints if that shrank (going back in dir depth) or stays equal (file on same hierarchy level).






      share|improve this answer












      You're looking to printing non-directory files only? Try piping your result through



      awk -F/ 'NF <= OLDNF print LAST; OLDNF = NF; LAST = $0 END print LAST'
      /random/custom/hive/jars
      /random/app/nifi/egispub
      /random/app/nifi/empgis
      /random/app/nifi/ods
      /random/app/nifi/ptcsm
      /random/app/nifi/tmds
      /random/app/nifi/ucmdb
      /random/app/oozie/efdm/ensco/standardized_efdm_ensco_parser_5min/lib
      /random/app/oozie/efdm/mermec/cleansed_efdm_mermec_5min
      /random/app/oozie/efdm/mermec/standardized_efdm_mermec_5min
      /random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/lib
      /random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/schemas


      It looks for "growing depth" of the path read, and prints if that shrank (going back in dir depth) or stays equal (file on same hierarchy level).







      share|improve this answer












      share|improve this answer



      share|improve this answer










      answered 3 hours ago









      RudiC

      2,201110




      2,201110











      • lines need to be feed to awk with sorted and this will fail if you had a lines like /c/dn/e/f/cn/a/b. since you are checking the number of fields
        – sddgob
        2 hours ago

















      • lines need to be feed to awk with sorted and this will fail if you had a lines like /c/dn/e/f/cn/a/b. since you are checking the number of fields
        – sddgob
        2 hours ago
















      lines need to be feed to awk with sorted and this will fail if you had a lines like /c/dn/e/f/cn/a/b. since you are checking the number of fields
      – sddgob
      2 hours ago





      lines need to be feed to awk with sorted and this will fail if you had a lines like /c/dn/e/f/cn/a/b. since you are checking the number of fields
      – sddgob
      2 hours ago













      up vote
      0
      down vote













      Another awk approach which is based on matching current line against the previous line. and you must sort the input first.



      ... |sort | awk '$0 ~ pre pre=$0; next preprint pre pre=$0 END print '


      Input:



      /random/custom
      /c/d
      /e/f/c
      /a/b
      /random/custom/hive/jars
      /random/app
      /random/app/nifi
      /random/app/nifi/egispub
      /random/app/nifi/empgis
      /random/app/nifi/ods
      /random/app/nifi/ptcsm
      /random/app/nifi/tmds
      /random/app/nifi/ucmdb
      /random/app/oozie
      /random/app/oozie/efdm
      /random/app/oozie/efdm/ensco
      /random/app/oozie/efdm/ensco/standardized_efdm_ensco_parser_5min
      /random/app/oozie/efdm/ensco/standardized_efdm_ensco_parser_5min/lib
      /random/app/oozie/efdm/mermec
      /random/app/oozie/efdm/mermec/cleansed_efdm_mermec_5min
      /random/app/oozie/efdm/mermec/standardized_efdm_mermec_5min
      /random/app/oozie/gis
      /random/app/oozie/gis/opk
      /random/app/oozie/gis/opk/standardized_gis_opk_parser_10min
      /random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/lib
      /random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/schemas


      Output:



      $ awk '$0 ~ pre pre=$0; next preprint pre pre=$0 END print ' <(sort infile)
      /a/b
      /c/d
      /e/f/c
      /random/app/nifi/egispub
      /random/app/nifi/empgis
      /random/app/nifi/ods
      /random/app/nifi/ptcsm
      /random/app/nifi/tmds
      /random/app/nifi/ucmdb
      /random/app/oozie/efdm/ensco/standardized_efdm_ensco_parser_5min/lib
      /random/app/oozie/efdm/mermec/cleansed_efdm_mermec_5min
      /random/app/oozie/efdm/mermec/standardized_efdm_mermec_5min
      /random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/lib
      /random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/schemas
      /random/custom/hive/jars





      share|improve this answer
























        up vote
        0
        down vote













        Another awk approach which is based on matching current line against the previous line. and you must sort the input first.



        ... |sort | awk '$0 ~ pre pre=$0; next preprint pre pre=$0 END print '


        Input:



        /random/custom
        /c/d
        /e/f/c
        /a/b
        /random/custom/hive/jars
        /random/app
        /random/app/nifi
        /random/app/nifi/egispub
        /random/app/nifi/empgis
        /random/app/nifi/ods
        /random/app/nifi/ptcsm
        /random/app/nifi/tmds
        /random/app/nifi/ucmdb
        /random/app/oozie
        /random/app/oozie/efdm
        /random/app/oozie/efdm/ensco
        /random/app/oozie/efdm/ensco/standardized_efdm_ensco_parser_5min
        /random/app/oozie/efdm/ensco/standardized_efdm_ensco_parser_5min/lib
        /random/app/oozie/efdm/mermec
        /random/app/oozie/efdm/mermec/cleansed_efdm_mermec_5min
        /random/app/oozie/efdm/mermec/standardized_efdm_mermec_5min
        /random/app/oozie/gis
        /random/app/oozie/gis/opk
        /random/app/oozie/gis/opk/standardized_gis_opk_parser_10min
        /random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/lib
        /random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/schemas


        Output:



        $ awk '$0 ~ pre pre=$0; next preprint pre pre=$0 END print ' <(sort infile)
        /a/b
        /c/d
        /e/f/c
        /random/app/nifi/egispub
        /random/app/nifi/empgis
        /random/app/nifi/ods
        /random/app/nifi/ptcsm
        /random/app/nifi/tmds
        /random/app/nifi/ucmdb
        /random/app/oozie/efdm/ensco/standardized_efdm_ensco_parser_5min/lib
        /random/app/oozie/efdm/mermec/cleansed_efdm_mermec_5min
        /random/app/oozie/efdm/mermec/standardized_efdm_mermec_5min
        /random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/lib
        /random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/schemas
        /random/custom/hive/jars





        share|improve this answer






















          up vote
          0
          down vote










          up vote
          0
          down vote









          Another awk approach which is based on matching current line against the previous line. and you must sort the input first.



          ... |sort | awk '$0 ~ pre pre=$0; next preprint pre pre=$0 END print '


          Input:



          /random/custom
          /c/d
          /e/f/c
          /a/b
          /random/custom/hive/jars
          /random/app
          /random/app/nifi
          /random/app/nifi/egispub
          /random/app/nifi/empgis
          /random/app/nifi/ods
          /random/app/nifi/ptcsm
          /random/app/nifi/tmds
          /random/app/nifi/ucmdb
          /random/app/oozie
          /random/app/oozie/efdm
          /random/app/oozie/efdm/ensco
          /random/app/oozie/efdm/ensco/standardized_efdm_ensco_parser_5min
          /random/app/oozie/efdm/ensco/standardized_efdm_ensco_parser_5min/lib
          /random/app/oozie/efdm/mermec
          /random/app/oozie/efdm/mermec/cleansed_efdm_mermec_5min
          /random/app/oozie/efdm/mermec/standardized_efdm_mermec_5min
          /random/app/oozie/gis
          /random/app/oozie/gis/opk
          /random/app/oozie/gis/opk/standardized_gis_opk_parser_10min
          /random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/lib
          /random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/schemas


          Output:



          $ awk '$0 ~ pre pre=$0; next preprint pre pre=$0 END print ' <(sort infile)
          /a/b
          /c/d
          /e/f/c
          /random/app/nifi/egispub
          /random/app/nifi/empgis
          /random/app/nifi/ods
          /random/app/nifi/ptcsm
          /random/app/nifi/tmds
          /random/app/nifi/ucmdb
          /random/app/oozie/efdm/ensco/standardized_efdm_ensco_parser_5min/lib
          /random/app/oozie/efdm/mermec/cleansed_efdm_mermec_5min
          /random/app/oozie/efdm/mermec/standardized_efdm_mermec_5min
          /random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/lib
          /random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/schemas
          /random/custom/hive/jars





          share|improve this answer












          Another awk approach which is based on matching current line against the previous line. and you must sort the input first.



          ... |sort | awk '$0 ~ pre pre=$0; next preprint pre pre=$0 END print '


          Input:



          /random/custom
          /c/d
          /e/f/c
          /a/b
          /random/custom/hive/jars
          /random/app
          /random/app/nifi
          /random/app/nifi/egispub
          /random/app/nifi/empgis
          /random/app/nifi/ods
          /random/app/nifi/ptcsm
          /random/app/nifi/tmds
          /random/app/nifi/ucmdb
          /random/app/oozie
          /random/app/oozie/efdm
          /random/app/oozie/efdm/ensco
          /random/app/oozie/efdm/ensco/standardized_efdm_ensco_parser_5min
          /random/app/oozie/efdm/ensco/standardized_efdm_ensco_parser_5min/lib
          /random/app/oozie/efdm/mermec
          /random/app/oozie/efdm/mermec/cleansed_efdm_mermec_5min
          /random/app/oozie/efdm/mermec/standardized_efdm_mermec_5min
          /random/app/oozie/gis
          /random/app/oozie/gis/opk
          /random/app/oozie/gis/opk/standardized_gis_opk_parser_10min
          /random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/lib
          /random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/schemas


          Output:



          $ awk '$0 ~ pre pre=$0; next preprint pre pre=$0 END print ' <(sort infile)
          /a/b
          /c/d
          /e/f/c
          /random/app/nifi/egispub
          /random/app/nifi/empgis
          /random/app/nifi/ods
          /random/app/nifi/ptcsm
          /random/app/nifi/tmds
          /random/app/nifi/ucmdb
          /random/app/oozie/efdm/ensco/standardized_efdm_ensco_parser_5min/lib
          /random/app/oozie/efdm/mermec/cleansed_efdm_mermec_5min
          /random/app/oozie/efdm/mermec/standardized_efdm_mermec_5min
          /random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/lib
          /random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/schemas
          /random/custom/hive/jars






          share|improve this answer












          share|improve this answer



          share|improve this answer










          answered 2 hours ago









          sddgob

          16.2k102564




          16.2k102564




















              up vote
              0
              down vote













              With modern seds (and assuming sorted input):



              sed -E '$!N;/(.+)n1/!P;D' infile


              If your sed is anticuado try:



              sed '$!N;/(.1,)n1/!P;D' infile




              share
























                up vote
                0
                down vote













                With modern seds (and assuming sorted input):



                sed -E '$!N;/(.+)n1/!P;D' infile


                If your sed is anticuado try:



                sed '$!N;/(.1,)n1/!P;D' infile




                share






















                  up vote
                  0
                  down vote










                  up vote
                  0
                  down vote









                  With modern seds (and assuming sorted input):



                  sed -E '$!N;/(.+)n1/!P;D' infile


                  If your sed is anticuado try:



                  sed '$!N;/(.1,)n1/!P;D' infile




                  share












                  With modern seds (and assuming sorted input):



                  sed -E '$!N;/(.+)n1/!P;D' infile


                  If your sed is anticuado try:



                  sed '$!N;/(.1,)n1/!P;D' infile





                  share











                  share


                  share










                  answered 4 mins ago









                  don_crissti

                  48k15126155




                  48k15126155




















                      user316697 is a new contributor. Be nice, and check out our Code of Conduct.









                       

                      draft saved


                      draft discarded


















                      user316697 is a new contributor. Be nice, and check out our Code of Conduct.












                      user316697 is a new contributor. Be nice, and check out our Code of Conduct.











                      user316697 is a new contributor. Be nice, and check out our Code of Conduct.













                       


                      draft saved


                      draft discarded














                      StackExchange.ready(
                      function ()
                      StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2funix.stackexchange.com%2fquestions%2f476577%2fremove-all-parent-directories-from-a-list-of-paths%23new-answer', 'question_page');

                      );

                      Post as a guest
































































                      -

                      Popular posts from this blog

                      How to check contact read email or not when send email to Individual?

                      Image
                      Clash Royale CLAN TAG #URR8PPP up vote 1 down vote favorite I'm using WordPress 4.9.8, CiviCRM to 5.5.1, I usually send email to contact by Search> Find contacts View contact details Action> Send email Send email ok, Contact received mail ok like picture But status only Email sent though contact read email or not. So, can CiviCRM can change status to Email read when contact read email? wordpress email share | improve this question asked Sep 26 at 0:12 ToanLuong 49 9 add a comment  |  up vote 1 down vote favorite I'm using WordPress 4.9.8, CiviCRM to 5.5.1, I usually send email to contact by Search> Find contacts View contact details Action> Send email Send email ok, Contact received mail ok like picture But status only Email sent though contact read email or not. So, can CiviCRM can change status to Email read when contact read email? wordpress email share | improve this questi...
                      Read more

                      Displaying single band from multi-band raster using QGIS

                      Image
                      Clash Royale CLAN TAG #URR8PPP 1 How can I extract a single band from multi-band raster in QGIS? I have an remote sensed image which has 6 bands (including NDVI band), I want to display each band separately, but have no idea how to do. I have seen some questions similar here but none worked for me. The original image (has 6 bands) is: I want to display the band 6 which should be like this: But I tried gdal_translate, and couldn't get the correct result. What I have got is: qgis raster multi-band share | improve this question edited Mar 5 at 0:53 Summer asked Mar 4 at 6:42 Summer Summer 23 6 Is this any help gis.stackexchange.com/questions/220658/… ? if not gis.stackexchange.com/questions/62133/… might help. – Michael Stimson Mar 4 at 6:46 Thanks for answering but when I used gdal_translate, qgis showed that 'Error 4: Kayena.tif: No such file or directory". Would you know how to fi...
                      Read more

                      How many registers does an x86_64 CPU actually have?

                      Image
                      Clash Royale CLAN TAG #URR8PPP up vote 2 down vote favorite I am currently learning reverse engineering and am studying the flags register. I had in my mind that rflags was just another name for one of the 16 general purpose registers, for example rax or rbx . But it looks like rflags is actually an additional register. So that makes 17 registers in total... how many more could there be? I have spent at least an hour on this and found numerous different answers. The best answer so far is this, which says that there are 40 registers in total. 16 General Purpose Registers 2 Status Registers 6 Code Segment Registers 16 SSE Registers 8 FPU/MMX Registers But if I add that up, I get 48. Could anybody provide an official answer on how many registers an x86_64 CPU has (e.g. an Intel i7). Additionally, I have seen references to 'hardware' and 'architectural' registers. What are those registers and how many are there? register x86-64 share | improve this...
                      Read more