Remove all parent directories from a list of paths

The name of the pictureThe name of the pictureThe name of the pictureClash Royale CLAN TAG#URR8PPP











up vote
1
down vote

favorite












I have a bash command that lists the directories in HDFS beginning with '/random'.



It goes as follows:



hdfs dfs -ls -R /random | grep '^d' | awk 'print $NF'


It generates the following output:



/random/custom
/random/custom/hive
/random/custom/hive/jars
/random/app
/random/app/nifi
/random/app/nifi/egispub
/random/app/nifi/empgis
/random/app/nifi/ods
/random/app/nifi/ptcsm
/random/app/nifi/tmds
/random/app/nifi/ucmdb
/random/app/oozie
/random/app/oozie/efdm
/random/app/oozie/efdm/ensco
/random/app/oozie/efdm/ensco/standardized_efdm_ensco_parser_5min
/random/app/oozie/efdm/ensco/standardized_efdm_ensco_parser_5min/lib
/random/app/oozie/efdm/mermec
/random/app/oozie/efdm/mermec/cleansed_efdm_mermec_5min
/random/app/oozie/efdm/mermec/standardized_efdm_mermec_5min
/random/app/oozie/gis
/random/app/oozie/gis/opk
/random/app/oozie/gis/opk/standardized_gis_opk_parser_10min
/random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/lib
/random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/schemas


I would like to modify my command so that only the full directory path is listed, as follows:



/random/custom/hive/jars
/random/app/nifi/egispub
/random/app/nifi/empgis
/random/app/nifi/ods
/random/app/nifi/ptcsm
/random/app/nifi/tmds
/random/app/nifi/ucmdb
/random/app/oozie/efdm/ensco/standardized_efdm_ensco_parser_5min/lib
/random/app/oozie/efdm/mermec/cleansed_efdm_mermec_5min
/random/app/oozie/efdm/mermec/standardized_efdm_mermec_5min
/random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/lib
/random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/schemas


How would you do it?






text-processing







share|improve this question









New contributor




user316697 is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.



















  • "I would like to modify my command so that only the full directory path is listed." What do you mean by this? Do you mean that only /random/custom/hive/jars should be output (assuming jars is a directory)? Do you mean that only the path to the /random/custom directory should be listed? The full directory path to which location?
    – code_dredd
    4 hours ago











  • Also, did you try anything? If so, what was it?
    – code_dredd
    4 hours ago










  • Hi, I updated my post to answer your question. I have not tried anything yet. I am looking into awk, sed and grep as options.
    – user316697
    4 hours ago














up vote
1
down vote

favorite












I have a bash command that lists the directories in HDFS beginning with '/random'.



It goes as follows:



hdfs dfs -ls -R /random | grep '^d' | awk 'print $NF'


It generates the following output:



/random/custom
/random/custom/hive
/random/custom/hive/jars
/random/app
/random/app/nifi
/random/app/nifi/egispub
/random/app/nifi/empgis
/random/app/nifi/ods
/random/app/nifi/ptcsm
/random/app/nifi/tmds
/random/app/nifi/ucmdb
/random/app/oozie
/random/app/oozie/efdm
/random/app/oozie/efdm/ensco
/random/app/oozie/efdm/ensco/standardized_efdm_ensco_parser_5min
/random/app/oozie/efdm/ensco/standardized_efdm_ensco_parser_5min/lib
/random/app/oozie/efdm/mermec
/random/app/oozie/efdm/mermec/cleansed_efdm_mermec_5min
/random/app/oozie/efdm/mermec/standardized_efdm_mermec_5min
/random/app/oozie/gis
/random/app/oozie/gis/opk
/random/app/oozie/gis/opk/standardized_gis_opk_parser_10min
/random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/lib
/random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/schemas


I would like to modify my command so that only the full directory path is listed, as follows:



/random/custom/hive/jars
/random/app/nifi/egispub
/random/app/nifi/empgis
/random/app/nifi/ods
/random/app/nifi/ptcsm
/random/app/nifi/tmds
/random/app/nifi/ucmdb
/random/app/oozie/efdm/ensco/standardized_efdm_ensco_parser_5min/lib
/random/app/oozie/efdm/mermec/cleansed_efdm_mermec_5min
/random/app/oozie/efdm/mermec/standardized_efdm_mermec_5min
/random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/lib
/random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/schemas


How would you do it?






text-processing







share|improve this question









New contributor




user316697 is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.



















  • "I would like to modify my command so that only the full directory path is listed." What do you mean by this? Do you mean that only /random/custom/hive/jars should be output (assuming jars is a directory)? Do you mean that only the path to the /random/custom directory should be listed? The full directory path to which location?
    – code_dredd
    4 hours ago











  • Also, did you try anything? If so, what was it?
    – code_dredd
    4 hours ago










  • Hi, I updated my post to answer your question. I have not tried anything yet. I am looking into awk, sed and grep as options.
    – user316697
    4 hours ago












up vote
1
down vote

favorite









up vote
1
down vote

favorite











I have a bash command that lists the directories in HDFS beginning with '/random'.



It goes as follows:



hdfs dfs -ls -R /random | grep '^d' | awk 'print $NF'


It generates the following output:



/random/custom
/random/custom/hive
/random/custom/hive/jars
/random/app
/random/app/nifi
/random/app/nifi/egispub
/random/app/nifi/empgis
/random/app/nifi/ods
/random/app/nifi/ptcsm
/random/app/nifi/tmds
/random/app/nifi/ucmdb
/random/app/oozie
/random/app/oozie/efdm
/random/app/oozie/efdm/ensco
/random/app/oozie/efdm/ensco/standardized_efdm_ensco_parser_5min
/random/app/oozie/efdm/ensco/standardized_efdm_ensco_parser_5min/lib
/random/app/oozie/efdm/mermec
/random/app/oozie/efdm/mermec/cleansed_efdm_mermec_5min
/random/app/oozie/efdm/mermec/standardized_efdm_mermec_5min
/random/app/oozie/gis
/random/app/oozie/gis/opk
/random/app/oozie/gis/opk/standardized_gis_opk_parser_10min
/random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/lib
/random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/schemas


I would like to modify my command so that only the full directory path is listed, as follows:



/random/custom/hive/jars
/random/app/nifi/egispub
/random/app/nifi/empgis
/random/app/nifi/ods
/random/app/nifi/ptcsm
/random/app/nifi/tmds
/random/app/nifi/ucmdb
/random/app/oozie/efdm/ensco/standardized_efdm_ensco_parser_5min/lib
/random/app/oozie/efdm/mermec/cleansed_efdm_mermec_5min
/random/app/oozie/efdm/mermec/standardized_efdm_mermec_5min
/random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/lib
/random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/schemas


How would you do it?






text-processing







share|improve this question









New contributor




user316697 is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.











I have a bash command that lists the directories in HDFS beginning with '/random'.



It goes as follows:



hdfs dfs -ls -R /random | grep '^d' | awk 'print $NF'


It generates the following output:



/random/custom
/random/custom/hive
/random/custom/hive/jars
/random/app
/random/app/nifi
/random/app/nifi/egispub
/random/app/nifi/empgis
/random/app/nifi/ods
/random/app/nifi/ptcsm
/random/app/nifi/tmds
/random/app/nifi/ucmdb
/random/app/oozie
/random/app/oozie/efdm
/random/app/oozie/efdm/ensco
/random/app/oozie/efdm/ensco/standardized_efdm_ensco_parser_5min
/random/app/oozie/efdm/ensco/standardized_efdm_ensco_parser_5min/lib
/random/app/oozie/efdm/mermec
/random/app/oozie/efdm/mermec/cleansed_efdm_mermec_5min
/random/app/oozie/efdm/mermec/standardized_efdm_mermec_5min
/random/app/oozie/gis
/random/app/oozie/gis/opk
/random/app/oozie/gis/opk/standardized_gis_opk_parser_10min
/random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/lib
/random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/schemas


I would like to modify my command so that only the full directory path is listed, as follows:



/random/custom/hive/jars
/random/app/nifi/egispub
/random/app/nifi/empgis
/random/app/nifi/ods
/random/app/nifi/ptcsm
/random/app/nifi/tmds
/random/app/nifi/ucmdb
/random/app/oozie/efdm/ensco/standardized_efdm_ensco_parser_5min/lib
/random/app/oozie/efdm/mermec/cleansed_efdm_mermec_5min
/random/app/oozie/efdm/mermec/standardized_efdm_mermec_5min
/random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/lib
/random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/schemas


How would you do it?






text-processing




text-processing






share|improve this question









New contributor




user316697 is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.











share|improve this question









New contributor




user316697 is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.









share|improve this question




share|improve this question








edited 2 mins ago









don_crissti

48k15126155




48k15126155






New contributor




user316697 is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.









asked 4 hours ago









user316697

62




62




New contributor




user316697 is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.





New contributor





user316697 is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.






user316697 is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.











  • "I would like to modify my command so that only the full directory path is listed." What do you mean by this? Do you mean that only /random/custom/hive/jars should be output (assuming jars is a directory)? Do you mean that only the path to the /random/custom directory should be listed? The full directory path to which location?
    – code_dredd
    4 hours ago











  • Also, did you try anything? If so, what was it?
    – code_dredd
    4 hours ago










  • Hi, I updated my post to answer your question. I have not tried anything yet. I am looking into awk, sed and grep as options.
    – user316697
    4 hours ago
















  • "I would like to modify my command so that only the full directory path is listed." What do you mean by this? Do you mean that only /random/custom/hive/jars should be output (assuming jars is a directory)? Do you mean that only the path to the /random/custom directory should be listed? The full directory path to which location?
    – code_dredd
    4 hours ago











  • Also, did you try anything? If so, what was it?
    – code_dredd
    4 hours ago










  • Hi, I updated my post to answer your question. I have not tried anything yet. I am looking into awk, sed and grep as options.
    – user316697
    4 hours ago















"I would like to modify my command so that only the full directory path is listed." What do you mean by this? Do you mean that only /random/custom/hive/jars should be output (assuming jars is a directory)? Do you mean that only the path to the /random/custom directory should be listed? The full directory path to which location?
– code_dredd
4 hours ago





"I would like to modify my command so that only the full directory path is listed." What do you mean by this? Do you mean that only /random/custom/hive/jars should be output (assuming jars is a directory)? Do you mean that only the path to the /random/custom directory should be listed? The full directory path to which location?
– code_dredd
4 hours ago













Also, did you try anything? If so, what was it?
– code_dredd
4 hours ago




Also, did you try anything? If so, what was it?
– code_dredd
4 hours ago












Hi, I updated my post to answer your question. I have not tried anything yet. I am looking into awk, sed and grep as options.
– user316697
4 hours ago




Hi, I updated my post to answer your question. I have not tried anything yet. I am looking into awk, sed and grep as options.
– user316697
4 hours ago










3 Answers
3






active

oldest

votes

















up vote
1
down vote













You're looking to printing non-directory files only? Try piping your result through



awk -F/ 'NF <= OLDNF print LAST; OLDNF = NF; LAST = $0 END print LAST'
/random/custom/hive/jars
/random/app/nifi/egispub
/random/app/nifi/empgis
/random/app/nifi/ods
/random/app/nifi/ptcsm
/random/app/nifi/tmds
/random/app/nifi/ucmdb
/random/app/oozie/efdm/ensco/standardized_efdm_ensco_parser_5min/lib
/random/app/oozie/efdm/mermec/cleansed_efdm_mermec_5min
/random/app/oozie/efdm/mermec/standardized_efdm_mermec_5min
/random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/lib
/random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/schemas


It looks for "growing depth" of the path read, and prints if that shrank (going back in dir depth) or stays equal (file on same hierarchy level).






share|improve this answer




















  • lines need to be feed to awk with sorted and this will fail if you had a lines like /c/dn/e/f/cn/a/b. since you are checking the number of fields
    – sddgob
    2 hours ago


















up vote
0
down vote













Another awk approach which is based on matching current line against the previous line. and you must sort the input first.



... |sort | awk '$0 ~ pre pre=$0; next preprint pre pre=$0 END print '


Input:



/random/custom
/c/d
/e/f/c
/a/b
/random/custom/hive/jars
/random/app
/random/app/nifi
/random/app/nifi/egispub
/random/app/nifi/empgis
/random/app/nifi/ods
/random/app/nifi/ptcsm
/random/app/nifi/tmds
/random/app/nifi/ucmdb
/random/app/oozie
/random/app/oozie/efdm
/random/app/oozie/efdm/ensco
/random/app/oozie/efdm/ensco/standardized_efdm_ensco_parser_5min
/random/app/oozie/efdm/ensco/standardized_efdm_ensco_parser_5min/lib
/random/app/oozie/efdm/mermec
/random/app/oozie/efdm/mermec/cleansed_efdm_mermec_5min
/random/app/oozie/efdm/mermec/standardized_efdm_mermec_5min
/random/app/oozie/gis
/random/app/oozie/gis/opk
/random/app/oozie/gis/opk/standardized_gis_opk_parser_10min
/random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/lib
/random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/schemas


Output:



$ awk '$0 ~ pre pre=$0; next preprint pre pre=$0 END print ' <(sort infile)
/a/b
/c/d
/e/f/c
/random/app/nifi/egispub
/random/app/nifi/empgis
/random/app/nifi/ods
/random/app/nifi/ptcsm
/random/app/nifi/tmds
/random/app/nifi/ucmdb
/random/app/oozie/efdm/ensco/standardized_efdm_ensco_parser_5min/lib
/random/app/oozie/efdm/mermec/cleansed_efdm_mermec_5min
/random/app/oozie/efdm/mermec/standardized_efdm_mermec_5min
/random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/lib
/random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/schemas
/random/custom/hive/jars





share|improve this answer



























    up vote
    0
    down vote













    With modern seds (and assuming sorted input):



    sed -E '$!N;/(.+)n1/!P;D' infile


    If your sed is anticuado try:



    sed '$!N;/(.1,)n1/!P;D' infile




    share




















      Your Answer







      StackExchange.ready(function()
      var channelOptions =
      tags: "".split(" "),
      id: "106"
      ;
      initTagRenderer("".split(" "), "".split(" "), channelOptions);

      StackExchange.using("externalEditor", function()
      // Have to fire editor after snippets, if snippets enabled
      if (StackExchange.settings.snippets.snippetsEnabled)
      StackExchange.using("snippets", function()
      createEditor();
      );

      else
      createEditor();

      );

      function createEditor()
      StackExchange.prepareEditor(
      heartbeatType: 'answer',
      convertImagesToLinks: false,
      noModals: false,
      showLowRepImageUploadWarning: true,
      reputationToPostImages: null,
      bindNavPrevention: true,
      postfix: "",
      onDemand: true,
      discardSelector: ".discard-answer"
      ,immediatelyShowMarkdownHelp:true
      );



      );






      user316697 is a new contributor. Be nice, and check out our Code of Conduct.









       

      draft saved


      draft discarded


















      StackExchange.ready(
      function ()
      StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2funix.stackexchange.com%2fquestions%2f476577%2fremove-all-parent-directories-from-a-list-of-paths%23new-answer', 'question_page');

      );

      Post as a guest

















      3 Answers
      3






      active

      oldest

      votes








      3 Answers
      3






      active

      oldest

      votes









      active

      oldest

      votes






      active

      oldest

      votes








      up vote
      1
      down vote













      You're looking to printing non-directory files only? Try piping your result through



      awk -F/ 'NF <= OLDNF print LAST; OLDNF = NF; LAST = $0 END print LAST'
      /random/custom/hive/jars
      /random/app/nifi/egispub
      /random/app/nifi/empgis
      /random/app/nifi/ods
      /random/app/nifi/ptcsm
      /random/app/nifi/tmds
      /random/app/nifi/ucmdb
      /random/app/oozie/efdm/ensco/standardized_efdm_ensco_parser_5min/lib
      /random/app/oozie/efdm/mermec/cleansed_efdm_mermec_5min
      /random/app/oozie/efdm/mermec/standardized_efdm_mermec_5min
      /random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/lib
      /random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/schemas


      It looks for "growing depth" of the path read, and prints if that shrank (going back in dir depth) or stays equal (file on same hierarchy level).






      share|improve this answer




















      • lines need to be feed to awk with sorted and this will fail if you had a lines like /c/dn/e/f/cn/a/b. since you are checking the number of fields
        – sddgob
        2 hours ago















      up vote
      1
      down vote













      You're looking to printing non-directory files only? Try piping your result through



      awk -F/ 'NF <= OLDNF print LAST; OLDNF = NF; LAST = $0 END print LAST'
      /random/custom/hive/jars
      /random/app/nifi/egispub
      /random/app/nifi/empgis
      /random/app/nifi/ods
      /random/app/nifi/ptcsm
      /random/app/nifi/tmds
      /random/app/nifi/ucmdb
      /random/app/oozie/efdm/ensco/standardized_efdm_ensco_parser_5min/lib
      /random/app/oozie/efdm/mermec/cleansed_efdm_mermec_5min
      /random/app/oozie/efdm/mermec/standardized_efdm_mermec_5min
      /random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/lib
      /random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/schemas


      It looks for "growing depth" of the path read, and prints if that shrank (going back in dir depth) or stays equal (file on same hierarchy level).






      share|improve this answer




















      • lines need to be feed to awk with sorted and this will fail if you had a lines like /c/dn/e/f/cn/a/b. since you are checking the number of fields
        – sddgob
        2 hours ago













      up vote
      1
      down vote










      up vote
      1
      down vote









      You're looking to printing non-directory files only? Try piping your result through



      awk -F/ 'NF <= OLDNF print LAST; OLDNF = NF; LAST = $0 END print LAST'
      /random/custom/hive/jars
      /random/app/nifi/egispub
      /random/app/nifi/empgis
      /random/app/nifi/ods
      /random/app/nifi/ptcsm
      /random/app/nifi/tmds
      /random/app/nifi/ucmdb
      /random/app/oozie/efdm/ensco/standardized_efdm_ensco_parser_5min/lib
      /random/app/oozie/efdm/mermec/cleansed_efdm_mermec_5min
      /random/app/oozie/efdm/mermec/standardized_efdm_mermec_5min
      /random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/lib
      /random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/schemas


      It looks for "growing depth" of the path read, and prints if that shrank (going back in dir depth) or stays equal (file on same hierarchy level).






      share|improve this answer












      You're looking to printing non-directory files only? Try piping your result through



      awk -F/ 'NF <= OLDNF print LAST; OLDNF = NF; LAST = $0 END print LAST'
      /random/custom/hive/jars
      /random/app/nifi/egispub
      /random/app/nifi/empgis
      /random/app/nifi/ods
      /random/app/nifi/ptcsm
      /random/app/nifi/tmds
      /random/app/nifi/ucmdb
      /random/app/oozie/efdm/ensco/standardized_efdm_ensco_parser_5min/lib
      /random/app/oozie/efdm/mermec/cleansed_efdm_mermec_5min
      /random/app/oozie/efdm/mermec/standardized_efdm_mermec_5min
      /random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/lib
      /random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/schemas


      It looks for "growing depth" of the path read, and prints if that shrank (going back in dir depth) or stays equal (file on same hierarchy level).







      share|improve this answer












      share|improve this answer



      share|improve this answer










      answered 3 hours ago









      RudiC

      2,201110




      2,201110











      • lines need to be feed to awk with sorted and this will fail if you had a lines like /c/dn/e/f/cn/a/b. since you are checking the number of fields
        – sddgob
        2 hours ago

















      • lines need to be feed to awk with sorted and this will fail if you had a lines like /c/dn/e/f/cn/a/b. since you are checking the number of fields
        – sddgob
        2 hours ago
















      lines need to be feed to awk with sorted and this will fail if you had a lines like /c/dn/e/f/cn/a/b. since you are checking the number of fields
      – sddgob
      2 hours ago





      lines need to be feed to awk with sorted and this will fail if you had a lines like /c/dn/e/f/cn/a/b. since you are checking the number of fields
      – sddgob
      2 hours ago













      up vote
      0
      down vote













      Another awk approach which is based on matching current line against the previous line. and you must sort the input first.



      ... |sort | awk '$0 ~ pre pre=$0; next preprint pre pre=$0 END print '


      Input:



      /random/custom
      /c/d
      /e/f/c
      /a/b
      /random/custom/hive/jars
      /random/app
      /random/app/nifi
      /random/app/nifi/egispub
      /random/app/nifi/empgis
      /random/app/nifi/ods
      /random/app/nifi/ptcsm
      /random/app/nifi/tmds
      /random/app/nifi/ucmdb
      /random/app/oozie
      /random/app/oozie/efdm
      /random/app/oozie/efdm/ensco
      /random/app/oozie/efdm/ensco/standardized_efdm_ensco_parser_5min
      /random/app/oozie/efdm/ensco/standardized_efdm_ensco_parser_5min/lib
      /random/app/oozie/efdm/mermec
      /random/app/oozie/efdm/mermec/cleansed_efdm_mermec_5min
      /random/app/oozie/efdm/mermec/standardized_efdm_mermec_5min
      /random/app/oozie/gis
      /random/app/oozie/gis/opk
      /random/app/oozie/gis/opk/standardized_gis_opk_parser_10min
      /random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/lib
      /random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/schemas


      Output:



      $ awk '$0 ~ pre pre=$0; next preprint pre pre=$0 END print ' <(sort infile)
      /a/b
      /c/d
      /e/f/c
      /random/app/nifi/egispub
      /random/app/nifi/empgis
      /random/app/nifi/ods
      /random/app/nifi/ptcsm
      /random/app/nifi/tmds
      /random/app/nifi/ucmdb
      /random/app/oozie/efdm/ensco/standardized_efdm_ensco_parser_5min/lib
      /random/app/oozie/efdm/mermec/cleansed_efdm_mermec_5min
      /random/app/oozie/efdm/mermec/standardized_efdm_mermec_5min
      /random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/lib
      /random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/schemas
      /random/custom/hive/jars





      share|improve this answer
























        up vote
        0
        down vote













        Another awk approach which is based on matching current line against the previous line. and you must sort the input first.



        ... |sort | awk '$0 ~ pre pre=$0; next preprint pre pre=$0 END print '


        Input:



        /random/custom
        /c/d
        /e/f/c
        /a/b
        /random/custom/hive/jars
        /random/app
        /random/app/nifi
        /random/app/nifi/egispub
        /random/app/nifi/empgis
        /random/app/nifi/ods
        /random/app/nifi/ptcsm
        /random/app/nifi/tmds
        /random/app/nifi/ucmdb
        /random/app/oozie
        /random/app/oozie/efdm
        /random/app/oozie/efdm/ensco
        /random/app/oozie/efdm/ensco/standardized_efdm_ensco_parser_5min
        /random/app/oozie/efdm/ensco/standardized_efdm_ensco_parser_5min/lib
        /random/app/oozie/efdm/mermec
        /random/app/oozie/efdm/mermec/cleansed_efdm_mermec_5min
        /random/app/oozie/efdm/mermec/standardized_efdm_mermec_5min
        /random/app/oozie/gis
        /random/app/oozie/gis/opk
        /random/app/oozie/gis/opk/standardized_gis_opk_parser_10min
        /random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/lib
        /random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/schemas


        Output:



        $ awk '$0 ~ pre pre=$0; next preprint pre pre=$0 END print ' <(sort infile)
        /a/b
        /c/d
        /e/f/c
        /random/app/nifi/egispub
        /random/app/nifi/empgis
        /random/app/nifi/ods
        /random/app/nifi/ptcsm
        /random/app/nifi/tmds
        /random/app/nifi/ucmdb
        /random/app/oozie/efdm/ensco/standardized_efdm_ensco_parser_5min/lib
        /random/app/oozie/efdm/mermec/cleansed_efdm_mermec_5min
        /random/app/oozie/efdm/mermec/standardized_efdm_mermec_5min
        /random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/lib
        /random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/schemas
        /random/custom/hive/jars





        share|improve this answer






















          up vote
          0
          down vote










          up vote
          0
          down vote









          Another awk approach which is based on matching current line against the previous line. and you must sort the input first.



          ... |sort | awk '$0 ~ pre pre=$0; next preprint pre pre=$0 END print '


          Input:



          /random/custom
          /c/d
          /e/f/c
          /a/b
          /random/custom/hive/jars
          /random/app
          /random/app/nifi
          /random/app/nifi/egispub
          /random/app/nifi/empgis
          /random/app/nifi/ods
          /random/app/nifi/ptcsm
          /random/app/nifi/tmds
          /random/app/nifi/ucmdb
          /random/app/oozie
          /random/app/oozie/efdm
          /random/app/oozie/efdm/ensco
          /random/app/oozie/efdm/ensco/standardized_efdm_ensco_parser_5min
          /random/app/oozie/efdm/ensco/standardized_efdm_ensco_parser_5min/lib
          /random/app/oozie/efdm/mermec
          /random/app/oozie/efdm/mermec/cleansed_efdm_mermec_5min
          /random/app/oozie/efdm/mermec/standardized_efdm_mermec_5min
          /random/app/oozie/gis
          /random/app/oozie/gis/opk
          /random/app/oozie/gis/opk/standardized_gis_opk_parser_10min
          /random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/lib
          /random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/schemas


          Output:



          $ awk '$0 ~ pre pre=$0; next preprint pre pre=$0 END print ' <(sort infile)
          /a/b
          /c/d
          /e/f/c
          /random/app/nifi/egispub
          /random/app/nifi/empgis
          /random/app/nifi/ods
          /random/app/nifi/ptcsm
          /random/app/nifi/tmds
          /random/app/nifi/ucmdb
          /random/app/oozie/efdm/ensco/standardized_efdm_ensco_parser_5min/lib
          /random/app/oozie/efdm/mermec/cleansed_efdm_mermec_5min
          /random/app/oozie/efdm/mermec/standardized_efdm_mermec_5min
          /random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/lib
          /random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/schemas
          /random/custom/hive/jars





          share|improve this answer












          Another awk approach which is based on matching current line against the previous line. and you must sort the input first.



          ... |sort | awk '$0 ~ pre pre=$0; next preprint pre pre=$0 END print '


          Input:



          /random/custom
          /c/d
          /e/f/c
          /a/b
          /random/custom/hive/jars
          /random/app
          /random/app/nifi
          /random/app/nifi/egispub
          /random/app/nifi/empgis
          /random/app/nifi/ods
          /random/app/nifi/ptcsm
          /random/app/nifi/tmds
          /random/app/nifi/ucmdb
          /random/app/oozie
          /random/app/oozie/efdm
          /random/app/oozie/efdm/ensco
          /random/app/oozie/efdm/ensco/standardized_efdm_ensco_parser_5min
          /random/app/oozie/efdm/ensco/standardized_efdm_ensco_parser_5min/lib
          /random/app/oozie/efdm/mermec
          /random/app/oozie/efdm/mermec/cleansed_efdm_mermec_5min
          /random/app/oozie/efdm/mermec/standardized_efdm_mermec_5min
          /random/app/oozie/gis
          /random/app/oozie/gis/opk
          /random/app/oozie/gis/opk/standardized_gis_opk_parser_10min
          /random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/lib
          /random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/schemas


          Output:



          $ awk '$0 ~ pre pre=$0; next preprint pre pre=$0 END print ' <(sort infile)
          /a/b
          /c/d
          /e/f/c
          /random/app/nifi/egispub
          /random/app/nifi/empgis
          /random/app/nifi/ods
          /random/app/nifi/ptcsm
          /random/app/nifi/tmds
          /random/app/nifi/ucmdb
          /random/app/oozie/efdm/ensco/standardized_efdm_ensco_parser_5min/lib
          /random/app/oozie/efdm/mermec/cleansed_efdm_mermec_5min
          /random/app/oozie/efdm/mermec/standardized_efdm_mermec_5min
          /random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/lib
          /random/app/oozie/gis/opk/standardized_gis_opk_parser_10min/schemas
          /random/custom/hive/jars






          share|improve this answer












          share|improve this answer



          share|improve this answer










          answered 2 hours ago









          sddgob

          16.2k102564




          16.2k102564




















              up vote
              0
              down vote













              With modern seds (and assuming sorted input):



              sed -E '$!N;/(.+)n1/!P;D' infile


              If your sed is anticuado try:



              sed '$!N;/(.1,)n1/!P;D' infile




              share
























                up vote
                0
                down vote













                With modern seds (and assuming sorted input):



                sed -E '$!N;/(.+)n1/!P;D' infile


                If your sed is anticuado try:



                sed '$!N;/(.1,)n1/!P;D' infile




                share






















                  up vote
                  0
                  down vote










                  up vote
                  0
                  down vote









                  With modern seds (and assuming sorted input):



                  sed -E '$!N;/(.+)n1/!P;D' infile


                  If your sed is anticuado try:



                  sed '$!N;/(.1,)n1/!P;D' infile




                  share












                  With modern seds (and assuming sorted input):



                  sed -E '$!N;/(.+)n1/!P;D' infile


                  If your sed is anticuado try:



                  sed '$!N;/(.1,)n1/!P;D' infile





                  share











                  share


                  share










                  answered 4 mins ago









                  don_crissti

                  48k15126155




                  48k15126155




















                      user316697 is a new contributor. Be nice, and check out our Code of Conduct.









                       

                      draft saved


                      draft discarded


















                      user316697 is a new contributor. Be nice, and check out our Code of Conduct.












                      user316697 is a new contributor. Be nice, and check out our Code of Conduct.











                      user316697 is a new contributor. Be nice, and check out our Code of Conduct.













                       


                      draft saved


                      draft discarded














                      StackExchange.ready(
                      function ()
                      StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2funix.stackexchange.com%2fquestions%2f476577%2fremove-all-parent-directories-from-a-list-of-paths%23new-answer', 'question_page');

                      );

                      Post as a guest
































































                      -

                      Popular posts from this blog

                      How to check contact read email or not when send email to Individual?

                      Image
                      Clash Royale CLAN TAG #URR8PPP up vote 1 down vote favorite I'm using WordPress 4.9.8, CiviCRM to 5.5.1, I usually send email to contact by Search> Find contacts View contact details Action> Send email Send email ok, Contact received mail ok like picture But status only Email sent though contact read email or not. So, can CiviCRM can change status to Email read when contact read email? wordpress email share | improve this question asked Sep 26 at 0:12 ToanLuong 49 9 add a comment  |  up vote 1 down vote favorite I'm using WordPress 4.9.8, CiviCRM to 5.5.1, I usually send email to contact by Search> Find contacts View contact details Action> Send email Send email ok, Contact received mail ok like picture But status only Email sent though contact read email or not. So, can CiviCRM can change status to Email read when contact read email? wordpress email share | improve this questi...
                      Read more

                      Christian Cage

                      Image
                      Christian Cage Christian in March 2015 Birth name William Jason Reso Born ( 1973-11-30 ) November 30, 1973 (age 45) Kitchener, Ontario, Canada Residence Tampa, Florida, United States Spouse(s) Denise Hartmann ( m.   2001 ) Children 1 Professional wrestling career Ring name(s) Christian [1] Christian Cage [2] Conquistador Dos [3] Male Nurse [4] Billed height 6 ft 1 in (1.85 m) [1] Billed weight 212 lb (96 kg) [1] Billed from Tampa, Florida (WM18, TNA) Toronto, Ontario, Canada [1] Trained by Dory Funk Jr. [2] Ron Hutchison [5] Debut 1995 [5] Retired 2014 [6] William Jason Reso (born November 30, 1973) is a Canadian actor, podcaster and retired professional wrestler best known for his time in WWE under the ring name Christian , a shortened version of his original ring name Christian Cage that was also used during his tenure in Total Nonstop Action Wrestling (TNA). Reso was trained by former professional wrestlers Ron Hutchison and Dory Funk Jr. and m...
                      Read more

                      How to properly install USB display driver for Fresco Logic FL2000DX on Ubuntu?

                      Image
                      Clash Royale CLAN TAG #URR8PPP up vote 4 down vote favorite 1 I need to connect additional monitors on my computer and I get Fresco Logic FL2000DX USB display adapters. This adapters works perfect on Windows but I need to use on my development machine based on Ubuntu 16.04. I find this on git hub: https://github.com/fresco-fl2000/fl2000 and try to install it but installation fail. Can anyone help me regarding this? Thanks! ubuntu drivers display-settings proprietary-drivers share | improve this question asked Aug 16 '17 at 16:42 Ivijan Stefan Stipić 142 1 6 add a comment  |  up vote 4 down vote favorite 1 I need to connect additional monitors on my computer and I get Fresco Logic FL2000DX USB display adapters. This adapters works perfect on Windows but I need to use on my development machine based on Ubuntu 16.04. I find this on git hub: https://github.com/fresco-fl2000/fl2000 and ...
                      Read more