Using AWK to select rows with specific value in specific column

The name of the pictureThe name of the pictureThe name of the pictureClash Royale CLAN TAG#URR8PPP











up vote
2
down vote

favorite












I have a big csv file, which looks like this:



1,2,3,4,5,6,-99
1,2,3,4,5,6,-99
1,2,3,4,5,6,-99
1,2,3,4,5,6,25178
1,2,3,4,5,6,27986
1,2,3,4,5,6,-99


I want to select only the lines in which the 7th columns is equal to -99, so my output be:



1,2,3,4,5,6,-99
1,2,3,4,5,6,-99
1,2,3,4,5,6,-99
1,2,3,4,5,6,-99


I tried the following:



awk -F, '$7 == -99' input.txt > output.txt
awk -F, ' if ($7 == -99) print $1,$2,$3,$4,$5,$6,$7 ' input.txt > output.txt


But both of them returned an empty output.txt. Can anyone tell me what I'm doing wrong?
Thanks.




linux shell awk csv




share|improve this question


















  • 3




    the first command works for me, second has a minor typo (closing parenthesis in print stmt) and doesn't set OFS... what is your awk version? probably you have dos style line endings? (but that doesn't cause an issue when I checked)
    – Sundeep
    Oct 21 '17 at 15:36










  • How do I know my awk version? Yes, I typed it wrong in here, but it's correct in my script.
    – Isabela Martins
    Oct 21 '17 at 15:58










  • With old awk you could try awk -F, '$7 == "-99"'.
    – Satō Katsura
    Oct 21 '17 at 15:59










  • for version, try the command awk --version if that doesn't work, check man awk
    – Sundeep
    Oct 21 '17 at 16:02










  • My version is 1.2
    – Isabela Martins
    Oct 21 '17 at 16:31














up vote
2
down vote

favorite












I have a big csv file, which looks like this:



1,2,3,4,5,6,-99
1,2,3,4,5,6,-99
1,2,3,4,5,6,-99
1,2,3,4,5,6,25178
1,2,3,4,5,6,27986
1,2,3,4,5,6,-99


I want to select only the lines in which the 7th columns is equal to -99, so my output be:



1,2,3,4,5,6,-99
1,2,3,4,5,6,-99
1,2,3,4,5,6,-99
1,2,3,4,5,6,-99


I tried the following:



awk -F, '$7 == -99' input.txt > output.txt
awk -F, ' if ($7 == -99) print $1,$2,$3,$4,$5,$6,$7 ' input.txt > output.txt


But both of them returned an empty output.txt. Can anyone tell me what I'm doing wrong?
Thanks.




linux shell awk csv




share|improve this question


















  • 3




    the first command works for me, second has a minor typo (closing parenthesis in print stmt) and doesn't set OFS... what is your awk version? probably you have dos style line endings? (but that doesn't cause an issue when I checked)
    – Sundeep
    Oct 21 '17 at 15:36










  • How do I know my awk version? Yes, I typed it wrong in here, but it's correct in my script.
    – Isabela Martins
    Oct 21 '17 at 15:58










  • With old awk you could try awk -F, '$7 == "-99"'.
    – Satō Katsura
    Oct 21 '17 at 15:59










  • for version, try the command awk --version if that doesn't work, check man awk
    – Sundeep
    Oct 21 '17 at 16:02










  • My version is 1.2
    – Isabela Martins
    Oct 21 '17 at 16:31












up vote
2
down vote

favorite









up vote
2
down vote

favorite











I have a big csv file, which looks like this:



1,2,3,4,5,6,-99
1,2,3,4,5,6,-99
1,2,3,4,5,6,-99
1,2,3,4,5,6,25178
1,2,3,4,5,6,27986
1,2,3,4,5,6,-99


I want to select only the lines in which the 7th columns is equal to -99, so my output be:



1,2,3,4,5,6,-99
1,2,3,4,5,6,-99
1,2,3,4,5,6,-99
1,2,3,4,5,6,-99


I tried the following:



awk -F, '$7 == -99' input.txt > output.txt
awk -F, ' if ($7 == -99) print $1,$2,$3,$4,$5,$6,$7 ' input.txt > output.txt


But both of them returned an empty output.txt. Can anyone tell me what I'm doing wrong?
Thanks.




linux shell awk csv




share|improve this question














I have a big csv file, which looks like this:



1,2,3,4,5,6,-99
1,2,3,4,5,6,-99
1,2,3,4,5,6,-99
1,2,3,4,5,6,25178
1,2,3,4,5,6,27986
1,2,3,4,5,6,-99


I want to select only the lines in which the 7th columns is equal to -99, so my output be:



1,2,3,4,5,6,-99
1,2,3,4,5,6,-99
1,2,3,4,5,6,-99
1,2,3,4,5,6,-99


I tried the following:



awk -F, '$7 == -99' input.txt > output.txt
awk -F, ' if ($7 == -99) print $1,$2,$3,$4,$5,$6,$7 ' input.txt > output.txt


But both of them returned an empty output.txt. Can anyone tell me what I'm doing wrong?
Thanks.





linux shell awk csv





share|improve this question













share|improve this question




share|improve this question








edited Oct 21 '17 at 16:01









αғsнιη

15.6k92563




15.6k92563










asked Oct 21 '17 at 15:32









Isabela Martins

1313




1313







  • 3




    the first command works for me, second has a minor typo (closing parenthesis in print stmt) and doesn't set OFS... what is your awk version? probably you have dos style line endings? (but that doesn't cause an issue when I checked)
    – Sundeep
    Oct 21 '17 at 15:36










  • How do I know my awk version? Yes, I typed it wrong in here, but it's correct in my script.
    – Isabela Martins
    Oct 21 '17 at 15:58










  • With old awk you could try awk -F, '$7 == "-99"'.
    – Satō Katsura
    Oct 21 '17 at 15:59










  • for version, try the command awk --version if that doesn't work, check man awk
    – Sundeep
    Oct 21 '17 at 16:02










  • My version is 1.2
    – Isabela Martins
    Oct 21 '17 at 16:31












  • 3




    the first command works for me, second has a minor typo (closing parenthesis in print stmt) and doesn't set OFS... what is your awk version? probably you have dos style line endings? (but that doesn't cause an issue when I checked)
    – Sundeep
    Oct 21 '17 at 15:36










  • How do I know my awk version? Yes, I typed it wrong in here, but it's correct in my script.
    – Isabela Martins
    Oct 21 '17 at 15:58










  • With old awk you could try awk -F, '$7 == "-99"'.
    – Satō Katsura
    Oct 21 '17 at 15:59










  • for version, try the command awk --version if that doesn't work, check man awk
    – Sundeep
    Oct 21 '17 at 16:02










  • My version is 1.2
    – Isabela Martins
    Oct 21 '17 at 16:31







3




3




the first command works for me, second has a minor typo (closing parenthesis in print stmt) and doesn't set OFS... what is your awk version? probably you have dos style line endings? (but that doesn't cause an issue when I checked)
– Sundeep
Oct 21 '17 at 15:36




the first command works for me, second has a minor typo (closing parenthesis in print stmt) and doesn't set OFS... what is your awk version? probably you have dos style line endings? (but that doesn't cause an issue when I checked)
– Sundeep
Oct 21 '17 at 15:36












How do I know my awk version? Yes, I typed it wrong in here, but it's correct in my script.
– Isabela Martins
Oct 21 '17 at 15:58




How do I know my awk version? Yes, I typed it wrong in here, but it's correct in my script.
– Isabela Martins
Oct 21 '17 at 15:58












With old awk you could try awk -F, '$7 == "-99"'.
– Satō Katsura
Oct 21 '17 at 15:59




With old awk you could try awk -F, '$7 == "-99"'.
– Satō Katsura
Oct 21 '17 at 15:59












for version, try the command awk --version if that doesn't work, check man awk
– Sundeep
Oct 21 '17 at 16:02




for version, try the command awk --version if that doesn't work, check man awk
– Sundeep
Oct 21 '17 at 16:02












My version is 1.2
– Isabela Martins
Oct 21 '17 at 16:31




My version is 1.2
– Isabela Martins
Oct 21 '17 at 16:31










3 Answers
3






active

oldest

votes

















up vote
2
down vote



accepted










The file that you run the script on has DOS line-endings. It may be that it was created on a Windows machine.



Use dos2unix to convert it to a Unix text file.



Alternatively, run it through tr:



tr -d 'r' <input.txt >input-unix.txt


Then use input-unix.txt with your otherwise correct awk code.



To modify the awk code instead of the input file:



awk -F, '$7 == "-99r"' input.txt >output.txt


This takes the carriage-return at the end of the line into account.



Or,



awk -F, '$7 + 0 == -99' input.txt >output.txt


This forces the 7th column to be interpreted as a number, which "removes" the carriage-return.



Similarly,



awk -F, 'int($7) == -99' input.txt >output.txt


would also remove the r.






share|improve this answer






















  • I tried the "-99r" and it worked! That was it. Thank you very much!!
    – Isabela Martins
    Oct 21 '17 at 16:42

















up vote
1
down vote













awk -F, 'if($7==-99)print $0'


will do that...






share|improve this answer
















  • 1




    As would awk -F, '$7 == -99' input.txt (from the question), which means that there's something else going on than just getting the awk code right.
    – Kusalananda
    Oct 21 '17 at 16:31










  • Empty output...
    – Isabela Martins
    Oct 21 '17 at 16:35

















up vote
0
down vote













A slight modification to @tonioc's answer 



awk 'if($7 == -99)print' file > outfile





share|improve this answer




















    Your Answer







    StackExchange.ready(function()
    var channelOptions =
    tags: "".split(" "),
    id: "106"
    ;
    initTagRenderer("".split(" "), "".split(" "), channelOptions);

    StackExchange.using("externalEditor", function()
    // Have to fire editor after snippets, if snippets enabled
    if (StackExchange.settings.snippets.snippetsEnabled)
    StackExchange.using("snippets", function()
    createEditor();
    );

    else
    createEditor();

    );

    function createEditor()
    StackExchange.prepareEditor(
    heartbeatType: 'answer',
    convertImagesToLinks: false,
    noModals: false,
    showLowRepImageUploadWarning: true,
    reputationToPostImages: null,
    bindNavPrevention: true,
    postfix: "",
    onDemand: true,
    discardSelector: ".discard-answer"
    ,immediatelyShowMarkdownHelp:true
    );



    );













     

    draft saved


    draft discarded


















    StackExchange.ready(
    function ()
    StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2funix.stackexchange.com%2fquestions%2f399560%2fusing-awk-to-select-rows-with-specific-value-in-specific-column%23new-answer', 'question_page');

    );

    Post as a guest

















    3 Answers
    3






    active

    oldest

    votes








    3 Answers
    3






    active

    oldest

    votes









    active

    oldest

    votes






    active

    oldest

    votes








    up vote
    2
    down vote



    accepted










    The file that you run the script on has DOS line-endings. It may be that it was created on a Windows machine.



    Use dos2unix to convert it to a Unix text file.



    Alternatively, run it through tr:



    tr -d 'r' <input.txt >input-unix.txt


    Then use input-unix.txt with your otherwise correct awk code.



    To modify the awk code instead of the input file:



    awk -F, '$7 == "-99r"' input.txt >output.txt


    This takes the carriage-return at the end of the line into account.



    Or,



    awk -F, '$7 + 0 == -99' input.txt >output.txt


    This forces the 7th column to be interpreted as a number, which "removes" the carriage-return.



    Similarly,



    awk -F, 'int($7) == -99' input.txt >output.txt


    would also remove the r.






    share|improve this answer






















    • I tried the "-99r" and it worked! That was it. Thank you very much!!
      – Isabela Martins
      Oct 21 '17 at 16:42














    up vote
    2
    down vote



    accepted










    The file that you run the script on has DOS line-endings. It may be that it was created on a Windows machine.



    Use dos2unix to convert it to a Unix text file.



    Alternatively, run it through tr:



    tr -d 'r' <input.txt >input-unix.txt


    Then use input-unix.txt with your otherwise correct awk code.



    To modify the awk code instead of the input file:



    awk -F, '$7 == "-99r"' input.txt >output.txt


    This takes the carriage-return at the end of the line into account.



    Or,



    awk -F, '$7 + 0 == -99' input.txt >output.txt


    This forces the 7th column to be interpreted as a number, which "removes" the carriage-return.



    Similarly,



    awk -F, 'int($7) == -99' input.txt >output.txt


    would also remove the r.






    share|improve this answer






















    • I tried the "-99r" and it worked! That was it. Thank you very much!!
      – Isabela Martins
      Oct 21 '17 at 16:42












    up vote
    2
    down vote



    accepted







    up vote
    2
    down vote



    accepted






    The file that you run the script on has DOS line-endings. It may be that it was created on a Windows machine.



    Use dos2unix to convert it to a Unix text file.



    Alternatively, run it through tr:



    tr -d 'r' <input.txt >input-unix.txt


    Then use input-unix.txt with your otherwise correct awk code.



    To modify the awk code instead of the input file:



    awk -F, '$7 == "-99r"' input.txt >output.txt


    This takes the carriage-return at the end of the line into account.



    Or,



    awk -F, '$7 + 0 == -99' input.txt >output.txt


    This forces the 7th column to be interpreted as a number, which "removes" the carriage-return.



    Similarly,



    awk -F, 'int($7) == -99' input.txt >output.txt


    would also remove the r.






    share|improve this answer














    The file that you run the script on has DOS line-endings. It may be that it was created on a Windows machine.



    Use dos2unix to convert it to a Unix text file.



    Alternatively, run it through tr:



    tr -d 'r' <input.txt >input-unix.txt


    Then use input-unix.txt with your otherwise correct awk code.



    To modify the awk code instead of the input file:



    awk -F, '$7 == "-99r"' input.txt >output.txt


    This takes the carriage-return at the end of the line into account.



    Or,



    awk -F, '$7 + 0 == -99' input.txt >output.txt


    This forces the 7th column to be interpreted as a number, which "removes" the carriage-return.



    Similarly,



    awk -F, 'int($7) == -99' input.txt >output.txt


    would also remove the r.







    share|improve this answer














    share|improve this answer



    share|improve this answer








    edited Oct 21 '17 at 16:43

























    answered Oct 21 '17 at 16:34









    Kusalananda

    105k14209326




    105k14209326











    • I tried the "-99r" and it worked! That was it. Thank you very much!!
      – Isabela Martins
      Oct 21 '17 at 16:42
















    • I tried the "-99r" and it worked! That was it. Thank you very much!!
      – Isabela Martins
      Oct 21 '17 at 16:42















    I tried the "-99r" and it worked! That was it. Thank you very much!!
    – Isabela Martins
    Oct 21 '17 at 16:42




    I tried the "-99r" and it worked! That was it. Thank you very much!!
    – Isabela Martins
    Oct 21 '17 at 16:42












    up vote
    1
    down vote













    awk -F, 'if($7==-99)print $0'


    will do that...






    share|improve this answer
















    • 1




      As would awk -F, '$7 == -99' input.txt (from the question), which means that there's something else going on than just getting the awk code right.
      – Kusalananda
      Oct 21 '17 at 16:31










    • Empty output...
      – Isabela Martins
      Oct 21 '17 at 16:35














    up vote
    1
    down vote













    awk -F, 'if($7==-99)print $0'


    will do that...






    share|improve this answer
















    • 1




      As would awk -F, '$7 == -99' input.txt (from the question), which means that there's something else going on than just getting the awk code right.
      – Kusalananda
      Oct 21 '17 at 16:31










    • Empty output...
      – Isabela Martins
      Oct 21 '17 at 16:35












    up vote
    1
    down vote










    up vote
    1
    down vote









    awk -F, 'if($7==-99)print $0'


    will do that...






    share|improve this answer












    awk -F, 'if($7==-99)print $0'


    will do that...







    share|improve this answer












    share|improve this answer



    share|improve this answer










    answered Oct 21 '17 at 16:20









    tonioc

    1,12457




    1,12457







    • 1




      As would awk -F, '$7 == -99' input.txt (from the question), which means that there's something else going on than just getting the awk code right.
      – Kusalananda
      Oct 21 '17 at 16:31










    • Empty output...
      – Isabela Martins
      Oct 21 '17 at 16:35












    • 1




      As would awk -F, '$7 == -99' input.txt (from the question), which means that there's something else going on than just getting the awk code right.
      – Kusalananda
      Oct 21 '17 at 16:31










    • Empty output...
      – Isabela Martins
      Oct 21 '17 at 16:35







    1




    1




    As would awk -F, '$7 == -99' input.txt (from the question), which means that there's something else going on than just getting the awk code right.
    – Kusalananda
    Oct 21 '17 at 16:31




    As would awk -F, '$7 == -99' input.txt (from the question), which means that there's something else going on than just getting the awk code right.
    – Kusalananda
    Oct 21 '17 at 16:31












    Empty output...
    – Isabela Martins
    Oct 21 '17 at 16:35




    Empty output...
    – Isabela Martins
    Oct 21 '17 at 16:35










    up vote
    0
    down vote













    A slight modification to @tonioc's answer 



    awk 'if($7 == -99)print' file > outfile





    share|improve this answer
























      up vote
      0
      down vote













      A slight modification to @tonioc's answer 



      awk 'if($7 == -99)print' file > outfile





      share|improve this answer






















        up vote
        0
        down vote










        up vote
        0
        down vote









        A slight modification to @tonioc's answer 



        awk 'if($7 == -99)print' file > outfile





        share|improve this answer












        A slight modification to @tonioc's answer 



        awk 'if($7 == -99)print' file > outfile






        share|improve this answer












        share|improve this answer



        share|improve this answer










        answered Apr 27 at 9:46









        Lakshmi KrishnaKumaar

        1




        1



























             

            draft saved


            draft discarded















































             


            draft saved


            draft discarded














            StackExchange.ready(
            function ()
            StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2funix.stackexchange.com%2fquestions%2f399560%2fusing-awk-to-select-rows-with-specific-value-in-specific-column%23new-answer', 'question_page');

            );

            Post as a guest
































































            -

            Popular posts from this blog

            How to check contact read email or not when send email to Individual?

            Image
            Clash Royale CLAN TAG #URR8PPP up vote 1 down vote favorite I'm using WordPress 4.9.8, CiviCRM to 5.5.1, I usually send email to contact by Search> Find contacts View contact details Action> Send email Send email ok, Contact received mail ok like picture But status only Email sent though contact read email or not. So, can CiviCRM can change status to Email read when contact read email? wordpress email share | improve this question asked Sep 26 at 0:12 ToanLuong 49 9 add a comment  |  up vote 1 down vote favorite I'm using WordPress 4.9.8, CiviCRM to 5.5.1, I usually send email to contact by Search> Find contacts View contact details Action> Send email Send email ok, Contact received mail ok like picture But status only Email sent though contact read email or not. So, can CiviCRM can change status to Email read when contact read email? wordpress email share | improve this questi...
            Read more

            Displaying single band from multi-band raster using QGIS

            Image
            Clash Royale CLAN TAG #URR8PPP 1 How can I extract a single band from multi-band raster in QGIS? I have an remote sensed image which has 6 bands (including NDVI band), I want to display each band separately, but have no idea how to do. I have seen some questions similar here but none worked for me. The original image (has 6 bands) is: I want to display the band 6 which should be like this: But I tried gdal_translate, and couldn't get the correct result. What I have got is: qgis raster multi-band share | improve this question edited Mar 5 at 0:53 Summer asked Mar 4 at 6:42 Summer Summer 23 6 Is this any help gis.stackexchange.com/questions/220658/… ? if not gis.stackexchange.com/questions/62133/… might help. – Michael Stimson Mar 4 at 6:46 Thanks for answering but when I used gdal_translate, qgis showed that 'Error 4: Kayena.tif: No such file or directory". Would you know how to fi...
            Read more

            How many registers does an x86_64 CPU actually have?

            Image
            Clash Royale CLAN TAG #URR8PPP up vote 2 down vote favorite I am currently learning reverse engineering and am studying the flags register. I had in my mind that rflags was just another name for one of the 16 general purpose registers, for example rax or rbx . But it looks like rflags is actually an additional register. So that makes 17 registers in total... how many more could there be? I have spent at least an hour on this and found numerous different answers. The best answer so far is this, which says that there are 40 registers in total. 16 General Purpose Registers 2 Status Registers 6 Code Segment Registers 16 SSE Registers 8 FPU/MMX Registers But if I add that up, I get 48. Could anybody provide an official answer on how many registers an x86_64 CPU has (e.g. an Intel i7). Additionally, I have seen references to 'hardware' and 'architectural' registers. What are those registers and how many are there? register x86-64 share | improve this...
            Read more